Jul 22 02:37:18.004997 ip-10-0-143-160 systemd[1]: Starting Kubernetes Kubelet...
Jul 22 02:37:18.311547 ip-10-0-143-160 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 02:37:18.311547 ip-10-0-143-160 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 22 02:37:18.311547 ip-10-0-143-160 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 02:37:18.311547 ip-10-0-143-160 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 22 02:37:18.311547 ip-10-0-143-160 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 02:37:18.312459 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.312321    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 22 02:37:18.317427 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317402    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 02:37:18.317427 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317422    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 02:37:18.317427 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317428    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 02:37:18.317427 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317432    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 02:37:18.317427 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317436    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 02:37:18.317784 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317440    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 02:37:18.317784 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317445    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 02:37:18.317784 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317450    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 02:37:18.317784 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317453    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 02:37:18.317784 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317458    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 02:37:18.317784 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317462    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 02:37:18.317784 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317465    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 02:37:18.317784 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317469    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 02:37:18.317784 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317472    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 02:37:18.317784 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317476    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 02:37:18.317784 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317479    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 02:37:18.317784 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317483    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 02:37:18.317784 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317487    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 02:37:18.317784 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317491    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 02:37:18.317784 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317495    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 02:37:18.317784 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317499    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 02:37:18.317784 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317502    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 02:37:18.317784 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317505    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 02:37:18.317784 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317509    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 02:37:18.317784 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317512    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 02:37:18.318589 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317516    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 02:37:18.318589 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317522    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 02:37:18.318589 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317528    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 02:37:18.318589 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317533    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 02:37:18.318589 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317538    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 02:37:18.318589 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317542    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 02:37:18.318589 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317545    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 02:37:18.318589 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317549    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 02:37:18.318589 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317553    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 02:37:18.318589 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317557    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 02:37:18.318589 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317561    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 02:37:18.318589 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317567    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 02:37:18.318589 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317573    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 02:37:18.318589 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317579    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 02:37:18.318589 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317584    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 02:37:18.318589 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317588    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 02:37:18.318589 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317593    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 02:37:18.318589 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317597    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 02:37:18.318589 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317602    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 02:37:18.319435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317606    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 02:37:18.319435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317610    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 02:37:18.319435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317614    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 02:37:18.319435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317618    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 02:37:18.319435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317622    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 02:37:18.319435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317626    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 02:37:18.319435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317630    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 02:37:18.319435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317634    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 02:37:18.319435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317638    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 02:37:18.319435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317645    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 02:37:18.319435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317651    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 02:37:18.319435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317655    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 02:37:18.319435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317659    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 02:37:18.319435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317671    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 02:37:18.319435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317676    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 02:37:18.319435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317680    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 02:37:18.319435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317684    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 02:37:18.319435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317688    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 02:37:18.319435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317694    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 02:37:18.319435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317698    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 02:37:18.320315 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317703    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 02:37:18.320315 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317723    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 02:37:18.320315 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317727    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 02:37:18.320315 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317731    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 02:37:18.320315 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317735    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 02:37:18.320315 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317742    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 02:37:18.320315 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317747    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 02:37:18.320315 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317752    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 02:37:18.320315 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317757    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 02:37:18.320315 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317761    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 02:37:18.320315 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317765    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 02:37:18.320315 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317769    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 02:37:18.320315 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317773    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 02:37:18.320315 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317778    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 02:37:18.320315 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317781    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 02:37:18.320315 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317785    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 02:37:18.320315 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317789    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 02:37:18.320315 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317793    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 02:37:18.320315 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317797    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 02:37:18.320315 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317801    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 02:37:18.321184 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317805    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 02:37:18.321184 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317809    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 02:37:18.321184 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317813    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 02:37:18.321184 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317817    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 02:37:18.321184 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317821    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 02:37:18.321184 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317826    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 02:37:18.321184 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317830    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 02:37:18.321184 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317834    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 02:37:18.321184 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317838    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 02:37:18.321184 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317842    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 02:37:18.321184 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317846    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 02:37:18.321184 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317851    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 02:37:18.321184 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317855    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 02:37:18.321184 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317859    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 02:37:18.321184 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.317863    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 02:37:18.321184 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319051    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 02:37:18.321184 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319062    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 02:37:18.321184 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319066    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 02:37:18.321184 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319072    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 02:37:18.321184 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319076    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 02:37:18.322123 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319080    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 02:37:18.322123 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319084    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 02:37:18.322123 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319089    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 02:37:18.322123 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319093    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 02:37:18.322123 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319098    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 02:37:18.322123 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319103    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 02:37:18.322123 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319107    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 02:37:18.322123 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319111    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 02:37:18.322123 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319115    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 02:37:18.322123 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319119    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 02:37:18.322123 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319125    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 02:37:18.322123 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319128    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 02:37:18.322123 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319133    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 02:37:18.322123 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319137    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 02:37:18.322123 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319141    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 02:37:18.322123 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319145    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 02:37:18.322123 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319149    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 02:37:18.322123 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319153    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 02:37:18.322123 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319158    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 02:37:18.322123 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319162    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 02:37:18.322669 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319167    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 02:37:18.322669 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319171    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 02:37:18.322669 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319175    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 02:37:18.322669 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319179    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 02:37:18.322669 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319183    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 02:37:18.322669 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319187    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 02:37:18.322669 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319192    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 02:37:18.322669 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319196    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 02:37:18.322669 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319200    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 02:37:18.322669 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319204    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 02:37:18.322669 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319209    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 02:37:18.322669 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319213    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 02:37:18.322669 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319218    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 02:37:18.322669 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319222    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 02:37:18.322669 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319226    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 02:37:18.322669 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319229    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 02:37:18.322669 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319234    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 02:37:18.322669 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319239    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 02:37:18.322669 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319243    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 02:37:18.322669 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319248    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 02:37:18.323299 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319254    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 02:37:18.323299 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319261    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 02:37:18.323299 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319264    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 02:37:18.323299 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319269    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 02:37:18.323299 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319272    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 02:37:18.323299 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319277    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 02:37:18.323299 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319280    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 02:37:18.323299 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319284    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 02:37:18.323299 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319288    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 02:37:18.323299 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319292    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 02:37:18.323299 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319296    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 02:37:18.323299 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319300    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 02:37:18.323299 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319304    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 02:37:18.323299 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319308    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 02:37:18.323299 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319312    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 02:37:18.323299 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319316    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 02:37:18.323299 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319320    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 02:37:18.323299 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319323    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 02:37:18.323299 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319328    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 02:37:18.324017 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319332    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 02:37:18.324017 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319336    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 02:37:18.324017 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319341    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 02:37:18.324017 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319347    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 02:37:18.324017 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319351    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 02:37:18.324017 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319356    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 02:37:18.324017 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319360    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 02:37:18.324017 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319364    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 02:37:18.324017 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319368    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 02:37:18.324017 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319372    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 02:37:18.324017 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319376    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 02:37:18.324017 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319382    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 02:37:18.324017 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319386    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 02:37:18.324017 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319389    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 02:37:18.324017 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319394    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 02:37:18.324017 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319400    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 02:37:18.324017 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319404    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 02:37:18.324017 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319408    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 02:37:18.324017 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319412    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 02:37:18.324017 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319416    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 02:37:18.324527 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319420    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 02:37:18.324527 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319424    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 02:37:18.324527 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319428    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 02:37:18.324527 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319431    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 02:37:18.324527 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319435    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 02:37:18.324527 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319441    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 02:37:18.324527 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319447    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 02:37:18.324527 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319451    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 02:37:18.324527 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319456    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 02:37:18.324527 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319460    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 02:37:18.324527 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319465    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 02:37:18.324527 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319469    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 02:37:18.324527 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319475    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 02:37:18.324527 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319480    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 02:37:18.324527 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.319485    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 02:37:18.324527 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320142    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 02:37:18.324527 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320151    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 02:37:18.324527 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320156    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 02:37:18.324527 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320161    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 02:37:18.325083 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320165    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 02:37:18.325083 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320170    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 02:37:18.325083 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320174    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 02:37:18.325083 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320179    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 02:37:18.325083 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320184    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 02:37:18.325083 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320188    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 02:37:18.325083 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320192    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 02:37:18.325083 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320197    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 02:37:18.325083 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320201    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 02:37:18.325083 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320206    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 02:37:18.325083 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320210    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 02:37:18.325083 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320214    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 02:37:18.325083 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320219    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 02:37:18.325083 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320226    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 02:37:18.325083 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320232    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 02:37:18.325083 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320237    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 02:37:18.325083 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320241    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 02:37:18.325083 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320246    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 02:37:18.325083 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320250    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 02:37:18.325587 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320255    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 02:37:18.325587 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320259    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 02:37:18.325587 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320263    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 02:37:18.325587 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320267    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 02:37:18.325587 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320271    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 02:37:18.325587 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320276    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 02:37:18.325587 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320280    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 02:37:18.325587 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320284    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 02:37:18.325587 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320288    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 02:37:18.325587 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320296    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 02:37:18.325587 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320300    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 02:37:18.325587 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320304    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 02:37:18.325587 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320308    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 02:37:18.325587 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320312    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 02:37:18.325587 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320316    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 02:37:18.325587 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320319    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 02:37:18.325587 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320326    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 02:37:18.325587 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320331    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 02:37:18.325587 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320336    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 02:37:18.326106 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320340    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 02:37:18.326106 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320345    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 02:37:18.326106 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320349    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 02:37:18.326106 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320353    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 02:37:18.326106 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320357    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 02:37:18.326106 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320361    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 02:37:18.326106 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320366    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 02:37:18.326106 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320370    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 02:37:18.326106 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320375    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 02:37:18.326106 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320379    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 02:37:18.326106 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320384    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 02:37:18.326106 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320388    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 02:37:18.326106 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320392    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 02:37:18.326106 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320396    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 02:37:18.326106 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320400    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 02:37:18.326106 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320404    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 02:37:18.326106 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320408    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 02:37:18.326106 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320413    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 02:37:18.326106 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320417    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 02:37:18.326106 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320421    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 02:37:18.326598 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320424    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 02:37:18.326598 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320431    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 02:37:18.326598 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320436    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 02:37:18.326598 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320441    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 02:37:18.326598 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320446    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 02:37:18.326598 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320450    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 02:37:18.326598 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320455    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 02:37:18.326598 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320460    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 02:37:18.326598 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320464    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 02:37:18.326598 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320468    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 02:37:18.326598 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320472    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 02:37:18.326598 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320476    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 02:37:18.326598 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320481    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 02:37:18.326598 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320486    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 02:37:18.326598 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320490    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 02:37:18.326598 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320494    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 02:37:18.326598 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320498    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 02:37:18.326598 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320502    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 02:37:18.326598 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320506    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 02:37:18.326598 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320510    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 02:37:18.327112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320514    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 02:37:18.327112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320518    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 02:37:18.327112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320522    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 02:37:18.327112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320527    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 02:37:18.327112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320531    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 02:37:18.327112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320535    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 02:37:18.327112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320539    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 02:37:18.327112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320543    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 02:37:18.327112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320548    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 02:37:18.327112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320552    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 02:37:18.327112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320556    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 02:37:18.327112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320560    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 02:37:18.327112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320564    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 02:37:18.327112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320568    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 02:37:18.327112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320573    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 02:37:18.327112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320577    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 02:37:18.327112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.320581    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 02:37:18.327112 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320695    2577 flags.go:64] FLAG: --address="0.0.0.0"
Jul 22 02:37:18.327112 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320725    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 22 02:37:18.327112 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320738    2577 flags.go:64] FLAG: --anonymous-auth="true"
Jul 22 02:37:18.327112 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320745    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 22 02:37:18.327621 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320752    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 22 02:37:18.327621 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320757    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 22 02:37:18.327621 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320764    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 22 02:37:18.327621 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320771    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 22 02:37:18.327621 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320777    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 22 02:37:18.327621 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320782    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 22 02:37:18.327621 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320787    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 22 02:37:18.327621 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320793    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 22 02:37:18.327621 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320798    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 22 02:37:18.327621 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320803    2577 flags.go:64] FLAG: --cgroup-root=""
Jul 22 02:37:18.327621 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320807    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 22 02:37:18.327621 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320812    2577 flags.go:64] FLAG: --client-ca-file=""
Jul 22 02:37:18.327621 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320817    2577 flags.go:64] FLAG: --cloud-provider="external"
Jul 22 02:37:18.327621 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320821    2577 flags.go:64] FLAG: --cluster-dns="[]"
Jul 22 02:37:18.327621 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320828    2577 flags.go:64] FLAG: --cluster-domain=""
Jul 22 02:37:18.327621 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320833    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 22 02:37:18.327621 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320838    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 22 02:37:18.327621 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320843    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 22 02:37:18.327621 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320848    2577 flags.go:64] FLAG: --container-log-max-files="5"
Jul 22 02:37:18.327621 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320855    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 22 02:37:18.327621 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320859    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 22 02:37:18.327621 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320864    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 22 02:37:18.327621 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320870    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 22 02:37:18.328256 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320875    2577 flags.go:64] FLAG: --contention-profiling="false"
Jul 22 02:37:18.328256 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320880    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 22 02:37:18.328256 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320885    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 22 02:37:18.328256 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320890    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 22 02:37:18.328256 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320895    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 22 02:37:18.328256 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320901    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 22 02:37:18.328256 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320906    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 22 02:37:18.328256 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320911    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 22 02:37:18.328256 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320916    2577 flags.go:64] FLAG: --enable-load-reader="false"
Jul 22 02:37:18.328256 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320920    2577 flags.go:64] FLAG: --enable-server="true"
Jul 22 02:37:18.328256 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320925    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 22 02:37:18.328256 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320932    2577 flags.go:64] FLAG: --event-burst="100"
Jul 22 02:37:18.328256 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320937    2577 flags.go:64] FLAG: --event-qps="50"
Jul 22 02:37:18.328256 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320942    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 22 02:37:18.328256 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320947    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 22 02:37:18.328256 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320952    2577 flags.go:64] FLAG: --eviction-hard=""
Jul 22 02:37:18.328256 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320958    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 22 02:37:18.328256 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320963    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 22 02:37:18.328256 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320967    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 22 02:37:18.328256 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320972    2577 flags.go:64] FLAG: --eviction-soft=""
Jul 22 02:37:18.328256 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320977    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 22 02:37:18.328256 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320981    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 22 02:37:18.328256 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320986    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 22 02:37:18.328256 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320991    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 22 02:37:18.328256 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.320995    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 22 02:37:18.328929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321000    2577 flags.go:64] FLAG: --fail-swap-on="true"
Jul 22 02:37:18.328929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321004    2577 flags.go:64] FLAG: --feature-gates=""
Jul 22 02:37:18.328929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321010    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 22 02:37:18.328929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321015    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 22 02:37:18.328929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321019    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 22 02:37:18.328929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321024    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 22 02:37:18.328929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321029    2577 flags.go:64] FLAG: --healthz-port="10248"
Jul 22 02:37:18.328929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321034    2577 flags.go:64] FLAG: --help="false"
Jul 22 02:37:18.328929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321038    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-143-160.ec2.internal"
Jul 22 02:37:18.328929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321044    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 22 02:37:18.328929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321048    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 22 02:37:18.328929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321053    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 22 02:37:18.328929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321058    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 22 02:37:18.328929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321064    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 22 02:37:18.328929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321068    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 22 02:37:18.328929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321073    2577 flags.go:64] FLAG: --image-service-endpoint=""
Jul 22 02:37:18.328929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321077    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 22 02:37:18.328929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321082    2577 flags.go:64] FLAG: --kube-api-burst="100"
Jul 22 02:37:18.328929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321087    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 22 02:37:18.328929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321092    2577 flags.go:64] FLAG: --kube-api-qps="50"
Jul 22 02:37:18.328929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321096    2577 flags.go:64] FLAG: --kube-reserved=""
Jul 22 02:37:18.328929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321101    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 22 02:37:18.328929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321106    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 22 02:37:18.328929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321111    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 22 02:37:18.329522 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321116    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 22 02:37:18.329522 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321121    2577 flags.go:64] FLAG: --lock-file=""
Jul 22 02:37:18.329522 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321126    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 22 02:37:18.329522 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321130    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 22 02:37:18.329522 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321135    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 22 02:37:18.329522 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321144    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 22 02:37:18.329522 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321149    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 22 02:37:18.329522 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321154    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 22 02:37:18.329522 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321159    2577 flags.go:64] FLAG: --logging-format="text"
Jul 22 02:37:18.329522 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321163    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 22 02:37:18.329522 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321168    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 22 02:37:18.329522 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321173    2577 flags.go:64] FLAG: --manifest-url=""
Jul 22 02:37:18.329522 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321177    2577 flags.go:64] FLAG: --manifest-url-header=""
Jul 22 02:37:18.329522 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321184    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 22 02:37:18.329522 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321188    2577 flags.go:64] FLAG: --max-open-files="1000000"
Jul 22 02:37:18.329522 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321194    2577 flags.go:64] FLAG: --max-pods="110"
Jul 22 02:37:18.329522 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321199    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 22 02:37:18.329522 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321206    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 22 02:37:18.329522 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321210    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 22 02:37:18.329522 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321215    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 22 02:37:18.329522 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321220    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 22 02:37:18.329522 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321224    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 22 02:37:18.329522 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321229    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 22 02:37:18.329522 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321241    2577 flags.go:64] FLAG: --node-status-max-images="50"
Jul 22 02:37:18.329522 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321245    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 22 02:37:18.330150 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321250    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 22 02:37:18.330150 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321255    2577 flags.go:64] FLAG: --pod-cidr=""
Jul 22 02:37:18.330150 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321260    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 22 02:37:18.330150 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321269    2577 flags.go:64] FLAG: --pod-manifest-path=""
Jul 22 02:37:18.330150 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321273    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 22 02:37:18.330150 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321279    2577 flags.go:64] FLAG: --pods-per-core="0"
Jul 22 02:37:18.330150 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321284    2577 flags.go:64] FLAG: --port="10250"
Jul 22 02:37:18.330150 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321289    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 22 02:37:18.330150 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321294    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0817960c6cdf060e7"
Jul 22 02:37:18.330150 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321298    2577 flags.go:64] FLAG: --qos-reserved=""
Jul 22 02:37:18.330150 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321304    2577 flags.go:64] FLAG: --read-only-port="10255"
Jul 22 02:37:18.330150 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321309    2577 flags.go:64] FLAG: --register-node="true"
Jul 22 02:37:18.330150 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321314    2577 flags.go:64] FLAG: --register-with-taints=""
Jul 22 02:37:18.330150 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321320    2577 flags.go:64] FLAG: --registry-burst="10"
Jul 22 02:37:18.330150 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321325    2577 flags.go:64] FLAG: --registry-qps="5"
Jul 22 02:37:18.330150 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321329    2577 flags.go:64] FLAG: --reserved-cpus=""
Jul 22 02:37:18.330150 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321334    2577 flags.go:64] FLAG: --reserved-memory=""
Jul 22 02:37:18.330150 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321340    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 22 02:37:18.330150 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321345    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 22 02:37:18.330150 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321350    2577 flags.go:64] FLAG: --rotate-certificates="false"
Jul 22 02:37:18.330150 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321355    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 22 02:37:18.330150 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321359    2577 flags.go:64] FLAG: --runonce="false"
Jul 22 02:37:18.330150 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321364    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 22 02:37:18.330150 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321369    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 22 02:37:18.330150 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321377    2577 flags.go:64] FLAG: --seccomp-default="false"
Jul 22 02:37:18.330789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321381    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 22 02:37:18.330789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321386    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 22 02:37:18.330789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321391    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 22 02:37:18.330789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321396    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 22 02:37:18.330789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321401    2577 flags.go:64] FLAG: --storage-driver-password="root"
Jul 22 02:37:18.330789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321406    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 22 02:37:18.330789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321410    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 22 02:37:18.330789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321415    2577 flags.go:64] FLAG: --storage-driver-user="root"
Jul 22 02:37:18.330789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321420    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 22 02:37:18.330789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321424    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 22 02:37:18.330789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321429    2577 flags.go:64] FLAG: --system-cgroups=""
Jul 22 02:37:18.330789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321434    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 22 02:37:18.330789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321442    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 22 02:37:18.330789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321446    2577 flags.go:64] FLAG: --tls-cert-file=""
Jul 22 02:37:18.330789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321453    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 22 02:37:18.330789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321459    2577 flags.go:64] FLAG: --tls-min-version=""
Jul 22 02:37:18.330789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321463    2577 flags.go:64] FLAG: --tls-private-key-file=""
Jul 22 02:37:18.330789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321468    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 22 02:37:18.330789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321475    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 22 02:37:18.330789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321479    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 22 02:37:18.330789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321484    2577 flags.go:64] FLAG: --v="2"
Jul 22 02:37:18.330789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321490    2577 flags.go:64] FLAG: --version="false"
Jul 22 02:37:18.330789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321497    2577 flags.go:64] FLAG: --vmodule=""
Jul 22 02:37:18.330789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321503    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 22 02:37:18.330789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.321508    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 22 02:37:18.331404 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321724    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 02:37:18.331404 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321733    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 02:37:18.331404 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321738    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 02:37:18.331404 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321742    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 02:37:18.331404 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321746    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 02:37:18.331404 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321751    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 02:37:18.331404 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321758    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 02:37:18.331404 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321762    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 02:37:18.331404 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321766    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 02:37:18.331404 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321770    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 02:37:18.331404 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321774    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 02:37:18.331404 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321779    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 02:37:18.331404 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321783    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 02:37:18.331404 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321787    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 02:37:18.331404 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321791    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 02:37:18.331404 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321795    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 02:37:18.331404 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321799    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 02:37:18.331404 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321803    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 02:37:18.331404 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321807    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 02:37:18.331404 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321811    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 02:37:18.331919 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321815    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 02:37:18.331919 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321819    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 02:37:18.331919 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321824    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 02:37:18.331919 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321828    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 02:37:18.331919 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321833    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 02:37:18.331919 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321838    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 02:37:18.331919 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321843    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 02:37:18.331919 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321847    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 02:37:18.331919 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321853    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 02:37:18.331919 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321858    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 02:37:18.331919 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321863    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 02:37:18.331919 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321867    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 02:37:18.331919 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321871    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 02:37:18.331919 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321875    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 02:37:18.331919 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321879    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 02:37:18.331919 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321882    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 02:37:18.331919 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321887    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 02:37:18.331919 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321891    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 02:37:18.331919 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321897    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 02:37:18.331919 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321902    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 02:37:18.332436 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321908    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 02:37:18.332436 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321913    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 02:37:18.332436 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321918    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 02:37:18.332436 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321921    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 02:37:18.332436 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321926    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 02:37:18.332436 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321931    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 02:37:18.332436 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321935    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 02:37:18.332436 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321939    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 02:37:18.332436 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321943    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 02:37:18.332436 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321948    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 02:37:18.332436 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321952    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 02:37:18.332436 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321956    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 02:37:18.332436 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321962    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 02:37:18.332436 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321968    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 02:37:18.332436 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321973    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 02:37:18.332436 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321978    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 02:37:18.332436 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321983    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 02:37:18.332436 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321989    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 02:37:18.332436 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321993    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 02:37:18.332959 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.321997    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 02:37:18.332959 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322001    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 02:37:18.332959 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322005    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 02:37:18.332959 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322010    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 02:37:18.332959 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322014    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 02:37:18.332959 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322019    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 02:37:18.332959 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322023    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 02:37:18.332959 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322027    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 02:37:18.332959 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322031    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 02:37:18.332959 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322036    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 02:37:18.332959 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322040    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 02:37:18.332959 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322046    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 02:37:18.332959 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322049    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 02:37:18.332959 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322054    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 02:37:18.332959 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322058    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 02:37:18.332959 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322062    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 02:37:18.332959 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322066    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 02:37:18.332959 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322070    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 02:37:18.332959 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322074    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 02:37:18.332959 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322078    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 02:37:18.333451 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322082    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 02:37:18.333451 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322086    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 02:37:18.333451 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322090    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 02:37:18.333451 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322095    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 02:37:18.333451 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322099    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 02:37:18.333451 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322103    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 02:37:18.333451 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322108    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 02:37:18.333451 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322112    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 02:37:18.333451 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322116    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 02:37:18.333451 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322121    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 02:37:18.333451 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322129    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 02:37:18.333451 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322134    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 02:37:18.333451 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322138    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 02:37:18.333451 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322143    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 02:37:18.333451 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322147    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 02:37:18.333451 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322151    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 02:37:18.333451 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322156    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 02:37:18.333451 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322161    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 02:37:18.333451 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322166    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 02:37:18.333976 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.322170    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 02:37:18.333976 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.322804    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 02:37:18.333976 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.329729    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 22 02:37:18.333976 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.329746    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 22 02:37:18.333976 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.330323    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 22 02:37:18.333976 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.330334    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 22 02:37:18.333976 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330392    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 02:37:18.333976 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330397    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 02:37:18.333976 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330401    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 02:37:18.333976 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330404    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 02:37:18.333976 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330407    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 02:37:18.333976 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330410    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 02:37:18.333976 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330413    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 02:37:18.333976 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330416    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 02:37:18.333976 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330419    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 02:37:18.334356 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330423    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 02:37:18.334356 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330426    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 02:37:18.334356 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330429    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 02:37:18.334356 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330431    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 02:37:18.334356 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330434    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 02:37:18.334356 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330437    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 02:37:18.334356 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330440    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 02:37:18.334356 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330442    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 02:37:18.334356 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330444    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 02:37:18.334356 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330447    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 02:37:18.334356 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330449    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 02:37:18.334356 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330452    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 02:37:18.334356 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330455    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 02:37:18.334356 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330457    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 02:37:18.334356 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330460    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 02:37:18.334356 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330463    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 02:37:18.334356 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330466    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 02:37:18.334356 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330468    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 02:37:18.334356 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330470    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 02:37:18.334356 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330473    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 02:37:18.334951 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330477    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 02:37:18.334951 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330480    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 02:37:18.334951 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330482    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 02:37:18.334951 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330485    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 02:37:18.334951 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330487    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 02:37:18.334951 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330490    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 02:37:18.334951 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330492    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 02:37:18.334951 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330494    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 02:37:18.334951 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330497    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 02:37:18.334951 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330499    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 02:37:18.334951 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330502    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 02:37:18.334951 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330504    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 02:37:18.334951 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330507    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 02:37:18.334951 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330510    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 02:37:18.334951 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330512    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 02:37:18.334951 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330514    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 02:37:18.334951 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330517    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 02:37:18.334951 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330520    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 02:37:18.334951 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330523    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 02:37:18.334951 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330525    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 02:37:18.335435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330528    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 02:37:18.335435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330530    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 02:37:18.335435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330532    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 02:37:18.335435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330535    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 02:37:18.335435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330538    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 02:37:18.335435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330541    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 02:37:18.335435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330543    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 02:37:18.335435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330546    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 02:37:18.335435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330548    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 02:37:18.335435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330551    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 02:37:18.335435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330555    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 02:37:18.335435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330559    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 02:37:18.335435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330562    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 02:37:18.335435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330566    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 02:37:18.335435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330570    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 02:37:18.335435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330573    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 02:37:18.335435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330576    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 02:37:18.335435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330579    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 02:37:18.335435 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330581    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 02:37:18.335930 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330584    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 02:37:18.335930 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330587    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 02:37:18.335930 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330590    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 02:37:18.335930 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330592    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 02:37:18.335930 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330596    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 02:37:18.335930 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330599    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 02:37:18.335930 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330602    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 02:37:18.335930 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330605    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 02:37:18.335930 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330607    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 02:37:18.335930 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330610    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 02:37:18.335930 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330612    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 02:37:18.335930 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330615    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 02:37:18.335930 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330618    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 02:37:18.335930 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330620    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 02:37:18.335930 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330623    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 02:37:18.335930 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330625    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 02:37:18.335930 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330628    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 02:37:18.335930 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330631    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 02:37:18.335930 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330635    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 02:37:18.336428 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330638    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 02:37:18.336428 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330641    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 02:37:18.336428 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330644    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 02:37:18.336428 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330647    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 02:37:18.336428 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330649    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 02:37:18.336428 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330652    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 02:37:18.336428 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330654    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 02:37:18.336428 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330657    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 02:37:18.336428 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330660    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 02:37:18.336428 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330662    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 02:37:18.336428 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330664    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 02:37:18.336428 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330667    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 02:37:18.336428 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.330672    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 02:37:18.336428 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330813    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 02:37:18.336428 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330820    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 02:37:18.336847 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330822    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 02:37:18.336847 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330825    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 02:37:18.336847 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330829    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 02:37:18.336847 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330832    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 02:37:18.336847 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330836    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 02:37:18.336847 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330839    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 02:37:18.336847 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330843    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 02:37:18.336847 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330846    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 02:37:18.336847 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330849    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 02:37:18.336847 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330851    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 02:37:18.336847 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330854    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 02:37:18.336847 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330856    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 02:37:18.336847 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330859    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 02:37:18.336847 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330861    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 02:37:18.336847 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330864    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 02:37:18.336847 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330867    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 02:37:18.336847 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330871    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 02:37:18.336847 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330874    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 02:37:18.336847 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330877    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 02:37:18.337324 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330880    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 02:37:18.337324 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330883    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 02:37:18.337324 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330885    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 02:37:18.337324 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330888    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 02:37:18.337324 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330890    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 02:37:18.337324 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330893    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 02:37:18.337324 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330895    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 02:37:18.337324 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330899    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 02:37:18.337324 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330901    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 02:37:18.337324 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330903    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 02:37:18.337324 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330906    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 02:37:18.337324 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330908    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 02:37:18.337324 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330911    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 02:37:18.337324 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330913    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 02:37:18.337324 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330916    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 02:37:18.337324 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330918    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 02:37:18.337324 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330920    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 02:37:18.337324 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330923    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 02:37:18.337324 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330925    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 02:37:18.338112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330928    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 02:37:18.338112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330930    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 02:37:18.338112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330932    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 02:37:18.338112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330935    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 02:37:18.338112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330937    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 02:37:18.338112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330939    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 02:37:18.338112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330942    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 02:37:18.338112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330944    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 02:37:18.338112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330947    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 02:37:18.338112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330949    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 02:37:18.338112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330952    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 02:37:18.338112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330954    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 02:37:18.338112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330956    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 02:37:18.338112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330959    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 02:37:18.338112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330961    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 02:37:18.338112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330963    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 02:37:18.338112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330966    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 02:37:18.338112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330968    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 02:37:18.338112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330971    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 02:37:18.338112 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330973    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 02:37:18.338886 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330976    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 02:37:18.338886 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330979    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 02:37:18.338886 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330982    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 02:37:18.338886 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330984    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 02:37:18.338886 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330986    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 02:37:18.338886 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330989    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 02:37:18.338886 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330992    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 02:37:18.338886 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330994    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 02:37:18.338886 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330997    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 02:37:18.338886 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.330999    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 02:37:18.338886 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331001    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 02:37:18.338886 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331004    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 02:37:18.338886 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331006    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 02:37:18.338886 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331009    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 02:37:18.338886 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331011    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 02:37:18.338886 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331014    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 02:37:18.338886 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331016    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 02:37:18.338886 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331019    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 02:37:18.338886 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331021    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 02:37:18.338886 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331024    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 02:37:18.339392 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331026    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 02:37:18.339392 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331029    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 02:37:18.339392 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331031    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 02:37:18.339392 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331034    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 02:37:18.339392 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331036    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 02:37:18.339392 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331038    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 02:37:18.339392 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331041    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 02:37:18.339392 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331043    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 02:37:18.339392 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331046    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 02:37:18.339392 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331048    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 02:37:18.339392 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331050    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 02:37:18.339392 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331053    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 02:37:18.339392 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331055    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 02:37:18.339392 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331058    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 02:37:18.339392 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331061    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 02:37:18.339392 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331063    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 02:37:18.339392 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331066    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 02:37:18.339392 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331068    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 02:37:18.339392 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:18.331070    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 02:37:18.340067 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.331075    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 02:37:18.340067 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.331195    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 22 02:37:18.340067 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.333117    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 22 02:37:18.340067 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.334270    2577 server.go:1019] "Starting client certificate rotation"
Jul 22 02:37:18.340067 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.334369    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 02:37:18.340067 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.334426    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 02:37:18.340067 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.337399    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 02:37:18.342142 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.342126    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 02:37:18.348294 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.348278    2577 log.go:25] "Validated CRI v1 runtime API"
Jul 22 02:37:18.352107 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.352090    2577 log.go:25] "Validated CRI v1 image API"
Jul 22 02:37:18.353454 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.353440    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 22 02:37:18.355387 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.355367    2577 fs.go:135] Filesystem UUIDs: map[48b14957-3d52-4a39-859d-9add9d4fdf1b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 88db04ef-1dc3-49b3-8a67-03dfce7d2066:/dev/nvme0n1p3]
Jul 22 02:37:18.355455 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.355386    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 22 02:37:18.360333 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.360216    2577 manager.go:216] Machine: {Timestamp:2026-07-22 02:37:18.359077403 +0000 UTC m=+0.259048017 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099893 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a3737e3fe82129603c249c37d3988 SystemUUID:ec2a3737-e3fe-8212-9603-c249c37d3988 BootID:1b37d7c6-1cdd-4c47-81e7-98a67c5044c7 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fa:80:fa:f2:13 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fa:80:fa:f2:13 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:33:15:c9:73:46 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 22 02:37:18.360333 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.360327    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 22 02:37:18.360473 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.360410    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 22 02:37:18.362788 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.362758    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 22 02:37:18.362962 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.362792    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-160.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 22 02:37:18.363495 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.363483    2577 topology_manager.go:138] "Creating topology manager with none policy"
Jul 22 02:37:18.363547 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.363503    2577 container_manager_linux.go:309] "Creating device plugin manager"
Jul 22 02:37:18.363547 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.363515    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 02:37:18.363984 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.363967    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 02:37:18.364076 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.364065    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 02:37:18.365329 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.365318    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 22 02:37:18.369162 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.369147    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 02:37:18.369304 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.369293    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 22 02:37:18.369359 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.369333    2577 kubelet.go:486] "Attempting to sync node with API server"
Jul 22 02:37:18.369359 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.369349    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 22 02:37:18.369451 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.369365    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 22 02:37:18.369451 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.369378    2577 kubelet.go:398] "Adding apiserver pod source"
Jul 22 02:37:18.369451 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.369392    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 22 02:37:18.369817 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.369802    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 02:37:18.369890 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.369824    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 02:37:18.371617 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.371601    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 22 02:37:18.374403 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.374377    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 22 02:37:18.374483 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.374428    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 22 02:37:18.375516 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.375496    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 22 02:37:18.375516 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.375519    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 22 02:37:18.375516 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.375526    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 22 02:37:18.375516 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.375531    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 22 02:37:18.375802 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.375630    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 22 02:37:18.375802 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.375652    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 22 02:37:18.375802 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.375764    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 22 02:37:18.375802 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.375792    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 22 02:37:18.375981 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.375812    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 22 02:37:18.375981 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.375826    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 22 02:37:18.375981 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.375863    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 22 02:37:18.375981 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.375877    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 22 02:37:18.376704 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.376680    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 22 02:37:18.376704 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.376697    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 22 02:37:18.378618 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:18.378595    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-160.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 22 02:37:18.378690 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.378617    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-160.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 22 02:37:18.378690 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:18.378596    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 22 02:37:18.380165 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.380150    2577 server.go:1268] "Started kubelet"
Jul 22 02:37:18.380266 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.380235    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 22 02:37:18.380302 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.380234    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 22 02:37:18.380335 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.380317    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 22 02:37:18.381094 ip-10-0-143-160 systemd[1]: Started Kubernetes Kubelet.
Jul 22 02:37:18.381481 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.381461    2577 server.go:310] "Adding debug handlers to kubelet server"
Jul 22 02:37:18.381901 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.381882    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 22 02:37:18.384651 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:18.384622    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 22 02:37:18.386845 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.386828    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nnnjs"
Jul 22 02:37:18.388208 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:18.387475    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-160.ec2.internal.18c47c22219b522e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-160.ec2.internal,UID:ip-10-0-143-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-160.ec2.internal,},FirstTimestamp:2026-07-22 02:37:18.380118574 +0000 UTC m=+0.280089187,LastTimestamp:2026-07-22 02:37:18.380118574 +0000 UTC m=+0.280089187,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-160.ec2.internal,}"
Jul 22 02:37:18.388381 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.388367    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 22 02:37:18.388415 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.388370    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 22 02:37:18.388561 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:18.388540    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-160.ec2.internal\" not found"
Jul 22 02:37:18.389054 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.389029    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 22 02:37:18.389054 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.389032    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 22 02:37:18.389054 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.389054    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 22 02:37:18.389243 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.389172    2577 reconstruct.go:97] "Volume reconstruction finished"
Jul 22 02:37:18.389243 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.389180    2577 reconciler.go:29] "Reconciler: start to sync state"
Jul 22 02:37:18.389348 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.389335    2577 factory.go:55] Registering systemd factory
Jul 22 02:37:18.389392 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.389356    2577 factory.go:223] Registration of the systemd container factory successfully
Jul 22 02:37:18.389591 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.389565    2577 factory.go:153] Registering CRI-O factory
Jul 22 02:37:18.389591 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.389582    2577 factory.go:223] Registration of the crio container factory successfully
Jul 22 02:37:18.389742 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.389636    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 22 02:37:18.389742 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.389657    2577 factory.go:103] Registering Raw factory
Jul 22 02:37:18.389742 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.389683    2577 manager.go:1196] Started watching for new ooms in manager
Jul 22 02:37:18.390262 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.390249    2577 manager.go:349] Starting recovery of all containers
Jul 22 02:37:18.392269 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:18.392247    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-160.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 22 02:37:18.392351 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:18.392330    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 22 02:37:18.394946 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.394925    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nnnjs"
Jul 22 02:37:18.401784 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.401762    2577 manager.go:354] Recovery completed
Jul 22 02:37:18.406358 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.406337    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 02:37:18.408790 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.408774    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 02:37:18.408864 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.408807    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 02:37:18.408864 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.408821    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientPID"
Jul 22 02:37:18.409419 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.409403    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 22 02:37:18.409419 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.409415    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 02:37:18.409571 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.409417    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 22 02:37:18.409571 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.409463    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 02:37:18.410198 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.410179    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 02:37:18.410278 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.410210    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 02:37:18.410278 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.410220    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientPID"
Jul 22 02:37:18.410809 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:18.410698    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-160.ec2.internal.18c47c222350d212  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-160.ec2.internal,UID:ip-10-0-143-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-160.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-160.ec2.internal,},FirstTimestamp:2026-07-22 02:37:18.408790546 +0000 UTC m=+0.308761158,LastTimestamp:2026-07-22 02:37:18.408790546 +0000 UTC m=+0.308761158,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-160.ec2.internal,}"
Jul 22 02:37:18.411589 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.411574    2577 policy_none.go:49] "None policy: Start"
Jul 22 02:37:18.411589 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.411592    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 22 02:37:18.411680 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.411603    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 22 02:37:18.413656 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.413644    2577 policy_none.go:47] "Start"
Jul 22 02:37:18.446288 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.446261    2577 manager.go:337] "Starting Device Plugin manager"
Jul 22 02:37:18.446393 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:18.446298    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 22 02:37:18.446393 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.446308    2577 server.go:87] "Starting device plugin registration server"
Jul 22 02:37:18.446629 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.446617    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 22 02:37:18.446661 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.446633    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 22 02:37:18.446746 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.446723    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 22 02:37:18.446860 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.446806    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 22 02:37:18.446860 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.446815    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 22 02:37:18.447383 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:18.447360    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 22 02:37:18.447459 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:18.447433    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-160.ec2.internal\" not found"
Jul 22 02:37:18.547257 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.547221    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 02:37:18.549526 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.548421    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 02:37:18.549526 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.548456    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 02:37:18.549526 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.548469    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientPID"
Jul 22 02:37:18.549526 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.548496    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-160.ec2.internal"
Jul 22 02:37:18.556621 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.556596    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-160.ec2.internal"
Jul 22 02:37:18.556621 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:18.556620    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-160.ec2.internal\": node \"ip-10-0-143-160.ec2.internal\" not found"
Jul 22 02:37:18.557909 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.557889    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 22 02:37:18.559325 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.559304    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 22 02:37:18.559428 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.559342    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 22 02:37:18.559428 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.559365    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 22 02:37:18.559428 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:18.559406    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 22 02:37:18.561920 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.561864    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 02:37:18.589026 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:18.589004    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-160.ec2.internal\" not found"
Jul 22 02:37:18.660330 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.660292    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-160.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal"]
Jul 22 02:37:18.660503 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.660370    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 02:37:18.661451 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.661429    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 02:37:18.661568 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.661464    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 02:37:18.661568 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.661505    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientPID"
Jul 22 02:37:18.663951 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.663936    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 02:37:18.664079 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.664063    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-160.ec2.internal"
Jul 22 02:37:18.664134 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.664098    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 02:37:18.664740 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.664700    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 02:37:18.664818 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.664750    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 02:37:18.664818 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.664757    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 02:37:18.664818 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.664768    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 02:37:18.664818 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.664772    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientPID"
Jul 22 02:37:18.664818 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.664781    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientPID"
Jul 22 02:37:18.667036 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.667016    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal"
Jul 22 02:37:18.667152 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.667051    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 02:37:18.667860 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.667844    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 02:37:18.667952 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.667877    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 02:37:18.667952 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.667890    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientPID"
Jul 22 02:37:18.689417 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:18.689394    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-160.ec2.internal\" not found"
Jul 22 02:37:18.689607 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:18.689591    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-160.ec2.internal\" not found" node="ip-10-0-143-160.ec2.internal"
Jul 22 02:37:18.691647 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.691631    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/760279d9ea477286e4f5ad9a50c57ba5-config\") pod \"kube-apiserver-proxy-ip-10-0-143-160.ec2.internal\" (UID: \"760279d9ea477286e4f5ad9a50c57ba5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-160.ec2.internal"
Jul 22 02:37:18.691744 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.691653    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c78f4b8e0da2d921ed52b00b7f21485-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal\" (UID: \"8c78f4b8e0da2d921ed52b00b7f21485\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal"
Jul 22 02:37:18.691744 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.691680    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c78f4b8e0da2d921ed52b00b7f21485-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal\" (UID: \"8c78f4b8e0da2d921ed52b00b7f21485\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal"
Jul 22 02:37:18.694304 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:18.694288    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-160.ec2.internal\" not found" node="ip-10-0-143-160.ec2.internal"
Jul 22 02:37:18.789931 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:18.789898    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-160.ec2.internal\" not found"
Jul 22 02:37:18.792119 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.792098    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c78f4b8e0da2d921ed52b00b7f21485-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal\" (UID: \"8c78f4b8e0da2d921ed52b00b7f21485\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal"
Jul 22 02:37:18.792172 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.792135    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c78f4b8e0da2d921ed52b00b7f21485-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal\" (UID: \"8c78f4b8e0da2d921ed52b00b7f21485\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal"
Jul 22 02:37:18.792210 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.792175    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c78f4b8e0da2d921ed52b00b7f21485-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal\" (UID: \"8c78f4b8e0da2d921ed52b00b7f21485\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal"
Jul 22 02:37:18.792210 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.792194    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/760279d9ea477286e4f5ad9a50c57ba5-config\") pod \"kube-apiserver-proxy-ip-10-0-143-160.ec2.internal\" (UID: \"760279d9ea477286e4f5ad9a50c57ba5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-160.ec2.internal"
Jul 22 02:37:18.792274 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.792218    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/760279d9ea477286e4f5ad9a50c57ba5-config\") pod \"kube-apiserver-proxy-ip-10-0-143-160.ec2.internal\" (UID: \"760279d9ea477286e4f5ad9a50c57ba5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-160.ec2.internal"
Jul 22 02:37:18.792274 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.792244    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c78f4b8e0da2d921ed52b00b7f21485-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal\" (UID: \"8c78f4b8e0da2d921ed52b00b7f21485\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal"
Jul 22 02:37:18.890343 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:18.890263    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-160.ec2.internal\" not found"
Jul 22 02:37:18.990739 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:18.990685    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-160.ec2.internal\" not found"
Jul 22 02:37:18.992942 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.992899    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-160.ec2.internal"
Jul 22 02:37:18.997982 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:18.997696    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal"
Jul 22 02:37:19.091642 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:19.091603    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-160.ec2.internal\" not found"
Jul 22 02:37:19.192294 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:19.192204    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-160.ec2.internal\" not found"
Jul 22 02:37:20.396913 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.396890    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 02:37:20.481212 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.481166    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-160.ec2.internal"
Jul 22 02:37:20.495209 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.495181    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 02:37:20.496570 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.496556    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal"
Jul 22 02:37:20.506710 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.506692    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 02:37:20.525886 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.525851    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 22 02:37:20.526036 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.526008    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 02:37:20.526106 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.526037    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 02:37:20.561141 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.561107    2577 apiserver.go:52] "Watching apiserver"
Jul 22 02:37:20.580385 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.580358    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 22 02:37:20.582760 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.582735    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 22 02:37:20.583099 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.583076    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-cjz5v","kube-system/kube-apiserver-proxy-ip-10-0-143-160.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j","openshift-image-registry/node-ca-2fr65","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal","openshift-multus/multus-additional-cni-plugins-wksbs","openshift-multus/multus-p7bn5","openshift-multus/network-metrics-daemon-snc7m","kube-system/konnectivity-agent-7mqzz","openshift-cluster-node-tuning-operator/tuned-v4g5p","openshift-dns/node-resolver-m59jm","openshift-network-diagnostics/network-check-target-bdgj4","openshift-network-operator/iptables-alerter-t4d8c","openshift-ovn-kubernetes/ovnkube-node-mqngf"]
Jul 22 02:37:20.586284 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.586266    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.588817 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.588797    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m59jm"
Jul 22 02:37:20.589102 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.589081    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 22 02:37:20.589200 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.589081    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 22 02:37:20.589296 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.589279    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 22 02:37:20.589343 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.589302    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 22 02:37:20.589512 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.589497    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-x87t8\""
Jul 22 02:37:20.590986 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.590966    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j"
Jul 22 02:37:20.591106 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.591090    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 22 02:37:20.593609 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.593591    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2fr65"
Jul 22 02:37:20.593845 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.593828    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 22 02:37:20.593907 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.593882    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-24wk5\""
Jul 22 02:37:20.595069 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.595043    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 02:32:19 +0000 UTC" deadline="2028-04-24 09:02:52.358392904 +0000 UTC"
Jul 22 02:37:20.595069 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.595067    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15414h25m31.763328198s"
Jul 22 02:37:20.595854 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.595838    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.598145 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.598126    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wksbs"
Jul 22 02:37:20.600884 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.600867    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7mqzz"
Jul 22 02:37:20.601426 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.601166    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 22 02:37:20.601426 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.601278    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 22 02:37:20.601426 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.601176    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-k9wxb\""
Jul 22 02:37:20.601663 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.601426    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 02:37:20.601663 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.601434    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 22 02:37:20.601663 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.601489    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 22 02:37:20.601663 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.601499    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9ld7b\""
Jul 22 02:37:20.601663 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.601547    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 22 02:37:20.601663 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.601630    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 22 02:37:20.601663 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.601489    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 22 02:37:20.601969 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.601755    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f2cpd\""
Jul 22 02:37:20.601969 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.601792    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 22 02:37:20.601969 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.601811    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 22 02:37:20.602751 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.602737    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 22 02:37:20.602818 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.602786    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 22 02:37:20.602873 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.602865    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 22 02:37:20.602924 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.602874    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 22 02:37:20.603765 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.603750    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t4d8c"
Jul 22 02:37:20.603844 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.603829    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-66px7\""
Jul 22 02:37:20.603931 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.603830    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 22 02:37:20.605231 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.605195    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 22 02:37:20.606279 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.606243    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 22 02:37:20.606633 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.606613    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dgk9z\""
Jul 22 02:37:20.607093 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.607071    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:20.607242 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:20.607216    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snc7m" podUID="cf3a32bc-8b07-4a3a-8b34-5ba92a675b90"
Jul 22 02:37:20.607907 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.607886    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 22 02:37:20.608004 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.607989    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 22 02:37:20.608053 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.607990    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-f7xr2\""
Jul 22 02:37:20.609703 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.609687    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.612370 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.612350    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 22 02:37:20.612464 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.612429    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:20.612521 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:20.612503    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz5v" podUID="58f296ac-da6c-473e-8c58-49fa164804f5"
Jul 22 02:37:20.612577 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.612527    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 22 02:37:20.612629 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.612595    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 22 02:37:20.613032 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.613011    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r2t5f\""
Jul 22 02:37:20.614950 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.614931    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:20.615040 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:20.614989    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgj4" podUID="b4abb13b-cb47-4cb3-9db4-c9531012e8c2"
Jul 22 02:37:20.624243 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.624227    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-n7kqk"
Jul 22 02:37:20.635321 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.635226    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-n7kqk"
Jul 22 02:37:20.682348 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.682325    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 22 02:37:20.687324 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.687300    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/43d40c9e-d94f-403e-bf2b-8447aa63c337-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wfb4j\" (UID: \"43d40c9e-d94f-403e-bf2b-8447aa63c337\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j"
Jul 22 02:37:20.687430 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.687329    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-var-lib-kubelet\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.687430 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.687346    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-host\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.687430 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.687370    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k245p\" (UniqueName: \"kubernetes.io/projected/b381967f-eb37-427b-ae7b-e2ef917ee729-kube-api-access-k245p\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.687430 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.687393    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-multus-cni-dir\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.687565 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.687429    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx4wh\" (UniqueName: \"kubernetes.io/projected/2e50e649-3f15-4e39-937b-73d8a14fdc1e-kube-api-access-zx4wh\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.687565 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.687482    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv5sw\" (UniqueName: \"kubernetes.io/projected/f451c68d-e137-4c8e-854b-441da8def534-kube-api-access-kv5sw\") pod \"node-resolver-m59jm\" (UID: \"f451c68d-e137-4c8e-854b-441da8def534\") " pod="openshift-dns/node-resolver-m59jm"
Jul 22 02:37:20.687565 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.687528    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3fb4dd6b-d6d7-409a-a6a3-a2f11d2a3375-serviceca\") pod \"node-ca-2fr65\" (UID: \"3fb4dd6b-d6d7-409a-a6a3-a2f11d2a3375\") " pod="openshift-image-registry/node-ca-2fr65"
Jul 22 02:37:20.687677 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.687565    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs444\" (UniqueName: \"kubernetes.io/projected/3fb4dd6b-d6d7-409a-a6a3-a2f11d2a3375-kube-api-access-zs444\") pod \"node-ca-2fr65\" (UID: \"3fb4dd6b-d6d7-409a-a6a3-a2f11d2a3375\") " pod="openshift-image-registry/node-ca-2fr65"
Jul 22 02:37:20.687677 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.687594    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7453e58d-d28e-457a-b67e-5231350eb4a0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wksbs\" (UID: \"7453e58d-d28e-457a-b67e-5231350eb4a0\") " pod="openshift-multus/multus-additional-cni-plugins-wksbs"
Jul 22 02:37:20.687677 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.687619    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58f296ac-da6c-473e-8c58-49fa164804f5-original-pull-secret\") pod \"global-pull-secret-syncer-cjz5v\" (UID: \"58f296ac-da6c-473e-8c58-49fa164804f5\") " pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:20.687677 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.687651    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-host-var-lib-cni-bin\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.687792 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.687671    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-run-openvswitch\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.687792 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.687700    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.687792 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.687723    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/43d40c9e-d94f-403e-bf2b-8447aa63c337-registration-dir\") pod \"aws-ebs-csi-driver-node-wfb4j\" (UID: \"43d40c9e-d94f-403e-bf2b-8447aa63c337\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j"
Jul 22 02:37:20.687792 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.687742    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-etc-systemd\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.687792 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.687762    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-os-release\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.687961 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.687797    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e50e649-3f15-4e39-937b-73d8a14fdc1e-multus-daemon-config\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.687961 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.687821    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-etc-kubernetes\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.687961 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.687835    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-run-ovn\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.687961 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.687854    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df0a8110-6951-4b69-8a89-41c4cc793ba9-host-slash\") pod \"iptables-alerter-t4d8c\" (UID: \"df0a8110-6951-4b69-8a89-41c4cc793ba9\") " pod="openshift-network-operator/iptables-alerter-t4d8c"
Jul 22 02:37:20.687961 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.687874    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-systemd-units\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.687961 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.687894    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-ovnkube-config\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.687961 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.687914    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/43d40c9e-d94f-403e-bf2b-8447aa63c337-etc-selinux\") pod \"aws-ebs-csi-driver-node-wfb4j\" (UID: \"43d40c9e-d94f-403e-bf2b-8447aa63c337\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j"
Jul 22 02:37:20.687961 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.687955    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-metrics-certs\") pod \"network-metrics-daemon-snc7m\" (UID: \"cf3a32bc-8b07-4a3a-8b34-5ba92a675b90\") " pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:20.688219 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.687976    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-etc-modprobe-d\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.688219 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688034    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-etc-sysctl-d\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.688219 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688056    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-etc-sysctl-conf\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.688219 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688076    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/58f296ac-da6c-473e-8c58-49fa164804f5-kubelet-config\") pod \"global-pull-secret-syncer-cjz5v\" (UID: \"58f296ac-da6c-473e-8c58-49fa164804f5\") " pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:20.688219 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688110    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-ovn-node-metrics-cert\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.688219 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688132    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b381967f-eb37-427b-ae7b-e2ef917ee729-etc-tuned\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.688219 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688153    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-system-cni-dir\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.688219 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688178    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-host-run-k8s-cni-cncf-io\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.688219 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688196    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f451c68d-e137-4c8e-854b-441da8def534-hosts-file\") pod \"node-resolver-m59jm\" (UID: \"f451c68d-e137-4c8e-854b-441da8def534\") " pod="openshift-dns/node-resolver-m59jm"
Jul 22 02:37:20.688219 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688216    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f97aea05-b7fe-4242-b768-6daf68120ccd-konnectivity-ca\") pod \"konnectivity-agent-7mqzz\" (UID: \"f97aea05-b7fe-4242-b768-6daf68120ccd\") " pod="kube-system/konnectivity-agent-7mqzz"
Jul 22 02:37:20.688614 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688272    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f451c68d-e137-4c8e-854b-441da8def534-tmp-dir\") pod \"node-resolver-m59jm\" (UID: \"f451c68d-e137-4c8e-854b-441da8def534\") " pod="openshift-dns/node-resolver-m59jm"
Jul 22 02:37:20.688614 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688313    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3fb4dd6b-d6d7-409a-a6a3-a2f11d2a3375-host\") pod \"node-ca-2fr65\" (UID: \"3fb4dd6b-d6d7-409a-a6a3-a2f11d2a3375\") " pod="openshift-image-registry/node-ca-2fr65"
Jul 22 02:37:20.688614 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688335    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-ovnkube-script-lib\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.688614 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688364    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7453e58d-d28e-457a-b67e-5231350eb4a0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wksbs\" (UID: \"7453e58d-d28e-457a-b67e-5231350eb4a0\") " pod="openshift-multus/multus-additional-cni-plugins-wksbs"
Jul 22 02:37:20.688614 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688378    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/43d40c9e-d94f-403e-bf2b-8447aa63c337-sys-fs\") pod \"aws-ebs-csi-driver-node-wfb4j\" (UID: \"43d40c9e-d94f-403e-bf2b-8447aa63c337\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j"
Jul 22 02:37:20.688614 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688395    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-lib-modules\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.688614 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688433    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/58f296ac-da6c-473e-8c58-49fa164804f5-dbus\") pod \"global-pull-secret-syncer-cjz5v\" (UID: \"58f296ac-da6c-473e-8c58-49fa164804f5\") " pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:20.688614 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688465    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-hostroot\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.688614 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688490    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-etc-openvswitch\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.688614 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688512    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7453e58d-d28e-457a-b67e-5231350eb4a0-cni-binary-copy\") pod \"multus-additional-cni-plugins-wksbs\" (UID: \"7453e58d-d28e-457a-b67e-5231350eb4a0\") " pod="openshift-multus/multus-additional-cni-plugins-wksbs"
Jul 22 02:37:20.688614 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688533    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-host-var-lib-kubelet\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.688614 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688554    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-host-slash\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.688614 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688574    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-var-lib-openvswitch\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.688614 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688597    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-host-cni-bin\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.688614 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688616    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6ptj\" (UniqueName: \"kubernetes.io/projected/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-kube-api-access-w6ptj\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.689295 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688631    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7453e58d-d28e-457a-b67e-5231350eb4a0-system-cni-dir\") pod \"multus-additional-cni-plugins-wksbs\" (UID: \"7453e58d-d28e-457a-b67e-5231350eb4a0\") " pod="openshift-multus/multus-additional-cni-plugins-wksbs"
Jul 22 02:37:20.689295 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688645    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f97aea05-b7fe-4242-b768-6daf68120ccd-agent-certs\") pod \"konnectivity-agent-7mqzz\" (UID: \"f97aea05-b7fe-4242-b768-6daf68120ccd\") " pod="kube-system/konnectivity-agent-7mqzz"
Jul 22 02:37:20.689295 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688675    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-multus-socket-dir-parent\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.689295 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688697    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-host-run-multus-certs\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.689295 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688744    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-run-systemd\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.689295 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688785    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-log-socket\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.689295 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688811    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-etc-sysconfig\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.689295 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688834    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-multus-conf-dir\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.689295 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688857    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-host-cni-netd\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.689295 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688882    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdcbp\" (UniqueName: \"kubernetes.io/projected/43d40c9e-d94f-403e-bf2b-8447aa63c337-kube-api-access-pdcbp\") pod \"aws-ebs-csi-driver-node-wfb4j\" (UID: \"43d40c9e-d94f-403e-bf2b-8447aa63c337\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j"
Jul 22 02:37:20.689295 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688915    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-sys\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.689295 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688938    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b381967f-eb37-427b-ae7b-e2ef917ee729-tmp\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.689295 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688972    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-cnibin\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.689295 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.688994    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-env-overrides\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.689295 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.689027    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7453e58d-d28e-457a-b67e-5231350eb4a0-cnibin\") pod \"multus-additional-cni-plugins-wksbs\" (UID: \"7453e58d-d28e-457a-b67e-5231350eb4a0\") " pod="openshift-multus/multus-additional-cni-plugins-wksbs"
Jul 22 02:37:20.689295 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.689053    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xblsn\" (UniqueName: \"kubernetes.io/projected/df0a8110-6951-4b69-8a89-41c4cc793ba9-kube-api-access-xblsn\") pod \"iptables-alerter-t4d8c\" (UID: \"df0a8110-6951-4b69-8a89-41c4cc793ba9\") " pod="openshift-network-operator/iptables-alerter-t4d8c"
Jul 22 02:37:20.689748 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.689083    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/43d40c9e-d94f-403e-bf2b-8447aa63c337-device-dir\") pod \"aws-ebs-csi-driver-node-wfb4j\" (UID: \"43d40c9e-d94f-403e-bf2b-8447aa63c337\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j"
Jul 22 02:37:20.689748 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.689111    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6kqc\" (UniqueName: \"kubernetes.io/projected/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-kube-api-access-k6kqc\") pod \"network-metrics-daemon-snc7m\" (UID: \"cf3a32bc-8b07-4a3a-8b34-5ba92a675b90\") " pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:20.689748 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.689133    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-run\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.689748 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.689156    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-host-kubelet\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.689748 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.689186    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.689748 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.689222    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7453e58d-d28e-457a-b67e-5231350eb4a0-os-release\") pod \"multus-additional-cni-plugins-wksbs\" (UID: \"7453e58d-d28e-457a-b67e-5231350eb4a0\") " pod="openshift-multus/multus-additional-cni-plugins-wksbs"
Jul 22 02:37:20.689748 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.689321    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/df0a8110-6951-4b69-8a89-41c4cc793ba9-iptables-alerter-script\") pod \"iptables-alerter-t4d8c\" (UID: \"df0a8110-6951-4b69-8a89-41c4cc793ba9\") " pod="openshift-network-operator/iptables-alerter-t4d8c"
Jul 22 02:37:20.689748 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.689345    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/43d40c9e-d94f-403e-bf2b-8447aa63c337-socket-dir\") pod \"aws-ebs-csi-driver-node-wfb4j\" (UID: \"43d40c9e-d94f-403e-bf2b-8447aa63c337\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j"
Jul 22 02:37:20.689748 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.689367    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-etc-kubernetes\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.689748 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.689386    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-host-run-netns\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.689748 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.689401    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-host-run-netns\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.689748 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.689424    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-node-log\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.689748 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.689460    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7453e58d-d28e-457a-b67e-5231350eb4a0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wksbs\" (UID: \"7453e58d-d28e-457a-b67e-5231350eb4a0\") " pod="openshift-multus/multus-additional-cni-plugins-wksbs"
Jul 22 02:37:20.689748 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.689483    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgmcm\" (UniqueName: \"kubernetes.io/projected/7453e58d-d28e-457a-b67e-5231350eb4a0-kube-api-access-tgmcm\") pod \"multus-additional-cni-plugins-wksbs\" (UID: \"7453e58d-d28e-457a-b67e-5231350eb4a0\") " pod="openshift-multus/multus-additional-cni-plugins-wksbs"
Jul 22 02:37:20.689748 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.689506    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6cql\" (UniqueName: \"kubernetes.io/projected/b4abb13b-cb47-4cb3-9db4-c9531012e8c2-kube-api-access-q6cql\") pod \"network-check-target-bdgj4\" (UID: \"b4abb13b-cb47-4cb3-9db4-c9531012e8c2\") " pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:20.689748 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.689521    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e50e649-3f15-4e39-937b-73d8a14fdc1e-cni-binary-copy\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.690231 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.689536    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-host-var-lib-cni-multus\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.751467 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:20.751355    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod760279d9ea477286e4f5ad9a50c57ba5.slice/crio-4bed1a96c71071c95e0db2775cd9db231b690a10d7845f5297b1713f82bfeb18 WatchSource:0}: Error finding container 4bed1a96c71071c95e0db2775cd9db231b690a10d7845f5297b1713f82bfeb18: Status 404 returned error can't find the container with id 4bed1a96c71071c95e0db2775cd9db231b690a10d7845f5297b1713f82bfeb18
Jul 22 02:37:20.756334 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.756315    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 02:37:20.761673 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:20.761649    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c78f4b8e0da2d921ed52b00b7f21485.slice/crio-1c6e5a6dc0f0996fcf268e752b163da4ce0d65e4e01ca9f6d9496f0dfd622bfc WatchSource:0}: Error finding container 1c6e5a6dc0f0996fcf268e752b163da4ce0d65e4e01ca9f6d9496f0dfd622bfc: Status 404 returned error can't find the container with id 1c6e5a6dc0f0996fcf268e752b163da4ce0d65e4e01ca9f6d9496f0dfd622bfc
Jul 22 02:37:20.789763 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.789722    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6kqc\" (UniqueName: \"kubernetes.io/projected/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-kube-api-access-k6kqc\") pod \"network-metrics-daemon-snc7m\" (UID: \"cf3a32bc-8b07-4a3a-8b34-5ba92a675b90\") " pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:20.789763 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.789756    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-run\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.790009 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.789780    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-host-kubelet\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.790009 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.789796    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.790009 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.789849    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7453e58d-d28e-457a-b67e-5231350eb4a0-os-release\") pod \"multus-additional-cni-plugins-wksbs\" (UID: \"7453e58d-d28e-457a-b67e-5231350eb4a0\") " pod="openshift-multus/multus-additional-cni-plugins-wksbs"
Jul 22 02:37:20.790009 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.789887    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/df0a8110-6951-4b69-8a89-41c4cc793ba9-iptables-alerter-script\") pod \"iptables-alerter-t4d8c\" (UID: \"df0a8110-6951-4b69-8a89-41c4cc793ba9\") " pod="openshift-network-operator/iptables-alerter-t4d8c"
Jul 22 02:37:20.790009 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.789896    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-run\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.790009 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.789912    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/43d40c9e-d94f-403e-bf2b-8447aa63c337-socket-dir\") pod \"aws-ebs-csi-driver-node-wfb4j\" (UID: \"43d40c9e-d94f-403e-bf2b-8447aa63c337\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j"
Jul 22 02:37:20.790009 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.789935    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-etc-kubernetes\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.790009 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.789941    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-host-kubelet\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.790009 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.789938    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7453e58d-d28e-457a-b67e-5231350eb4a0-os-release\") pod \"multus-additional-cni-plugins-wksbs\" (UID: \"7453e58d-d28e-457a-b67e-5231350eb4a0\") " pod="openshift-multus/multus-additional-cni-plugins-wksbs"
Jul 22 02:37:20.790009 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.789959    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-host-run-netns\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.790009 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.789855    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.790009 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.789983    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-host-run-netns\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.790658 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790025    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-host-run-netns\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.790658 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790041    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-host-run-netns\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.790658 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790042    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-node-log\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.790658 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790071    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/43d40c9e-d94f-403e-bf2b-8447aa63c337-socket-dir\") pod \"aws-ebs-csi-driver-node-wfb4j\" (UID: \"43d40c9e-d94f-403e-bf2b-8447aa63c337\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j"
Jul 22 02:37:20.790658 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790088    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-node-log\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.790658 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790092    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7453e58d-d28e-457a-b67e-5231350eb4a0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wksbs\" (UID: \"7453e58d-d28e-457a-b67e-5231350eb4a0\") " pod="openshift-multus/multus-additional-cni-plugins-wksbs"
Jul 22 02:37:20.790658 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790117    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-etc-kubernetes\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.790658 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790170    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgmcm\" (UniqueName: \"kubernetes.io/projected/7453e58d-d28e-457a-b67e-5231350eb4a0-kube-api-access-tgmcm\") pod \"multus-additional-cni-plugins-wksbs\" (UID: \"7453e58d-d28e-457a-b67e-5231350eb4a0\") " pod="openshift-multus/multus-additional-cni-plugins-wksbs"
Jul 22 02:37:20.790658 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790200    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6cql\" (UniqueName: \"kubernetes.io/projected/b4abb13b-cb47-4cb3-9db4-c9531012e8c2-kube-api-access-q6cql\") pod \"network-check-target-bdgj4\" (UID: \"b4abb13b-cb47-4cb3-9db4-c9531012e8c2\") " pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:20.790658 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790229    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e50e649-3f15-4e39-937b-73d8a14fdc1e-cni-binary-copy\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.790658 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790274    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-host-var-lib-cni-multus\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.790658 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790299    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/43d40c9e-d94f-403e-bf2b-8447aa63c337-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wfb4j\" (UID: \"43d40c9e-d94f-403e-bf2b-8447aa63c337\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j"
Jul 22 02:37:20.790658 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790322    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-var-lib-kubelet\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.790658 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790345    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-host\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.790658 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790366    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k245p\" (UniqueName: \"kubernetes.io/projected/b381967f-eb37-427b-ae7b-e2ef917ee729-kube-api-access-k245p\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.790658 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790389    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-multus-cni-dir\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.790658 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790413    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx4wh\" (UniqueName: \"kubernetes.io/projected/2e50e649-3f15-4e39-937b-73d8a14fdc1e-kube-api-access-zx4wh\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.791533 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790439    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv5sw\" (UniqueName: \"kubernetes.io/projected/f451c68d-e137-4c8e-854b-441da8def534-kube-api-access-kv5sw\") pod \"node-resolver-m59jm\" (UID: \"f451c68d-e137-4c8e-854b-441da8def534\") " pod="openshift-dns/node-resolver-m59jm"
Jul 22 02:37:20.791533 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790463    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3fb4dd6b-d6d7-409a-a6a3-a2f11d2a3375-serviceca\") pod \"node-ca-2fr65\" (UID: \"3fb4dd6b-d6d7-409a-a6a3-a2f11d2a3375\") " pod="openshift-image-registry/node-ca-2fr65"
Jul 22 02:37:20.791533 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790485    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs444\" (UniqueName: \"kubernetes.io/projected/3fb4dd6b-d6d7-409a-a6a3-a2f11d2a3375-kube-api-access-zs444\") pod \"node-ca-2fr65\" (UID: \"3fb4dd6b-d6d7-409a-a6a3-a2f11d2a3375\") " pod="openshift-image-registry/node-ca-2fr65"
Jul 22 02:37:20.791533 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790506    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7453e58d-d28e-457a-b67e-5231350eb4a0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wksbs\" (UID: \"7453e58d-d28e-457a-b67e-5231350eb4a0\") " pod="openshift-multus/multus-additional-cni-plugins-wksbs"
Jul 22 02:37:20.791533 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790520    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-host\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.791533 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790530    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58f296ac-da6c-473e-8c58-49fa164804f5-original-pull-secret\") pod \"global-pull-secret-syncer-cjz5v\" (UID: \"58f296ac-da6c-473e-8c58-49fa164804f5\") " pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:20.791533 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790604    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-host-var-lib-cni-bin\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.791533 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:20.790628    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:20.791533 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790632    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-run-openvswitch\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.791533 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790642    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/df0a8110-6951-4b69-8a89-41c4cc793ba9-iptables-alerter-script\") pod \"iptables-alerter-t4d8c\" (UID: \"df0a8110-6951-4b69-8a89-41c4cc793ba9\") " pod="openshift-network-operator/iptables-alerter-t4d8c"
Jul 22 02:37:20.791533 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790658    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.791533 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790683    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/43d40c9e-d94f-403e-bf2b-8447aa63c337-registration-dir\") pod \"aws-ebs-csi-driver-node-wfb4j\" (UID: \"43d40c9e-d94f-403e-bf2b-8447aa63c337\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j"
Jul 22 02:37:20.791533 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790714    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-etc-systemd\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.791533 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790710    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7453e58d-d28e-457a-b67e-5231350eb4a0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wksbs\" (UID: \"7453e58d-d28e-457a-b67e-5231350eb4a0\") " pod="openshift-multus/multus-additional-cni-plugins-wksbs"
Jul 22 02:37:20.791533 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:20.790757    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58f296ac-da6c-473e-8c58-49fa164804f5-original-pull-secret podName:58f296ac-da6c-473e-8c58-49fa164804f5 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:21.290722831 +0000 UTC m=+1.999151427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58f296ac-da6c-473e-8c58-49fa164804f5-original-pull-secret") pod "global-pull-secret-syncer-cjz5v" (UID: "58f296ac-da6c-473e-8c58-49fa164804f5") : object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:20.791533 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790770    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-host-var-lib-cni-multus\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.791533 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790811    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e50e649-3f15-4e39-937b-73d8a14fdc1e-cni-binary-copy\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.792412 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790823    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-multus-cni-dir\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.792412 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790853    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/43d40c9e-d94f-403e-bf2b-8447aa63c337-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wfb4j\" (UID: \"43d40c9e-d94f-403e-bf2b-8447aa63c337\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j"
Jul 22 02:37:20.792412 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790872    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-os-release\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.792412 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790898    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-var-lib-kubelet\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.792412 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790898    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e50e649-3f15-4e39-937b-73d8a14fdc1e-multus-daemon-config\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.792412 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790935    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-etc-kubernetes\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.792412 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790968    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/43d40c9e-d94f-403e-bf2b-8447aa63c337-registration-dir\") pod \"aws-ebs-csi-driver-node-wfb4j\" (UID: \"43d40c9e-d94f-403e-bf2b-8447aa63c337\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j"
Jul 22 02:37:20.792412 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790979    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-host-var-lib-cni-bin\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.792412 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790970    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-os-release\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.792412 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.790974    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-etc-kubernetes\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.792412 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791002    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-run-openvswitch\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.792412 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791025    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-run-ovn\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.792412 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791031    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.792412 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791050    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df0a8110-6951-4b69-8a89-41c4cc793ba9-host-slash\") pod \"iptables-alerter-t4d8c\" (UID: \"df0a8110-6951-4b69-8a89-41c4cc793ba9\") " pod="openshift-network-operator/iptables-alerter-t4d8c"
Jul 22 02:37:20.792412 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791074    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-systemd-units\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.792412 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791075    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-etc-systemd\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.792412 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791106    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df0a8110-6951-4b69-8a89-41c4cc793ba9-host-slash\") pod \"iptables-alerter-t4d8c\" (UID: \"df0a8110-6951-4b69-8a89-41c4cc793ba9\") " pod="openshift-network-operator/iptables-alerter-t4d8c"
Jul 22 02:37:20.792412 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791109    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-systemd-units\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.793466 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791130    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-ovnkube-config\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.793466 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791160    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/43d40c9e-d94f-403e-bf2b-8447aa63c337-etc-selinux\") pod \"aws-ebs-csi-driver-node-wfb4j\" (UID: \"43d40c9e-d94f-403e-bf2b-8447aa63c337\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j"
Jul 22 02:37:20.793466 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791188    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-metrics-certs\") pod \"network-metrics-daemon-snc7m\" (UID: \"cf3a32bc-8b07-4a3a-8b34-5ba92a675b90\") " pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:20.793466 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791240    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-etc-modprobe-d\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.793466 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791273    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3fb4dd6b-d6d7-409a-a6a3-a2f11d2a3375-serviceca\") pod \"node-ca-2fr65\" (UID: \"3fb4dd6b-d6d7-409a-a6a3-a2f11d2a3375\") " pod="openshift-image-registry/node-ca-2fr65"
Jul 22 02:37:20.793466 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:20.791282    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:20.793466 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791302    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/43d40c9e-d94f-403e-bf2b-8447aa63c337-etc-selinux\") pod \"aws-ebs-csi-driver-node-wfb4j\" (UID: \"43d40c9e-d94f-403e-bf2b-8447aa63c337\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j"
Jul 22 02:37:20.793466 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791331    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7453e58d-d28e-457a-b67e-5231350eb4a0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wksbs\" (UID: \"7453e58d-d28e-457a-b67e-5231350eb4a0\") " pod="openshift-multus/multus-additional-cni-plugins-wksbs"
Jul 22 02:37:20.793466 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791284    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-etc-sysctl-d\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.793466 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:20.791342    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-metrics-certs podName:cf3a32bc-8b07-4a3a-8b34-5ba92a675b90 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:21.291324632 +0000 UTC m=+1.999753231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-metrics-certs") pod "network-metrics-daemon-snc7m" (UID: "cf3a32bc-8b07-4a3a-8b34-5ba92a675b90") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:20.793466 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791356    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-etc-modprobe-d\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.793466 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791397    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-etc-sysctl-d\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.793466 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791391    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-etc-sysctl-conf\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.793466 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791415    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e50e649-3f15-4e39-937b-73d8a14fdc1e-multus-daemon-config\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.793466 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791438    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/58f296ac-da6c-473e-8c58-49fa164804f5-kubelet-config\") pod \"global-pull-secret-syncer-cjz5v\" (UID: \"58f296ac-da6c-473e-8c58-49fa164804f5\") " pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:20.793466 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791456    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-ovn-node-metrics-cert\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.793466 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791471    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b381967f-eb37-427b-ae7b-e2ef917ee729-etc-tuned\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.794322 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791493    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-system-cni-dir\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.794322 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791491    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/58f296ac-da6c-473e-8c58-49fa164804f5-kubelet-config\") pod \"global-pull-secret-syncer-cjz5v\" (UID: \"58f296ac-da6c-473e-8c58-49fa164804f5\") " pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:20.794322 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791525    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-etc-sysctl-conf\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.794322 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791544    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-system-cni-dir\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.794322 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791558    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-host-run-k8s-cni-cncf-io\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.794322 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791584    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f451c68d-e137-4c8e-854b-441da8def534-hosts-file\") pod \"node-resolver-m59jm\" (UID: \"f451c68d-e137-4c8e-854b-441da8def534\") " pod="openshift-dns/node-resolver-m59jm"
Jul 22 02:37:20.794322 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791591    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-host-run-k8s-cni-cncf-io\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.794322 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791600    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f97aea05-b7fe-4242-b768-6daf68120ccd-konnectivity-ca\") pod \"konnectivity-agent-7mqzz\" (UID: \"f97aea05-b7fe-4242-b768-6daf68120ccd\") " pod="kube-system/konnectivity-agent-7mqzz"
Jul 22 02:37:20.794322 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791619    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f451c68d-e137-4c8e-854b-441da8def534-tmp-dir\") pod \"node-resolver-m59jm\" (UID: \"f451c68d-e137-4c8e-854b-441da8def534\") " pod="openshift-dns/node-resolver-m59jm"
Jul 22 02:37:20.794322 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791640    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3fb4dd6b-d6d7-409a-a6a3-a2f11d2a3375-host\") pod \"node-ca-2fr65\" (UID: \"3fb4dd6b-d6d7-409a-a6a3-a2f11d2a3375\") " pod="openshift-image-registry/node-ca-2fr65"
Jul 22 02:37:20.794322 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791654    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f451c68d-e137-4c8e-854b-441da8def534-hosts-file\") pod \"node-resolver-m59jm\" (UID: \"f451c68d-e137-4c8e-854b-441da8def534\") " pod="openshift-dns/node-resolver-m59jm"
Jul 22 02:37:20.794322 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791664    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-ovnkube-script-lib\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.794322 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791689    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7453e58d-d28e-457a-b67e-5231350eb4a0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wksbs\" (UID: \"7453e58d-d28e-457a-b67e-5231350eb4a0\") " pod="openshift-multus/multus-additional-cni-plugins-wksbs"
Jul 22 02:37:20.794322 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791697    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3fb4dd6b-d6d7-409a-a6a3-a2f11d2a3375-host\") pod \"node-ca-2fr65\" (UID: \"3fb4dd6b-d6d7-409a-a6a3-a2f11d2a3375\") " pod="openshift-image-registry/node-ca-2fr65"
Jul 22 02:37:20.794322 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791716    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-ovnkube-config\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.794322 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791730    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/43d40c9e-d94f-403e-bf2b-8447aa63c337-sys-fs\") pod \"aws-ebs-csi-driver-node-wfb4j\" (UID: \"43d40c9e-d94f-403e-bf2b-8447aa63c337\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j"
Jul 22 02:37:20.794322 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791754    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-lib-modules\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.794322 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791772    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 22 02:37:20.795035 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791796    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/58f296ac-da6c-473e-8c58-49fa164804f5-dbus\") pod \"global-pull-secret-syncer-cjz5v\" (UID: \"58f296ac-da6c-473e-8c58-49fa164804f5\") " pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:20.795035 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791837    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-hostroot\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.795035 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791840    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/43d40c9e-d94f-403e-bf2b-8447aa63c337-sys-fs\") pod \"aws-ebs-csi-driver-node-wfb4j\" (UID: \"43d40c9e-d94f-403e-bf2b-8447aa63c337\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j"
Jul 22 02:37:20.795035 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791873    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-etc-openvswitch\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.795035 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791775    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-run-ovn\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.795035 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791887    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-hostroot\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.795035 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791904    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7453e58d-d28e-457a-b67e-5231350eb4a0-cni-binary-copy\") pod \"multus-additional-cni-plugins-wksbs\" (UID: \"7453e58d-d28e-457a-b67e-5231350eb4a0\") " pod="openshift-multus/multus-additional-cni-plugins-wksbs"
Jul 22 02:37:20.795035 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791929    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-host-var-lib-kubelet\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.795035 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791965    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f451c68d-e137-4c8e-854b-441da8def534-tmp-dir\") pod \"node-resolver-m59jm\" (UID: \"f451c68d-e137-4c8e-854b-441da8def534\") " pod="openshift-dns/node-resolver-m59jm"
Jul 22 02:37:20.795035 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791988    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-lib-modules\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.795035 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791995    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/58f296ac-da6c-473e-8c58-49fa164804f5-dbus\") pod \"global-pull-secret-syncer-cjz5v\" (UID: \"58f296ac-da6c-473e-8c58-49fa164804f5\") " pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:20.795035 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791974    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-host-slash\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.795035 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792005    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-host-slash\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.795035 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.791874    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7453e58d-d28e-457a-b67e-5231350eb4a0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wksbs\" (UID: \"7453e58d-d28e-457a-b67e-5231350eb4a0\") " pod="openshift-multus/multus-additional-cni-plugins-wksbs"
Jul 22 02:37:20.795035 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792030    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-etc-openvswitch\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.795035 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792046    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-host-var-lib-kubelet\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.795035 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792074    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-var-lib-openvswitch\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.795035 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792098    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-host-cni-bin\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.795634 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792122    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6ptj\" (UniqueName: \"kubernetes.io/projected/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-kube-api-access-w6ptj\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.795634 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792130    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-var-lib-openvswitch\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.795634 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792136    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f97aea05-b7fe-4242-b768-6daf68120ccd-konnectivity-ca\") pod \"konnectivity-agent-7mqzz\" (UID: \"f97aea05-b7fe-4242-b768-6daf68120ccd\") " pod="kube-system/konnectivity-agent-7mqzz"
Jul 22 02:37:20.795634 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792152    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7453e58d-d28e-457a-b67e-5231350eb4a0-system-cni-dir\") pod \"multus-additional-cni-plugins-wksbs\" (UID: \"7453e58d-d28e-457a-b67e-5231350eb4a0\") " pod="openshift-multus/multus-additional-cni-plugins-wksbs"
Jul 22 02:37:20.795634 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792157    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-host-cni-bin\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.795634 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792177    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f97aea05-b7fe-4242-b768-6daf68120ccd-agent-certs\") pod \"konnectivity-agent-7mqzz\" (UID: \"f97aea05-b7fe-4242-b768-6daf68120ccd\") " pod="kube-system/konnectivity-agent-7mqzz"
Jul 22 02:37:20.795634 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792201    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-multus-socket-dir-parent\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.795634 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792213    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7453e58d-d28e-457a-b67e-5231350eb4a0-system-cni-dir\") pod \"multus-additional-cni-plugins-wksbs\" (UID: \"7453e58d-d28e-457a-b67e-5231350eb4a0\") " pod="openshift-multus/multus-additional-cni-plugins-wksbs"
Jul 22 02:37:20.795634 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792225    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-host-run-multus-certs\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.795634 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792280    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-ovnkube-script-lib\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.795634 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792291    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-host-run-multus-certs\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.795634 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792369    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-multus-socket-dir-parent\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.795634 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792379    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-run-systemd\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.795634 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792410    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-log-socket\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.795634 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792419    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7453e58d-d28e-457a-b67e-5231350eb4a0-cni-binary-copy\") pod \"multus-additional-cni-plugins-wksbs\" (UID: \"7453e58d-d28e-457a-b67e-5231350eb4a0\") " pod="openshift-multus/multus-additional-cni-plugins-wksbs"
Jul 22 02:37:20.795634 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792410    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-run-systemd\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.795634 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792445    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-log-socket\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.796115 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792467    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-etc-sysconfig\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.796115 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792508    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-multus-conf-dir\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.796115 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792533    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-host-cni-netd\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.796115 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792559    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdcbp\" (UniqueName: \"kubernetes.io/projected/43d40c9e-d94f-403e-bf2b-8447aa63c337-kube-api-access-pdcbp\") pod \"aws-ebs-csi-driver-node-wfb4j\" (UID: \"43d40c9e-d94f-403e-bf2b-8447aa63c337\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j"
Jul 22 02:37:20.796115 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792563    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-etc-sysconfig\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.796115 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792571    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-multus-conf-dir\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.796115 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792588    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-sys\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.796115 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792607    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b381967f-eb37-427b-ae7b-e2ef917ee729-tmp\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.796115 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792624    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-cnibin\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.796115 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792638    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-env-overrides\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.796115 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792653    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7453e58d-d28e-457a-b67e-5231350eb4a0-cnibin\") pod \"multus-additional-cni-plugins-wksbs\" (UID: \"7453e58d-d28e-457a-b67e-5231350eb4a0\") " pod="openshift-multus/multus-additional-cni-plugins-wksbs"
Jul 22 02:37:20.796115 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792706    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e50e649-3f15-4e39-937b-73d8a14fdc1e-cnibin\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.796115 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792747    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xblsn\" (UniqueName: \"kubernetes.io/projected/df0a8110-6951-4b69-8a89-41c4cc793ba9-kube-api-access-xblsn\") pod \"iptables-alerter-t4d8c\" (UID: \"df0a8110-6951-4b69-8a89-41c4cc793ba9\") " pod="openshift-network-operator/iptables-alerter-t4d8c"
Jul 22 02:37:20.796115 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792764    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b381967f-eb37-427b-ae7b-e2ef917ee729-sys\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.796115 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792774    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/43d40c9e-d94f-403e-bf2b-8447aa63c337-device-dir\") pod \"aws-ebs-csi-driver-node-wfb4j\" (UID: \"43d40c9e-d94f-403e-bf2b-8447aa63c337\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j"
Jul 22 02:37:20.796115 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792769    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-host-cni-netd\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.796115 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792808    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7453e58d-d28e-457a-b67e-5231350eb4a0-cnibin\") pod \"multus-additional-cni-plugins-wksbs\" (UID: \"7453e58d-d28e-457a-b67e-5231350eb4a0\") " pod="openshift-multus/multus-additional-cni-plugins-wksbs"
Jul 22 02:37:20.796115 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.792955    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/43d40c9e-d94f-403e-bf2b-8447aa63c337-device-dir\") pod \"aws-ebs-csi-driver-node-wfb4j\" (UID: \"43d40c9e-d94f-403e-bf2b-8447aa63c337\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j"
Jul 22 02:37:20.796657 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.793288    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-env-overrides\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.796657 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.794884    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b381967f-eb37-427b-ae7b-e2ef917ee729-tmp\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.796657 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.794909    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b381967f-eb37-427b-ae7b-e2ef917ee729-etc-tuned\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.796657 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.794933    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-ovn-node-metrics-cert\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.796657 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.795092    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f97aea05-b7fe-4242-b768-6daf68120ccd-agent-certs\") pod \"konnectivity-agent-7mqzz\" (UID: \"f97aea05-b7fe-4242-b768-6daf68120ccd\") " pod="kube-system/konnectivity-agent-7mqzz"
Jul 22 02:37:20.797598 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.797582    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 02:37:20.803856 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:20.803827    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 02:37:20.803856 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:20.803846    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 02:37:20.803856 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:20.803856    2577 projected.go:196] Error preparing data for projected volume kube-api-access-q6cql for pod openshift-network-diagnostics/network-check-target-bdgj4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:20.804024 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:20.803902    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4abb13b-cb47-4cb3-9db4-c9531012e8c2-kube-api-access-q6cql podName:b4abb13b-cb47-4cb3-9db4-c9531012e8c2 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:21.30389031 +0000 UTC m=+2.012318889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q6cql" (UniqueName: "kubernetes.io/projected/b4abb13b-cb47-4cb3-9db4-c9531012e8c2-kube-api-access-q6cql") pod "network-check-target-bdgj4" (UID: "b4abb13b-cb47-4cb3-9db4-c9531012e8c2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:20.806229 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.806200    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xblsn\" (UniqueName: \"kubernetes.io/projected/df0a8110-6951-4b69-8a89-41c4cc793ba9-kube-api-access-xblsn\") pod \"iptables-alerter-t4d8c\" (UID: \"df0a8110-6951-4b69-8a89-41c4cc793ba9\") " pod="openshift-network-operator/iptables-alerter-t4d8c"
Jul 22 02:37:20.806409 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.806390    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs444\" (UniqueName: \"kubernetes.io/projected/3fb4dd6b-d6d7-409a-a6a3-a2f11d2a3375-kube-api-access-zs444\") pod \"node-ca-2fr65\" (UID: \"3fb4dd6b-d6d7-409a-a6a3-a2f11d2a3375\") " pod="openshift-image-registry/node-ca-2fr65"
Jul 22 02:37:20.806567 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.806548    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgmcm\" (UniqueName: \"kubernetes.io/projected/7453e58d-d28e-457a-b67e-5231350eb4a0-kube-api-access-tgmcm\") pod \"multus-additional-cni-plugins-wksbs\" (UID: \"7453e58d-d28e-457a-b67e-5231350eb4a0\") " pod="openshift-multus/multus-additional-cni-plugins-wksbs"
Jul 22 02:37:20.807291 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.807240    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv5sw\" (UniqueName: \"kubernetes.io/projected/f451c68d-e137-4c8e-854b-441da8def534-kube-api-access-kv5sw\") pod \"node-resolver-m59jm\" (UID: \"f451c68d-e137-4c8e-854b-441da8def534\") " pod="openshift-dns/node-resolver-m59jm"
Jul 22 02:37:20.808133 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.808110    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6kqc\" (UniqueName: \"kubernetes.io/projected/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-kube-api-access-k6kqc\") pod \"network-metrics-daemon-snc7m\" (UID: \"cf3a32bc-8b07-4a3a-8b34-5ba92a675b90\") " pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:20.808634 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.808613    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx4wh\" (UniqueName: \"kubernetes.io/projected/2e50e649-3f15-4e39-937b-73d8a14fdc1e-kube-api-access-zx4wh\") pod \"multus-p7bn5\" (UID: \"2e50e649-3f15-4e39-937b-73d8a14fdc1e\") " pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.809234 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.809213    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k245p\" (UniqueName: \"kubernetes.io/projected/b381967f-eb37-427b-ae7b-e2ef917ee729-kube-api-access-k245p\") pod \"tuned-v4g5p\" (UID: \"b381967f-eb37-427b-ae7b-e2ef917ee729\") " pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:20.810148 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.810129    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdcbp\" (UniqueName: \"kubernetes.io/projected/43d40c9e-d94f-403e-bf2b-8447aa63c337-kube-api-access-pdcbp\") pod \"aws-ebs-csi-driver-node-wfb4j\" (UID: \"43d40c9e-d94f-403e-bf2b-8447aa63c337\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j"
Jul 22 02:37:20.810435 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.810418    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6ptj\" (UniqueName: \"kubernetes.io/projected/6461ea33-ff4c-48c5-8c29-b4026c2f67b0-kube-api-access-w6ptj\") pod \"ovnkube-node-mqngf\" (UID: \"6461ea33-ff4c-48c5-8c29-b4026c2f67b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.918537 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.918442    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p7bn5"
Jul 22 02:37:20.923059 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.922725    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m59jm"
Jul 22 02:37:20.931602 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:20.931572    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e50e649_3f15_4e39_937b_73d8a14fdc1e.slice/crio-0b090a0611dceb16f185f540578e8aaa36d4fa1d6c90b13b4a85f75f791d3ab0 WatchSource:0}: Error finding container 0b090a0611dceb16f185f540578e8aaa36d4fa1d6c90b13b4a85f75f791d3ab0: Status 404 returned error can't find the container with id 0b090a0611dceb16f185f540578e8aaa36d4fa1d6c90b13b4a85f75f791d3ab0
Jul 22 02:37:20.933499 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:20.933474    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf451c68d_e137_4c8e_854b_441da8def534.slice/crio-f807a8c08932bad86f69dc68ca7806eeadf3c9b0616d31fe0a8c87793faa906f WatchSource:0}: Error finding container f807a8c08932bad86f69dc68ca7806eeadf3c9b0616d31fe0a8c87793faa906f: Status 404 returned error can't find the container with id f807a8c08932bad86f69dc68ca7806eeadf3c9b0616d31fe0a8c87793faa906f
Jul 22 02:37:20.944951 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.944927    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j"
Jul 22 02:37:20.955094 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:20.955064    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43d40c9e_d94f_403e_bf2b_8447aa63c337.slice/crio-573725e2b715acc3c8dde0675ced84fd9ae4491d795ae9a65ed192f893e0388a WatchSource:0}: Error finding container 573725e2b715acc3c8dde0675ced84fd9ae4491d795ae9a65ed192f893e0388a: Status 404 returned error can't find the container with id 573725e2b715acc3c8dde0675ced84fd9ae4491d795ae9a65ed192f893e0388a
Jul 22 02:37:20.960830 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.960810    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2fr65"
Jul 22 02:37:20.969306 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:20.969279    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fb4dd6b_d6d7_409a_a6a3_a2f11d2a3375.slice/crio-f0704e3a9ac21aeb9125d6d466afd6f569b8c77e0bcced3987ed92299b997753 WatchSource:0}: Error finding container f0704e3a9ac21aeb9125d6d466afd6f569b8c77e0bcced3987ed92299b997753: Status 404 returned error can't find the container with id f0704e3a9ac21aeb9125d6d466afd6f569b8c77e0bcced3987ed92299b997753
Jul 22 02:37:20.975413 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.975394    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:20.983919 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:20.983897    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6461ea33_ff4c_48c5_8c29_b4026c2f67b0.slice/crio-8225b303c41c05ca24060e35a86a92932825b2ca91fe62965dd3b03e377edc82 WatchSource:0}: Error finding container 8225b303c41c05ca24060e35a86a92932825b2ca91fe62965dd3b03e377edc82: Status 404 returned error can't find the container with id 8225b303c41c05ca24060e35a86a92932825b2ca91fe62965dd3b03e377edc82
Jul 22 02:37:20.993109 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:20.993079    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wksbs"
Jul 22 02:37:21.001053 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:21.001030    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7453e58d_d28e_457a_b67e_5231350eb4a0.slice/crio-04d1c4db06680a3bd0173366f2b70ff99c0f9f3721649b60b3c2427959e179ee WatchSource:0}: Error finding container 04d1c4db06680a3bd0173366f2b70ff99c0f9f3721649b60b3c2427959e179ee: Status 404 returned error can't find the container with id 04d1c4db06680a3bd0173366f2b70ff99c0f9f3721649b60b3c2427959e179ee
Jul 22 02:37:21.007346 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:21.007329    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7mqzz"
Jul 22 02:37:21.015714 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:21.015691    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf97aea05_b7fe_4242_b768_6daf68120ccd.slice/crio-676c7f8a7faae77226697ba56d0805a56debbfdb37cfac80fa2c67135e06ca55 WatchSource:0}: Error finding container 676c7f8a7faae77226697ba56d0805a56debbfdb37cfac80fa2c67135e06ca55: Status 404 returned error can't find the container with id 676c7f8a7faae77226697ba56d0805a56debbfdb37cfac80fa2c67135e06ca55
Jul 22 02:37:21.025054 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:21.025030    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t4d8c"
Jul 22 02:37:21.029890 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:21.029871    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v4g5p"
Jul 22 02:37:21.033341 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:21.033318    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf0a8110_6951_4b69_8a89_41c4cc793ba9.slice/crio-515982110c65a9e5b6cb11b351cad22047d89c3a96b8391557ef9336f3be1d24 WatchSource:0}: Error finding container 515982110c65a9e5b6cb11b351cad22047d89c3a96b8391557ef9336f3be1d24: Status 404 returned error can't find the container with id 515982110c65a9e5b6cb11b351cad22047d89c3a96b8391557ef9336f3be1d24
Jul 22 02:37:21.038734 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:21.038708    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb381967f_eb37_427b_ae7b_e2ef917ee729.slice/crio-1e3b466f008fc1b3e5da1b18e56757679258ec035d763d8181735a34c5a8cad3 WatchSource:0}: Error finding container 1e3b466f008fc1b3e5da1b18e56757679258ec035d763d8181735a34c5a8cad3: Status 404 returned error can't find the container with id 1e3b466f008fc1b3e5da1b18e56757679258ec035d763d8181735a34c5a8cad3
Jul 22 02:37:21.103180 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:21.103147    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 02:37:21.296181 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:21.296139    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58f296ac-da6c-473e-8c58-49fa164804f5-original-pull-secret\") pod \"global-pull-secret-syncer-cjz5v\" (UID: \"58f296ac-da6c-473e-8c58-49fa164804f5\") " pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:21.296377 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:21.296196    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-metrics-certs\") pod \"network-metrics-daemon-snc7m\" (UID: \"cf3a32bc-8b07-4a3a-8b34-5ba92a675b90\") " pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:21.296469 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:21.296440    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:21.296523 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:21.296507    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58f296ac-da6c-473e-8c58-49fa164804f5-original-pull-secret podName:58f296ac-da6c-473e-8c58-49fa164804f5 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:22.296491582 +0000 UTC m=+3.004920165 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58f296ac-da6c-473e-8c58-49fa164804f5-original-pull-secret") pod "global-pull-secret-syncer-cjz5v" (UID: "58f296ac-da6c-473e-8c58-49fa164804f5") : object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:21.296876 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:21.296856    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:21.296959 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:21.296909    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-metrics-certs podName:cf3a32bc-8b07-4a3a-8b34-5ba92a675b90 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:22.296896033 +0000 UTC m=+3.005324610 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-metrics-certs") pod "network-metrics-daemon-snc7m" (UID: "cf3a32bc-8b07-4a3a-8b34-5ba92a675b90") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:21.378363 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:21.378331    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 02:37:21.396673 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:21.396613    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6cql\" (UniqueName: \"kubernetes.io/projected/b4abb13b-cb47-4cb3-9db4-c9531012e8c2-kube-api-access-q6cql\") pod \"network-check-target-bdgj4\" (UID: \"b4abb13b-cb47-4cb3-9db4-c9531012e8c2\") " pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:21.396932 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:21.396911    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 02:37:21.397013 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:21.396939    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 02:37:21.397013 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:21.396952    2577 projected.go:196] Error preparing data for projected volume kube-api-access-q6cql for pod openshift-network-diagnostics/network-check-target-bdgj4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:21.397124 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:21.397013    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4abb13b-cb47-4cb3-9db4-c9531012e8c2-kube-api-access-q6cql podName:b4abb13b-cb47-4cb3-9db4-c9531012e8c2 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:22.396993915 +0000 UTC m=+3.105422494 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-q6cql" (UniqueName: "kubernetes.io/projected/b4abb13b-cb47-4cb3-9db4-c9531012e8c2-kube-api-access-q6cql") pod "network-check-target-bdgj4" (UID: "b4abb13b-cb47-4cb3-9db4-c9531012e8c2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:21.637947 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:21.637823    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 02:32:20 +0000 UTC" deadline="2028-02-27 21:54:20.278967758 +0000 UTC"
Jul 22 02:37:21.637947 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:21.637888    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14059h16m58.641083726s"
Jul 22 02:37:21.782430 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:21.782366    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j" event={"ID":"43d40c9e-d94f-403e-bf2b-8447aa63c337","Type":"ContainerStarted","Data":"573725e2b715acc3c8dde0675ced84fd9ae4491d795ae9a65ed192f893e0388a"}
Jul 22 02:37:21.791933 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:21.791887    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m59jm" event={"ID":"f451c68d-e137-4c8e-854b-441da8def534","Type":"ContainerStarted","Data":"f807a8c08932bad86f69dc68ca7806eeadf3c9b0616d31fe0a8c87793faa906f"}
Jul 22 02:37:21.796963 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:21.796922    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p7bn5" event={"ID":"2e50e649-3f15-4e39-937b-73d8a14fdc1e","Type":"ContainerStarted","Data":"0b090a0611dceb16f185f540578e8aaa36d4fa1d6c90b13b4a85f75f791d3ab0"}
Jul 22 02:37:21.811520 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:21.811478    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v4g5p" event={"ID":"b381967f-eb37-427b-ae7b-e2ef917ee729","Type":"ContainerStarted","Data":"1e3b466f008fc1b3e5da1b18e56757679258ec035d763d8181735a34c5a8cad3"}
Jul 22 02:37:21.821653 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:21.821611    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal" event={"ID":"8c78f4b8e0da2d921ed52b00b7f21485","Type":"ContainerStarted","Data":"1c6e5a6dc0f0996fcf268e752b163da4ce0d65e4e01ca9f6d9496f0dfd622bfc"}
Jul 22 02:37:21.842233 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:21.841946    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-160.ec2.internal" event={"ID":"760279d9ea477286e4f5ad9a50c57ba5","Type":"ContainerStarted","Data":"4bed1a96c71071c95e0db2775cd9db231b690a10d7845f5297b1713f82bfeb18"}
Jul 22 02:37:21.845778 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:21.845746    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t4d8c" event={"ID":"df0a8110-6951-4b69-8a89-41c4cc793ba9","Type":"ContainerStarted","Data":"515982110c65a9e5b6cb11b351cad22047d89c3a96b8391557ef9336f3be1d24"}
Jul 22 02:37:21.861618 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:21.861569    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7mqzz" event={"ID":"f97aea05-b7fe-4242-b768-6daf68120ccd","Type":"ContainerStarted","Data":"676c7f8a7faae77226697ba56d0805a56debbfdb37cfac80fa2c67135e06ca55"}
Jul 22 02:37:21.873816 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:21.873777    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wksbs" event={"ID":"7453e58d-d28e-457a-b67e-5231350eb4a0","Type":"ContainerStarted","Data":"04d1c4db06680a3bd0173366f2b70ff99c0f9f3721649b60b3c2427959e179ee"}
Jul 22 02:37:21.881078 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:21.881037    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqngf" event={"ID":"6461ea33-ff4c-48c5-8c29-b4026c2f67b0","Type":"ContainerStarted","Data":"8225b303c41c05ca24060e35a86a92932825b2ca91fe62965dd3b03e377edc82"}
Jul 22 02:37:21.892722 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:21.892630    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2fr65" event={"ID":"3fb4dd6b-d6d7-409a-a6a3-a2f11d2a3375","Type":"ContainerStarted","Data":"f0704e3a9ac21aeb9125d6d466afd6f569b8c77e0bcced3987ed92299b997753"}
Jul 22 02:37:22.304474 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:22.304432    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-metrics-certs\") pod \"network-metrics-daemon-snc7m\" (UID: \"cf3a32bc-8b07-4a3a-8b34-5ba92a675b90\") " pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:22.304670 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:22.304545    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58f296ac-da6c-473e-8c58-49fa164804f5-original-pull-secret\") pod \"global-pull-secret-syncer-cjz5v\" (UID: \"58f296ac-da6c-473e-8c58-49fa164804f5\") " pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:22.304670 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:22.304626    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:22.304670 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:22.304655    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:22.304835 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:22.304705    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-metrics-certs podName:cf3a32bc-8b07-4a3a-8b34-5ba92a675b90 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:24.304684884 +0000 UTC m=+5.013113467 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-metrics-certs") pod "network-metrics-daemon-snc7m" (UID: "cf3a32bc-8b07-4a3a-8b34-5ba92a675b90") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:22.304835 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:22.304726    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58f296ac-da6c-473e-8c58-49fa164804f5-original-pull-secret podName:58f296ac-da6c-473e-8c58-49fa164804f5 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:24.304716696 +0000 UTC m=+5.013145279 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58f296ac-da6c-473e-8c58-49fa164804f5-original-pull-secret") pod "global-pull-secret-syncer-cjz5v" (UID: "58f296ac-da6c-473e-8c58-49fa164804f5") : object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:22.405592 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:22.405546    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6cql\" (UniqueName: \"kubernetes.io/projected/b4abb13b-cb47-4cb3-9db4-c9531012e8c2-kube-api-access-q6cql\") pod \"network-check-target-bdgj4\" (UID: \"b4abb13b-cb47-4cb3-9db4-c9531012e8c2\") " pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:22.405781 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:22.405752    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 02:37:22.405781 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:22.405774    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 02:37:22.405917 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:22.405787    2577 projected.go:196] Error preparing data for projected volume kube-api-access-q6cql for pod openshift-network-diagnostics/network-check-target-bdgj4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:22.405917 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:22.405847    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4abb13b-cb47-4cb3-9db4-c9531012e8c2-kube-api-access-q6cql podName:b4abb13b-cb47-4cb3-9db4-c9531012e8c2 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:24.405828789 +0000 UTC m=+5.114257380 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-q6cql" (UniqueName: "kubernetes.io/projected/b4abb13b-cb47-4cb3-9db4-c9531012e8c2-kube-api-access-q6cql") pod "network-check-target-bdgj4" (UID: "b4abb13b-cb47-4cb3-9db4-c9531012e8c2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:22.638812 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:22.638752    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 02:32:20 +0000 UTC" deadline="2028-01-14 09:50:22.990367724 +0000 UTC"
Jul 22 02:37:22.638812 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:22.638800    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12991h13m0.351572983s"
Jul 22 02:37:22.751838 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:22.751782    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:22.752034 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:22.751923    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgj4" podUID="b4abb13b-cb47-4cb3-9db4-c9531012e8c2"
Jul 22 02:37:22.752425 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:22.752395    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:22.752543 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:22.752514    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snc7m" podUID="cf3a32bc-8b07-4a3a-8b34-5ba92a675b90"
Jul 22 02:37:22.752637 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:22.752584    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:22.752693 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:22.752658    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz5v" podUID="58f296ac-da6c-473e-8c58-49fa164804f5"
Jul 22 02:37:22.987623 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:22.987534    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 02:37:24.327152 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:24.322021    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-metrics-certs\") pod \"network-metrics-daemon-snc7m\" (UID: \"cf3a32bc-8b07-4a3a-8b34-5ba92a675b90\") " pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:24.327152 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:24.322174    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58f296ac-da6c-473e-8c58-49fa164804f5-original-pull-secret\") pod \"global-pull-secret-syncer-cjz5v\" (UID: \"58f296ac-da6c-473e-8c58-49fa164804f5\") " pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:24.327152 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:24.323430    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:24.327152 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:24.323515    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-metrics-certs podName:cf3a32bc-8b07-4a3a-8b34-5ba92a675b90 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:28.323494764 +0000 UTC m=+9.031923361 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-metrics-certs") pod "network-metrics-daemon-snc7m" (UID: "cf3a32bc-8b07-4a3a-8b34-5ba92a675b90") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:24.327152 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:24.324166    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:24.327152 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:24.324234    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58f296ac-da6c-473e-8c58-49fa164804f5-original-pull-secret podName:58f296ac-da6c-473e-8c58-49fa164804f5 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:28.324216013 +0000 UTC m=+9.032644596 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58f296ac-da6c-473e-8c58-49fa164804f5-original-pull-secret") pod "global-pull-secret-syncer-cjz5v" (UID: "58f296ac-da6c-473e-8c58-49fa164804f5") : object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:24.423270 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:24.423226    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6cql\" (UniqueName: \"kubernetes.io/projected/b4abb13b-cb47-4cb3-9db4-c9531012e8c2-kube-api-access-q6cql\") pod \"network-check-target-bdgj4\" (UID: \"b4abb13b-cb47-4cb3-9db4-c9531012e8c2\") " pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:24.423491 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:24.423408    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 02:37:24.423491 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:24.423432    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 02:37:24.423491 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:24.423445    2577 projected.go:196] Error preparing data for projected volume kube-api-access-q6cql for pod openshift-network-diagnostics/network-check-target-bdgj4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:24.423674 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:24.423503    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4abb13b-cb47-4cb3-9db4-c9531012e8c2-kube-api-access-q6cql podName:b4abb13b-cb47-4cb3-9db4-c9531012e8c2 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:28.423484755 +0000 UTC m=+9.131913349 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-q6cql" (UniqueName: "kubernetes.io/projected/b4abb13b-cb47-4cb3-9db4-c9531012e8c2-kube-api-access-q6cql") pod "network-check-target-bdgj4" (UID: "b4abb13b-cb47-4cb3-9db4-c9531012e8c2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:24.752480 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:24.751528    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:24.752480 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:24.751713    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgj4" podUID="b4abb13b-cb47-4cb3-9db4-c9531012e8c2"
Jul 22 02:37:24.752480 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:24.752207    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:24.752480 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:24.752314    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snc7m" podUID="cf3a32bc-8b07-4a3a-8b34-5ba92a675b90"
Jul 22 02:37:24.752480 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:24.752375    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:24.752480 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:24.752444    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz5v" podUID="58f296ac-da6c-473e-8c58-49fa164804f5"
Jul 22 02:37:26.752169 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:26.751726    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:26.752169 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:26.751760    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:26.752169 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:26.751726    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:26.752169 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:26.751860    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgj4" podUID="b4abb13b-cb47-4cb3-9db4-c9531012e8c2"
Jul 22 02:37:26.752169 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:26.751981    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snc7m" podUID="cf3a32bc-8b07-4a3a-8b34-5ba92a675b90"
Jul 22 02:37:26.752169 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:26.752071    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz5v" podUID="58f296ac-da6c-473e-8c58-49fa164804f5"
Jul 22 02:37:28.361057 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:28.360792    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58f296ac-da6c-473e-8c58-49fa164804f5-original-pull-secret\") pod \"global-pull-secret-syncer-cjz5v\" (UID: \"58f296ac-da6c-473e-8c58-49fa164804f5\") " pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:28.361627 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:28.361082    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-metrics-certs\") pod \"network-metrics-daemon-snc7m\" (UID: \"cf3a32bc-8b07-4a3a-8b34-5ba92a675b90\") " pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:28.361627 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:28.361099    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:28.361627 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:28.361176    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58f296ac-da6c-473e-8c58-49fa164804f5-original-pull-secret podName:58f296ac-da6c-473e-8c58-49fa164804f5 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:36.361154457 +0000 UTC m=+17.069583034 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58f296ac-da6c-473e-8c58-49fa164804f5-original-pull-secret") pod "global-pull-secret-syncer-cjz5v" (UID: "58f296ac-da6c-473e-8c58-49fa164804f5") : object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:28.361627 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:28.361189    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:28.361627 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:28.361239    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-metrics-certs podName:cf3a32bc-8b07-4a3a-8b34-5ba92a675b90 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:36.361226225 +0000 UTC m=+17.069654803 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-metrics-certs") pod "network-metrics-daemon-snc7m" (UID: "cf3a32bc-8b07-4a3a-8b34-5ba92a675b90") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:28.462303 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:28.462262    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6cql\" (UniqueName: \"kubernetes.io/projected/b4abb13b-cb47-4cb3-9db4-c9531012e8c2-kube-api-access-q6cql\") pod \"network-check-target-bdgj4\" (UID: \"b4abb13b-cb47-4cb3-9db4-c9531012e8c2\") " pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:28.462502 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:28.462438    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 02:37:28.462502 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:28.462458    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 02:37:28.462502 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:28.462469    2577 projected.go:196] Error preparing data for projected volume kube-api-access-q6cql for pod openshift-network-diagnostics/network-check-target-bdgj4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:28.462660 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:28.462527    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4abb13b-cb47-4cb3-9db4-c9531012e8c2-kube-api-access-q6cql podName:b4abb13b-cb47-4cb3-9db4-c9531012e8c2 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:36.462508435 +0000 UTC m=+17.170937013 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-q6cql" (UniqueName: "kubernetes.io/projected/b4abb13b-cb47-4cb3-9db4-c9531012e8c2-kube-api-access-q6cql") pod "network-check-target-bdgj4" (UID: "b4abb13b-cb47-4cb3-9db4-c9531012e8c2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:28.751998 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:28.751961    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:28.752192 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:28.751962    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:28.752192 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:28.752090    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz5v" podUID="58f296ac-da6c-473e-8c58-49fa164804f5"
Jul 22 02:37:28.752192 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:28.751981    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:28.752192 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:28.752177    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snc7m" podUID="cf3a32bc-8b07-4a3a-8b34-5ba92a675b90"
Jul 22 02:37:28.752490 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:28.752230    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgj4" podUID="b4abb13b-cb47-4cb3-9db4-c9531012e8c2"
Jul 22 02:37:30.751693 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:30.751658    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:30.752155 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:30.751785    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgj4" podUID="b4abb13b-cb47-4cb3-9db4-c9531012e8c2"
Jul 22 02:37:30.752155 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:30.751908    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:30.752155 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:30.751919    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:30.752155 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:30.752028    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz5v" podUID="58f296ac-da6c-473e-8c58-49fa164804f5"
Jul 22 02:37:30.752155 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:30.752128    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snc7m" podUID="cf3a32bc-8b07-4a3a-8b34-5ba92a675b90"
Jul 22 02:37:32.751347 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:32.751304    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:32.751697 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:32.751318    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:32.751697 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:32.751425    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgj4" podUID="b4abb13b-cb47-4cb3-9db4-c9531012e8c2"
Jul 22 02:37:32.751697 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:32.751326    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:32.751697 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:32.751491    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz5v" podUID="58f296ac-da6c-473e-8c58-49fa164804f5"
Jul 22 02:37:32.751697 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:32.751584    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snc7m" podUID="cf3a32bc-8b07-4a3a-8b34-5ba92a675b90"
Jul 22 02:37:34.751506 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:34.751465    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:34.751506 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:34.751498    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:34.752009 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:34.751473    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:34.752009 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:34.751606    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz5v" podUID="58f296ac-da6c-473e-8c58-49fa164804f5"
Jul 22 02:37:34.752009 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:34.751685    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snc7m" podUID="cf3a32bc-8b07-4a3a-8b34-5ba92a675b90"
Jul 22 02:37:34.752009 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:34.751763    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgj4" podUID="b4abb13b-cb47-4cb3-9db4-c9531012e8c2"
Jul 22 02:37:36.426009 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:36.425971    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58f296ac-da6c-473e-8c58-49fa164804f5-original-pull-secret\") pod \"global-pull-secret-syncer-cjz5v\" (UID: \"58f296ac-da6c-473e-8c58-49fa164804f5\") " pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:36.426009 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:36.426012    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-metrics-certs\") pod \"network-metrics-daemon-snc7m\" (UID: \"cf3a32bc-8b07-4a3a-8b34-5ba92a675b90\") " pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:36.426553 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:36.426116    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:36.426553 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:36.426117    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:36.426553 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:36.426184    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-metrics-certs podName:cf3a32bc-8b07-4a3a-8b34-5ba92a675b90 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:52.426165331 +0000 UTC m=+33.134593912 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-metrics-certs") pod "network-metrics-daemon-snc7m" (UID: "cf3a32bc-8b07-4a3a-8b34-5ba92a675b90") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:36.426553 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:36.426198    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58f296ac-da6c-473e-8c58-49fa164804f5-original-pull-secret podName:58f296ac-da6c-473e-8c58-49fa164804f5 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:52.426191873 +0000 UTC m=+33.134620452 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58f296ac-da6c-473e-8c58-49fa164804f5-original-pull-secret") pod "global-pull-secret-syncer-cjz5v" (UID: "58f296ac-da6c-473e-8c58-49fa164804f5") : object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:36.527381 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:36.527335    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6cql\" (UniqueName: \"kubernetes.io/projected/b4abb13b-cb47-4cb3-9db4-c9531012e8c2-kube-api-access-q6cql\") pod \"network-check-target-bdgj4\" (UID: \"b4abb13b-cb47-4cb3-9db4-c9531012e8c2\") " pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:36.527555 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:36.527483    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 02:37:36.527555 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:36.527502    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 02:37:36.527555 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:36.527521    2577 projected.go:196] Error preparing data for projected volume kube-api-access-q6cql for pod openshift-network-diagnostics/network-check-target-bdgj4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:36.527679 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:36.527586    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4abb13b-cb47-4cb3-9db4-c9531012e8c2-kube-api-access-q6cql podName:b4abb13b-cb47-4cb3-9db4-c9531012e8c2 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:52.52756949 +0000 UTC m=+33.235998087 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-q6cql" (UniqueName: "kubernetes.io/projected/b4abb13b-cb47-4cb3-9db4-c9531012e8c2-kube-api-access-q6cql") pod "network-check-target-bdgj4" (UID: "b4abb13b-cb47-4cb3-9db4-c9531012e8c2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:36.751790 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:36.751745    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:36.751790 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:36.751785    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:36.752041 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:36.751755    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:36.752041 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:36.751865    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snc7m" podUID="cf3a32bc-8b07-4a3a-8b34-5ba92a675b90"
Jul 22 02:37:36.752041 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:36.751917    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgj4" podUID="b4abb13b-cb47-4cb3-9db4-c9531012e8c2"
Jul 22 02:37:36.752041 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:36.751976    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz5v" podUID="58f296ac-da6c-473e-8c58-49fa164804f5"
Jul 22 02:37:38.751387 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:38.751350    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:38.751387 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:38.751381    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:38.751891 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:38.751382    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:38.751891 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:38.751452    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgj4" podUID="b4abb13b-cb47-4cb3-9db4-c9531012e8c2"
Jul 22 02:37:38.751891 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:38.751586    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snc7m" podUID="cf3a32bc-8b07-4a3a-8b34-5ba92a675b90"
Jul 22 02:37:38.751891 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:38.751677    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz5v" podUID="58f296ac-da6c-473e-8c58-49fa164804f5"
Jul 22 02:37:40.752079 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:40.752038    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:40.752079 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:40.752067    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:40.752593 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:40.752082    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:40.752593 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:40.752175    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snc7m" podUID="cf3a32bc-8b07-4a3a-8b34-5ba92a675b90"
Jul 22 02:37:40.752593 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:40.752301    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgj4" podUID="b4abb13b-cb47-4cb3-9db4-c9531012e8c2"
Jul 22 02:37:40.752593 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:40.752384    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz5v" podUID="58f296ac-da6c-473e-8c58-49fa164804f5"
Jul 22 02:37:41.948770 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:41.948537    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p7bn5" event={"ID":"2e50e649-3f15-4e39-937b-73d8a14fdc1e","Type":"ContainerStarted","Data":"7e09c831e688baa096fdbab3f5811baf7726d45cc376467b4638d41263d3cb1a"}
Jul 22 02:37:41.951990 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:41.951054    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v4g5p" event={"ID":"b381967f-eb37-427b-ae7b-e2ef917ee729","Type":"ContainerStarted","Data":"0513abe32db36d23e922f90cf36ae311dd9641f661587f90157ce4fd9c5c4a4c"}
Jul 22 02:37:41.953827 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:41.953162    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-160.ec2.internal" event={"ID":"760279d9ea477286e4f5ad9a50c57ba5","Type":"ContainerStarted","Data":"90cbc0ab46da2e11b355db1eedf58a1077583a84cdce2d4ac3e9d2edee06db97"}
Jul 22 02:37:41.956726 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:41.956683    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqngf_6461ea33-ff4c-48c5-8c29-b4026c2f67b0/ovn-acl-logging/0.log"
Jul 22 02:37:41.957155 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:41.957138    2577 generic.go:356] "Generic (PLEG): container finished" podID="6461ea33-ff4c-48c5-8c29-b4026c2f67b0" containerID="c0759577d50600eb1219735225b6571bfe14777a65bf4e45673f5830a56f1f8c" exitCode=1
Jul 22 02:37:41.957300 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:41.957286    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqngf" event={"ID":"6461ea33-ff4c-48c5-8c29-b4026c2f67b0","Type":"ContainerStarted","Data":"aa21fc9a49ba5e4d36d33c3fc054bd9e5985ca60cc087ae91c06cc1a96332ec0"}
Jul 22 02:37:41.957486 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:41.957394    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqngf" event={"ID":"6461ea33-ff4c-48c5-8c29-b4026c2f67b0","Type":"ContainerDied","Data":"c0759577d50600eb1219735225b6571bfe14777a65bf4e45673f5830a56f1f8c"}
Jul 22 02:37:41.957631 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:41.957617    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqngf" event={"ID":"6461ea33-ff4c-48c5-8c29-b4026c2f67b0","Type":"ContainerStarted","Data":"76eb6a5c71796154ff51b2f23f906288f87d04f07ad19c6aa706db6ea32c1ba1"}
Jul 22 02:37:41.971688 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:41.971641    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-p7bn5" podStartSLOduration=2.223261324 podStartE2EDuration="22.971624034s" totalImagesPullingTime="20.74836271s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:41.970883073 +0000 UTC m=+22.679311674" watchObservedRunningTime="2026-07-22 02:37:41.971624034 +0000 UTC m=+22.680052635"
Jul 22 02:37:41.990195 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:41.990140    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-160.ec2.internal" podStartSLOduration=21.990119354 podStartE2EDuration="21.990119354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:37:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:41.989373178 +0000 UTC m=+22.697801781" watchObservedRunningTime="2026-07-22 02:37:41.990119354 +0000 UTC m=+22.698547955"
Jul 22 02:37:42.007316 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:42.007265    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-v4g5p" podStartSLOduration=2.63948216 podStartE2EDuration="23.007235376s" totalImagesPullingTime="20.367753216s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:42.007221591 +0000 UTC m=+22.715650182" watchObservedRunningTime="2026-07-22 02:37:42.007235376 +0000 UTC m=+22.715663975"
Jul 22 02:37:42.751636 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:42.751421    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:42.751824 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:42.751451    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:42.751824 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:42.751718    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgj4" podUID="b4abb13b-cb47-4cb3-9db4-c9531012e8c2"
Jul 22 02:37:42.751824 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:42.751451    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:42.751824 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:42.751782    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz5v" podUID="58f296ac-da6c-473e-8c58-49fa164804f5"
Jul 22 02:37:42.751977 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:42.751858    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snc7m" podUID="cf3a32bc-8b07-4a3a-8b34-5ba92a675b90"
Jul 22 02:37:42.961819 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:42.961778    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t4d8c" event={"ID":"df0a8110-6951-4b69-8a89-41c4cc793ba9","Type":"ContainerStarted","Data":"8c7e15210841ac425fb780d245c8f07912209c279142392c47b138730a2261f2"}
Jul 22 02:37:42.963553 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:42.963519    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7mqzz" event={"ID":"f97aea05-b7fe-4242-b768-6daf68120ccd","Type":"ContainerStarted","Data":"f28b9dd208f504f1e5b6374a198e0689752ab88de6742b42fa72a64ded5e1d4f"}
Jul 22 02:37:42.965374 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:42.965340    2577 generic.go:356] "Generic (PLEG): container finished" podID="7453e58d-d28e-457a-b67e-5231350eb4a0" containerID="d64a206c751bbf7ed7b6099a8ef5c2f96621e9226266f25d36d00d1466f485e1" exitCode=0
Jul 22 02:37:42.965494 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:42.965419    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wksbs" event={"ID":"7453e58d-d28e-457a-b67e-5231350eb4a0","Type":"ContainerDied","Data":"d64a206c751bbf7ed7b6099a8ef5c2f96621e9226266f25d36d00d1466f485e1"}
Jul 22 02:37:42.968838 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:42.968783    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqngf_6461ea33-ff4c-48c5-8c29-b4026c2f67b0/ovn-acl-logging/0.log"
Jul 22 02:37:42.969284 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:42.969238    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqngf" event={"ID":"6461ea33-ff4c-48c5-8c29-b4026c2f67b0","Type":"ContainerStarted","Data":"093bfda88b30243e725fb9bbbef05028c5e46e306d440015d8e861c95c594ae2"}
Jul 22 02:37:42.969396 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:42.969340    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqngf" event={"ID":"6461ea33-ff4c-48c5-8c29-b4026c2f67b0","Type":"ContainerStarted","Data":"9bc4fbd1dfcc2c70e33aad9a1eaf1a5a4e32ed19790fe067c43d8256d6d81229"}
Jul 22 02:37:42.969459 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:42.969396    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqngf" event={"ID":"6461ea33-ff4c-48c5-8c29-b4026c2f67b0","Type":"ContainerStarted","Data":"7a60ec8f5f2a041853f75d7f37fb9b0b73ebdacbdd50a152a06bb3c98702f6d7"}
Jul 22 02:37:42.970960 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:42.970908    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2fr65" event={"ID":"3fb4dd6b-d6d7-409a-a6a3-a2f11d2a3375","Type":"ContainerStarted","Data":"8672f277983f9b626b32291ac87350cb66ec8747e848bf6287a7a5bac147afcf"}
Jul 22 02:37:42.972562 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:42.972535    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j" event={"ID":"43d40c9e-d94f-403e-bf2b-8447aa63c337","Type":"ContainerStarted","Data":"07eb153db9e1207df75916b9b0e095e31af0749c50795dffe3ec9b437b5ef630"}
Jul 22 02:37:42.974164 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:42.974143    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m59jm" event={"ID":"f451c68d-e137-4c8e-854b-441da8def534","Type":"ContainerStarted","Data":"88860a099325db8fe235d228c973621aea1778e3f2640df5a296bf1243bf0d1c"}
Jul 22 02:37:42.975947 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:42.975926    2577 generic.go:356] "Generic (PLEG): container finished" podID="8c78f4b8e0da2d921ed52b00b7f21485" containerID="36ad0651749ad293318d5ffb5571bf19b73820ef4bb317ca77b0d20bade79595" exitCode=0
Jul 22 02:37:42.976186 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:42.976162    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal" event={"ID":"8c78f4b8e0da2d921ed52b00b7f21485","Type":"ContainerDied","Data":"36ad0651749ad293318d5ffb5571bf19b73820ef4bb317ca77b0d20bade79595"}
Jul 22 02:37:42.987540 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:42.987497    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-t4d8c" podStartSLOduration=3.6385937779999997 podStartE2EDuration="23.987483483s" totalImagesPullingTime="20.348889705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:42.987357135 +0000 UTC m=+23.695785736" watchObservedRunningTime="2026-07-22 02:37:42.987483483 +0000 UTC m=+23.695912079"
Jul 22 02:37:43.058275 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:43.058212    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-m59jm" podStartSLOduration=3.587353096 podStartE2EDuration="24.058194712s" totalImagesPullingTime="20.470841616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:43.057007145 +0000 UTC m=+23.765435745" watchObservedRunningTime="2026-07-22 02:37:43.058194712 +0000 UTC m=+23.766623312"
Jul 22 02:37:43.080105 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:43.080059    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2fr65" podStartSLOduration=3.644515858 podStartE2EDuration="24.080041931s" totalImagesPullingTime="20.435526073s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:43.079882463 +0000 UTC m=+23.788311075" watchObservedRunningTime="2026-07-22 02:37:43.080041931 +0000 UTC m=+23.788470582"
Jul 22 02:37:43.155026 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:43.154983    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7mqzz" podStartSLOduration=3.765095991 podStartE2EDuration="24.154967862s" totalImagesPullingTime="20.389871871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:43.154863082 +0000 UTC m=+23.863291682" watchObservedRunningTime="2026-07-22 02:37:43.154967862 +0000 UTC m=+23.863396461"
Jul 22 02:37:43.377077 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:43.377053    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7mqzz"
Jul 22 02:37:43.377660 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:43.377644    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7mqzz"
Jul 22 02:37:43.443346 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:43.443319    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 22 02:37:43.650988 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:43.650816    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T02:37:43.443339495Z","UUID":"bd9a7d98-d77a-4e17-849f-3892daed4063","Handler":null,"Name":"","Endpoint":""}
Jul 22 02:37:43.653963 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:43.653935    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 22 02:37:43.654119 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:43.653982    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 22 02:37:43.981145 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:43.981060    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal" event={"ID":"8c78f4b8e0da2d921ed52b00b7f21485","Type":"ContainerStarted","Data":"2d8001e60590caff8bdb87db25e0e9a49e2d97d71f087094cf2ec986cd8700a0"}
Jul 22 02:37:43.983728 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:43.983692    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j" event={"ID":"43d40c9e-d94f-403e-bf2b-8447aa63c337","Type":"ContainerStarted","Data":"91ba738b1320776cf716b34c4ca7f6fac98c25ba981443f5668cc1f0ccee21d5"}
Jul 22 02:37:43.984454 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:43.984424    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7mqzz"
Jul 22 02:37:43.984876 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:43.984844    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7mqzz"
Jul 22 02:37:43.999425 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:43.999375    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal" podStartSLOduration=23.999360301 podStartE2EDuration="23.999360301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:37:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:43.999088322 +0000 UTC m=+24.707516925" watchObservedRunningTime="2026-07-22 02:37:43.999360301 +0000 UTC m=+24.707788900"
Jul 22 02:37:44.751469 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:44.751387    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:44.751469 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:44.751439    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:44.751720 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:44.751519    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:44.751720 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:44.751515    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz5v" podUID="58f296ac-da6c-473e-8c58-49fa164804f5"
Jul 22 02:37:44.751720 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:44.751573    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgj4" podUID="b4abb13b-cb47-4cb3-9db4-c9531012e8c2"
Jul 22 02:37:44.751720 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:44.751645    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snc7m" podUID="cf3a32bc-8b07-4a3a-8b34-5ba92a675b90"
Jul 22 02:37:44.989974 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:44.989947    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqngf_6461ea33-ff4c-48c5-8c29-b4026c2f67b0/ovn-acl-logging/0.log"
Jul 22 02:37:44.990452 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:44.990424    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqngf" event={"ID":"6461ea33-ff4c-48c5-8c29-b4026c2f67b0","Type":"ContainerStarted","Data":"a6d647ae9931f18d07e6c2860529b28e00f508a07192b6faed6efc63262701f2"}
Jul 22 02:37:44.992653 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:44.992619    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j" event={"ID":"43d40c9e-d94f-403e-bf2b-8447aa63c337","Type":"ContainerStarted","Data":"1203ab3c3b13bbf050dbf4954326c038860392d5e52cf97fffe8dc1293347ba5"}
Jul 22 02:37:46.751617 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:46.751368    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:46.752063 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:46.751397    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:46.752063 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:46.751405    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:46.752063 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:46.751734    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snc7m" podUID="cf3a32bc-8b07-4a3a-8b34-5ba92a675b90"
Jul 22 02:37:46.752063 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:46.751855    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz5v" podUID="58f296ac-da6c-473e-8c58-49fa164804f5"
Jul 22 02:37:46.752063 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:46.751946    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgj4" podUID="b4abb13b-cb47-4cb3-9db4-c9531012e8c2"
Jul 22 02:37:48.001565 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:48.001529    2577 generic.go:356] "Generic (PLEG): container finished" podID="7453e58d-d28e-457a-b67e-5231350eb4a0" containerID="b821f5348aae0fd43237e2685863b90951cbd9bd9a6a48c21b0c0d8cbe97d276" exitCode=0
Jul 22 02:37:48.002333 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:48.001598    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wksbs" event={"ID":"7453e58d-d28e-457a-b67e-5231350eb4a0","Type":"ContainerDied","Data":"b821f5348aae0fd43237e2685863b90951cbd9bd9a6a48c21b0c0d8cbe97d276"}
Jul 22 02:37:48.005308 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:48.005286    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqngf_6461ea33-ff4c-48c5-8c29-b4026c2f67b0/ovn-acl-logging/0.log"
Jul 22 02:37:48.005638 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:48.005618    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqngf" event={"ID":"6461ea33-ff4c-48c5-8c29-b4026c2f67b0","Type":"ContainerStarted","Data":"810bdb8b4879e6b6c34575fb543042f726dd307ee72e5a61eaacc13c788a82ff"}
Jul 22 02:37:48.005870 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:48.005856    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:48.006033 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:48.006018    2577 scope.go:117] "RemoveContainer" containerID="c0759577d50600eb1219735225b6571bfe14777a65bf4e45673f5830a56f1f8c"
Jul 22 02:37:48.023382 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:48.023359    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:48.024831 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:48.024781    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wfb4j" podStartSLOduration=5.923345751 podStartE2EDuration="29.024759305s" totalImagesPullingTime="23.101413554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:37:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:45.021171627 +0000 UTC m=+25.729600226" watchObservedRunningTime="2026-07-22 02:37:48.024759305 +0000 UTC m=+28.733187907"
Jul 22 02:37:48.751926 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:48.751747    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:48.752155 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:48.751747    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:48.752155 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:48.752003    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snc7m" podUID="cf3a32bc-8b07-4a3a-8b34-5ba92a675b90"
Jul 22 02:37:48.752155 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:48.752073    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz5v" podUID="58f296ac-da6c-473e-8c58-49fa164804f5"
Jul 22 02:37:48.752155 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:48.751775    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:48.752155 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:48.752144    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgj4" podUID="b4abb13b-cb47-4cb3-9db4-c9531012e8c2"
Jul 22 02:37:49.013998 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:49.013912    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqngf_6461ea33-ff4c-48c5-8c29-b4026c2f67b0/ovn-acl-logging/0.log"
Jul 22 02:37:49.014442 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:49.014350    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqngf" event={"ID":"6461ea33-ff4c-48c5-8c29-b4026c2f67b0","Type":"ContainerStarted","Data":"fd7d969aba6e5e2ff96df90153b263d99f7b19cd6fe9ec1ba7009b260c2c59eb"}
Jul 22 02:37:49.014602 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:49.014579    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:49.014661 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:49.014644    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:49.031519 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:49.031488    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:37:49.052346 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:49.052299    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mqngf" podStartSLOduration=9.583885067 podStartE2EDuration="30.052282291s" totalImagesPullingTime="20.468397224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:49.052014306 +0000 UTC m=+29.760442920" watchObservedRunningTime="2026-07-22 02:37:49.052282291 +0000 UTC m=+29.760710888"
Jul 22 02:37:49.325270 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:49.325149    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-snc7m"]
Jul 22 02:37:49.325458 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:49.325317    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:49.325458 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:49.325417    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snc7m" podUID="cf3a32bc-8b07-4a3a-8b34-5ba92a675b90"
Jul 22 02:37:49.325969 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:49.325943    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bdgj4"]
Jul 22 02:37:49.326079 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:49.326053    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:49.326177 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:49.326152    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgj4" podUID="b4abb13b-cb47-4cb3-9db4-c9531012e8c2"
Jul 22 02:37:49.326534 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:49.326509    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cjz5v"]
Jul 22 02:37:49.326639 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:49.326592    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:49.326693 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:49.326658    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz5v" podUID="58f296ac-da6c-473e-8c58-49fa164804f5"
Jul 22 02:37:50.022137 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:50.022102    2577 generic.go:356] "Generic (PLEG): container finished" podID="7453e58d-d28e-457a-b67e-5231350eb4a0" containerID="8505a8096d5f6541c528e43de3e24c97c1f8d7e8638d51e0c37b55d006179e79" exitCode=0
Jul 22 02:37:50.022585 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:50.022200    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wksbs" event={"ID":"7453e58d-d28e-457a-b67e-5231350eb4a0","Type":"ContainerDied","Data":"8505a8096d5f6541c528e43de3e24c97c1f8d7e8638d51e0c37b55d006179e79"}
Jul 22 02:37:50.751502 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:50.751455    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:50.751661 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:50.751470    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:50.751661 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:50.751583    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgj4" podUID="b4abb13b-cb47-4cb3-9db4-c9531012e8c2"
Jul 22 02:37:50.751788 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:50.751689    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz5v" podUID="58f296ac-da6c-473e-8c58-49fa164804f5"
Jul 22 02:37:51.483415 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:51.483335    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:37:51.695911 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:51.695877    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:37:51.751221 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:51.751191    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:51.751429 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:51.751327    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snc7m" podUID="cf3a32bc-8b07-4a3a-8b34-5ba92a675b90"
Jul 22 02:37:52.029199 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:52.029112    2577 generic.go:356] "Generic (PLEG): container finished" podID="7453e58d-d28e-457a-b67e-5231350eb4a0" containerID="468edf19eb1270553a12bba647124d5b95603d74cba43a9d09659acb5abf639d" exitCode=0
Jul 22 02:37:52.029199 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:52.029166    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wksbs" event={"ID":"7453e58d-d28e-457a-b67e-5231350eb4a0","Type":"ContainerDied","Data":"468edf19eb1270553a12bba647124d5b95603d74cba43a9d09659acb5abf639d"}
Jul 22 02:37:52.074557 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:52.074525    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:37:52.178590 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:52.178560    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:37:52.446717 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:52.446616    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58f296ac-da6c-473e-8c58-49fa164804f5-original-pull-secret\") pod \"global-pull-secret-syncer-cjz5v\" (UID: \"58f296ac-da6c-473e-8c58-49fa164804f5\") " pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:52.446717 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:52.446679    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-metrics-certs\") pod \"network-metrics-daemon-snc7m\" (UID: \"cf3a32bc-8b07-4a3a-8b34-5ba92a675b90\") " pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:52.446933 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:52.446790    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:52.446933 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:52.446796    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:52.446933 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:52.446845    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-metrics-certs podName:cf3a32bc-8b07-4a3a-8b34-5ba92a675b90 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:24.446831382 +0000 UTC m=+65.155259959 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-metrics-certs") pod "network-metrics-daemon-snc7m" (UID: "cf3a32bc-8b07-4a3a-8b34-5ba92a675b90") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:52.446933 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:52.446861    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58f296ac-da6c-473e-8c58-49fa164804f5-original-pull-secret podName:58f296ac-da6c-473e-8c58-49fa164804f5 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:24.446852712 +0000 UTC m=+65.155281289 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58f296ac-da6c-473e-8c58-49fa164804f5-original-pull-secret") pod "global-pull-secret-syncer-cjz5v" (UID: "58f296ac-da6c-473e-8c58-49fa164804f5") : object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:52.548074 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:52.548024    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6cql\" (UniqueName: \"kubernetes.io/projected/b4abb13b-cb47-4cb3-9db4-c9531012e8c2-kube-api-access-q6cql\") pod \"network-check-target-bdgj4\" (UID: \"b4abb13b-cb47-4cb3-9db4-c9531012e8c2\") " pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:52.548590 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:52.548193    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 02:37:52.548590 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:52.548216    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 02:37:52.548590 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:52.548229    2577 projected.go:196] Error preparing data for projected volume kube-api-access-q6cql for pod openshift-network-diagnostics/network-check-target-bdgj4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:52.548590 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:52.548316    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4abb13b-cb47-4cb3-9db4-c9531012e8c2-kube-api-access-q6cql podName:b4abb13b-cb47-4cb3-9db4-c9531012e8c2 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:24.548296544 +0000 UTC m=+65.256725125 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-q6cql" (UniqueName: "kubernetes.io/projected/b4abb13b-cb47-4cb3-9db4-c9531012e8c2-kube-api-access-q6cql") pod "network-check-target-bdgj4" (UID: "b4abb13b-cb47-4cb3-9db4-c9531012e8c2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:52.751614 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:52.751567    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:52.751614 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:52.751619    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:52.751851 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:52.751731    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz5v" podUID="58f296ac-da6c-473e-8c58-49fa164804f5"
Jul 22 02:37:52.751900 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:52.751847    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgj4" podUID="b4abb13b-cb47-4cb3-9db4-c9531012e8c2"
Jul 22 02:37:53.468340 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:53.468296    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:37:53.671071 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:53.671027    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:37:53.751411 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:53.751375    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:53.751670 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:53.751523    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snc7m" podUID="cf3a32bc-8b07-4a3a-8b34-5ba92a675b90"
Jul 22 02:37:53.773765 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:53.773691    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:37:54.644136 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.644108    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeReady"
Jul 22 02:37:54.644338 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.644284    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 22 02:37:54.705375 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.705339    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rzqqh"]
Jul 22 02:37:54.709233 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.709212    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5n9x9"]
Jul 22 02:37:54.709387 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.709332    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rzqqh"
Jul 22 02:37:54.712081 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.712059    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7k6rz\""
Jul 22 02:37:54.712081 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.712066    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 22 02:37:54.712677 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.712658    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 22 02:37:54.712829 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.712804    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5n9x9"
Jul 22 02:37:54.715733 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.715712    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 22 02:37:54.715925 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.715712    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 22 02:37:54.716270 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.716055    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 22 02:37:54.716270 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.716079    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gq2kr\""
Jul 22 02:37:54.727550 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.727523    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rzqqh"]
Jul 22 02:37:54.728146 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.728127    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5n9x9"]
Jul 22 02:37:54.751627 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.751476    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:37:54.754318 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.751925    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:37:54.755532 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.755512    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 02:37:54.755788 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.755758    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 02:37:54.755788 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.755770    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 02:37:54.756190 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.756173    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d24b6\""
Jul 22 02:37:54.865765 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.865721    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72707ca0-ba6e-415d-beb5-ba8599c6ddc8-cert\") pod \"ingress-canary-5n9x9\" (UID: \"72707ca0-ba6e-415d-beb5-ba8599c6ddc8\") " pod="openshift-ingress-canary/ingress-canary-5n9x9"
Jul 22 02:37:54.865935 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.865774    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-config-volume\") pod \"dns-default-rzqqh\" (UID: \"6dd99316-c6d8-40d8-ba60-e1e01b9b8622\") " pod="openshift-dns/dns-default-rzqqh"
Jul 22 02:37:54.865935 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.865877    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-tmp-dir\") pod \"dns-default-rzqqh\" (UID: \"6dd99316-c6d8-40d8-ba60-e1e01b9b8622\") " pod="openshift-dns/dns-default-rzqqh"
Jul 22 02:37:54.865935 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.865928    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-metrics-tls\") pod \"dns-default-rzqqh\" (UID: \"6dd99316-c6d8-40d8-ba60-e1e01b9b8622\") " pod="openshift-dns/dns-default-rzqqh"
Jul 22 02:37:54.866060 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.865990    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr5kt\" (UniqueName: \"kubernetes.io/projected/72707ca0-ba6e-415d-beb5-ba8599c6ddc8-kube-api-access-kr5kt\") pod \"ingress-canary-5n9x9\" (UID: \"72707ca0-ba6e-415d-beb5-ba8599c6ddc8\") " pod="openshift-ingress-canary/ingress-canary-5n9x9"
Jul 22 02:37:54.866060 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.866010    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j89h\" (UniqueName: \"kubernetes.io/projected/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-kube-api-access-9j89h\") pod \"dns-default-rzqqh\" (UID: \"6dd99316-c6d8-40d8-ba60-e1e01b9b8622\") " pod="openshift-dns/dns-default-rzqqh"
Jul 22 02:37:54.967075 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.966995    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr5kt\" (UniqueName: \"kubernetes.io/projected/72707ca0-ba6e-415d-beb5-ba8599c6ddc8-kube-api-access-kr5kt\") pod \"ingress-canary-5n9x9\" (UID: \"72707ca0-ba6e-415d-beb5-ba8599c6ddc8\") " pod="openshift-ingress-canary/ingress-canary-5n9x9"
Jul 22 02:37:54.967075 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.967055    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j89h\" (UniqueName: \"kubernetes.io/projected/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-kube-api-access-9j89h\") pod \"dns-default-rzqqh\" (UID: \"6dd99316-c6d8-40d8-ba60-e1e01b9b8622\") " pod="openshift-dns/dns-default-rzqqh"
Jul 22 02:37:54.967397 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.967108    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72707ca0-ba6e-415d-beb5-ba8599c6ddc8-cert\") pod \"ingress-canary-5n9x9\" (UID: \"72707ca0-ba6e-415d-beb5-ba8599c6ddc8\") " pod="openshift-ingress-canary/ingress-canary-5n9x9"
Jul 22 02:37:54.967397 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.967132    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-config-volume\") pod \"dns-default-rzqqh\" (UID: \"6dd99316-c6d8-40d8-ba60-e1e01b9b8622\") " pod="openshift-dns/dns-default-rzqqh"
Jul 22 02:37:54.967397 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.967174    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-tmp-dir\") pod \"dns-default-rzqqh\" (UID: \"6dd99316-c6d8-40d8-ba60-e1e01b9b8622\") " pod="openshift-dns/dns-default-rzqqh"
Jul 22 02:37:54.967397 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.967229    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-metrics-tls\") pod \"dns-default-rzqqh\" (UID: \"6dd99316-c6d8-40d8-ba60-e1e01b9b8622\") " pod="openshift-dns/dns-default-rzqqh"
Jul 22 02:37:54.967397 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:54.967385    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 02:37:54.967626 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:54.967452    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-metrics-tls podName:6dd99316-c6d8-40d8-ba60-e1e01b9b8622 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:55.46743109 +0000 UTC m=+36.175859668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-metrics-tls") pod "dns-default-rzqqh" (UID: "6dd99316-c6d8-40d8-ba60-e1e01b9b8622") : secret "dns-default-metrics-tls" not found
Jul 22 02:37:54.967626 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.967598    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-tmp-dir\") pod \"dns-default-rzqqh\" (UID: \"6dd99316-c6d8-40d8-ba60-e1e01b9b8622\") " pod="openshift-dns/dns-default-rzqqh"
Jul 22 02:37:54.967828 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.967797    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-config-volume\") pod \"dns-default-rzqqh\" (UID: \"6dd99316-c6d8-40d8-ba60-e1e01b9b8622\") " pod="openshift-dns/dns-default-rzqqh"
Jul 22 02:37:54.971942 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.971918    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72707ca0-ba6e-415d-beb5-ba8599c6ddc8-cert\") pod \"ingress-canary-5n9x9\" (UID: \"72707ca0-ba6e-415d-beb5-ba8599c6ddc8\") " pod="openshift-ingress-canary/ingress-canary-5n9x9"
Jul 22 02:37:54.978111 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.978067    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr5kt\" (UniqueName: \"kubernetes.io/projected/72707ca0-ba6e-415d-beb5-ba8599c6ddc8-kube-api-access-kr5kt\") pod \"ingress-canary-5n9x9\" (UID: \"72707ca0-ba6e-415d-beb5-ba8599c6ddc8\") " pod="openshift-ingress-canary/ingress-canary-5n9x9"
Jul 22 02:37:54.978602 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:54.978583    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j89h\" (UniqueName: \"kubernetes.io/projected/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-kube-api-access-9j89h\") pod \"dns-default-rzqqh\" (UID: \"6dd99316-c6d8-40d8-ba60-e1e01b9b8622\") " pod="openshift-dns/dns-default-rzqqh"
Jul 22 02:37:55.030882 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:55.030842    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5n9x9"
Jul 22 02:37:55.470089 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:55.470047    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-metrics-tls\") pod \"dns-default-rzqqh\" (UID: \"6dd99316-c6d8-40d8-ba60-e1e01b9b8622\") " pod="openshift-dns/dns-default-rzqqh"
Jul 22 02:37:55.470316 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:55.470222    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 02:37:55.470399 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:55.470317    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-metrics-tls podName:6dd99316-c6d8-40d8-ba60-e1e01b9b8622 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:56.470295808 +0000 UTC m=+37.178724387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-metrics-tls") pod "dns-default-rzqqh" (UID: "6dd99316-c6d8-40d8-ba60-e1e01b9b8622") : secret "dns-default-metrics-tls" not found
Jul 22 02:37:55.751228 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:55.751193    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:37:55.754246 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:55.754207    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-48l7s\""
Jul 22 02:37:55.754394 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:55.754207    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 02:37:56.106852 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:56.106655    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5n9x9"]
Jul 22 02:37:56.110865 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:56.110840    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72707ca0_ba6e_415d_beb5_ba8599c6ddc8.slice/crio-5da71138ba313cad63b289614c034fefedf1ebbe9390019429ac386f723b82ea WatchSource:0}: Error finding container 5da71138ba313cad63b289614c034fefedf1ebbe9390019429ac386f723b82ea: Status 404 returned error can't find the container with id 5da71138ba313cad63b289614c034fefedf1ebbe9390019429ac386f723b82ea
Jul 22 02:37:56.473865 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:56.473744    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:37:56.479472 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:56.479447    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-metrics-tls\") pod \"dns-default-rzqqh\" (UID: \"6dd99316-c6d8-40d8-ba60-e1e01b9b8622\") " pod="openshift-dns/dns-default-rzqqh"
Jul 22 02:37:56.479610 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:56.479576    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 02:37:56.479647 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:56.479636    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-metrics-tls podName:6dd99316-c6d8-40d8-ba60-e1e01b9b8622 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:58.479617741 +0000 UTC m=+39.188046319 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-metrics-tls") pod "dns-default-rzqqh" (UID: "6dd99316-c6d8-40d8-ba60-e1e01b9b8622") : secret "dns-default-metrics-tls" not found
Jul 22 02:37:56.601225 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:56.601186    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:37:57.043665 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:57.043630    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5n9x9" event={"ID":"72707ca0-ba6e-415d-beb5-ba8599c6ddc8","Type":"ContainerStarted","Data":"5da71138ba313cad63b289614c034fefedf1ebbe9390019429ac386f723b82ea"}
Jul 22 02:37:57.046907 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:57.046876    2577 generic.go:356] "Generic (PLEG): container finished" podID="7453e58d-d28e-457a-b67e-5231350eb4a0" containerID="1d6546cfb4173814c73735c3f77b51c11736126f0bca4f419c052eb8bde36c85" exitCode=0
Jul 22 02:37:57.047053 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:57.046940    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wksbs" event={"ID":"7453e58d-d28e-457a-b67e-5231350eb4a0","Type":"ContainerDied","Data":"1d6546cfb4173814c73735c3f77b51c11736126f0bca4f419c052eb8bde36c85"}
Jul 22 02:37:57.523370 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:57.523335    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:37:57.604548 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:57.604514    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:37:58.027113 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.027083    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:37:58.053813 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.053773    2577 generic.go:356] "Generic (PLEG): container finished" podID="7453e58d-d28e-457a-b67e-5231350eb4a0" containerID="3a796818257adf30baa2a172fef0e942a2f0bb28baa2a86c3ff4a8d39f3c8d31" exitCode=0
Jul 22 02:37:58.054312 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.053830    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wksbs" event={"ID":"7453e58d-d28e-457a-b67e-5231350eb4a0","Type":"ContainerDied","Data":"3a796818257adf30baa2a172fef0e942a2f0bb28baa2a86c3ff4a8d39f3c8d31"}
Jul 22 02:37:58.089987 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.089945    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:37:58.413741 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.413659    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dxwdl"]
Jul 22 02:37:58.446160 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.446122    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dxwdl"]
Jul 22 02:37:58.446340 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.446275    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dxwdl"
Jul 22 02:37:58.448900 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.448872    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:37:58.450235 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.450205    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 22 02:37:58.450380 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.450234    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 22 02:37:58.450380 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.450302    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5gmrt\""
Jul 22 02:37:58.450380 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.450246    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 22 02:37:58.450380 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.450209    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 22 02:37:58.499267 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.499197    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-metrics-tls\") pod \"dns-default-rzqqh\" (UID: \"6dd99316-c6d8-40d8-ba60-e1e01b9b8622\") " pod="openshift-dns/dns-default-rzqqh"
Jul 22 02:37:58.499473 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:58.499374    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 02:37:58.499473 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:58.499452    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-metrics-tls podName:6dd99316-c6d8-40d8-ba60-e1e01b9b8622 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:02.499434407 +0000 UTC m=+43.207862985 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-metrics-tls") pod "dns-default-rzqqh" (UID: "6dd99316-c6d8-40d8-ba60-e1e01b9b8622") : secret "dns-default-metrics-tls" not found
Jul 22 02:37:58.520895 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.520782    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:37:58.599577 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.599556    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/344515fb-2b59-406b-98a1-da9975ccea10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dxwdl\" (UID: \"344515fb-2b59-406b-98a1-da9975ccea10\") " pod="openshift-insights/insights-runtime-extractor-dxwdl"
Jul 22 02:37:58.599679 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.599604    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/344515fb-2b59-406b-98a1-da9975ccea10-crio-socket\") pod \"insights-runtime-extractor-dxwdl\" (UID: \"344515fb-2b59-406b-98a1-da9975ccea10\") " pod="openshift-insights/insights-runtime-extractor-dxwdl"
Jul 22 02:37:58.599679 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.599660    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/344515fb-2b59-406b-98a1-da9975ccea10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dxwdl\" (UID: \"344515fb-2b59-406b-98a1-da9975ccea10\") " pod="openshift-insights/insights-runtime-extractor-dxwdl"
Jul 22 02:37:58.599744 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.599709    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/344515fb-2b59-406b-98a1-da9975ccea10-data-volume\") pod \"insights-runtime-extractor-dxwdl\" (UID: \"344515fb-2b59-406b-98a1-da9975ccea10\") " pod="openshift-insights/insights-runtime-extractor-dxwdl"
Jul 22 02:37:58.599744 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.599739    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfqm9\" (UniqueName: \"kubernetes.io/projected/344515fb-2b59-406b-98a1-da9975ccea10-kube-api-access-nfqm9\") pod \"insights-runtime-extractor-dxwdl\" (UID: \"344515fb-2b59-406b-98a1-da9975ccea10\") " pod="openshift-insights/insights-runtime-extractor-dxwdl"
Jul 22 02:37:58.652274 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.652231    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6cmnw"]
Jul 22 02:37:58.658020 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.657991    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:37:58.665115 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.665056    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6cmnw"
Jul 22 02:37:58.667977 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.667953    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 22 02:37:58.668101 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.667957    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-p9ghp\""
Jul 22 02:37:58.668101 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.667989    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 22 02:37:58.676198 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.676174    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6cmnw"]
Jul 22 02:37:58.700164 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.700143    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/344515fb-2b59-406b-98a1-da9975ccea10-crio-socket\") pod \"insights-runtime-extractor-dxwdl\" (UID: \"344515fb-2b59-406b-98a1-da9975ccea10\") " pod="openshift-insights/insights-runtime-extractor-dxwdl"
Jul 22 02:37:58.700310 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.700178    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/344515fb-2b59-406b-98a1-da9975ccea10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dxwdl\" (UID: \"344515fb-2b59-406b-98a1-da9975ccea10\") " pod="openshift-insights/insights-runtime-extractor-dxwdl"
Jul 22 02:37:58.700310 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.700239    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/344515fb-2b59-406b-98a1-da9975ccea10-data-volume\") pod \"insights-runtime-extractor-dxwdl\" (UID: \"344515fb-2b59-406b-98a1-da9975ccea10\") " pod="openshift-insights/insights-runtime-extractor-dxwdl"
Jul 22 02:37:58.700310 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.700278    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfqm9\" (UniqueName: \"kubernetes.io/projected/344515fb-2b59-406b-98a1-da9975ccea10-kube-api-access-nfqm9\") pod \"insights-runtime-extractor-dxwdl\" (UID: \"344515fb-2b59-406b-98a1-da9975ccea10\") " pod="openshift-insights/insights-runtime-extractor-dxwdl"
Jul 22 02:37:58.700493 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.700371    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/344515fb-2b59-406b-98a1-da9975ccea10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dxwdl\" (UID: \"344515fb-2b59-406b-98a1-da9975ccea10\") " pod="openshift-insights/insights-runtime-extractor-dxwdl"
Jul 22 02:37:58.700493 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.700393    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/344515fb-2b59-406b-98a1-da9975ccea10-crio-socket\") pod \"insights-runtime-extractor-dxwdl\" (UID: \"344515fb-2b59-406b-98a1-da9975ccea10\") " pod="openshift-insights/insights-runtime-extractor-dxwdl"
Jul 22 02:37:58.700493 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:58.700432    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 02:37:58.700493 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:58.700458    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 02:37:58.700678 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:58.700504    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/344515fb-2b59-406b-98a1-da9975ccea10-insights-runtime-extractor-tls podName:344515fb-2b59-406b-98a1-da9975ccea10 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:59.200483627 +0000 UTC m=+39.908912206 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/344515fb-2b59-406b-98a1-da9975ccea10-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dxwdl" (UID: "344515fb-2b59-406b-98a1-da9975ccea10") : secret "insights-runtime-extractor-tls" not found
Jul 22 02:37:58.700678 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:58.700529    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/344515fb-2b59-406b-98a1-da9975ccea10-kube-rbac-proxy-cm podName:344515fb-2b59-406b-98a1-da9975ccea10 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:59.20051275 +0000 UTC m=+39.908941375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/344515fb-2b59-406b-98a1-da9975ccea10-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dxwdl" (UID: "344515fb-2b59-406b-98a1-da9975ccea10") : configmap "kube-rbac-proxy" not found
Jul 22 02:37:58.700678 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.700607    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/344515fb-2b59-406b-98a1-da9975ccea10-data-volume\") pod \"insights-runtime-extractor-dxwdl\" (UID: \"344515fb-2b59-406b-98a1-da9975ccea10\") " pod="openshift-insights/insights-runtime-extractor-dxwdl"
Jul 22 02:37:58.724470 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.724437    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfqm9\" (UniqueName: \"kubernetes.io/projected/344515fb-2b59-406b-98a1-da9975ccea10-kube-api-access-nfqm9\") pod \"insights-runtime-extractor-dxwdl\" (UID: \"344515fb-2b59-406b-98a1-da9975ccea10\") " pod="openshift-insights/insights-runtime-extractor-dxwdl"
Jul 22 02:37:58.785179 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.785151    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:37:58.801365 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.801340    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtj72\" (UniqueName: \"kubernetes.io/projected/9ab2392f-bdf8-41ec-b9e9-373cb374ea1f-kube-api-access-rtj72\") pod \"migrator-7cc9c7ffd7-6cmnw\" (UID: \"9ab2392f-bdf8-41ec-b9e9-373cb374ea1f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6cmnw"
Jul 22 02:37:58.856917 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.856881    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:37:58.902027 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.902000    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtj72\" (UniqueName: \"kubernetes.io/projected/9ab2392f-bdf8-41ec-b9e9-373cb374ea1f-kube-api-access-rtj72\") pod \"migrator-7cc9c7ffd7-6cmnw\" (UID: \"9ab2392f-bdf8-41ec-b9e9-373cb374ea1f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6cmnw"
Jul 22 02:37:58.911807 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.911780    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtj72\" (UniqueName: \"kubernetes.io/projected/9ab2392f-bdf8-41ec-b9e9-373cb374ea1f-kube-api-access-rtj72\") pod \"migrator-7cc9c7ffd7-6cmnw\" (UID: \"9ab2392f-bdf8-41ec-b9e9-373cb374ea1f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6cmnw"
Jul 22 02:37:58.999847 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:58.999640    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6cmnw"
Jul 22 02:37:59.063312 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:59.063275    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wksbs" event={"ID":"7453e58d-d28e-457a-b67e-5231350eb4a0","Type":"ContainerStarted","Data":"493516127d1dad07257fb157b7b04cc658f800a458a6fdb2d28d4440249635a7"}
Jul 22 02:37:59.090639 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:59.090577    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wksbs" podStartSLOduration=9.384853506 podStartE2EDuration="40.090557976s" totalImagesPullingTime="30.70570447s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:37:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:59.088801814 +0000 UTC m=+39.797230416" watchObservedRunningTime="2026-07-22 02:37:59.090557976 +0000 UTC m=+39.798986577"
Jul 22 02:37:59.176471 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:59.176395    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6cmnw"]
Jul 22 02:37:59.182689 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:37:59.182659    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ab2392f_bdf8_41ec_b9e9_373cb374ea1f.slice/crio-0f8fed891bfd58164ee5d675e533289fbf7f81c34e9af96dde3a4d00f033f089 WatchSource:0}: Error finding container 0f8fed891bfd58164ee5d675e533289fbf7f81c34e9af96dde3a4d00f033f089: Status 404 returned error can't find the container with id 0f8fed891bfd58164ee5d675e533289fbf7f81c34e9af96dde3a4d00f033f089
Jul 22 02:37:59.204868 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:59.204825    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/344515fb-2b59-406b-98a1-da9975ccea10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dxwdl\" (UID: \"344515fb-2b59-406b-98a1-da9975ccea10\") " pod="openshift-insights/insights-runtime-extractor-dxwdl"
Jul 22 02:37:59.205050 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:59.204912    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 02:37:59.205050 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:59.204980    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/344515fb-2b59-406b-98a1-da9975ccea10-kube-rbac-proxy-cm podName:344515fb-2b59-406b-98a1-da9975ccea10 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:00.204961442 +0000 UTC m=+40.913390039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/344515fb-2b59-406b-98a1-da9975ccea10-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dxwdl" (UID: "344515fb-2b59-406b-98a1-da9975ccea10") : configmap "kube-rbac-proxy" not found
Jul 22 02:37:59.205050 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:59.204986    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 02:37:59.205050 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:37:59.205031    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/344515fb-2b59-406b-98a1-da9975ccea10-insights-runtime-extractor-tls podName:344515fb-2b59-406b-98a1-da9975ccea10 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:00.205020816 +0000 UTC m=+40.913449403 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/344515fb-2b59-406b-98a1-da9975ccea10-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dxwdl" (UID: "344515fb-2b59-406b-98a1-da9975ccea10") : secret "insights-runtime-extractor-tls" not found
Jul 22 02:37:59.205050 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:59.204912    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/344515fb-2b59-406b-98a1-da9975ccea10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dxwdl\" (UID: \"344515fb-2b59-406b-98a1-da9975ccea10\") " pod="openshift-insights/insights-runtime-extractor-dxwdl"
Jul 22 02:37:59.226015 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:59.225931    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:37:59.326584 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:59.326547    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:37:59.425349 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:37:59.425318    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:00.067599 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:00.067561    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5n9x9" event={"ID":"72707ca0-ba6e-415d-beb5-ba8599c6ddc8","Type":"ContainerStarted","Data":"7994acccf00b77542fcba6ca0a3f74990a6af28d982121bbea1d96cd5536b9b9"}
Jul 22 02:38:00.068930 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:00.068901    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6cmnw" event={"ID":"9ab2392f-bdf8-41ec-b9e9-373cb374ea1f","Type":"ContainerStarted","Data":"0f8fed891bfd58164ee5d675e533289fbf7f81c34e9af96dde3a4d00f033f089"}
Jul 22 02:38:00.086275 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:00.086191    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5n9x9" podStartSLOduration=3.2244060230000002 podStartE2EDuration="6.086171278s" totalImagesPullingTime="2.861765255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:37:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:00.085519155 +0000 UTC m=+40.793947754" watchObservedRunningTime="2026-07-22 02:38:00.086171278 +0000 UTC m=+40.794599879"
Jul 22 02:38:00.212012 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:00.211966    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/344515fb-2b59-406b-98a1-da9975ccea10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dxwdl\" (UID: \"344515fb-2b59-406b-98a1-da9975ccea10\") " pod="openshift-insights/insights-runtime-extractor-dxwdl"
Jul 22 02:38:00.212190 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:00.212061    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/344515fb-2b59-406b-98a1-da9975ccea10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dxwdl\" (UID: \"344515fb-2b59-406b-98a1-da9975ccea10\") " pod="openshift-insights/insights-runtime-extractor-dxwdl"
Jul 22 02:38:00.212190 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:38:00.212140    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 02:38:00.212366 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:38:00.212206    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 02:38:00.212366 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:38:00.212226    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/344515fb-2b59-406b-98a1-da9975ccea10-kube-rbac-proxy-cm podName:344515fb-2b59-406b-98a1-da9975ccea10 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:02.212202073 +0000 UTC m=+42.920630674 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/344515fb-2b59-406b-98a1-da9975ccea10-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dxwdl" (UID: "344515fb-2b59-406b-98a1-da9975ccea10") : configmap "kube-rbac-proxy" not found
Jul 22 02:38:00.212366 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:38:00.212290    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/344515fb-2b59-406b-98a1-da9975ccea10-insights-runtime-extractor-tls podName:344515fb-2b59-406b-98a1-da9975ccea10 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:02.212273228 +0000 UTC m=+42.920701820 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/344515fb-2b59-406b-98a1-da9975ccea10-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dxwdl" (UID: "344515fb-2b59-406b-98a1-da9975ccea10") : secret "insights-runtime-extractor-tls" not found
Jul 22 02:38:00.369992 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:00.369881    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:00.431264 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:00.431207    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:00.527093 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:00.527040    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:00.606363 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:00.606333    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m59jm_f451c68d-e137-4c8e-854b-441da8def534/dns-node-resolver/0.log"
Jul 22 02:38:00.626562 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:00.626476    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:00.702708 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:00.702676    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:01.073517 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:01.073481    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6cmnw" event={"ID":"9ab2392f-bdf8-41ec-b9e9-373cb374ea1f","Type":"ContainerStarted","Data":"196881eae19b5b6b822fdc07ef48e6b746b9e26168072b979aac56599b0d1977"}
Jul 22 02:38:01.203575 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:01.203482    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:01.207912 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:01.207889    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2fr65_3fb4dd6b-d6d7-409a-a6a3-a2f11d2a3375/node-ca/0.log"
Jul 22 02:38:02.006369 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:02.006338    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5n9x9_72707ca0-ba6e-415d-beb5-ba8599c6ddc8/serve-healthcheck-canary/0.log"
Jul 22 02:38:02.077828 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:02.077792    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6cmnw" event={"ID":"9ab2392f-bdf8-41ec-b9e9-373cb374ea1f","Type":"ContainerStarted","Data":"8c62c147e790a16e92f5b03014810efdf560ceb6b3e2eacf0d65beda759dc1cf"}
Jul 22 02:38:02.100948 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:02.100898    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6cmnw" podStartSLOduration=2.377762531 podStartE2EDuration="4.100880497s" totalImagesPullingTime="1.723117966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:37:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:02.099808457 +0000 UTC m=+42.808237060" watchObservedRunningTime="2026-07-22 02:38:02.100880497 +0000 UTC m=+42.809309199"
Jul 22 02:38:02.228348 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:02.228304    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/344515fb-2b59-406b-98a1-da9975ccea10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dxwdl\" (UID: \"344515fb-2b59-406b-98a1-da9975ccea10\") " pod="openshift-insights/insights-runtime-extractor-dxwdl"
Jul 22 02:38:02.228532 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:02.228358    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/344515fb-2b59-406b-98a1-da9975ccea10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dxwdl\" (UID: \"344515fb-2b59-406b-98a1-da9975ccea10\") " pod="openshift-insights/insights-runtime-extractor-dxwdl"
Jul 22 02:38:02.228532 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:38:02.228435    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 02:38:02.228532 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:38:02.228483    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 02:38:02.228532 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:38:02.228511    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/344515fb-2b59-406b-98a1-da9975ccea10-kube-rbac-proxy-cm podName:344515fb-2b59-406b-98a1-da9975ccea10 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:06.228496607 +0000 UTC m=+46.936925185 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/344515fb-2b59-406b-98a1-da9975ccea10-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dxwdl" (UID: "344515fb-2b59-406b-98a1-da9975ccea10") : configmap "kube-rbac-proxy" not found
Jul 22 02:38:02.228662 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:38:02.228539    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/344515fb-2b59-406b-98a1-da9975ccea10-insights-runtime-extractor-tls podName:344515fb-2b59-406b-98a1-da9975ccea10 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:06.228524626 +0000 UTC m=+46.936953205 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/344515fb-2b59-406b-98a1-da9975ccea10-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dxwdl" (UID: "344515fb-2b59-406b-98a1-da9975ccea10") : secret "insights-runtime-extractor-tls" not found
Jul 22 02:38:02.531172 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:02.531131    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-metrics-tls\") pod \"dns-default-rzqqh\" (UID: \"6dd99316-c6d8-40d8-ba60-e1e01b9b8622\") " pod="openshift-dns/dns-default-rzqqh"
Jul 22 02:38:02.531365 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:38:02.531318    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 02:38:02.531405 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:38:02.531387    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-metrics-tls podName:6dd99316-c6d8-40d8-ba60-e1e01b9b8622 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:10.531370138 +0000 UTC m=+51.239798736 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-metrics-tls") pod "dns-default-rzqqh" (UID: "6dd99316-c6d8-40d8-ba60-e1e01b9b8622") : secret "dns-default-metrics-tls" not found
Jul 22 02:38:03.767063 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:03.767028    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:04.046991 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:04.046915    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:04.210308 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:04.210276    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:04.313281 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:04.313171    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:04.412564 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:04.412528    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:04.485245 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:04.485211    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:04.620276 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:04.620174    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:04.738176 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:04.738138    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:05.532423 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:05.532390    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:06.134281 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:06.134234    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:06.262625 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:06.262585    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/344515fb-2b59-406b-98a1-da9975ccea10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dxwdl\" (UID: \"344515fb-2b59-406b-98a1-da9975ccea10\") " pod="openshift-insights/insights-runtime-extractor-dxwdl"
Jul 22 02:38:06.262625 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:06.262634    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/344515fb-2b59-406b-98a1-da9975ccea10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dxwdl\" (UID: \"344515fb-2b59-406b-98a1-da9975ccea10\") " pod="openshift-insights/insights-runtime-extractor-dxwdl"
Jul 22 02:38:06.262881 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:38:06.262721    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 02:38:06.262881 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:38:06.262775    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/344515fb-2b59-406b-98a1-da9975ccea10-insights-runtime-extractor-tls podName:344515fb-2b59-406b-98a1-da9975ccea10 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:14.262761984 +0000 UTC m=+54.971190561 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/344515fb-2b59-406b-98a1-da9975ccea10-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dxwdl" (UID: "344515fb-2b59-406b-98a1-da9975ccea10") : secret "insights-runtime-extractor-tls" not found
Jul 22 02:38:06.263236 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:06.263210    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/344515fb-2b59-406b-98a1-da9975ccea10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dxwdl\" (UID: \"344515fb-2b59-406b-98a1-da9975ccea10\") " pod="openshift-insights/insights-runtime-extractor-dxwdl"
Jul 22 02:38:06.328211 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:06.328176    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:06.537977 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:06.537944    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:06.944317 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:06.944229    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:07.745778 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:07.745742    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:07.817892 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:07.817858    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:07.944522 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:07.944486    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:08.131062 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:08.130942    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:08.534302 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:08.534270    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:08.634285 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:08.634201    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:08.776568 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:08.776540    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:08.846924 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:08.846856    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:09.342753 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:09.342721    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:09.745020 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:09.744993    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:09.845918 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:09.845886    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:09.944731 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:09.944698    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:10.134383 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:10.134296    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:10.542759 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:10.542722    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:10.597087 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:10.597054    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-metrics-tls\") pod \"dns-default-rzqqh\" (UID: \"6dd99316-c6d8-40d8-ba60-e1e01b9b8622\") " pod="openshift-dns/dns-default-rzqqh"
Jul 22 02:38:10.600110 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:10.600085    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dd99316-c6d8-40d8-ba60-e1e01b9b8622-metrics-tls\") pod \"dns-default-rzqqh\" (UID: \"6dd99316-c6d8-40d8-ba60-e1e01b9b8622\") " pod="openshift-dns/dns-default-rzqqh"
Jul 22 02:38:10.622152 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:10.622108    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rzqqh"
Jul 22 02:38:10.769746 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:10.769716    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rzqqh"]
Jul 22 02:38:10.773300 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:38:10.773236    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dd99316_c6d8_40d8_ba60_e1e01b9b8622.slice/crio-ba6d44995c21754a061632f117f31447fb61b78476e79f58e17253541ab0f5cd WatchSource:0}: Error finding container ba6d44995c21754a061632f117f31447fb61b78476e79f58e17253541ab0f5cd: Status 404 returned error can't find the container with id ba6d44995c21754a061632f117f31447fb61b78476e79f58e17253541ab0f5cd
Jul 22 02:38:10.925305 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:10.925190    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:11.100636 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:11.100602    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rzqqh" event={"ID":"6dd99316-c6d8-40d8-ba60-e1e01b9b8622","Type":"ContainerStarted","Data":"ba6d44995c21754a061632f117f31447fb61b78476e79f58e17253541ab0f5cd"}
Jul 22 02:38:11.429714 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:11.429679    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:11.531236 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:11.531203    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:11.609164 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:11.609127    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:11.937792 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:11.937748    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:12.331949 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:12.331919    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:12.541490 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:12.541455    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:12.900504 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:12.900472    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:13.143540 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:13.143500    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:13.623014 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:13.622980    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:13.945515 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:13.945425    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:14.111813 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:14.111776    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rzqqh" event={"ID":"6dd99316-c6d8-40d8-ba60-e1e01b9b8622","Type":"ContainerStarted","Data":"a6e9afc5da3f808a2cc3db00d27d7ac22ee0aa23838f14a8c0484576afc31812"}
Jul 22 02:38:14.111978 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:14.111829    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rzqqh" event={"ID":"6dd99316-c6d8-40d8-ba60-e1e01b9b8622","Type":"ContainerStarted","Data":"92c4c8680eea3e4757e077ff1b9e5f3fd4405a9ee4beabf829cdd505b7fb8300"}
Jul 22 02:38:14.111978 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:14.111939    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rzqqh"
Jul 22 02:38:14.132426 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:14.132375    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rzqqh" podStartSLOduration=17.611400878 podStartE2EDuration="20.132356338s" totalImagesPullingTime="2.52095546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:37:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:14.13163885 +0000 UTC m=+54.840067649" watchObservedRunningTime="2026-07-22 02:38:14.132356338 +0000 UTC m=+54.840784937"
Jul 22 02:38:14.329509 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:14.329408    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/344515fb-2b59-406b-98a1-da9975ccea10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dxwdl\" (UID: \"344515fb-2b59-406b-98a1-da9975ccea10\") " pod="openshift-insights/insights-runtime-extractor-dxwdl"
Jul 22 02:38:14.330663 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:14.330640    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:14.331967 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:14.331943    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/344515fb-2b59-406b-98a1-da9975ccea10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dxwdl\" (UID: \"344515fb-2b59-406b-98a1-da9975ccea10\") " pod="openshift-insights/insights-runtime-extractor-dxwdl"
Jul 22 02:38:14.358915 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:14.358875    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dxwdl"
Jul 22 02:38:14.495441 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:14.495407    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dxwdl"]
Jul 22 02:38:14.498601 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:38:14.498574    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod344515fb_2b59_406b_98a1_da9975ccea10.slice/crio-4d2e78bdf8e06911d4a9697fccb91e661b0e144e6edf6f09ca104e0057045cda WatchSource:0}: Error finding container 4d2e78bdf8e06911d4a9697fccb91e661b0e144e6edf6f09ca104e0057045cda: Status 404 returned error can't find the container with id 4d2e78bdf8e06911d4a9697fccb91e661b0e144e6edf6f09ca104e0057045cda
Jul 22 02:38:14.548452 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:14.548417    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:14.745364 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:14.745329    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:15.119147 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:15.119056    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dxwdl" event={"ID":"344515fb-2b59-406b-98a1-da9975ccea10","Type":"ContainerStarted","Data":"4d2e78bdf8e06911d4a9697fccb91e661b0e144e6edf6f09ca104e0057045cda"}
Jul 22 02:38:20.138187 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:20.138116    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dxwdl" event={"ID":"344515fb-2b59-406b-98a1-da9975ccea10","Type":"ContainerStarted","Data":"e8d1c8554c477cb0445227099ace045d7de2623766590f1cab13b90c9d7c9843"}
Jul 22 02:38:21.046323 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:21.046291    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mqngf"
Jul 22 02:38:22.341931 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:22.341900    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:22.440427 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:22.440384    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:22.500636 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:22.500608    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:22.614450 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:22.614361    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:22.790642 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:22.790573    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:22.891465 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:22.891381    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:23.031815 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.031784    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:23.109361 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.109302    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:23.247570 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.247544    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6"]
Jul 22 02:38:23.250481 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.250465    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6"
Jul 22 02:38:23.255095 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.255077    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 22 02:38:23.256309 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.256286    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 22 02:38:23.256473 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.256364    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 22 02:38:23.256473 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.256398    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 22 02:38:23.256751 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.256671    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 22 02:38:23.256751 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.256712    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 22 02:38:23.260495 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.260477    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 22 02:38:23.288229 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.288207    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6"]
Jul 22 02:38:23.301437 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.301417    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/beb36780-d158-4411-8e03-e660caa40df1-ca\") pod \"cluster-proxy-proxy-agent-564d787f6b-4jkp6\" (UID: \"beb36780-d158-4411-8e03-e660caa40df1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6"
Jul 22 02:38:23.301535 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.301470    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p98c\" (UniqueName: \"kubernetes.io/projected/beb36780-d158-4411-8e03-e660caa40df1-kube-api-access-5p98c\") pod \"cluster-proxy-proxy-agent-564d787f6b-4jkp6\" (UID: \"beb36780-d158-4411-8e03-e660caa40df1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6"
Jul 22 02:38:23.301535 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.301493    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/beb36780-d158-4411-8e03-e660caa40df1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-564d787f6b-4jkp6\" (UID: \"beb36780-d158-4411-8e03-e660caa40df1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6"
Jul 22 02:38:23.301614 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.301535    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/beb36780-d158-4411-8e03-e660caa40df1-hub\") pod \"cluster-proxy-proxy-agent-564d787f6b-4jkp6\" (UID: \"beb36780-d158-4411-8e03-e660caa40df1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6"
Jul 22 02:38:23.301614 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.301585    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/beb36780-d158-4411-8e03-e660caa40df1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-564d787f6b-4jkp6\" (UID: \"beb36780-d158-4411-8e03-e660caa40df1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6"
Jul 22 02:38:23.301614 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.301601    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/beb36780-d158-4411-8e03-e660caa40df1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-564d787f6b-4jkp6\" (UID: \"beb36780-d158-4411-8e03-e660caa40df1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6"
Jul 22 02:38:23.394342 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.394308    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:23.402429 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.402406    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/beb36780-d158-4411-8e03-e660caa40df1-hub\") pod \"cluster-proxy-proxy-agent-564d787f6b-4jkp6\" (UID: \"beb36780-d158-4411-8e03-e660caa40df1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6"
Jul 22 02:38:23.402492 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.402459    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/beb36780-d158-4411-8e03-e660caa40df1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-564d787f6b-4jkp6\" (UID: \"beb36780-d158-4411-8e03-e660caa40df1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6"
Jul 22 02:38:23.402492 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.402479    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/beb36780-d158-4411-8e03-e660caa40df1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-564d787f6b-4jkp6\" (UID: \"beb36780-d158-4411-8e03-e660caa40df1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6"
Jul 22 02:38:23.402560 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.402500    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/beb36780-d158-4411-8e03-e660caa40df1-ca\") pod \"cluster-proxy-proxy-agent-564d787f6b-4jkp6\" (UID: \"beb36780-d158-4411-8e03-e660caa40df1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6"
Jul 22 02:38:23.402560 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.402532    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p98c\" (UniqueName: \"kubernetes.io/projected/beb36780-d158-4411-8e03-e660caa40df1-kube-api-access-5p98c\") pod \"cluster-proxy-proxy-agent-564d787f6b-4jkp6\" (UID: \"beb36780-d158-4411-8e03-e660caa40df1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6"
Jul 22 02:38:23.402560 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.402549    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/beb36780-d158-4411-8e03-e660caa40df1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-564d787f6b-4jkp6\" (UID: \"beb36780-d158-4411-8e03-e660caa40df1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6"
Jul 22 02:38:23.403387 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.403363    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/beb36780-d158-4411-8e03-e660caa40df1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-564d787f6b-4jkp6\" (UID: \"beb36780-d158-4411-8e03-e660caa40df1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6"
Jul 22 02:38:23.405296 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.405271    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/beb36780-d158-4411-8e03-e660caa40df1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-564d787f6b-4jkp6\" (UID: \"beb36780-d158-4411-8e03-e660caa40df1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6"
Jul 22 02:38:23.405408 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.405276    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/beb36780-d158-4411-8e03-e660caa40df1-hub\") pod \"cluster-proxy-proxy-agent-564d787f6b-4jkp6\" (UID: \"beb36780-d158-4411-8e03-e660caa40df1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6"
Jul 22 02:38:23.405604 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.405583    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/beb36780-d158-4411-8e03-e660caa40df1-ca\") pod \"cluster-proxy-proxy-agent-564d787f6b-4jkp6\" (UID: \"beb36780-d158-4411-8e03-e660caa40df1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6"
Jul 22 02:38:23.405823 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.405798    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/beb36780-d158-4411-8e03-e660caa40df1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-564d787f6b-4jkp6\" (UID: \"beb36780-d158-4411-8e03-e660caa40df1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6"
Jul 22 02:38:23.414509 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.414485    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p98c\" (UniqueName: \"kubernetes.io/projected/beb36780-d158-4411-8e03-e660caa40df1-kube-api-access-5p98c\") pod \"cluster-proxy-proxy-agent-564d787f6b-4jkp6\" (UID: \"beb36780-d158-4411-8e03-e660caa40df1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6"
Jul 22 02:38:23.502490 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.502448    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:23.569363 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.569326    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6"
Jul 22 02:38:23.603189 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.603149    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:23.697616 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.697582    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:23.720763 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.720725    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6"]
Jul 22 02:38:23.725510 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:38:23.725477    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbeb36780_d158_4411_8e03_e660caa40df1.slice/crio-431bd30d89ef237289b909821719311e0cd89631eb5a67a0403c9f4fb563b967 WatchSource:0}: Error finding container 431bd30d89ef237289b909821719311e0cd89631eb5a67a0403c9f4fb563b967: Status 404 returned error can't find the container with id 431bd30d89ef237289b909821719311e0cd89631eb5a67a0403c9f4fb563b967
Jul 22 02:38:23.909850 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:23.909743    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:24.010396 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:24.010357    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:24.069856 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:24.069827    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:24.121994 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:24.121958    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rzqqh"
Jul 22 02:38:24.156503 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:24.156447    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dxwdl" event={"ID":"344515fb-2b59-406b-98a1-da9975ccea10","Type":"ContainerStarted","Data":"f451fba3726c7895a50fc8b83b447e19ef4837ca026dcf137861a3d99632960b"}
Jul 22 02:38:24.157808 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:24.157783    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6" event={"ID":"beb36780-d158-4411-8e03-e660caa40df1","Type":"ContainerStarted","Data":"431bd30d89ef237289b909821719311e0cd89631eb5a67a0403c9f4fb563b967"}
Jul 22 02:38:24.209937 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:24.209856    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:24.468594 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:24.468500    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:24.511675 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:24.511631    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58f296ac-da6c-473e-8c58-49fa164804f5-original-pull-secret\") pod \"global-pull-secret-syncer-cjz5v\" (UID: \"58f296ac-da6c-473e-8c58-49fa164804f5\") " pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:38:24.511877 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:24.511696    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-metrics-certs\") pod \"network-metrics-daemon-snc7m\" (UID: \"cf3a32bc-8b07-4a3a-8b34-5ba92a675b90\") " pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:38:24.514656 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:24.514627    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 02:38:24.514917 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:24.514898    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 02:38:24.525760 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:24.525733    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58f296ac-da6c-473e-8c58-49fa164804f5-original-pull-secret\") pod \"global-pull-secret-syncer-cjz5v\" (UID: \"58f296ac-da6c-473e-8c58-49fa164804f5\") " pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:38:24.525878 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:24.525733    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf3a32bc-8b07-4a3a-8b34-5ba92a675b90-metrics-certs\") pod \"network-metrics-daemon-snc7m\" (UID: \"cf3a32bc-8b07-4a3a-8b34-5ba92a675b90\") " pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:38:24.564818 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:24.564784    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-48l7s\""
Jul 22 02:38:24.572143 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:24.572118    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snc7m"
Jul 22 02:38:24.612992 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:24.612951    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6cql\" (UniqueName: \"kubernetes.io/projected/b4abb13b-cb47-4cb3-9db4-c9531012e8c2-kube-api-access-q6cql\") pod \"network-check-target-bdgj4\" (UID: \"b4abb13b-cb47-4cb3-9db4-c9531012e8c2\") " pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:38:24.616286 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:24.616036    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 02:38:24.626277 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:24.626153    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 02:38:24.636955 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:24.636930    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6cql\" (UniqueName: \"kubernetes.io/projected/b4abb13b-cb47-4cb3-9db4-c9531012e8c2-kube-api-access-q6cql\") pod \"network-check-target-bdgj4\" (UID: \"b4abb13b-cb47-4cb3-9db4-c9531012e8c2\") " pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:38:24.722954 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:24.722873    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-snc7m"]
Jul 22 02:38:24.727126 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:38:24.727091    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf3a32bc_8b07_4a3a_8b34_5ba92a675b90.slice/crio-8f5032ca706c2227cca056a5a9776041d30c78df5b0e8ac14f9e044a70f842bb WatchSource:0}: Error finding container 8f5032ca706c2227cca056a5a9776041d30c78df5b0e8ac14f9e044a70f842bb: Status 404 returned error can't find the container with id 8f5032ca706c2227cca056a5a9776041d30c78df5b0e8ac14f9e044a70f842bb
Jul 22 02:38:24.764243 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:24.764208    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz5v"
Jul 22 02:38:24.774518 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:24.774490    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d24b6\""
Jul 22 02:38:24.782041 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:24.782017    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:38:24.928968 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:24.928934    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cjz5v"]
Jul 22 02:38:24.933116 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:38:24.933076    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58f296ac_da6c_473e_8c58_49fa164804f5.slice/crio-f927e1f7e44b9527627f699d141741ea3fab8f5bc712ce4a7bc9524570bcc173 WatchSource:0}: Error finding container f927e1f7e44b9527627f699d141741ea3fab8f5bc712ce4a7bc9524570bcc173: Status 404 returned error can't find the container with id f927e1f7e44b9527627f699d141741ea3fab8f5bc712ce4a7bc9524570bcc173
Jul 22 02:38:24.943140 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:24.943112    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bdgj4"]
Jul 22 02:38:24.946610 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:38:24.946581    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4abb13b_cb47_4cb3_9db4_c9531012e8c2.slice/crio-6baba74310e4fd72152c5222fb6973530ef69696bcafd35dabbd4d3f051ba73b WatchSource:0}: Error finding container 6baba74310e4fd72152c5222fb6973530ef69696bcafd35dabbd4d3f051ba73b: Status 404 returned error can't find the container with id 6baba74310e4fd72152c5222fb6973530ef69696bcafd35dabbd4d3f051ba73b
Jul 22 02:38:25.162530 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:25.162493    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bdgj4" event={"ID":"b4abb13b-cb47-4cb3-9db4-c9531012e8c2","Type":"ContainerStarted","Data":"6baba74310e4fd72152c5222fb6973530ef69696bcafd35dabbd4d3f051ba73b"}
Jul 22 02:38:25.163992 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:25.163961    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cjz5v" event={"ID":"58f296ac-da6c-473e-8c58-49fa164804f5","Type":"ContainerStarted","Data":"f927e1f7e44b9527627f699d141741ea3fab8f5bc712ce4a7bc9524570bcc173"}
Jul 22 02:38:25.165182 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:25.165156    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-snc7m" event={"ID":"cf3a32bc-8b07-4a3a-8b34-5ba92a675b90","Type":"ContainerStarted","Data":"8f5032ca706c2227cca056a5a9776041d30c78df5b0e8ac14f9e044a70f842bb"}
Jul 22 02:38:25.429046 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:25.428951    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:26.437148 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:26.437119    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:26.526302 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:26.526224    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:27.176225 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:27.176136    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dxwdl" event={"ID":"344515fb-2b59-406b-98a1-da9975ccea10","Type":"ContainerStarted","Data":"54a26220fba6713125b1e6770750782bf5359a1d07e5acf396dd1e9e332f472f"}
Jul 22 02:38:27.208676 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:27.207910    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dxwdl" podStartSLOduration=17.07518966 podStartE2EDuration="29.207882237s" totalImagesPullingTime="12.132692577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:37:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:27.205536622 +0000 UTC m=+67.913965223" watchObservedRunningTime="2026-07-22 02:38:27.207882237 +0000 UTC m=+67.916310838"
Jul 22 02:38:27.626856 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:27.626791    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:27.728071 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:27.728019    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:27.827866 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:27.827825    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:28.182242 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:28.182205    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-snc7m" event={"ID":"cf3a32bc-8b07-4a3a-8b34-5ba92a675b90","Type":"ContainerStarted","Data":"1a053adc28cdd0f7f89fe15388ca4ec3f165caf4304e7a7a511eac54c626a47b"}
Jul 22 02:38:28.737357 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:28.737312    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:28.839017 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:28.838980    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:28.918671 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:28.918634    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:29.156662 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:29.156624    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:29.190274 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:29.190213    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-snc7m" event={"ID":"cf3a32bc-8b07-4a3a-8b34-5ba92a675b90","Type":"ContainerStarted","Data":"3c8ce2a396904836bb631cc3d5f1be4620cfc874451606299f3f2fff991017b7"}
Jul 22 02:38:29.210769 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:29.210718    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-snc7m" podStartSLOduration=67.046386894 podStartE2EDuration="1m10.210672575s" totalImagesPullingTime="3.164285681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:29.209806232 +0000 UTC m=+69.918234833" watchObservedRunningTime="2026-07-22 02:38:29.210672575 +0000 UTC m=+69.919101179"
Jul 22 02:38:29.313440 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:29.313382    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:29.413583 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:29.413501    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:29.597496 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:29.597465    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:29.697937 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:29.697860    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:29.799754 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:29.799714    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:31.198043 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:31.198014    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cjz5v" event={"ID":"58f296ac-da6c-473e-8c58-49fa164804f5","Type":"ContainerStarted","Data":"7010c54f1806d1c1ede6a1fd4319da66337ae0f58dcb8403e28f1d68d874a83e"}
Jul 22 02:38:31.199699 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:31.199677    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bdgj4" event={"ID":"b4abb13b-cb47-4cb3-9db4-c9531012e8c2","Type":"ContainerStarted","Data":"7f701271c821879db12591056c1dfb15374e733fd04850b85eecc915836ccdbd"}
Jul 22 02:38:31.199815 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:31.199800    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:38:31.225492 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:31.225443    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cjz5v" podStartSLOduration=66.043537183 podStartE2EDuration="1m12.225426513s" totalImagesPullingTime="6.18188933s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:31.223002079 +0000 UTC m=+71.931430680" watchObservedRunningTime="2026-07-22 02:38:31.225426513 +0000 UTC m=+71.933855090"
Jul 22 02:38:31.245225 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:31.245163    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bdgj4" podStartSLOduration=66.080650154 podStartE2EDuration="1m12.245142001s" totalImagesPullingTime="6.164491847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:31.244854785 +0000 UTC m=+71.953283387" watchObservedRunningTime="2026-07-22 02:38:31.245142001 +0000 UTC m=+71.953570601"
Jul 22 02:38:31.773571 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:31.773539    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:31.924100 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:31.924065    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:33.329711 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:33.329675    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:33.429355 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:33.429320    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:33.933331 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:33.933293    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:34.004416 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:34.004382    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:34.098124 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:34.098066    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:35.549792 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:35.549759    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:35.701078 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:35.701023    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:36.616108 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:36.616070    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:38.118539 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.118501    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:38.287298 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.287242    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:38.386374 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.386239    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:38.420408 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.420116    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-gz495"]
Jul 22 02:38:38.425548 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.425513    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gz495"
Jul 22 02:38:38.430630 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.430539    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 22 02:38:38.431031 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.431006    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 22 02:38:38.431132 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.431117    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 22 02:38:38.432072 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.431880    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-z5x4q\""
Jul 22 02:38:38.432072 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.431925    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 22 02:38:38.432244 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.432152    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 22 02:38:38.434889 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.433600    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-n529t"]
Jul 22 02:38:38.438618 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.438593    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-gz495"]
Jul 22 02:38:38.438760 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.438731    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.442283 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.441916    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 22 02:38:38.442283 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.442012    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 22 02:38:38.442283 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.442120    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 22 02:38:38.442283 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.442161    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9tpt9\""
Jul 22 02:38:38.448112 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.446825    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-fjcsj"]
Jul 22 02:38:38.455216 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.454584    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-fjcsj"
Jul 22 02:38:38.457273 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.457226    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 22 02:38:38.457786 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.457763    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 22 02:38:38.457917 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.457845    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-qnvg9\""
Jul 22 02:38:38.458013 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.457995    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 22 02:38:38.462441 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.462412    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-fjcsj"]
Jul 22 02:38:38.482324 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.482293    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:38.512968 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.512932    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-metrics-client-ca\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.513179 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.512983    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22f72727-dcff-475b-826d-200a3890b33e-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-fjcsj\" (UID: \"22f72727-dcff-475b-826d-200a3890b33e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fjcsj"
Jul 22 02:38:38.513179 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.513021    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22f72727-dcff-475b-826d-200a3890b33e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-fjcsj\" (UID: \"22f72727-dcff-475b-826d-200a3890b33e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fjcsj"
Jul 22 02:38:38.513179 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.513050    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/22f72727-dcff-475b-826d-200a3890b33e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-fjcsj\" (UID: \"22f72727-dcff-475b-826d-200a3890b33e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fjcsj"
Jul 22 02:38:38.513179 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.513085    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93bf60cb-40d7-48f9-a3dd-3044119c410f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-gz495\" (UID: \"93bf60cb-40d7-48f9-a3dd-3044119c410f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gz495"
Jul 22 02:38:38.513179 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.513113    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-sys\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.513179 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.513141    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-root\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.513179 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.513164    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-node-exporter-tls\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.513574 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.513192    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.513574 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.513220    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-node-exporter-wtmp\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.513574 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.513287    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/22f72727-dcff-475b-826d-200a3890b33e-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-fjcsj\" (UID: \"22f72727-dcff-475b-826d-200a3890b33e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fjcsj"
Jul 22 02:38:38.513574 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.513322    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76dvg\" (UniqueName: \"kubernetes.io/projected/93bf60cb-40d7-48f9-a3dd-3044119c410f-kube-api-access-76dvg\") pod \"openshift-state-metrics-79f6958cdf-gz495\" (UID: \"93bf60cb-40d7-48f9-a3dd-3044119c410f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gz495"
Jul 22 02:38:38.513574 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.513368    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/22f72727-dcff-475b-826d-200a3890b33e-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-fjcsj\" (UID: \"22f72727-dcff-475b-826d-200a3890b33e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fjcsj"
Jul 22 02:38:38.513574 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.513403    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-node-exporter-textfile\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.513574 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.513432    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/93bf60cb-40d7-48f9-a3dd-3044119c410f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-gz495\" (UID: \"93bf60cb-40d7-48f9-a3dd-3044119c410f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gz495"
Jul 22 02:38:38.513574 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.513467    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93bf60cb-40d7-48f9-a3dd-3044119c410f-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-gz495\" (UID: \"93bf60cb-40d7-48f9-a3dd-3044119c410f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gz495"
Jul 22 02:38:38.513574 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.513495    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.513574 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.513527    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p9hm\" (UniqueName: \"kubernetes.io/projected/22f72727-dcff-475b-826d-200a3890b33e-kube-api-access-7p9hm\") pod \"kube-state-metrics-56c5594674-fjcsj\" (UID: \"22f72727-dcff-475b-826d-200a3890b33e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fjcsj"
Jul 22 02:38:38.513574 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.513551    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m86d2\" (UniqueName: \"kubernetes.io/projected/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-kube-api-access-m86d2\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.564640 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.564602    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:38.614693 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.614652    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22f72727-dcff-475b-826d-200a3890b33e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-fjcsj\" (UID: \"22f72727-dcff-475b-826d-200a3890b33e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fjcsj"
Jul 22 02:38:38.614885 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.614708    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/22f72727-dcff-475b-826d-200a3890b33e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-fjcsj\" (UID: \"22f72727-dcff-475b-826d-200a3890b33e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fjcsj"
Jul 22 02:38:38.614885 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.614743    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93bf60cb-40d7-48f9-a3dd-3044119c410f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-gz495\" (UID: \"93bf60cb-40d7-48f9-a3dd-3044119c410f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gz495"
Jul 22 02:38:38.614885 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.614769    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-sys\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.614885 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.614827    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-sys\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.615093 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.614953    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-root\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.615093 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.614996    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-node-exporter-tls\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.615093 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.615029    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.615093 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.615064    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-node-exporter-wtmp\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.615329 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.615098    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/22f72727-dcff-475b-826d-200a3890b33e-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-fjcsj\" (UID: \"22f72727-dcff-475b-826d-200a3890b33e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fjcsj"
Jul 22 02:38:38.615329 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:38:38.615185    2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 22 02:38:38.615329 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:38:38.615281    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-node-exporter-tls podName:c2f05d08-dad3-42e1-a2a1-c1ab639992f0 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:39.115234422 +0000 UTC m=+79.823663005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-node-exporter-tls") pod "node-exporter-n529t" (UID: "c2f05d08-dad3-42e1-a2a1-c1ab639992f0") : secret "node-exporter-tls" not found
Jul 22 02:38:38.615492 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.615331    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-root\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.615492 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.615368    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76dvg\" (UniqueName: \"kubernetes.io/projected/93bf60cb-40d7-48f9-a3dd-3044119c410f-kube-api-access-76dvg\") pod \"openshift-state-metrics-79f6958cdf-gz495\" (UID: \"93bf60cb-40d7-48f9-a3dd-3044119c410f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gz495"
Jul 22 02:38:38.615492 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.615421    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/22f72727-dcff-475b-826d-200a3890b33e-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-fjcsj\" (UID: \"22f72727-dcff-475b-826d-200a3890b33e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fjcsj"
Jul 22 02:38:38.615633 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.615456    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-node-exporter-textfile\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.615633 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.615595    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/22f72727-dcff-475b-826d-200a3890b33e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-fjcsj\" (UID: \"22f72727-dcff-475b-826d-200a3890b33e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fjcsj"
Jul 22 02:38:38.615726 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.615646    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/93bf60cb-40d7-48f9-a3dd-3044119c410f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-gz495\" (UID: \"93bf60cb-40d7-48f9-a3dd-3044119c410f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gz495"
Jul 22 02:38:38.615726 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.615680    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93bf60cb-40d7-48f9-a3dd-3044119c410f-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-gz495\" (UID: \"93bf60cb-40d7-48f9-a3dd-3044119c410f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gz495"
Jul 22 02:38:38.615726 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.615706    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.615926 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.615745    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p9hm\" (UniqueName: \"kubernetes.io/projected/22f72727-dcff-475b-826d-200a3890b33e-kube-api-access-7p9hm\") pod \"kube-state-metrics-56c5594674-fjcsj\" (UID: \"22f72727-dcff-475b-826d-200a3890b33e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fjcsj"
Jul 22 02:38:38.615926 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.615775    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m86d2\" (UniqueName: \"kubernetes.io/projected/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-kube-api-access-m86d2\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.615926 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.615806    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-metrics-client-ca\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.615926 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.615848    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22f72727-dcff-475b-826d-200a3890b33e-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-fjcsj\" (UID: \"22f72727-dcff-475b-826d-200a3890b33e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fjcsj"
Jul 22 02:38:38.617013 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.616487    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/22f72727-dcff-475b-826d-200a3890b33e-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-fjcsj\" (UID: \"22f72727-dcff-475b-826d-200a3890b33e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fjcsj"
Jul 22 02:38:38.617013 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.616548    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22f72727-dcff-475b-826d-200a3890b33e-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-fjcsj\" (UID: \"22f72727-dcff-475b-826d-200a3890b33e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fjcsj"
Jul 22 02:38:38.617013 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.616803    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-node-exporter-textfile\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.617013 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.615745    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-node-exporter-wtmp\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.617013 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:38:38.616904    2577 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 22 02:38:38.617013 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:38:38.616969    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93bf60cb-40d7-48f9-a3dd-3044119c410f-openshift-state-metrics-tls podName:93bf60cb-40d7-48f9-a3dd-3044119c410f nodeName:}" failed. No retries permitted until 2026-07-22 02:38:39.116948421 +0000 UTC m=+79.825377016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/93bf60cb-40d7-48f9-a3dd-3044119c410f-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-gz495" (UID: "93bf60cb-40d7-48f9-a3dd-3044119c410f") : secret "openshift-state-metrics-tls" not found
Jul 22 02:38:38.617457 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.617080    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.617457 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.617283    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-metrics-client-ca\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.620031 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.617856    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93bf60cb-40d7-48f9-a3dd-3044119c410f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-gz495\" (UID: \"93bf60cb-40d7-48f9-a3dd-3044119c410f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gz495"
Jul 22 02:38:38.620031 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.618060    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93bf60cb-40d7-48f9-a3dd-3044119c410f-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-gz495\" (UID: \"93bf60cb-40d7-48f9-a3dd-3044119c410f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gz495"
Jul 22 02:38:38.620231 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.620202    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.620414 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.620391    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22f72727-dcff-475b-826d-200a3890b33e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-fjcsj\" (UID: \"22f72727-dcff-475b-826d-200a3890b33e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fjcsj"
Jul 22 02:38:38.620574 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.620548    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/22f72727-dcff-475b-826d-200a3890b33e-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-fjcsj\" (UID: \"22f72727-dcff-475b-826d-200a3890b33e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fjcsj"
Jul 22 02:38:38.631695 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.631666    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p9hm\" (UniqueName: \"kubernetes.io/projected/22f72727-dcff-475b-826d-200a3890b33e-kube-api-access-7p9hm\") pod \"kube-state-metrics-56c5594674-fjcsj\" (UID: \"22f72727-dcff-475b-826d-200a3890b33e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fjcsj"
Jul 22 02:38:38.632045 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.632026    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m86d2\" (UniqueName: \"kubernetes.io/projected/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-kube-api-access-m86d2\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:38.633213 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.633191    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76dvg\" (UniqueName: \"kubernetes.io/projected/93bf60cb-40d7-48f9-a3dd-3044119c410f-kube-api-access-76dvg\") pod \"openshift-state-metrics-79f6958cdf-gz495\" (UID: \"93bf60cb-40d7-48f9-a3dd-3044119c410f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gz495"
Jul 22 02:38:38.689908 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.689789    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:38.768628 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.768596    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-fjcsj"
Jul 22 02:38:38.825832 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.825794    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:38.925657 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:38.925625    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:39.026715 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.026681    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:39.121809 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.121774    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/93bf60cb-40d7-48f9-a3dd-3044119c410f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-gz495\" (UID: \"93bf60cb-40d7-48f9-a3dd-3044119c410f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gz495"
Jul 22 02:38:39.122343 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.121832    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-node-exporter-tls\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:39.124488 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.124455    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/93bf60cb-40d7-48f9-a3dd-3044119c410f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-gz495\" (UID: \"93bf60cb-40d7-48f9-a3dd-3044119c410f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gz495"
Jul 22 02:38:39.124905 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.124884    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2f05d08-dad3-42e1-a2a1-c1ab639992f0-node-exporter-tls\") pod \"node-exporter-n529t\" (UID: \"c2f05d08-dad3-42e1-a2a1-c1ab639992f0\") " pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:39.294567 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.294482    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-fjcsj"]
Jul 22 02:38:39.297363 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:38:39.297337    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22f72727_dcff_475b_826d_200a3890b33e.slice/crio-902c9cdf0947ca1d855fc9779dff88b4530ba6610639d2ebd57f120aaa9c3b67 WatchSource:0}: Error finding container 902c9cdf0947ca1d855fc9779dff88b4530ba6610639d2ebd57f120aaa9c3b67: Status 404 returned error can't find the container with id 902c9cdf0947ca1d855fc9779dff88b4530ba6610639d2ebd57f120aaa9c3b67
Jul 22 02:38:39.339212 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.339177    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gz495"
Jul 22 02:38:39.356532 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.356501    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n529t"
Jul 22 02:38:39.368730 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:38:39.368672    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2f05d08_dad3_42e1_a2a1_c1ab639992f0.slice/crio-7de8b190b6d6d70c3301bdb16fea5e506738fc3c681974913ebac73c77a73893 WatchSource:0}: Error finding container 7de8b190b6d6d70c3301bdb16fea5e506738fc3c681974913ebac73c77a73893: Status 404 returned error can't find the container with id 7de8b190b6d6d70c3301bdb16fea5e506738fc3c681974913ebac73c77a73893
Jul 22 02:38:39.502090 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.502057    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:39.508283 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.508236    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-gz495"]
Jul 22 02:38:39.511479 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:38:39.511454    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93bf60cb_40d7_48f9_a3dd_3044119c410f.slice/crio-89c03f15067b3951ba8addc5a8fd07ba16fdf8307f354c5c855884a927e2970d WatchSource:0}: Error finding container 89c03f15067b3951ba8addc5a8fd07ba16fdf8307f354c5c855884a927e2970d: Status 404 returned error can't find the container with id 89c03f15067b3951ba8addc5a8fd07ba16fdf8307f354c5c855884a927e2970d
Jul 22 02:38:39.658832 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.658804    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:39.689137 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.689101    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 02:38:39.692794 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.692771    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.707486 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.707462    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 22 02:38:39.707607 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.707537    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 22 02:38:39.707752 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.707733    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 22 02:38:39.707825 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.707733    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 22 02:38:39.707825 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.707779    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5nv8r\""
Jul 22 02:38:39.707925 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.707827    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 22 02:38:39.707925 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.707846    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 22 02:38:39.707925 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.707863    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 22 02:38:39.707925 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.707832    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 22 02:38:39.707925 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.707880    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 22 02:38:39.725734 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.725702    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 02:38:39.828020 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.827931    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/36b4a1cb-92c8-47af-b863-95368f33b573-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.828020 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.827981    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36b4a1cb-92c8-47af-b863-95368f33b573-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.828275 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.828023    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.828275 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.828061    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-config-volume\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.828275 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.828083    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36b4a1cb-92c8-47af-b863-95368f33b573-tls-assets\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.828275 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.828106    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36b4a1cb-92c8-47af-b863-95368f33b573-config-out\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.828275 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.828120    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.828275 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.828148    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.828275 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.828169    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36b4a1cb-92c8-47af-b863-95368f33b573-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.828275 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.828187    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.828275 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.828208    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-web-config\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.828275 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.828229    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.828275 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.828268    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hphmr\" (UniqueName: \"kubernetes.io/projected/36b4a1cb-92c8-47af-b863-95368f33b573-kube-api-access-hphmr\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.929132 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.929084    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-web-config\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.929345 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.929148    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.929345 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.929191    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hphmr\" (UniqueName: \"kubernetes.io/projected/36b4a1cb-92c8-47af-b863-95368f33b573-kube-api-access-hphmr\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.929345 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.929246    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/36b4a1cb-92c8-47af-b863-95368f33b573-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.929345 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.929299    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36b4a1cb-92c8-47af-b863-95368f33b573-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.929598 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.929346    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.929598 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.929382    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-config-volume\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.929598 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.929406    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36b4a1cb-92c8-47af-b863-95368f33b573-tls-assets\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.929598 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.929437    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36b4a1cb-92c8-47af-b863-95368f33b573-config-out\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.929598 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.929504    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.929598 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.929543    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.929598 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.929569    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36b4a1cb-92c8-47af-b863-95368f33b573-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.929598 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.929597    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.929980 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:38:39.929746    2577 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 22 02:38:39.929980 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:38:39.929829    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-main-tls podName:36b4a1cb-92c8-47af-b863-95368f33b573 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:40.42980556 +0000 UTC m=+81.138234160 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "36b4a1cb-92c8-47af-b863-95368f33b573") : secret "alertmanager-main-tls" not found
Jul 22 02:38:39.930601 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.930570    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/36b4a1cb-92c8-47af-b863-95368f33b573-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.931232 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.931203    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36b4a1cb-92c8-47af-b863-95368f33b573-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.931815 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.931709    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36b4a1cb-92c8-47af-b863-95368f33b573-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.935002 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.934921    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.935140 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.935029    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-config-volume\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.935661 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.935617    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.936269 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.936229    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36b4a1cb-92c8-47af-b863-95368f33b573-tls-assets\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.936372 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.936242    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.936745 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.936722    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.939133 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.939084    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36b4a1cb-92c8-47af-b863-95368f33b573-config-out\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.939900 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.939868    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-web-config\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:39.942173 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:39.942150    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hphmr\" (UniqueName: \"kubernetes.io/projected/36b4a1cb-92c8-47af-b863-95368f33b573-kube-api-access-hphmr\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:40.200323 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:40.200122    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:40.232470 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:40.232430    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-fjcsj" event={"ID":"22f72727-dcff-475b-826d-200a3890b33e","Type":"ContainerStarted","Data":"902c9cdf0947ca1d855fc9779dff88b4530ba6610639d2ebd57f120aaa9c3b67"}
Jul 22 02:38:40.235092 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:40.235049    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gz495" event={"ID":"93bf60cb-40d7-48f9-a3dd-3044119c410f","Type":"ContainerStarted","Data":"28f96c5130414f4017d113632ac83e64fe675250e5c1e5322249d8ca3e844afe"}
Jul 22 02:38:40.235264 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:40.235123    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gz495" event={"ID":"93bf60cb-40d7-48f9-a3dd-3044119c410f","Type":"ContainerStarted","Data":"5b3d899b2b1489a6accb250796c4f7b736296c405c5c42d8ab512f116e3960d9"}
Jul 22 02:38:40.235264 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:40.235155    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gz495" event={"ID":"93bf60cb-40d7-48f9-a3dd-3044119c410f","Type":"ContainerStarted","Data":"89c03f15067b3951ba8addc5a8fd07ba16fdf8307f354c5c855884a927e2970d"}
Jul 22 02:38:40.236612 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:40.236578    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n529t" event={"ID":"c2f05d08-dad3-42e1-a2a1-c1ab639992f0","Type":"ContainerStarted","Data":"7de8b190b6d6d70c3301bdb16fea5e506738fc3c681974913ebac73c77a73893"}
Jul 22 02:38:40.433484 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:40.433438    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:40.436612 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:40.436577    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:40.602228 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:40.602191    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:38:40.865629 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:40.865531    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:40.968520 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:40.968492    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:41.147869 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:41.147840    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 02:38:41.243347 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:41.243303    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-fjcsj" event={"ID":"22f72727-dcff-475b-826d-200a3890b33e","Type":"ContainerStarted","Data":"77940dc902af733fdc107b1ed8a4990677624454fd4d810ce9d76930928a1f85"}
Jul 22 02:38:41.245998 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:41.245954    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gz495" event={"ID":"93bf60cb-40d7-48f9-a3dd-3044119c410f","Type":"ContainerStarted","Data":"7dc2574ac2ebef0f7e2d47ae33983eeb88ef10dd5cdc0ed89dd48cdd1b596788"}
Jul 22 02:38:41.247743 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:41.247673    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n529t" event={"ID":"c2f05d08-dad3-42e1-a2a1-c1ab639992f0","Type":"ContainerStarted","Data":"260afc55def82687305ad63964c01ef0d08bf136530cdd4b82b1c2355bab2bea"}
Jul 22 02:38:41.347213 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:41.347155    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gz495" podStartSLOduration=1.975498227 podStartE2EDuration="3.347132999s" totalImagesPullingTime="1.371634772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:41.291205955 +0000 UTC m=+81.999634556" watchObservedRunningTime="2026-07-22 02:38:41.347132999 +0000 UTC m=+82.055561600"
Jul 22 02:38:41.383073 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:41.383024    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:41.540831 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:41.540746    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:41.640523 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:41.640475    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:41.866389 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:41.866300    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:41.967212 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:41.967183    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:42.067174 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:42.067100    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:42.265619 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:38:42.265582    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b4a1cb_92c8_47af_b863_95368f33b573.slice/crio-f794c0250391e74cbe3c89f6ebff1f593a2e439004a864150793e6eab796c36e WatchSource:0}: Error finding container f794c0250391e74cbe3c89f6ebff1f593a2e439004a864150793e6eab796c36e: Status 404 returned error can't find the container with id f794c0250391e74cbe3c89f6ebff1f593a2e439004a864150793e6eab796c36e
Jul 22 02:38:42.513354 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:42.513327    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:43.159964 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:43.159926    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:43.256680 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:43.256619    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36b4a1cb-92c8-47af-b863-95368f33b573","Type":"ContainerStarted","Data":"f794c0250391e74cbe3c89f6ebff1f593a2e439004a864150793e6eab796c36e"}
Jul 22 02:38:43.259176 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:43.259146    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6" event={"ID":"beb36780-d158-4411-8e03-e660caa40df1","Type":"ContainerStarted","Data":"d716a60bca491e5527c9980b58d0b808097ed0412513718709964a4ebd31ab9c"}
Jul 22 02:38:43.259342 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:43.259188    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6" event={"ID":"beb36780-d158-4411-8e03-e660caa40df1","Type":"ContainerStarted","Data":"943772b08a6034fd9ca0795a851ac57055fa898db01ff87e446ccbf02a15849a"}
Jul 22 02:38:43.259342 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:43.259206    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6" event={"ID":"beb36780-d158-4411-8e03-e660caa40df1","Type":"ContainerStarted","Data":"32f10f4ed4c105d518abb7ac70dacefff804be0aac228b2868746d9c4e3e42c4"}
Jul 22 02:38:43.261153 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:43.261127    2577 generic.go:356] "Generic (PLEG): container finished" podID="c2f05d08-dad3-42e1-a2a1-c1ab639992f0" containerID="260afc55def82687305ad63964c01ef0d08bf136530cdd4b82b1c2355bab2bea" exitCode=0
Jul 22 02:38:43.261313 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:43.261206    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n529t" event={"ID":"c2f05d08-dad3-42e1-a2a1-c1ab639992f0","Type":"ContainerDied","Data":"260afc55def82687305ad63964c01ef0d08bf136530cdd4b82b1c2355bab2bea"}
Jul 22 02:38:43.263929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:43.263892    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-fjcsj" event={"ID":"22f72727-dcff-475b-826d-200a3890b33e","Type":"ContainerStarted","Data":"693efb03804f7d79c8f29be5d2ba0ff4a51afd5d31577045e904028dfccc6995"}
Jul 22 02:38:43.264039 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:43.263949    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-fjcsj" event={"ID":"22f72727-dcff-475b-826d-200a3890b33e","Type":"ContainerStarted","Data":"d8a16a4835e1e2e183c2071f042f9caf798f16177a2d11707ced8097a50c99b1"}
Jul 22 02:38:43.273664 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:43.273635    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:43.287968 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:43.287909    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d787f6b-4jkp6" podStartSLOduration=1.6802967629999999 podStartE2EDuration="20.28789325s" totalImagesPullingTime="18.607596487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:38:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:43.286862312 +0000 UTC m=+83.995290914" watchObservedRunningTime="2026-07-22 02:38:43.28789325 +0000 UTC m=+83.996321850"
Jul 22 02:38:43.349619 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:43.349560    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-fjcsj" podStartSLOduration=3.689826411 podStartE2EDuration="5.349541257s" totalImagesPullingTime="1.659714846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:43.348432659 +0000 UTC m=+84.056861259" watchObservedRunningTime="2026-07-22 02:38:43.349541257 +0000 UTC m=+84.057969871"
Jul 22 02:38:43.867160 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:43.867128    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:44.270237 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.270209    2577 generic.go:356] "Generic (PLEG): container finished" podID="36b4a1cb-92c8-47af-b863-95368f33b573" containerID="a1bccccd945b92c20a6a509bcac945edd9116f9827782490eb7dfad4aea68c15" exitCode=0
Jul 22 02:38:44.270384 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.270300    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36b4a1cb-92c8-47af-b863-95368f33b573","Type":"ContainerDied","Data":"a1bccccd945b92c20a6a509bcac945edd9116f9827782490eb7dfad4aea68c15"}
Jul 22 02:38:44.272675 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.272655    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n529t" event={"ID":"c2f05d08-dad3-42e1-a2a1-c1ab639992f0","Type":"ContainerStarted","Data":"aca05a3920b0bf4df2616372eac4b60213843a45aeaa15b3017b304145359510"}
Jul 22 02:38:44.272765 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.272703    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n529t" event={"ID":"c2f05d08-dad3-42e1-a2a1-c1ab639992f0","Type":"ContainerStarted","Data":"88db171eb567c365a3f3b7b00dca6f1620148f3ffc05ecb754a31f1cdac19100"}
Jul 22 02:38:44.328598 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.328542    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-n529t" podStartSLOduration=4.651825141 podStartE2EDuration="6.328524498s" totalImagesPullingTime="1.588125698s" totalInitContainerRuntime="88.573659ms" isStatefulPod=true podCreationTimestamp="2026-07-22 02:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:44.328045383 +0000 UTC m=+85.036474008" watchObservedRunningTime="2026-07-22 02:38:44.328524498 +0000 UTC m=+85.036953109"
Jul 22 02:38:44.885935 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.884854    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 02:38:44.886980 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.886945    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:44.890007 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.889985    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:44.893677 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.893641    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 22 02:38:44.893677 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.893663    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3sirg10fuq68a\""
Jul 22 02:38:44.893866 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.893647    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 22 02:38:44.893866 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.893692    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 22 02:38:44.893866 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.893649    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 22 02:38:44.893866 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.893647    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 22 02:38:44.894045 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.894029    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 22 02:38:44.894083 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.894047    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 22 02:38:44.894491 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.894478    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 22 02:38:44.894900 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.894725    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 22 02:38:44.894900 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.894744    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ksznj\""
Jul 22 02:38:44.894900 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.894758    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 22 02:38:44.894900 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.894773    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 22 02:38:44.894900 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.894760    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 22 02:38:44.894900 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.894764    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 22 02:38:44.897224 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.897203    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 22 02:38:44.901282 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.901242    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 22 02:38:44.902521 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.902499    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 02:38:44.977687 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.977654    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:44.977892 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.977737    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:44.977892 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.977777    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:44.977892 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.977811    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-config-out\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:44.977892 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.977834    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:44.978075 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.977906    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:44.978075 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.977952    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-config\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:44.978075 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.977981    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:44.978075 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.978011    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh5hx\" (UniqueName: \"kubernetes.io/projected/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-kube-api-access-hh5hx\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:44.978075 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.978047    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-web-config\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:44.978319 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.978077    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:44.978319 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.978134    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:44.978319 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.978160    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:44.978319 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.978183    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:44.978319 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.978233    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:44.978319 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.978279    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:44.978319 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.978311    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:44.978606 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.978326    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:44.978606 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.978364    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:44.978606 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:44.978393    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.078854 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.078814    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.078854 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.078860    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.079102 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.078879    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.079102 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.078897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.079102 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.078919    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-config-out\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.079102 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.078934    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.079102 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.078963    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.079102 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.078991    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-config\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.079102 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.079016    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.079102 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.079044    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh5hx\" (UniqueName: \"kubernetes.io/projected/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-kube-api-access-hh5hx\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.079102 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.079084    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-web-config\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.079595 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.079114    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.079595 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.079159    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.079595 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.079184    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.079595 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.079205    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.079595 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.079231    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.079595 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.079284    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.079595 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.079318    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.079595 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.079345    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.079595 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.079375    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.079595 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.079382    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.080058 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.080031    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.080112 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.080070    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.081188 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.081154    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.081655 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.081624    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.082721 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.082305    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-config-out\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.082721 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.082597    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.082721 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.082634    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.083064 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.083017    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.083219 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.083193    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.083935 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.083624    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-web-config\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.083935 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.083897    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.084070 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.084021    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.084844 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.084745    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-config\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.084944 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.084879    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.085266 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.085226    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.085644 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.085626    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.085805 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.085788    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.086233 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.086216    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.089680 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.089660    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh5hx\" (UniqueName: \"kubernetes.io/projected/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-kube-api-access-hh5hx\") pod \"prometheus-k8s-0\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.199926 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.199841    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:45.264952 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.264915    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:45.322094 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.322059    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:45.367730 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:45.367707    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 02:38:45.370496 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:38:45.370458    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda08a8b10_228a_4ff9_bfb4_5d48c5ba8312.slice/crio-6b8a2de0068df09ea54322f9599dffd14d19ee82b759cb6742db1e360d820feb WatchSource:0}: Error finding container 6b8a2de0068df09ea54322f9599dffd14d19ee82b759cb6742db1e360d820feb: Status 404 returned error can't find the container with id 6b8a2de0068df09ea54322f9599dffd14d19ee82b759cb6742db1e360d820feb
Jul 22 02:38:46.038532 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:46.038477    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:46.126595 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:46.126566    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:46.287784 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:46.287744    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36b4a1cb-92c8-47af-b863-95368f33b573","Type":"ContainerStarted","Data":"092d574c94296607f0de156208ef0f311b62aefa450051a0f34fda2d4a39229b"}
Jul 22 02:38:46.287979 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:46.287855    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36b4a1cb-92c8-47af-b863-95368f33b573","Type":"ContainerStarted","Data":"1d4a01792e7e4edf0774248a315a0defdf10660f9badde5a2d2d9ccae47d9b10"}
Jul 22 02:38:46.287979 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:46.287887    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36b4a1cb-92c8-47af-b863-95368f33b573","Type":"ContainerStarted","Data":"8c1eb3b9a9fbb8a88e05865d3ba81417be44562afe48989191f4d0dc08e0ffbe"}
Jul 22 02:38:46.287979 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:46.287913    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36b4a1cb-92c8-47af-b863-95368f33b573","Type":"ContainerStarted","Data":"5e88b5c803be20185c5add651ede7ec7710cda3f6999a59030242bed708e40c9"}
Jul 22 02:38:46.287979 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:46.287947    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36b4a1cb-92c8-47af-b863-95368f33b573","Type":"ContainerStarted","Data":"840429aa8d6552a0e491f8edfc9bd1c8e28b89ac08d73ced190b6440735c5407"}
Jul 22 02:38:46.289282 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:46.289233    2577 generic.go:356] "Generic (PLEG): container finished" podID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerID="12eda12b1ed811b4dbdd7bdeed3f9ad2f8c3c4854ea453a6903aaab4d1fa43e1" exitCode=0
Jul 22 02:38:46.289389 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:46.289313    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312","Type":"ContainerDied","Data":"12eda12b1ed811b4dbdd7bdeed3f9ad2f8c3c4854ea453a6903aaab4d1fa43e1"}
Jul 22 02:38:46.289389 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:46.289358    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312","Type":"ContainerStarted","Data":"6b8a2de0068df09ea54322f9599dffd14d19ee82b759cb6742db1e360d820feb"}
Jul 22 02:38:46.654565 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:46.654535    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:46.727086 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:46.727051    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:48.302815 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:48.302782    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36b4a1cb-92c8-47af-b863-95368f33b573","Type":"ContainerStarted","Data":"2c0518c6ce6449e4ea37ce3b5d2989aef9283880a56d72be19021a216788723c"}
Jul 22 02:38:48.335070 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:48.335019    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.457011377 podStartE2EDuration="9.335002739s" totalImagesPullingTime="3.86205362s" totalInitContainerRuntime="15.937742ms" isStatefulPod=false podCreationTimestamp="2026-07-22 02:38:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:48.334217404 +0000 UTC m=+89.042646005" watchObservedRunningTime="2026-07-22 02:38:48.335002739 +0000 UTC m=+89.043431393"
Jul 22 02:38:48.635874 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:48.635783    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:48.732383 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:48.732343    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:48.804811 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:48.804778    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:48.967744 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:48.967660    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:49.068817 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:49.068782    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:49.169837 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:49.169804    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:50.313704 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:50.313664    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312","Type":"ContainerStarted","Data":"be1b95a699d4c250c7a20ffe873df8778e96fd15229b0bf555a2f182aef5f74a"}
Jul 22 02:38:50.314182 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:50.313757    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312","Type":"ContainerStarted","Data":"fea8c1a673dd40f2baa43564f54de20f1f9197a6245aac3ce355661bb5a2128a"}
Jul 22 02:38:51.172782 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:51.172745    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:51.273022 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:51.272975    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:52.325969 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:52.325936    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312","Type":"ContainerStarted","Data":"8fdeb9b27cb7a65db08df400f5641a3499e7f398c100d8dcf8a3b97621ab2a05"}
Jul 22 02:38:52.326387 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:52.325996    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312","Type":"ContainerStarted","Data":"704b4c0b7e51fcc40998110a2ddc334fbae8839e6510ed7448e9f2336e55b813"}
Jul 22 02:38:52.326387 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:52.326024    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312","Type":"ContainerStarted","Data":"f4d03e6f540f8a2b7dbb7bdf5e22c215d497f5195c2d83e1a720e31391b5b083"}
Jul 22 02:38:52.326387 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:52.326049    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312","Type":"ContainerStarted","Data":"2a0f3c71137a00f265e538754a2a6323c3706b9f144875fc7743a2643e507d62"}
Jul 22 02:38:52.364383 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:52.364323    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.290841694 podStartE2EDuration="8.364305606s" totalImagesPullingTime="5.05324428s" totalInitContainerRuntime="20.219632ms" isStatefulPod=false podCreationTimestamp="2026-07-22 02:38:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:52.362658134 +0000 UTC m=+93.071086736" watchObservedRunningTime="2026-07-22 02:38:52.364305606 +0000 UTC m=+93.072734205"
Jul 22 02:38:55.200153 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:55.200112    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:38:55.672407 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:55.672371    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:55.729223 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:55.729192    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:56.432973 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:56.432944    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:56.512504 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:56.512472    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:56.738502 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:56.738419    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:56.837338 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:56.837296    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:38:56.895809 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:38:56.895779    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:39:02.204999 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:39:02.204970    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bdgj4"
Jul 22 02:39:11.436370 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:39:11.436338    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:39:11.499978 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:39:11.499914    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:39:45.201079 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:39:45.201030    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:39:45.221279 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:39:45.221230    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:39:45.546583 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:39:45.546550    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:39:57.870553 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:39:57.870515    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:39:58.432087 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:39:58.432054    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:39:58.993141 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:39:58.993095    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 02:39:58.993546 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:39:58.993420    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" containerName="alertmanager" containerID="cri-o://840429aa8d6552a0e491f8edfc9bd1c8e28b89ac08d73ced190b6440735c5407" gracePeriod=120
Jul 22 02:39:58.993546 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:39:58.993511    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" containerName="kube-rbac-proxy-web" containerID="cri-o://8c1eb3b9a9fbb8a88e05865d3ba81417be44562afe48989191f4d0dc08e0ffbe" gracePeriod=120
Jul 22 02:39:58.993667 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:39:58.993538    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" containerName="kube-rbac-proxy" containerID="cri-o://1d4a01792e7e4edf0774248a315a0defdf10660f9badde5a2d2d9ccae47d9b10" gracePeriod=120
Jul 22 02:39:58.993667 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:39:58.993565    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" containerName="prom-label-proxy" containerID="cri-o://2c0518c6ce6449e4ea37ce3b5d2989aef9283880a56d72be19021a216788723c" gracePeriod=120
Jul 22 02:39:58.993667 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:39:58.993569    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" containerName="config-reloader" containerID="cri-o://5e88b5c803be20185c5add651ede7ec7710cda3f6999a59030242bed708e40c9" gracePeriod=120
Jul 22 02:39:58.993815 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:39:58.993480    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" containerName="kube-rbac-proxy-metric" containerID="cri-o://092d574c94296607f0de156208ef0f311b62aefa450051a0f34fda2d4a39229b" gracePeriod=120
Jul 22 02:39:59.583767 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:39:59.583737    2577 generic.go:356] "Generic (PLEG): container finished" podID="36b4a1cb-92c8-47af-b863-95368f33b573" containerID="2c0518c6ce6449e4ea37ce3b5d2989aef9283880a56d72be19021a216788723c" exitCode=0
Jul 22 02:39:59.583767 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:39:59.583762    2577 generic.go:356] "Generic (PLEG): container finished" podID="36b4a1cb-92c8-47af-b863-95368f33b573" containerID="1d4a01792e7e4edf0774248a315a0defdf10660f9badde5a2d2d9ccae47d9b10" exitCode=0
Jul 22 02:39:59.583767 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:39:59.583769    2577 generic.go:356] "Generic (PLEG): container finished" podID="36b4a1cb-92c8-47af-b863-95368f33b573" containerID="5e88b5c803be20185c5add651ede7ec7710cda3f6999a59030242bed708e40c9" exitCode=0
Jul 22 02:39:59.583767 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:39:59.583775    2577 generic.go:356] "Generic (PLEG): container finished" podID="36b4a1cb-92c8-47af-b863-95368f33b573" containerID="840429aa8d6552a0e491f8edfc9bd1c8e28b89ac08d73ced190b6440735c5407" exitCode=0
Jul 22 02:39:59.584030 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:39:59.583817    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36b4a1cb-92c8-47af-b863-95368f33b573","Type":"ContainerDied","Data":"2c0518c6ce6449e4ea37ce3b5d2989aef9283880a56d72be19021a216788723c"}
Jul 22 02:39:59.584030 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:39:59.583880    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36b4a1cb-92c8-47af-b863-95368f33b573","Type":"ContainerDied","Data":"1d4a01792e7e4edf0774248a315a0defdf10660f9badde5a2d2d9ccae47d9b10"}
Jul 22 02:39:59.584030 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:39:59.583909    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36b4a1cb-92c8-47af-b863-95368f33b573","Type":"ContainerDied","Data":"5e88b5c803be20185c5add651ede7ec7710cda3f6999a59030242bed708e40c9"}
Jul 22 02:39:59.584030 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:39:59.583934    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36b4a1cb-92c8-47af-b863-95368f33b573","Type":"ContainerDied","Data":"840429aa8d6552a0e491f8edfc9bd1c8e28b89ac08d73ced190b6440735c5407"}
Jul 22 02:40:00.246148 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.246115    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.325169 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.325067    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36b4a1cb-92c8-47af-b863-95368f33b573-metrics-client-ca\") pod \"36b4a1cb-92c8-47af-b863-95368f33b573\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") "
Jul 22 02:40:00.325169 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.325110    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-kube-rbac-proxy\") pod \"36b4a1cb-92c8-47af-b863-95368f33b573\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") "
Jul 22 02:40:00.325169 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.325140    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/36b4a1cb-92c8-47af-b863-95368f33b573-alertmanager-main-db\") pod \"36b4a1cb-92c8-47af-b863-95368f33b573\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") "
Jul 22 02:40:00.325169 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.325157    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36b4a1cb-92c8-47af-b863-95368f33b573-tls-assets\") pod \"36b4a1cb-92c8-47af-b863-95368f33b573\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") "
Jul 22 02:40:00.325664 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.325191    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-config-volume\") pod \"36b4a1cb-92c8-47af-b863-95368f33b573\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") "
Jul 22 02:40:00.325664 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.325241    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-kube-rbac-proxy-web\") pod \"36b4a1cb-92c8-47af-b863-95368f33b573\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") "
Jul 22 02:40:00.325664 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.325282    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-web-config\") pod \"36b4a1cb-92c8-47af-b863-95368f33b573\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") "
Jul 22 02:40:00.325664 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.325336    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-kube-rbac-proxy-metric\") pod \"36b4a1cb-92c8-47af-b863-95368f33b573\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") "
Jul 22 02:40:00.325664 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.325367    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-main-tls\") pod \"36b4a1cb-92c8-47af-b863-95368f33b573\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") "
Jul 22 02:40:00.325664 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.325405    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36b4a1cb-92c8-47af-b863-95368f33b573-alertmanager-trusted-ca-bundle\") pod \"36b4a1cb-92c8-47af-b863-95368f33b573\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") "
Jul 22 02:40:00.325664 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.325431    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-cluster-tls-config\") pod \"36b4a1cb-92c8-47af-b863-95368f33b573\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") "
Jul 22 02:40:00.325664 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.325470    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hphmr\" (UniqueName: \"kubernetes.io/projected/36b4a1cb-92c8-47af-b863-95368f33b573-kube-api-access-hphmr\") pod \"36b4a1cb-92c8-47af-b863-95368f33b573\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") "
Jul 22 02:40:00.325664 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.325497    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36b4a1cb-92c8-47af-b863-95368f33b573-config-out\") pod \"36b4a1cb-92c8-47af-b863-95368f33b573\" (UID: \"36b4a1cb-92c8-47af-b863-95368f33b573\") "
Jul 22 02:40:00.325664 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.325573    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36b4a1cb-92c8-47af-b863-95368f33b573-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "36b4a1cb-92c8-47af-b863-95368f33b573" (UID: "36b4a1cb-92c8-47af-b863-95368f33b573"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 02:40:00.325664 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.325601    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36b4a1cb-92c8-47af-b863-95368f33b573-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "36b4a1cb-92c8-47af-b863-95368f33b573" (UID: "36b4a1cb-92c8-47af-b863-95368f33b573"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 02:40:00.326226 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.325944    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36b4a1cb-92c8-47af-b863-95368f33b573-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "36b4a1cb-92c8-47af-b863-95368f33b573" (UID: "36b4a1cb-92c8-47af-b863-95368f33b573"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 02:40:00.326226 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.325948    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36b4a1cb-92c8-47af-b863-95368f33b573-metrics-client-ca\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:00.326226 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.325987    2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/36b4a1cb-92c8-47af-b863-95368f33b573-alertmanager-main-db\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:00.330004 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.329495    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36b4a1cb-92c8-47af-b863-95368f33b573-config-out" (OuterVolumeSpecName: "config-out") pod "36b4a1cb-92c8-47af-b863-95368f33b573" (UID: "36b4a1cb-92c8-47af-b863-95368f33b573"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 02:40:00.330004 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.329633    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "36b4a1cb-92c8-47af-b863-95368f33b573" (UID: "36b4a1cb-92c8-47af-b863-95368f33b573"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:40:00.330004 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.329864    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-config-volume" (OuterVolumeSpecName: "config-volume") pod "36b4a1cb-92c8-47af-b863-95368f33b573" (UID: "36b4a1cb-92c8-47af-b863-95368f33b573"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:40:00.330639 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.330598    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36b4a1cb-92c8-47af-b863-95368f33b573-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "36b4a1cb-92c8-47af-b863-95368f33b573" (UID: "36b4a1cb-92c8-47af-b863-95368f33b573"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 02:40:00.330639 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.330628    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36b4a1cb-92c8-47af-b863-95368f33b573-kube-api-access-hphmr" (OuterVolumeSpecName: "kube-api-access-hphmr") pod "36b4a1cb-92c8-47af-b863-95368f33b573" (UID: "36b4a1cb-92c8-47af-b863-95368f33b573"). InnerVolumeSpecName "kube-api-access-hphmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 02:40:00.330810 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.330761    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "36b4a1cb-92c8-47af-b863-95368f33b573" (UID: "36b4a1cb-92c8-47af-b863-95368f33b573"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:40:00.330929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.330904    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "36b4a1cb-92c8-47af-b863-95368f33b573" (UID: "36b4a1cb-92c8-47af-b863-95368f33b573"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:40:00.332499 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.332458    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "36b4a1cb-92c8-47af-b863-95368f33b573" (UID: "36b4a1cb-92c8-47af-b863-95368f33b573"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:40:00.333755 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.333604    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "36b4a1cb-92c8-47af-b863-95368f33b573" (UID: "36b4a1cb-92c8-47af-b863-95368f33b573"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:40:00.340177 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.340156    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-web-config" (OuterVolumeSpecName: "web-config") pod "36b4a1cb-92c8-47af-b863-95368f33b573" (UID: "36b4a1cb-92c8-47af-b863-95368f33b573"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:40:00.426510 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.426473    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:00.426510 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.426503    2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-web-config\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:00.426510 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.426513    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:00.426510 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.426524    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-main-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:00.426782 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.426533    2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36b4a1cb-92c8-47af-b863-95368f33b573-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:00.426782 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.426542    2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-cluster-tls-config\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:00.426782 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.426552    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hphmr\" (UniqueName: \"kubernetes.io/projected/36b4a1cb-92c8-47af-b863-95368f33b573-kube-api-access-hphmr\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:00.426782 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.426561    2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36b4a1cb-92c8-47af-b863-95368f33b573-config-out\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:00.426782 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.426569    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:00.426782 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.426577    2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36b4a1cb-92c8-47af-b863-95368f33b573-tls-assets\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:00.426782 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.426585    2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/36b4a1cb-92c8-47af-b863-95368f33b573-config-volume\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:00.590235 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.590146    2577 generic.go:356] "Generic (PLEG): container finished" podID="36b4a1cb-92c8-47af-b863-95368f33b573" containerID="092d574c94296607f0de156208ef0f311b62aefa450051a0f34fda2d4a39229b" exitCode=0
Jul 22 02:40:00.590235 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.590175    2577 generic.go:356] "Generic (PLEG): container finished" podID="36b4a1cb-92c8-47af-b863-95368f33b573" containerID="8c1eb3b9a9fbb8a88e05865d3ba81417be44562afe48989191f4d0dc08e0ffbe" exitCode=0
Jul 22 02:40:00.590235 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.590220    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.590235 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.590218    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36b4a1cb-92c8-47af-b863-95368f33b573","Type":"ContainerDied","Data":"092d574c94296607f0de156208ef0f311b62aefa450051a0f34fda2d4a39229b"}
Jul 22 02:40:00.590480 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.590321    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36b4a1cb-92c8-47af-b863-95368f33b573","Type":"ContainerDied","Data":"8c1eb3b9a9fbb8a88e05865d3ba81417be44562afe48989191f4d0dc08e0ffbe"}
Jul 22 02:40:00.590480 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.590350    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36b4a1cb-92c8-47af-b863-95368f33b573","Type":"ContainerDied","Data":"f794c0250391e74cbe3c89f6ebff1f593a2e439004a864150793e6eab796c36e"}
Jul 22 02:40:00.590480 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.590396    2577 scope.go:117] "RemoveContainer" containerID="2c0518c6ce6449e4ea37ce3b5d2989aef9283880a56d72be19021a216788723c"
Jul 22 02:40:00.599363 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.599341    2577 scope.go:117] "RemoveContainer" containerID="092d574c94296607f0de156208ef0f311b62aefa450051a0f34fda2d4a39229b"
Jul 22 02:40:00.607544 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.607364    2577 scope.go:117] "RemoveContainer" containerID="1d4a01792e7e4edf0774248a315a0defdf10660f9badde5a2d2d9ccae47d9b10"
Jul 22 02:40:00.614298 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.614269    2577 scope.go:117] "RemoveContainer" containerID="8c1eb3b9a9fbb8a88e05865d3ba81417be44562afe48989191f4d0dc08e0ffbe"
Jul 22 02:40:00.620366 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.620342    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 02:40:00.622555 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.622536    2577 scope.go:117] "RemoveContainer" containerID="5e88b5c803be20185c5add651ede7ec7710cda3f6999a59030242bed708e40c9"
Jul 22 02:40:00.628631 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.628605    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 02:40:00.632474 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.632450    2577 scope.go:117] "RemoveContainer" containerID="840429aa8d6552a0e491f8edfc9bd1c8e28b89ac08d73ced190b6440735c5407"
Jul 22 02:40:00.640214 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.640196    2577 scope.go:117] "RemoveContainer" containerID="a1bccccd945b92c20a6a509bcac945edd9116f9827782490eb7dfad4aea68c15"
Jul 22 02:40:00.647325 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.647302    2577 scope.go:117] "RemoveContainer" containerID="2c0518c6ce6449e4ea37ce3b5d2989aef9283880a56d72be19021a216788723c"
Jul 22 02:40:00.647613 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:40:00.647591    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c0518c6ce6449e4ea37ce3b5d2989aef9283880a56d72be19021a216788723c\": container with ID starting with 2c0518c6ce6449e4ea37ce3b5d2989aef9283880a56d72be19021a216788723c not found: ID does not exist" containerID="2c0518c6ce6449e4ea37ce3b5d2989aef9283880a56d72be19021a216788723c"
Jul 22 02:40:00.647675 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.647623    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c0518c6ce6449e4ea37ce3b5d2989aef9283880a56d72be19021a216788723c"} err="failed to get container status \"2c0518c6ce6449e4ea37ce3b5d2989aef9283880a56d72be19021a216788723c\": rpc error: code = NotFound desc = could not find container \"2c0518c6ce6449e4ea37ce3b5d2989aef9283880a56d72be19021a216788723c\": container with ID starting with 2c0518c6ce6449e4ea37ce3b5d2989aef9283880a56d72be19021a216788723c not found: ID does not exist"
Jul 22 02:40:00.647675 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.647658    2577 scope.go:117] "RemoveContainer" containerID="092d574c94296607f0de156208ef0f311b62aefa450051a0f34fda2d4a39229b"
Jul 22 02:40:00.647891 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:40:00.647871    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"092d574c94296607f0de156208ef0f311b62aefa450051a0f34fda2d4a39229b\": container with ID starting with 092d574c94296607f0de156208ef0f311b62aefa450051a0f34fda2d4a39229b not found: ID does not exist" containerID="092d574c94296607f0de156208ef0f311b62aefa450051a0f34fda2d4a39229b"
Jul 22 02:40:00.647960 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.647898    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"092d574c94296607f0de156208ef0f311b62aefa450051a0f34fda2d4a39229b"} err="failed to get container status \"092d574c94296607f0de156208ef0f311b62aefa450051a0f34fda2d4a39229b\": rpc error: code = NotFound desc = could not find container \"092d574c94296607f0de156208ef0f311b62aefa450051a0f34fda2d4a39229b\": container with ID starting with 092d574c94296607f0de156208ef0f311b62aefa450051a0f34fda2d4a39229b not found: ID does not exist"
Jul 22 02:40:00.647960 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.647917    2577 scope.go:117] "RemoveContainer" containerID="1d4a01792e7e4edf0774248a315a0defdf10660f9badde5a2d2d9ccae47d9b10"
Jul 22 02:40:00.648140 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:40:00.648124    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d4a01792e7e4edf0774248a315a0defdf10660f9badde5a2d2d9ccae47d9b10\": container with ID starting with 1d4a01792e7e4edf0774248a315a0defdf10660f9badde5a2d2d9ccae47d9b10 not found: ID does not exist" containerID="1d4a01792e7e4edf0774248a315a0defdf10660f9badde5a2d2d9ccae47d9b10"
Jul 22 02:40:00.648186 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.648144    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d4a01792e7e4edf0774248a315a0defdf10660f9badde5a2d2d9ccae47d9b10"} err="failed to get container status \"1d4a01792e7e4edf0774248a315a0defdf10660f9badde5a2d2d9ccae47d9b10\": rpc error: code = NotFound desc = could not find container \"1d4a01792e7e4edf0774248a315a0defdf10660f9badde5a2d2d9ccae47d9b10\": container with ID starting with 1d4a01792e7e4edf0774248a315a0defdf10660f9badde5a2d2d9ccae47d9b10 not found: ID does not exist"
Jul 22 02:40:00.648186 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.648160    2577 scope.go:117] "RemoveContainer" containerID="8c1eb3b9a9fbb8a88e05865d3ba81417be44562afe48989191f4d0dc08e0ffbe"
Jul 22 02:40:00.648700 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:40:00.648680    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c1eb3b9a9fbb8a88e05865d3ba81417be44562afe48989191f4d0dc08e0ffbe\": container with ID starting with 8c1eb3b9a9fbb8a88e05865d3ba81417be44562afe48989191f4d0dc08e0ffbe not found: ID does not exist" containerID="8c1eb3b9a9fbb8a88e05865d3ba81417be44562afe48989191f4d0dc08e0ffbe"
Jul 22 02:40:00.648777 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.648701    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c1eb3b9a9fbb8a88e05865d3ba81417be44562afe48989191f4d0dc08e0ffbe"} err="failed to get container status \"8c1eb3b9a9fbb8a88e05865d3ba81417be44562afe48989191f4d0dc08e0ffbe\": rpc error: code = NotFound desc = could not find container \"8c1eb3b9a9fbb8a88e05865d3ba81417be44562afe48989191f4d0dc08e0ffbe\": container with ID starting with 8c1eb3b9a9fbb8a88e05865d3ba81417be44562afe48989191f4d0dc08e0ffbe not found: ID does not exist"
Jul 22 02:40:00.648777 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.648716    2577 scope.go:117] "RemoveContainer" containerID="5e88b5c803be20185c5add651ede7ec7710cda3f6999a59030242bed708e40c9"
Jul 22 02:40:00.648932 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:40:00.648914    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e88b5c803be20185c5add651ede7ec7710cda3f6999a59030242bed708e40c9\": container with ID starting with 5e88b5c803be20185c5add651ede7ec7710cda3f6999a59030242bed708e40c9 not found: ID does not exist" containerID="5e88b5c803be20185c5add651ede7ec7710cda3f6999a59030242bed708e40c9"
Jul 22 02:40:00.648968 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.648936    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e88b5c803be20185c5add651ede7ec7710cda3f6999a59030242bed708e40c9"} err="failed to get container status \"5e88b5c803be20185c5add651ede7ec7710cda3f6999a59030242bed708e40c9\": rpc error: code = NotFound desc = could not find container \"5e88b5c803be20185c5add651ede7ec7710cda3f6999a59030242bed708e40c9\": container with ID starting with 5e88b5c803be20185c5add651ede7ec7710cda3f6999a59030242bed708e40c9 not found: ID does not exist"
Jul 22 02:40:00.648968 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.648948    2577 scope.go:117] "RemoveContainer" containerID="840429aa8d6552a0e491f8edfc9bd1c8e28b89ac08d73ced190b6440735c5407"
Jul 22 02:40:00.649162 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:40:00.649147    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"840429aa8d6552a0e491f8edfc9bd1c8e28b89ac08d73ced190b6440735c5407\": container with ID starting with 840429aa8d6552a0e491f8edfc9bd1c8e28b89ac08d73ced190b6440735c5407 not found: ID does not exist" containerID="840429aa8d6552a0e491f8edfc9bd1c8e28b89ac08d73ced190b6440735c5407"
Jul 22 02:40:00.649199 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.649164    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"840429aa8d6552a0e491f8edfc9bd1c8e28b89ac08d73ced190b6440735c5407"} err="failed to get container status \"840429aa8d6552a0e491f8edfc9bd1c8e28b89ac08d73ced190b6440735c5407\": rpc error: code = NotFound desc = could not find container \"840429aa8d6552a0e491f8edfc9bd1c8e28b89ac08d73ced190b6440735c5407\": container with ID starting with 840429aa8d6552a0e491f8edfc9bd1c8e28b89ac08d73ced190b6440735c5407 not found: ID does not exist"
Jul 22 02:40:00.649199 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.649176    2577 scope.go:117] "RemoveContainer" containerID="a1bccccd945b92c20a6a509bcac945edd9116f9827782490eb7dfad4aea68c15"
Jul 22 02:40:00.649406 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:40:00.649390    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1bccccd945b92c20a6a509bcac945edd9116f9827782490eb7dfad4aea68c15\": container with ID starting with a1bccccd945b92c20a6a509bcac945edd9116f9827782490eb7dfad4aea68c15 not found: ID does not exist" containerID="a1bccccd945b92c20a6a509bcac945edd9116f9827782490eb7dfad4aea68c15"
Jul 22 02:40:00.649443 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.649410    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1bccccd945b92c20a6a509bcac945edd9116f9827782490eb7dfad4aea68c15"} err="failed to get container status \"a1bccccd945b92c20a6a509bcac945edd9116f9827782490eb7dfad4aea68c15\": rpc error: code = NotFound desc = could not find container \"a1bccccd945b92c20a6a509bcac945edd9116f9827782490eb7dfad4aea68c15\": container with ID starting with a1bccccd945b92c20a6a509bcac945edd9116f9827782490eb7dfad4aea68c15 not found: ID does not exist"
Jul 22 02:40:00.649443 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.649423    2577 scope.go:117] "RemoveContainer" containerID="2c0518c6ce6449e4ea37ce3b5d2989aef9283880a56d72be19021a216788723c"
Jul 22 02:40:00.649603 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.649587    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c0518c6ce6449e4ea37ce3b5d2989aef9283880a56d72be19021a216788723c"} err="failed to get container status \"2c0518c6ce6449e4ea37ce3b5d2989aef9283880a56d72be19021a216788723c\": rpc error: code = NotFound desc = could not find container \"2c0518c6ce6449e4ea37ce3b5d2989aef9283880a56d72be19021a216788723c\": container with ID starting with 2c0518c6ce6449e4ea37ce3b5d2989aef9283880a56d72be19021a216788723c not found: ID does not exist"
Jul 22 02:40:00.649642 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.649603    2577 scope.go:117] "RemoveContainer" containerID="092d574c94296607f0de156208ef0f311b62aefa450051a0f34fda2d4a39229b"
Jul 22 02:40:00.649801 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.649782    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"092d574c94296607f0de156208ef0f311b62aefa450051a0f34fda2d4a39229b"} err="failed to get container status \"092d574c94296607f0de156208ef0f311b62aefa450051a0f34fda2d4a39229b\": rpc error: code = NotFound desc = could not find container \"092d574c94296607f0de156208ef0f311b62aefa450051a0f34fda2d4a39229b\": container with ID starting with 092d574c94296607f0de156208ef0f311b62aefa450051a0f34fda2d4a39229b not found: ID does not exist"
Jul 22 02:40:00.649873 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.649804    2577 scope.go:117] "RemoveContainer" containerID="1d4a01792e7e4edf0774248a315a0defdf10660f9badde5a2d2d9ccae47d9b10"
Jul 22 02:40:00.650007 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.649992    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d4a01792e7e4edf0774248a315a0defdf10660f9badde5a2d2d9ccae47d9b10"} err="failed to get container status \"1d4a01792e7e4edf0774248a315a0defdf10660f9badde5a2d2d9ccae47d9b10\": rpc error: code = NotFound desc = could not find container \"1d4a01792e7e4edf0774248a315a0defdf10660f9badde5a2d2d9ccae47d9b10\": container with ID starting with 1d4a01792e7e4edf0774248a315a0defdf10660f9badde5a2d2d9ccae47d9b10 not found: ID does not exist"
Jul 22 02:40:00.650059 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.650007    2577 scope.go:117] "RemoveContainer" containerID="8c1eb3b9a9fbb8a88e05865d3ba81417be44562afe48989191f4d0dc08e0ffbe"
Jul 22 02:40:00.650216 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.650198    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c1eb3b9a9fbb8a88e05865d3ba81417be44562afe48989191f4d0dc08e0ffbe"} err="failed to get container status \"8c1eb3b9a9fbb8a88e05865d3ba81417be44562afe48989191f4d0dc08e0ffbe\": rpc error: code = NotFound desc = could not find container \"8c1eb3b9a9fbb8a88e05865d3ba81417be44562afe48989191f4d0dc08e0ffbe\": container with ID starting with 8c1eb3b9a9fbb8a88e05865d3ba81417be44562afe48989191f4d0dc08e0ffbe not found: ID does not exist"
Jul 22 02:40:00.650289 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.650216    2577 scope.go:117] "RemoveContainer" containerID="5e88b5c803be20185c5add651ede7ec7710cda3f6999a59030242bed708e40c9"
Jul 22 02:40:00.650382 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.650364    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e88b5c803be20185c5add651ede7ec7710cda3f6999a59030242bed708e40c9"} err="failed to get container status \"5e88b5c803be20185c5add651ede7ec7710cda3f6999a59030242bed708e40c9\": rpc error: code = NotFound desc = could not find container \"5e88b5c803be20185c5add651ede7ec7710cda3f6999a59030242bed708e40c9\": container with ID starting with 5e88b5c803be20185c5add651ede7ec7710cda3f6999a59030242bed708e40c9 not found: ID does not exist"
Jul 22 02:40:00.650449 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.650384    2577 scope.go:117] "RemoveContainer" containerID="840429aa8d6552a0e491f8edfc9bd1c8e28b89ac08d73ced190b6440735c5407"
Jul 22 02:40:00.650589 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.650571    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"840429aa8d6552a0e491f8edfc9bd1c8e28b89ac08d73ced190b6440735c5407"} err="failed to get container status \"840429aa8d6552a0e491f8edfc9bd1c8e28b89ac08d73ced190b6440735c5407\": rpc error: code = NotFound desc = could not find container \"840429aa8d6552a0e491f8edfc9bd1c8e28b89ac08d73ced190b6440735c5407\": container with ID starting with 840429aa8d6552a0e491f8edfc9bd1c8e28b89ac08d73ced190b6440735c5407 not found: ID does not exist"
Jul 22 02:40:00.650631 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.650589    2577 scope.go:117] "RemoveContainer" containerID="a1bccccd945b92c20a6a509bcac945edd9116f9827782490eb7dfad4aea68c15"
Jul 22 02:40:00.650784 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:00.650769    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1bccccd945b92c20a6a509bcac945edd9116f9827782490eb7dfad4aea68c15"} err="failed to get container status \"a1bccccd945b92c20a6a509bcac945edd9116f9827782490eb7dfad4aea68c15\": rpc error: code = NotFound desc = could not find container \"a1bccccd945b92c20a6a509bcac945edd9116f9827782490eb7dfad4aea68c15\": container with ID starting with a1bccccd945b92c20a6a509bcac945edd9116f9827782490eb7dfad4aea68c15 not found: ID does not exist"
Jul 22 02:40:01.755708 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:01.755679    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" path="/var/lib/kubelet/pods/36b4a1cb-92c8-47af-b863-95368f33b573/volumes"
Jul 22 02:40:03.343709 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:03.343670    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 02:40:03.344276 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:03.344085    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerName="prometheus" containerID="cri-o://fea8c1a673dd40f2baa43564f54de20f1f9197a6245aac3ce355661bb5a2128a" gracePeriod=600
Jul 22 02:40:03.344276 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:03.344139    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8fdeb9b27cb7a65db08df400f5641a3499e7f398c100d8dcf8a3b97621ab2a05" gracePeriod=600
Jul 22 02:40:03.344276 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:03.344158    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerName="kube-rbac-proxy-web" containerID="cri-o://f4d03e6f540f8a2b7dbb7bdf5e22c215d497f5195c2d83e1a720e31391b5b083" gracePeriod=600
Jul 22 02:40:03.344276 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:03.344191    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerName="kube-rbac-proxy" containerID="cri-o://704b4c0b7e51fcc40998110a2ddc334fbae8839e6510ed7448e9f2336e55b813" gracePeriod=600
Jul 22 02:40:03.344276 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:03.344218    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerName="thanos-sidecar" containerID="cri-o://2a0f3c71137a00f265e538754a2a6323c3706b9f144875fc7743a2643e507d62" gracePeriod=600
Jul 22 02:40:03.344510 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:03.344266    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerName="config-reloader" containerID="cri-o://be1b95a699d4c250c7a20ffe873df8778e96fd15229b0bf555a2f182aef5f74a" gracePeriod=600
Jul 22 02:40:03.605968 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:03.605866    2577 generic.go:356] "Generic (PLEG): container finished" podID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerID="8fdeb9b27cb7a65db08df400f5641a3499e7f398c100d8dcf8a3b97621ab2a05" exitCode=0
Jul 22 02:40:03.605968 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:03.605890    2577 generic.go:356] "Generic (PLEG): container finished" podID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerID="704b4c0b7e51fcc40998110a2ddc334fbae8839e6510ed7448e9f2336e55b813" exitCode=0
Jul 22 02:40:03.605968 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:03.605902    2577 generic.go:356] "Generic (PLEG): container finished" podID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerID="2a0f3c71137a00f265e538754a2a6323c3706b9f144875fc7743a2643e507d62" exitCode=0
Jul 22 02:40:03.605968 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:03.605911    2577 generic.go:356] "Generic (PLEG): container finished" podID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerID="be1b95a699d4c250c7a20ffe873df8778e96fd15229b0bf555a2f182aef5f74a" exitCode=0
Jul 22 02:40:03.605968 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:03.605918    2577 generic.go:356] "Generic (PLEG): container finished" podID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerID="fea8c1a673dd40f2baa43564f54de20f1f9197a6245aac3ce355661bb5a2128a" exitCode=0
Jul 22 02:40:03.605968 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:03.605935    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312","Type":"ContainerDied","Data":"8fdeb9b27cb7a65db08df400f5641a3499e7f398c100d8dcf8a3b97621ab2a05"}
Jul 22 02:40:03.606330 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:03.605997    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312","Type":"ContainerDied","Data":"704b4c0b7e51fcc40998110a2ddc334fbae8839e6510ed7448e9f2336e55b813"}
Jul 22 02:40:03.606330 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:03.606025    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312","Type":"ContainerDied","Data":"2a0f3c71137a00f265e538754a2a6323c3706b9f144875fc7743a2643e507d62"}
Jul 22 02:40:03.606330 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:03.606050    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312","Type":"ContainerDied","Data":"be1b95a699d4c250c7a20ffe873df8778e96fd15229b0bf555a2f182aef5f74a"}
Jul 22 02:40:03.606330 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:03.606072    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312","Type":"ContainerDied","Data":"fea8c1a673dd40f2baa43564f54de20f1f9197a6245aac3ce355661bb5a2128a"}
Jul 22 02:40:04.604618 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.604590    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:04.612374 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.612341    2577 generic.go:356] "Generic (PLEG): container finished" podID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerID="f4d03e6f540f8a2b7dbb7bdf5e22c215d497f5195c2d83e1a720e31391b5b083" exitCode=0
Jul 22 02:40:04.612562 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.612424    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312","Type":"ContainerDied","Data":"f4d03e6f540f8a2b7dbb7bdf5e22c215d497f5195c2d83e1a720e31391b5b083"}
Jul 22 02:40:04.612562 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.612453    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:04.612562 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.612493    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312","Type":"ContainerDied","Data":"6b8a2de0068df09ea54322f9599dffd14d19ee82b759cb6742db1e360d820feb"}
Jul 22 02:40:04.612562 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.612528    2577 scope.go:117] "RemoveContainer" containerID="8fdeb9b27cb7a65db08df400f5641a3499e7f398c100d8dcf8a3b97621ab2a05"
Jul 22 02:40:04.620138 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.620115    2577 scope.go:117] "RemoveContainer" containerID="704b4c0b7e51fcc40998110a2ddc334fbae8839e6510ed7448e9f2336e55b813"
Jul 22 02:40:04.627490 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.627470    2577 scope.go:117] "RemoveContainer" containerID="f4d03e6f540f8a2b7dbb7bdf5e22c215d497f5195c2d83e1a720e31391b5b083"
Jul 22 02:40:04.634551 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.634529    2577 scope.go:117] "RemoveContainer" containerID="2a0f3c71137a00f265e538754a2a6323c3706b9f144875fc7743a2643e507d62"
Jul 22 02:40:04.641405 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.641383    2577 scope.go:117] "RemoveContainer" containerID="be1b95a699d4c250c7a20ffe873df8778e96fd15229b0bf555a2f182aef5f74a"
Jul 22 02:40:04.648555 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.648527    2577 scope.go:117] "RemoveContainer" containerID="fea8c1a673dd40f2baa43564f54de20f1f9197a6245aac3ce355661bb5a2128a"
Jul 22 02:40:04.658115 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.658084    2577 scope.go:117] "RemoveContainer" containerID="12eda12b1ed811b4dbdd7bdeed3f9ad2f8c3c4854ea453a6903aaab4d1fa43e1"
Jul 22 02:40:04.661648 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.661622    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-metrics-client-certs\") pod \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") "
Jul 22 02:40:04.661789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.661668    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") "
Jul 22 02:40:04.661789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.661698    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-k8s-db\") pod \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") "
Jul 22 02:40:04.661789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.661722    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-config-out\") pod \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") "
Jul 22 02:40:04.661789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.661753    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-web-config\") pod \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") "
Jul 22 02:40:04.661789 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.661789    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-tls-assets\") pod \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") "
Jul 22 02:40:04.662868 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.661816    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-k8s-rulefiles-0\") pod \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") "
Jul 22 02:40:04.662868 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.661850    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-kube-rbac-proxy\") pod \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") "
Jul 22 02:40:04.662868 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.661906    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-k8s-rulefiles-1\") pod \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") "
Jul 22 02:40:04.662868 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.661942    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") "
Jul 22 02:40:04.662868 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.661974    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-k8s-rulefiles-2\") pod \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") "
Jul 22 02:40:04.662868 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.662009    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-trusted-ca-bundle\") pod \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") "
Jul 22 02:40:04.662868 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.662039    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-prometheus-k8s-tls\") pod \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") "
Jul 22 02:40:04.662868 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.662063    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-config\") pod \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") "
Jul 22 02:40:04.662868 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.662089    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hh5hx\" (UniqueName: \"kubernetes.io/projected/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-kube-api-access-hh5hx\") pod \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") "
Jul 22 02:40:04.662868 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.662124    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-configmap-serving-certs-ca-bundle\") pod \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") "
Jul 22 02:40:04.662868 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.662146    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-grpc-tls\") pod \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") "
Jul 22 02:40:04.662868 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.662180    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-configmap-kubelet-serving-ca-bundle\") pod \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") "
Jul 22 02:40:04.662868 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.662213    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-configmap-metrics-client-ca\") pod \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") "
Jul 22 02:40:04.662868 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.662237    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-thanos-prometheus-http-client-file\") pod \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\" (UID: \"a08a8b10-228a-4ff9-bfb4-5d48c5ba8312\") "
Jul 22 02:40:04.663995 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.663876    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" (UID: "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 02:40:04.664101 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.664076    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" (UID: "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 02:40:04.665286 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.665227    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" (UID: "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 02:40:04.666669 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.665362    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" (UID: "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 02:40:04.666669 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.666057    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" (UID: "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 02:40:04.666669 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.666183    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" (UID: "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 02:40:04.666926 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.666883    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" (UID: "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:40:04.667200 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.666915    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" (UID: "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 02:40:04.667562 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.667531    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" (UID: "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 02:40:04.669627 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.669598    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" (UID: "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:40:04.670385 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.670306    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" (UID: "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:40:04.670452 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.670435    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-config" (OuterVolumeSpecName: "config") pod "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" (UID: "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:40:04.670582 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.670451    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-config-out" (OuterVolumeSpecName: "config-out") pod "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" (UID: "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 02:40:04.670582 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.670506    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" (UID: "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:40:04.670582 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.670525    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" (UID: "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:40:04.670807 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.670595    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" (UID: "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 02:40:04.670807 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.670672    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" (UID: "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:40:04.671147 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.671114    2577 scope.go:117] "RemoveContainer" containerID="8fdeb9b27cb7a65db08df400f5641a3499e7f398c100d8dcf8a3b97621ab2a05"
Jul 22 02:40:04.672642 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:40:04.671927    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fdeb9b27cb7a65db08df400f5641a3499e7f398c100d8dcf8a3b97621ab2a05\": container with ID starting with 8fdeb9b27cb7a65db08df400f5641a3499e7f398c100d8dcf8a3b97621ab2a05 not found: ID does not exist" containerID="8fdeb9b27cb7a65db08df400f5641a3499e7f398c100d8dcf8a3b97621ab2a05"
Jul 22 02:40:04.672642 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.671963    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fdeb9b27cb7a65db08df400f5641a3499e7f398c100d8dcf8a3b97621ab2a05"} err="failed to get container status \"8fdeb9b27cb7a65db08df400f5641a3499e7f398c100d8dcf8a3b97621ab2a05\": rpc error: code = NotFound desc = could not find container \"8fdeb9b27cb7a65db08df400f5641a3499e7f398c100d8dcf8a3b97621ab2a05\": container with ID starting with 8fdeb9b27cb7a65db08df400f5641a3499e7f398c100d8dcf8a3b97621ab2a05 not found: ID does not exist"
Jul 22 02:40:04.672642 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.671991    2577 scope.go:117] "RemoveContainer" containerID="704b4c0b7e51fcc40998110a2ddc334fbae8839e6510ed7448e9f2336e55b813"
Jul 22 02:40:04.672642 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:40:04.672307    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"704b4c0b7e51fcc40998110a2ddc334fbae8839e6510ed7448e9f2336e55b813\": container with ID starting with 704b4c0b7e51fcc40998110a2ddc334fbae8839e6510ed7448e9f2336e55b813 not found: ID does not exist" containerID="704b4c0b7e51fcc40998110a2ddc334fbae8839e6510ed7448e9f2336e55b813"
Jul 22 02:40:04.672642 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.672334    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"704b4c0b7e51fcc40998110a2ddc334fbae8839e6510ed7448e9f2336e55b813"} err="failed to get container status \"704b4c0b7e51fcc40998110a2ddc334fbae8839e6510ed7448e9f2336e55b813\": rpc error: code = NotFound desc = could not find container \"704b4c0b7e51fcc40998110a2ddc334fbae8839e6510ed7448e9f2336e55b813\": container with ID starting with 704b4c0b7e51fcc40998110a2ddc334fbae8839e6510ed7448e9f2336e55b813 not found: ID does not exist"
Jul 22 02:40:04.672642 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.672356    2577 scope.go:117] "RemoveContainer" containerID="f4d03e6f540f8a2b7dbb7bdf5e22c215d497f5195c2d83e1a720e31391b5b083"
Jul 22 02:40:04.672642 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.672605    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" (UID: "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:40:04.673032 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:40:04.672679    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4d03e6f540f8a2b7dbb7bdf5e22c215d497f5195c2d83e1a720e31391b5b083\": container with ID starting with f4d03e6f540f8a2b7dbb7bdf5e22c215d497f5195c2d83e1a720e31391b5b083 not found: ID does not exist" containerID="f4d03e6f540f8a2b7dbb7bdf5e22c215d497f5195c2d83e1a720e31391b5b083"
Jul 22 02:40:04.673032 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.672708    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4d03e6f540f8a2b7dbb7bdf5e22c215d497f5195c2d83e1a720e31391b5b083"} err="failed to get container status \"f4d03e6f540f8a2b7dbb7bdf5e22c215d497f5195c2d83e1a720e31391b5b083\": rpc error: code = NotFound desc = could not find container \"f4d03e6f540f8a2b7dbb7bdf5e22c215d497f5195c2d83e1a720e31391b5b083\": container with ID starting with f4d03e6f540f8a2b7dbb7bdf5e22c215d497f5195c2d83e1a720e31391b5b083 not found: ID does not exist"
Jul 22 02:40:04.673032 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.672731    2577 scope.go:117] "RemoveContainer" containerID="2a0f3c71137a00f265e538754a2a6323c3706b9f144875fc7743a2643e507d62"
Jul 22 02:40:04.673032 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.672908    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-kube-api-access-hh5hx" (OuterVolumeSpecName: "kube-api-access-hh5hx") pod "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" (UID: "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312"). InnerVolumeSpecName "kube-api-access-hh5hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 02:40:04.673032 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:40:04.672986    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a0f3c71137a00f265e538754a2a6323c3706b9f144875fc7743a2643e507d62\": container with ID starting with 2a0f3c71137a00f265e538754a2a6323c3706b9f144875fc7743a2643e507d62 not found: ID does not exist" containerID="2a0f3c71137a00f265e538754a2a6323c3706b9f144875fc7743a2643e507d62"
Jul 22 02:40:04.673032 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.673014    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a0f3c71137a00f265e538754a2a6323c3706b9f144875fc7743a2643e507d62"} err="failed to get container status \"2a0f3c71137a00f265e538754a2a6323c3706b9f144875fc7743a2643e507d62\": rpc error: code = NotFound desc = could not find container \"2a0f3c71137a00f265e538754a2a6323c3706b9f144875fc7743a2643e507d62\": container with ID starting with 2a0f3c71137a00f265e538754a2a6323c3706b9f144875fc7743a2643e507d62 not found: ID does not exist"
Jul 22 02:40:04.673032 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.673035    2577 scope.go:117] "RemoveContainer" containerID="be1b95a699d4c250c7a20ffe873df8778e96fd15229b0bf555a2f182aef5f74a"
Jul 22 02:40:04.673399 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:40:04.673338    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be1b95a699d4c250c7a20ffe873df8778e96fd15229b0bf555a2f182aef5f74a\": container with ID starting with be1b95a699d4c250c7a20ffe873df8778e96fd15229b0bf555a2f182aef5f74a not found: ID does not exist" containerID="be1b95a699d4c250c7a20ffe873df8778e96fd15229b0bf555a2f182aef5f74a"
Jul 22 02:40:04.673399 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.673360    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be1b95a699d4c250c7a20ffe873df8778e96fd15229b0bf555a2f182aef5f74a"} err="failed to get container status \"be1b95a699d4c250c7a20ffe873df8778e96fd15229b0bf555a2f182aef5f74a\": rpc error: code = NotFound desc = could not find container \"be1b95a699d4c250c7a20ffe873df8778e96fd15229b0bf555a2f182aef5f74a\": container with ID starting with be1b95a699d4c250c7a20ffe873df8778e96fd15229b0bf555a2f182aef5f74a not found: ID does not exist"
Jul 22 02:40:04.673399 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.673378    2577 scope.go:117] "RemoveContainer" containerID="fea8c1a673dd40f2baa43564f54de20f1f9197a6245aac3ce355661bb5a2128a"
Jul 22 02:40:04.673679 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:40:04.673651    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fea8c1a673dd40f2baa43564f54de20f1f9197a6245aac3ce355661bb5a2128a\": container with ID starting with fea8c1a673dd40f2baa43564f54de20f1f9197a6245aac3ce355661bb5a2128a not found: ID does not exist" containerID="fea8c1a673dd40f2baa43564f54de20f1f9197a6245aac3ce355661bb5a2128a"
Jul 22 02:40:04.673776 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.673688    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fea8c1a673dd40f2baa43564f54de20f1f9197a6245aac3ce355661bb5a2128a"} err="failed to get container status \"fea8c1a673dd40f2baa43564f54de20f1f9197a6245aac3ce355661bb5a2128a\": rpc error: code = NotFound desc = could not find container \"fea8c1a673dd40f2baa43564f54de20f1f9197a6245aac3ce355661bb5a2128a\": container with ID starting with fea8c1a673dd40f2baa43564f54de20f1f9197a6245aac3ce355661bb5a2128a not found: ID does not exist"
Jul 22 02:40:04.673776 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.673710    2577 scope.go:117] "RemoveContainer" containerID="12eda12b1ed811b4dbdd7bdeed3f9ad2f8c3c4854ea453a6903aaab4d1fa43e1"
Jul 22 02:40:04.674133 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:40:04.674115    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12eda12b1ed811b4dbdd7bdeed3f9ad2f8c3c4854ea453a6903aaab4d1fa43e1\": container with ID starting with 12eda12b1ed811b4dbdd7bdeed3f9ad2f8c3c4854ea453a6903aaab4d1fa43e1 not found: ID does not exist" containerID="12eda12b1ed811b4dbdd7bdeed3f9ad2f8c3c4854ea453a6903aaab4d1fa43e1"
Jul 22 02:40:04.674208 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.674136    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12eda12b1ed811b4dbdd7bdeed3f9ad2f8c3c4854ea453a6903aaab4d1fa43e1"} err="failed to get container status \"12eda12b1ed811b4dbdd7bdeed3f9ad2f8c3c4854ea453a6903aaab4d1fa43e1\": rpc error: code = NotFound desc = could not find container \"12eda12b1ed811b4dbdd7bdeed3f9ad2f8c3c4854ea453a6903aaab4d1fa43e1\": container with ID starting with 12eda12b1ed811b4dbdd7bdeed3f9ad2f8c3c4854ea453a6903aaab4d1fa43e1 not found: ID does not exist"
Jul 22 02:40:04.682410 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.682383    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-web-config" (OuterVolumeSpecName: "web-config") pod "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" (UID: "a08a8b10-228a-4ff9-bfb4-5d48c5ba8312"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:40:04.763234 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.763181    2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:04.763234 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.763230    2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-metrics-client-certs\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:04.763468 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.763243    2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:04.763468 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.763288    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-k8s-db\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:04.763468 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.763301    2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-config-out\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:04.763468 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.763314    2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-web-config\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:04.763468 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.763326    2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-tls-assets\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:04.763468 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.763337    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:04.763468 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.763345    2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-kube-rbac-proxy\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:04.763468 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.763353    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:04.763468 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.763362    2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:04.763468 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.763370    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:04.763468 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.763380    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:04.763468 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.763390    2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:04.763468 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.763398    2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-config\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:04.763468 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.763406    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hh5hx\" (UniqueName: \"kubernetes.io/projected/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-kube-api-access-hh5hx\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:04.763468 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.763415    2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:04.763468 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.763423    2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-secret-grpc-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:04.763468 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.763431    2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:04.763468 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.763440    2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312-configmap-metrics-client-ca\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:40:04.941279 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.940828    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 02:40:04.946045 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.946010    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 02:40:04.989582 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.989549    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 02:40:04.989852 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.989838    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" containerName="kube-rbac-proxy-metric"
Jul 22 02:40:04.989891 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.989855    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" containerName="kube-rbac-proxy-metric"
Jul 22 02:40:04.989891 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.989865    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerName="init-config-reloader"
Jul 22 02:40:04.989891 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.989871    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerName="init-config-reloader"
Jul 22 02:40:04.989891 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.989878    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" containerName="prom-label-proxy"
Jul 22 02:40:04.989891 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.989883    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" containerName="prom-label-proxy"
Jul 22 02:40:04.989891 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.989890    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" containerName="config-reloader"
Jul 22 02:40:04.990059 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.989896    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" containerName="config-reloader"
Jul 22 02:40:04.990059 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.989902    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerName="config-reloader"
Jul 22 02:40:04.990059 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.989910    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerName="config-reloader"
Jul 22 02:40:04.990059 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.989919    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerName="kube-rbac-proxy-web"
Jul 22 02:40:04.990059 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.989926    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerName="kube-rbac-proxy-web"
Jul 22 02:40:04.990059 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.989935    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" containerName="alertmanager"
Jul 22 02:40:04.990059 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.989940    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" containerName="alertmanager"
Jul 22 02:40:04.990059 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.989947    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" containerName="kube-rbac-proxy-web"
Jul 22 02:40:04.990059 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.989953    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" containerName="kube-rbac-proxy-web"
Jul 22 02:40:04.990059 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.989958    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerName="thanos-sidecar"
Jul 22 02:40:04.990059 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.989963    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerName="thanos-sidecar"
Jul 22 02:40:04.990059 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.989970    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" containerName="kube-rbac-proxy"
Jul 22 02:40:04.990059 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.989974    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" containerName="kube-rbac-proxy"
Jul 22 02:40:04.990059 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.989979    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerName="kube-rbac-proxy-thanos"
Jul 22 02:40:04.990059 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.989986    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerName="kube-rbac-proxy-thanos"
Jul 22 02:40:04.990059 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.989996    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" containerName="init-config-reloader"
Jul 22 02:40:04.990059 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.990004    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" containerName="init-config-reloader"
Jul 22 02:40:04.990059 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.990011    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerName="kube-rbac-proxy"
Jul 22 02:40:04.990059 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.990016    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerName="kube-rbac-proxy"
Jul 22 02:40:04.990059 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.990023    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerName="prometheus"
Jul 22 02:40:04.990059 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.990028    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerName="prometheus"
Jul 22 02:40:04.990059 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.990066    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerName="thanos-sidecar"
Jul 22 02:40:04.990672 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.990079    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerName="prometheus"
Jul 22 02:40:04.990672 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.990087    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" containerName="kube-rbac-proxy-metric"
Jul 22 02:40:04.990672 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.990092    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" containerName="prom-label-proxy"
Jul 22 02:40:04.990672 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.990097    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerName="kube-rbac-proxy-thanos"
Jul 22 02:40:04.990672 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.990103    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" containerName="config-reloader"
Jul 22 02:40:04.990672 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.990108    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" containerName="kube-rbac-proxy"
Jul 22 02:40:04.990672 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.990114    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" containerName="alertmanager"
Jul 22 02:40:04.990672 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.990119    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerName="config-reloader"
Jul 22 02:40:04.990672 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.990125    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerName="kube-rbac-proxy-web"
Jul 22 02:40:04.990672 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.990130    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" containerName="kube-rbac-proxy"
Jul 22 02:40:04.990672 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.990135    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="36b4a1cb-92c8-47af-b863-95368f33b573" containerName="kube-rbac-proxy-web"
Jul 22 02:40:04.995612 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:04.995591    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.001109 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.001021    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 22 02:40:05.001109 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.001029    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ksznj\""
Jul 22 02:40:05.001357 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.001330    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 22 02:40:05.001421 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.001359    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 22 02:40:05.001421 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.001409    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 22 02:40:05.001704 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.001685    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 22 02:40:05.001807 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.001713    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 22 02:40:05.001807 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.001769    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 22 02:40:05.001970 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.001955    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 22 02:40:05.002085 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.002066    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 22 02:40:05.002171 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.002161    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 22 02:40:05.002917 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.002882    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 22 02:40:05.002917 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.002913    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 22 02:40:05.003082 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.002932    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 22 02:40:05.003208 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.003190    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3sirg10fuq68a\""
Jul 22 02:40:05.004542 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.004525    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 22 02:40:05.011382 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.011361    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 22 02:40:05.018775 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.018709    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 02:40:05.066156 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.066121    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c2059c5f-6fc1-48ca-adda-b09314ac92bd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.066372 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.066165    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-web-config\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.066372 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.066188    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2059c5f-6fc1-48ca-adda-b09314ac92bd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.066372 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.066205    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.066372 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.066229    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c2059c5f-6fc1-48ca-adda-b09314ac92bd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.066372 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.066292    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2059c5f-6fc1-48ca-adda-b09314ac92bd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.066372 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.066346    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2059c5f-6fc1-48ca-adda-b09314ac92bd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.066372 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.066368    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.066635 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.066388    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-config\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.066635 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.066426    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.066635 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.066441    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c2059c5f-6fc1-48ca-adda-b09314ac92bd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.066635 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.066459    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.066635 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.066483    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.066635 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.066520    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2059c5f-6fc1-48ca-adda-b09314ac92bd-config-out\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.066635 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.066543    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2059c5f-6fc1-48ca-adda-b09314ac92bd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.066635 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.066561    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.066635 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.066581    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2bl6\" (UniqueName: \"kubernetes.io/projected/c2059c5f-6fc1-48ca-adda-b09314ac92bd-kube-api-access-s2bl6\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.066635 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.066607    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2059c5f-6fc1-48ca-adda-b09314ac92bd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.066635 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.066636    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.066966 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.066661    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c2059c5f-6fc1-48ca-adda-b09314ac92bd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.167600 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.167567    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.167600 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.167602    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-config\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.167815 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.167624    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.167815 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.167737    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c2059c5f-6fc1-48ca-adda-b09314ac92bd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.167815 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.167769    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.167815 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.167786    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.167815 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.167816    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2059c5f-6fc1-48ca-adda-b09314ac92bd-config-out\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.168065 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.167834    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2059c5f-6fc1-48ca-adda-b09314ac92bd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.168065 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.167857    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.168065 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.167880    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2bl6\" (UniqueName: \"kubernetes.io/projected/c2059c5f-6fc1-48ca-adda-b09314ac92bd-kube-api-access-s2bl6\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.168065 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.167910    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2059c5f-6fc1-48ca-adda-b09314ac92bd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.168065 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.167939    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.168065 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.167987    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c2059c5f-6fc1-48ca-adda-b09314ac92bd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.168065 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.168020    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c2059c5f-6fc1-48ca-adda-b09314ac92bd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.168496 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.168074    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-web-config\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.168496 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.168110    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2059c5f-6fc1-48ca-adda-b09314ac92bd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.168496 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.168134    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.168496 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.168150    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c2059c5f-6fc1-48ca-adda-b09314ac92bd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.168496 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.168159    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c2059c5f-6fc1-48ca-adda-b09314ac92bd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.168496 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.168183    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2059c5f-6fc1-48ca-adda-b09314ac92bd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.168496 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.168237    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2059c5f-6fc1-48ca-adda-b09314ac92bd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.169025 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.169002    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2059c5f-6fc1-48ca-adda-b09314ac92bd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.169436 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.169376    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2059c5f-6fc1-48ca-adda-b09314ac92bd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.169951 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.169924    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c2059c5f-6fc1-48ca-adda-b09314ac92bd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.170308 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.170285    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2059c5f-6fc1-48ca-adda-b09314ac92bd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.170475 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.170450    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c2059c5f-6fc1-48ca-adda-b09314ac92bd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.171475 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.171450    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2059c5f-6fc1-48ca-adda-b09314ac92bd-config-out\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.171583 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.171522    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2059c5f-6fc1-48ca-adda-b09314ac92bd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.172082 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.172059    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c2059c5f-6fc1-48ca-adda-b09314ac92bd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.172524 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.172498    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.172788 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.172759    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.172863 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.172793    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.173007 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.172986    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.173089 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.173073    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2059c5f-6fc1-48ca-adda-b09314ac92bd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.173216 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.173193    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.173348 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.173331    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-config\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.173989 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.173966    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.174435 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.174417    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-web-config\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.174526 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.174510    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c2059c5f-6fc1-48ca-adda-b09314ac92bd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.179759 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.179737    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2bl6\" (UniqueName: \"kubernetes.io/projected/c2059c5f-6fc1-48ca-adda-b09314ac92bd-kube-api-access-s2bl6\") pod \"prometheus-k8s-0\" (UID: \"c2059c5f-6fc1-48ca-adda-b09314ac92bd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.306208 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.306110    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:05.457852 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.457826    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 02:40:05.459891 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:40:05.459863    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2059c5f_6fc1_48ca_adda_b09314ac92bd.slice/crio-87324a28bb7223ba28cad7c7fbe283a3eadac9ebb1d196d844e5937aac63f473 WatchSource:0}: Error finding container 87324a28bb7223ba28cad7c7fbe283a3eadac9ebb1d196d844e5937aac63f473: Status 404 returned error can't find the container with id 87324a28bb7223ba28cad7c7fbe283a3eadac9ebb1d196d844e5937aac63f473
Jul 22 02:40:05.617886 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.617851    2577 generic.go:356] "Generic (PLEG): container finished" podID="c2059c5f-6fc1-48ca-adda-b09314ac92bd" containerID="726e25a38f8975a4d5288df851a1f0aa5c9436bafeb84e28909a2189789a34a7" exitCode=0
Jul 22 02:40:05.618320 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.617934    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2059c5f-6fc1-48ca-adda-b09314ac92bd","Type":"ContainerDied","Data":"726e25a38f8975a4d5288df851a1f0aa5c9436bafeb84e28909a2189789a34a7"}
Jul 22 02:40:05.618320 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.618001    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2059c5f-6fc1-48ca-adda-b09314ac92bd","Type":"ContainerStarted","Data":"87324a28bb7223ba28cad7c7fbe283a3eadac9ebb1d196d844e5937aac63f473"}
Jul 22 02:40:05.757718 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:05.757681    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a08a8b10-228a-4ff9-bfb4-5d48c5ba8312" path="/var/lib/kubelet/pods/a08a8b10-228a-4ff9-bfb4-5d48c5ba8312/volumes"
Jul 22 02:40:06.464099 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:06.464065    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:40:06.626204 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:06.626163    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2059c5f-6fc1-48ca-adda-b09314ac92bd","Type":"ContainerStarted","Data":"03a5e8e38381ede95c006f30dd34d72c458024983987ecc324202e3a1886a1c0"}
Jul 22 02:40:06.626691 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:06.626303    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2059c5f-6fc1-48ca-adda-b09314ac92bd","Type":"ContainerStarted","Data":"9d04f1239cef6d10c0b9ce5587c0e039fa15cea4af466315916e086d537d5125"}
Jul 22 02:40:06.626691 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:06.626348    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2059c5f-6fc1-48ca-adda-b09314ac92bd","Type":"ContainerStarted","Data":"e3b09de15325a571495341eeeab46526319aa574be993914d7d4c884adbb6fe9"}
Jul 22 02:40:06.626691 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:06.626402    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2059c5f-6fc1-48ca-adda-b09314ac92bd","Type":"ContainerStarted","Data":"7d8d31ef324ffc80cdf56f1bff5922ba6fdf8099c91b0dc2e9116a175605f574"}
Jul 22 02:40:06.626691 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:06.626438    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2059c5f-6fc1-48ca-adda-b09314ac92bd","Type":"ContainerStarted","Data":"1159b87f05840fe45676b48e66011e6c89ed8e0d2932251c85b684f5c62b6d06"}
Jul 22 02:40:06.626691 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:06.626479    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2059c5f-6fc1-48ca-adda-b09314ac92bd","Type":"ContainerStarted","Data":"49dbbb49d925cf3ab60ffa560d35adc814a2defcb6cad1dcffc4d75bd57a4fb1"}
Jul 22 02:40:06.663528 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:06.663474    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.645327111 podStartE2EDuration="2.663456617s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.129506ms" isStatefulPod=false podCreationTimestamp="2026-07-22 02:40:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:40:06.660894269 +0000 UTC m=+167.369322870" watchObservedRunningTime="2026-07-22 02:40:06.663456617 +0000 UTC m=+167.371885217"
Jul 22 02:40:08.122342 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:08.122306    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:40:08.185597 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:08.185561    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:40:10.306622 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:10.306505    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:40:19.048203 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:19.048170    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:40:19.148473 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:19.148430    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:40:19.210052 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:19.210021    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:40:52.030731 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:52.030693    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:40:52.092743 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:52.092708    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:40:56.436293 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:56.436207    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:40:59.898675 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:59.898640    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:40:59.960448 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:40:59.960401    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:41:05.306754 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:41:05.306713    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:41:05.323189 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:41:05.323153    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:41:05.854855 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:41:05.854828    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 02:41:13.216655 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:41:13.216621    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:41:13.296000 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:41:13.295965    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:41:17.523961 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:41:17.523849    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:41:17.619131 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:41:17.619096    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:41:25.426167 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:41:25.426128    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:41:28.267230 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:41:28.267191    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:41:28.368562 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:41:28.368530    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:41:28.437190 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:41:28.437159    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:41:41.467231 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:41:41.467152    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:41:41.565422 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:41:41.565392    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:41:45.823747 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:41:45.823711    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:42:19.594664 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:42:19.594629    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqngf_6461ea33-ff4c-48c5-8c29-b4026c2f67b0/ovn-acl-logging/0.log"
Jul 22 02:42:19.599468 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:42:19.599443    2577 kubelet.go:1648] "Image garbage collection succeeded"
Jul 22 02:42:19.600273 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:42:19.600229    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqngf_6461ea33-ff4c-48c5-8c29-b4026c2f67b0/ovn-acl-logging/0.log"
Jul 22 02:42:20.147073 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:42:20.147042    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:42:21.346769 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:42:21.346733    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:42:42.570130 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:42:42.570097    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:42:42.892206 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:42:42.892111    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:42:46.963111 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:42:46.963074    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:42:47.075787 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:42:47.075755    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:42:48.791636 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:42:48.791603    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:42:48.928311 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:42:48.928269    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:42:49.366692 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:42:49.366642    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:42:49.449577 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:42:49.449542    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:42:51.627349 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:42:51.627317    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:42:52.014474 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:42:52.014432    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:42:53.370997 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:42:53.370965    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:42:53.455996 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:42:53.455959    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:42:58.578113 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:42:58.578077    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:42:58.689243 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:42:58.689207    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:42:59.591481 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:42:59.591450    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:15.091929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:15.091834    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:15.213807 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:15.213767    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:20.543874 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:20.543840    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:20.640670 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:20.640637    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:22.688945 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:22.688909    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:34.602830 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:34.602796    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:34.740310 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:34.740245    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:35.299322 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:35.299286    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:35.599708 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:35.599620    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:35.711368 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:35.711334    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:35.826684 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:35.826649    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk"]
Jul 22 02:43:35.829958 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:35.829941    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk"
Jul 22 02:43:35.834044 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:35.834003    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p8xl5\""
Jul 22 02:43:35.834044 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:35.834027    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 22 02:43:35.834044 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:35.834042    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 22 02:43:35.834377 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:35.834365    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 22 02:43:35.834811 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:35.834793    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 22 02:43:35.881440 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:35.881344    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk"]
Jul 22 02:43:35.955198 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:35.955163    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e-tmp\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk\" (UID: \"3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk"
Jul 22 02:43:35.955198 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:35.955203    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk\" (UID: \"3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk"
Jul 22 02:43:35.955436 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:35.955231    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e-manifests\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk\" (UID: \"3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk"
Jul 22 02:43:35.955436 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:35.955283    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zj42\" (UniqueName: \"kubernetes.io/projected/3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e-kube-api-access-4zj42\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk\" (UID: \"3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk"
Jul 22 02:43:35.955436 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:35.955328    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk\" (UID: \"3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk"
Jul 22 02:43:36.056639 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:36.056599    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk\" (UID: \"3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk"
Jul 22 02:43:36.056820 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:36.056669    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e-tmp\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk\" (UID: \"3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk"
Jul 22 02:43:36.056820 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:36.056700    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk\" (UID: \"3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk"
Jul 22 02:43:36.056820 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:36.056725    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e-manifests\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk\" (UID: \"3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk"
Jul 22 02:43:36.056820 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:36.056748    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zj42\" (UniqueName: \"kubernetes.io/projected/3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e-kube-api-access-4zj42\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk\" (UID: \"3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk"
Jul 22 02:43:36.057395 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:36.057372    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e-manifests\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk\" (UID: \"3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk"
Jul 22 02:43:36.057796 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:36.057770    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:36.059386 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:36.059362    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e-tmp\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk\" (UID: \"3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk"
Jul 22 02:43:36.059475 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:36.059411    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk\" (UID: \"3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk"
Jul 22 02:43:36.059529 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:36.059515    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk\" (UID: \"3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk"
Jul 22 02:43:36.078551 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:36.078523    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zj42\" (UniqueName: \"kubernetes.io/projected/3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e-kube-api-access-4zj42\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk\" (UID: \"3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk"
Jul 22 02:43:36.140481 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:36.140394    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk"
Jul 22 02:43:36.195663 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:36.195631    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:36.294393 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:36.294369    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk"]
Jul 22 02:43:36.297070 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:43:36.297045    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c1ec41b_c381_4cfc_b228_a8d6cb3d9a5e.slice/crio-2f58a6885f252d0a464623e12d4209016c1c79a7a265eb3e0e78493c61f7d174 WatchSource:0}: Error finding container 2f58a6885f252d0a464623e12d4209016c1c79a7a265eb3e0e78493c61f7d174: Status 404 returned error can't find the container with id 2f58a6885f252d0a464623e12d4209016c1c79a7a265eb3e0e78493c61f7d174
Jul 22 02:43:36.298793 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:36.298773    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 02:43:36.308983 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:36.308959    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:36.374065 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:36.374036    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk" event={"ID":"3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e","Type":"ContainerStarted","Data":"2f58a6885f252d0a464623e12d4209016c1c79a7a265eb3e0e78493c61f7d174"}
Jul 22 02:43:36.578237 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:36.578205    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:36.697068 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:36.697041    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:37.163844 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:37.163802    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:37.332702 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:37.332668    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:39.392532 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:39.392500    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk" event={"ID":"3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e","Type":"ContainerStarted","Data":"40f7c3fe2549db16bebed65ff8350e07e27a521b23559108383495c8a2677e48"}
Jul 22 02:43:40.397441 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:40.397411    2577 generic.go:356] "Generic (PLEG): container finished" podID="3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e" containerID="40f7c3fe2549db16bebed65ff8350e07e27a521b23559108383495c8a2677e48" exitCode=0
Jul 22 02:43:40.397871 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:40.397482    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk" event={"ID":"3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e","Type":"ContainerDied","Data":"40f7c3fe2549db16bebed65ff8350e07e27a521b23559108383495c8a2677e48"}
Jul 22 02:43:41.404130 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:41.404094    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk" event={"ID":"3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e","Type":"ContainerStarted","Data":"5f67897b6c1480679f6e222356304829bc10ce4ebd1723d5f97024e438fd986c"}
Jul 22 02:43:41.404595 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:41.404211    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk"
Jul 22 02:43:41.501990 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:41.501933    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk" podStartSLOduration=2.164412199 podStartE2EDuration="6.501914788s" totalImagesPullingTime="3.265128778s" totalInitContainerRuntime="1.072373811s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:43:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:43:41.50069462 +0000 UTC m=+382.209123221" watchObservedRunningTime="2026-07-22 02:43:41.501914788 +0000 UTC m=+382.210343388"
Jul 22 02:43:52.410275 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:52.410216    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk"
Jul 22 02:43:54.514579 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:54.514544    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:54.709590 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:54.709555    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:55.345231 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:55.345201    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:55.583074 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:55.583034    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:55.719020 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:55.718938    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d897679c6-g5gvd"]
Jul 22 02:43:55.731400 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:55.731363    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d897679c6-g5gvd"
Jul 22 02:43:55.735775 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:55.735741    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 22 02:43:55.738737 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:55.738717    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 22 02:43:55.739023 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:55.739002    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 22 02:43:55.742077 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:55.742058    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 22 02:43:55.742391 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:55.742379    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mzfx2\""
Jul 22 02:43:55.744419 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:55.744403    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 22 02:43:55.763847 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:55.763810    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d897679c6-g5gvd"]
Jul 22 02:43:55.809804 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:55.809771    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:55.830243 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:55.830202    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqbwp\" (UniqueName: \"kubernetes.io/projected/58051ede-7ae7-432b-b661-2a64f3defb8c-kube-api-access-zqbwp\") pod \"lws-controller-manager-d897679c6-g5gvd\" (UID: \"58051ede-7ae7-432b-b661-2a64f3defb8c\") " pod="openshift-lws-operator/lws-controller-manager-d897679c6-g5gvd"
Jul 22 02:43:55.830243 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:55.830270    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/58051ede-7ae7-432b-b661-2a64f3defb8c-metrics-cert\") pod \"lws-controller-manager-d897679c6-g5gvd\" (UID: \"58051ede-7ae7-432b-b661-2a64f3defb8c\") " pod="openshift-lws-operator/lws-controller-manager-d897679c6-g5gvd"
Jul 22 02:43:55.830540 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:55.830298    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/58051ede-7ae7-432b-b661-2a64f3defb8c-manager-config\") pod \"lws-controller-manager-d897679c6-g5gvd\" (UID: \"58051ede-7ae7-432b-b661-2a64f3defb8c\") " pod="openshift-lws-operator/lws-controller-manager-d897679c6-g5gvd"
Jul 22 02:43:55.830540 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:55.830377    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58051ede-7ae7-432b-b661-2a64f3defb8c-cert\") pod \"lws-controller-manager-d897679c6-g5gvd\" (UID: \"58051ede-7ae7-432b-b661-2a64f3defb8c\") " pod="openshift-lws-operator/lws-controller-manager-d897679c6-g5gvd"
Jul 22 02:43:55.931461 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:55.931418    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58051ede-7ae7-432b-b661-2a64f3defb8c-cert\") pod \"lws-controller-manager-d897679c6-g5gvd\" (UID: \"58051ede-7ae7-432b-b661-2a64f3defb8c\") " pod="openshift-lws-operator/lws-controller-manager-d897679c6-g5gvd"
Jul 22 02:43:55.931681 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:55.931502    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqbwp\" (UniqueName: \"kubernetes.io/projected/58051ede-7ae7-432b-b661-2a64f3defb8c-kube-api-access-zqbwp\") pod \"lws-controller-manager-d897679c6-g5gvd\" (UID: \"58051ede-7ae7-432b-b661-2a64f3defb8c\") " pod="openshift-lws-operator/lws-controller-manager-d897679c6-g5gvd"
Jul 22 02:43:55.931681 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:55.931551    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/58051ede-7ae7-432b-b661-2a64f3defb8c-metrics-cert\") pod \"lws-controller-manager-d897679c6-g5gvd\" (UID: \"58051ede-7ae7-432b-b661-2a64f3defb8c\") " pod="openshift-lws-operator/lws-controller-manager-d897679c6-g5gvd"
Jul 22 02:43:55.931681 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:55.931590    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/58051ede-7ae7-432b-b661-2a64f3defb8c-manager-config\") pod \"lws-controller-manager-d897679c6-g5gvd\" (UID: \"58051ede-7ae7-432b-b661-2a64f3defb8c\") " pod="openshift-lws-operator/lws-controller-manager-d897679c6-g5gvd"
Jul 22 02:43:55.932245 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:55.932205    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/58051ede-7ae7-432b-b661-2a64f3defb8c-manager-config\") pod \"lws-controller-manager-d897679c6-g5gvd\" (UID: \"58051ede-7ae7-432b-b661-2a64f3defb8c\") " pod="openshift-lws-operator/lws-controller-manager-d897679c6-g5gvd"
Jul 22 02:43:55.934328 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:55.934303    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/58051ede-7ae7-432b-b661-2a64f3defb8c-metrics-cert\") pod \"lws-controller-manager-d897679c6-g5gvd\" (UID: \"58051ede-7ae7-432b-b661-2a64f3defb8c\") " pod="openshift-lws-operator/lws-controller-manager-d897679c6-g5gvd"
Jul 22 02:43:55.934452 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:55.934414    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58051ede-7ae7-432b-b661-2a64f3defb8c-cert\") pod \"lws-controller-manager-d897679c6-g5gvd\" (UID: \"58051ede-7ae7-432b-b661-2a64f3defb8c\") " pod="openshift-lws-operator/lws-controller-manager-d897679c6-g5gvd"
Jul 22 02:43:55.942792 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:55.942761    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqbwp\" (UniqueName: \"kubernetes.io/projected/58051ede-7ae7-432b-b661-2a64f3defb8c-kube-api-access-zqbwp\") pod \"lws-controller-manager-d897679c6-g5gvd\" (UID: \"58051ede-7ae7-432b-b661-2a64f3defb8c\") " pod="openshift-lws-operator/lws-controller-manager-d897679c6-g5gvd"
Jul 22 02:43:55.972329 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:55.972212    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:56.041723 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:56.041686    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d897679c6-g5gvd"
Jul 22 02:43:56.084370 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:56.084314    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:56.233971 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:56.233848    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d897679c6-g5gvd"]
Jul 22 02:43:56.238809 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:43:56.238754    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58051ede_7ae7_432b_b661_2a64f3defb8c.slice/crio-780097c53f9e7c8d212a7fa2827a8e92f5a907a87b3f3534b36f7397889f2cfb WatchSource:0}: Error finding container 780097c53f9e7c8d212a7fa2827a8e92f5a907a87b3f3534b36f7397889f2cfb: Status 404 returned error can't find the container with id 780097c53f9e7c8d212a7fa2827a8e92f5a907a87b3f3534b36f7397889f2cfb
Jul 22 02:43:56.253036 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:56.253003    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:56.461295 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:56.461235    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d897679c6-g5gvd" event={"ID":"58051ede-7ae7-432b-b661-2a64f3defb8c","Type":"ContainerStarted","Data":"780097c53f9e7c8d212a7fa2827a8e92f5a907a87b3f3534b36f7397889f2cfb"}
Jul 22 02:43:56.961634 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:56.961599    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:57.059231 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:57.059199    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:57.433147 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:57.433113    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:57.536118 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:57.536085    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:59.039571 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:59.039537    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:43:59.478123 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:59.478021    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d897679c6-g5gvd" event={"ID":"58051ede-7ae7-432b-b661-2a64f3defb8c","Type":"ContainerStarted","Data":"71f1003537888a77e96cc103c8fdd034f711af523fc006fea53828540996ea8b"}
Jul 22 02:43:59.478317 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:59.478182    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d897679c6-g5gvd"
Jul 22 02:43:59.500838 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:43:59.500773    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d897679c6-g5gvd" podStartSLOduration=2.058382337 podStartE2EDuration="4.500749093s" totalImagesPullingTime="2.442366756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:43:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:43:59.498936385 +0000 UTC m=+400.207364984" watchObservedRunningTime="2026-07-22 02:43:59.500749093 +0000 UTC m=+400.209177695"
Jul 22 02:44:04.842798 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:04.842762    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"]
Jul 22 02:44:04.847219 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:04.847192    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"
Jul 22 02:44:04.851399 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:04.851372    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 22 02:44:04.851787 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:04.851767    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 22 02:44:04.851888 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:04.851802    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 22 02:44:04.851888 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:04.851829    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 22 02:44:04.852780 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:04.852763    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 22 02:44:04.852857 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:04.852800    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rgj7v\""
Jul 22 02:44:04.853022 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:04.853008    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 22 02:44:04.865191 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:04.865166    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"]
Jul 22 02:44:05.014864 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:05.014823    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5e7361b-aa83-4fd4-87a8-c23098be0392-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hb57g\" (UID: \"c5e7361b-aa83-4fd4-87a8-c23098be0392\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"
Jul 22 02:44:05.014864 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:05.014864    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5e7361b-aa83-4fd4-87a8-c23098be0392-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hb57g\" (UID: \"c5e7361b-aa83-4fd4-87a8-c23098be0392\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"
Jul 22 02:44:05.015090 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:05.014894    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54cmk\" (UniqueName: \"kubernetes.io/projected/c5e7361b-aa83-4fd4-87a8-c23098be0392-kube-api-access-54cmk\") pod \"istiod-openshift-gateway-94bb8fbfd-hb57g\" (UID: \"c5e7361b-aa83-4fd4-87a8-c23098be0392\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"
Jul 22 02:44:05.015090 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:05.014974    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5e7361b-aa83-4fd4-87a8-c23098be0392-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hb57g\" (UID: \"c5e7361b-aa83-4fd4-87a8-c23098be0392\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"
Jul 22 02:44:05.015090 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:05.015009    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5e7361b-aa83-4fd4-87a8-c23098be0392-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hb57g\" (UID: \"c5e7361b-aa83-4fd4-87a8-c23098be0392\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"
Jul 22 02:44:05.015090 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:05.015049    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5e7361b-aa83-4fd4-87a8-c23098be0392-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hb57g\" (UID: \"c5e7361b-aa83-4fd4-87a8-c23098be0392\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"
Jul 22 02:44:05.015090 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:05.015081    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5e7361b-aa83-4fd4-87a8-c23098be0392-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hb57g\" (UID: \"c5e7361b-aa83-4fd4-87a8-c23098be0392\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"
Jul 22 02:44:05.116605 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:05.116519    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54cmk\" (UniqueName: \"kubernetes.io/projected/c5e7361b-aa83-4fd4-87a8-c23098be0392-kube-api-access-54cmk\") pod \"istiod-openshift-gateway-94bb8fbfd-hb57g\" (UID: \"c5e7361b-aa83-4fd4-87a8-c23098be0392\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"
Jul 22 02:44:05.116605 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:05.116574    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5e7361b-aa83-4fd4-87a8-c23098be0392-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hb57g\" (UID: \"c5e7361b-aa83-4fd4-87a8-c23098be0392\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"
Jul 22 02:44:05.116605 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:05.116595    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5e7361b-aa83-4fd4-87a8-c23098be0392-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hb57g\" (UID: \"c5e7361b-aa83-4fd4-87a8-c23098be0392\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"
Jul 22 02:44:05.116860 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:05.116638    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5e7361b-aa83-4fd4-87a8-c23098be0392-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hb57g\" (UID: \"c5e7361b-aa83-4fd4-87a8-c23098be0392\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"
Jul 22 02:44:05.116860 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:05.116673    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5e7361b-aa83-4fd4-87a8-c23098be0392-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hb57g\" (UID: \"c5e7361b-aa83-4fd4-87a8-c23098be0392\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"
Jul 22 02:44:05.116860 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:05.116718    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5e7361b-aa83-4fd4-87a8-c23098be0392-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hb57g\" (UID: \"c5e7361b-aa83-4fd4-87a8-c23098be0392\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"
Jul 22 02:44:05.116860 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:05.116742    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5e7361b-aa83-4fd4-87a8-c23098be0392-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hb57g\" (UID: \"c5e7361b-aa83-4fd4-87a8-c23098be0392\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"
Jul 22 02:44:05.117719 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:05.117687    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5e7361b-aa83-4fd4-87a8-c23098be0392-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hb57g\" (UID: \"c5e7361b-aa83-4fd4-87a8-c23098be0392\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"
Jul 22 02:44:05.119709 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:05.119684    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5e7361b-aa83-4fd4-87a8-c23098be0392-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hb57g\" (UID: \"c5e7361b-aa83-4fd4-87a8-c23098be0392\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"
Jul 22 02:44:05.119822 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:05.119734    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5e7361b-aa83-4fd4-87a8-c23098be0392-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hb57g\" (UID: \"c5e7361b-aa83-4fd4-87a8-c23098be0392\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"
Jul 22 02:44:05.119926 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:05.119908    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5e7361b-aa83-4fd4-87a8-c23098be0392-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hb57g\" (UID: \"c5e7361b-aa83-4fd4-87a8-c23098be0392\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"
Jul 22 02:44:05.120079 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:05.120061    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5e7361b-aa83-4fd4-87a8-c23098be0392-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hb57g\" (UID: \"c5e7361b-aa83-4fd4-87a8-c23098be0392\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"
Jul 22 02:44:05.127634 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:05.127604    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5e7361b-aa83-4fd4-87a8-c23098be0392-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hb57g\" (UID: \"c5e7361b-aa83-4fd4-87a8-c23098be0392\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"
Jul 22 02:44:05.127778 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:05.127697    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54cmk\" (UniqueName: \"kubernetes.io/projected/c5e7361b-aa83-4fd4-87a8-c23098be0392-kube-api-access-54cmk\") pod \"istiod-openshift-gateway-94bb8fbfd-hb57g\" (UID: \"c5e7361b-aa83-4fd4-87a8-c23098be0392\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"
Jul 22 02:44:05.156661 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:05.156626    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"
Jul 22 02:44:05.392835 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:05.392802    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"]
Jul 22 02:44:05.395645 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:44:05.395616    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5e7361b_aa83_4fd4_87a8_c23098be0392.slice/crio-d5f39c41bb18f6f58ecd7d044b9627d513b736e0eb958c8b5f65dd6ca4e4d6d7 WatchSource:0}: Error finding container d5f39c41bb18f6f58ecd7d044b9627d513b736e0eb958c8b5f65dd6ca4e4d6d7: Status 404 returned error can't find the container with id d5f39c41bb18f6f58ecd7d044b9627d513b736e0eb958c8b5f65dd6ca4e4d6d7
Jul 22 02:44:05.507191 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:05.507155    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g" event={"ID":"c5e7361b-aa83-4fd4-87a8-c23098be0392","Type":"ContainerStarted","Data":"d5f39c41bb18f6f58ecd7d044b9627d513b736e0eb958c8b5f65dd6ca4e4d6d7"}
Jul 22 02:44:08.374033 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:08.373997    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:44:08.547838 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:08.547799    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:44:08.685316 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:08.685215    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:44:09.842579 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:09.842550    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:44:09.951390 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:09.951351    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:44:10.116345 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:10.116244    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:44:10.484056 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:10.483938    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d897679c6-g5gvd"
Jul 22 02:44:14.917375 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:14.917327    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 02:44:14.917692 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:14.917396    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 02:44:15.447285 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:15.447240    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:44:15.548302 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:15.548231    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g" event={"ID":"c5e7361b-aa83-4fd4-87a8-c23098be0392","Type":"ContainerStarted","Data":"c2ca2106afd9fb58e717374588366432410308cb1b497140bbbf6f63e7ae527d"}
Jul 22 02:44:15.548510 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:15.548486    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"
Jul 22 02:44:15.550205 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:15.550174    2577 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-hb57g container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 02:44:15.550332 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:15.550229    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g" podUID="c5e7361b-aa83-4fd4-87a8-c23098be0392" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 02:44:15.555937 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:15.555911    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:44:15.579997 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:15.579755    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g" podStartSLOduration=2.061017387 podStartE2EDuration="11.579730706s" totalImagesPullingTime="9.518713319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:44:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:44:15.576540715 +0000 UTC m=+416.284969403" watchObservedRunningTime="2026-07-22 02:44:15.579730706 +0000 UTC m=+416.288159307"
Jul 22 02:44:15.743048 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:15.743022    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:44:15.903645 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:15.903612    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:44:16.045380 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:16.045299    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:44:16.552685 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:16.552655    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hb57g"
Jul 22 02:44:38.459925 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:38.459888    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:44:56.199443 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:56.199362    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:44:56.316727 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:56.316691    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:44:56.459471 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:44:56.459389    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:18.534860 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:18.534823    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:21.921971 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:21.921928    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:23.165839 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:23.165806    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:23.268920 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:23.268879    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:25.183769 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:25.183734    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:26.619590 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:26.619549    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:26.738432 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:26.738402    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:27.543850 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:27.543814    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:30.664164 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:30.664110    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:31.579510 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:31.579476    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:33.389199 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:33.389160    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:34.321971 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:34.321926    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:34.423102 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:34.423068    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:34.521164 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:34.521126    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:34.771486 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:34.771447    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:34.948199 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:34.948165    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:35.049488 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:35.049401    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:38.544468 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:38.544415    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:38.612858 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:38.612817    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:45.250484 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:45.250442    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7x6s"]
Jul 22 02:45:45.254153 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:45.254127    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7x6s"
Jul 22 02:45:45.257770 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:45.257742    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 02:45:45.257914 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:45.257751    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 02:45:45.257914 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:45.257897    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4fvbz\""
Jul 22 02:45:45.278075 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:45.278039    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7x6s"]
Jul 22 02:45:45.360273 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:45.360206    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6snp\" (UniqueName: \"kubernetes.io/projected/aa2407fa-a66c-42ba-b09f-6349c5c04a26-kube-api-access-b6snp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z7x6s\" (UID: \"aa2407fa-a66c-42ba-b09f-6349c5c04a26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7x6s"
Jul 22 02:45:45.360479 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:45.360347    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa2407fa-a66c-42ba-b09f-6349c5c04a26-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z7x6s\" (UID: \"aa2407fa-a66c-42ba-b09f-6349c5c04a26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7x6s"
Jul 22 02:45:45.461341 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:45.461287    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa2407fa-a66c-42ba-b09f-6349c5c04a26-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z7x6s\" (UID: \"aa2407fa-a66c-42ba-b09f-6349c5c04a26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7x6s"
Jul 22 02:45:45.461521 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:45.461390    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6snp\" (UniqueName: \"kubernetes.io/projected/aa2407fa-a66c-42ba-b09f-6349c5c04a26-kube-api-access-b6snp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z7x6s\" (UID: \"aa2407fa-a66c-42ba-b09f-6349c5c04a26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7x6s"
Jul 22 02:45:45.461715 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:45.461698    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa2407fa-a66c-42ba-b09f-6349c5c04a26-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z7x6s\" (UID: \"aa2407fa-a66c-42ba-b09f-6349c5c04a26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7x6s"
Jul 22 02:45:45.475580 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:45.475546    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6snp\" (UniqueName: \"kubernetes.io/projected/aa2407fa-a66c-42ba-b09f-6349c5c04a26-kube-api-access-b6snp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z7x6s\" (UID: \"aa2407fa-a66c-42ba-b09f-6349c5c04a26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7x6s"
Jul 22 02:45:45.566622 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:45.566524    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7x6s"
Jul 22 02:45:45.727049 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:45.727020    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7x6s"]
Jul 22 02:45:45.727945 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:45:45.727922    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa2407fa_a66c_42ba_b09f_6349c5c04a26.slice/crio-69b065e92a10e70ba1c3f4c63267bfa20fae3ff7da3648afb7564a833a91e891 WatchSource:0}: Error finding container 69b065e92a10e70ba1c3f4c63267bfa20fae3ff7da3648afb7564a833a91e891: Status 404 returned error can't find the container with id 69b065e92a10e70ba1c3f4c63267bfa20fae3ff7da3648afb7564a833a91e891
Jul 22 02:45:45.887270 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:45.887160    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7x6s" event={"ID":"aa2407fa-a66c-42ba-b09f-6349c5c04a26","Type":"ContainerStarted","Data":"69b065e92a10e70ba1c3f4c63267bfa20fae3ff7da3648afb7564a833a91e891"}
Jul 22 02:45:48.151614 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:48.151567    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:48.252154 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:48.252113    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:49.906421 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:49.906383    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7x6s" event={"ID":"aa2407fa-a66c-42ba-b09f-6349c5c04a26","Type":"ContainerStarted","Data":"c906c8b1374bb94514b0542ed56a7af2bc3784c2287cfd245f1e7ad22798799d"}
Jul 22 02:45:49.906836 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:49.906519    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7x6s"
Jul 22 02:45:49.935807 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:49.935747    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7x6s" podStartSLOduration=0.85861397 podStartE2EDuration="4.935730198s" totalImagesPullingTime="4.077116228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:45:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:45:49.932806846 +0000 UTC m=+510.641235448" watchObservedRunningTime="2026-07-22 02:45:49.935730198 +0000 UTC m=+510.644158797"
Jul 22 02:45:51.240396 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:51.240350    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:51.352497 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:51.352458    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:53.740896 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:53.740858    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:53.846118 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:53.846083    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:57.366084 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:57.366046    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:45:57.434040 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:45:57.434006    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:46:00.913333 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:00.913296    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7x6s"
Jul 22 02:46:07.211604 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:07.211564    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:46:07.366407 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:07.366374    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:46:07.532600 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:07.532564    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:46:08.337198 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:08.337150    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7x6s"]
Jul 22 02:46:08.337703 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:08.337366    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7x6s" podUID="aa2407fa-a66c-42ba-b09f-6349c5c04a26" containerName="manager" containerID="cri-o://c906c8b1374bb94514b0542ed56a7af2bc3784c2287cfd245f1e7ad22798799d" gracePeriod=10
Jul 22 02:46:08.632215 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:08.632188    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7x6s"
Jul 22 02:46:08.663265 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:08.663212    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa2407fa-a66c-42ba-b09f-6349c5c04a26-extensions-socket-volume\") pod \"aa2407fa-a66c-42ba-b09f-6349c5c04a26\" (UID: \"aa2407fa-a66c-42ba-b09f-6349c5c04a26\") "
Jul 22 02:46:08.663420 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:08.663349    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6snp\" (UniqueName: \"kubernetes.io/projected/aa2407fa-a66c-42ba-b09f-6349c5c04a26-kube-api-access-b6snp\") pod \"aa2407fa-a66c-42ba-b09f-6349c5c04a26\" (UID: \"aa2407fa-a66c-42ba-b09f-6349c5c04a26\") "
Jul 22 02:46:08.663701 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:08.663675    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa2407fa-a66c-42ba-b09f-6349c5c04a26-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "aa2407fa-a66c-42ba-b09f-6349c5c04a26" (UID: "aa2407fa-a66c-42ba-b09f-6349c5c04a26"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 02:46:08.665638 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:08.665613    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa2407fa-a66c-42ba-b09f-6349c5c04a26-kube-api-access-b6snp" (OuterVolumeSpecName: "kube-api-access-b6snp") pod "aa2407fa-a66c-42ba-b09f-6349c5c04a26" (UID: "aa2407fa-a66c-42ba-b09f-6349c5c04a26"). InnerVolumeSpecName "kube-api-access-b6snp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 02:46:08.764182 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:08.764132    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa2407fa-a66c-42ba-b09f-6349c5c04a26-extensions-socket-volume\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:46:08.764182 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:08.764174    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6snp\" (UniqueName: \"kubernetes.io/projected/aa2407fa-a66c-42ba-b09f-6349c5c04a26-kube-api-access-b6snp\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:46:08.989894 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:08.989809    2577 generic.go:356] "Generic (PLEG): container finished" podID="aa2407fa-a66c-42ba-b09f-6349c5c04a26" containerID="c906c8b1374bb94514b0542ed56a7af2bc3784c2287cfd245f1e7ad22798799d" exitCode=0
Jul 22 02:46:08.989894 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:08.989849    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7x6s"
Jul 22 02:46:08.989894 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:08.989872    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7x6s" event={"ID":"aa2407fa-a66c-42ba-b09f-6349c5c04a26","Type":"ContainerDied","Data":"c906c8b1374bb94514b0542ed56a7af2bc3784c2287cfd245f1e7ad22798799d"}
Jul 22 02:46:08.990145 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:08.989921    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7x6s" event={"ID":"aa2407fa-a66c-42ba-b09f-6349c5c04a26","Type":"ContainerDied","Data":"69b065e92a10e70ba1c3f4c63267bfa20fae3ff7da3648afb7564a833a91e891"}
Jul 22 02:46:08.990145 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:08.989945    2577 scope.go:117] "RemoveContainer" containerID="c906c8b1374bb94514b0542ed56a7af2bc3784c2287cfd245f1e7ad22798799d"
Jul 22 02:46:08.999441 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:08.999423    2577 scope.go:117] "RemoveContainer" containerID="c906c8b1374bb94514b0542ed56a7af2bc3784c2287cfd245f1e7ad22798799d"
Jul 22 02:46:08.999729 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:46:08.999710    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c906c8b1374bb94514b0542ed56a7af2bc3784c2287cfd245f1e7ad22798799d\": container with ID starting with c906c8b1374bb94514b0542ed56a7af2bc3784c2287cfd245f1e7ad22798799d not found: ID does not exist" containerID="c906c8b1374bb94514b0542ed56a7af2bc3784c2287cfd245f1e7ad22798799d"
Jul 22 02:46:08.999768 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:08.999738    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c906c8b1374bb94514b0542ed56a7af2bc3784c2287cfd245f1e7ad22798799d"} err="failed to get container status \"c906c8b1374bb94514b0542ed56a7af2bc3784c2287cfd245f1e7ad22798799d\": rpc error: code = NotFound desc = could not find container \"c906c8b1374bb94514b0542ed56a7af2bc3784c2287cfd245f1e7ad22798799d\": container with ID starting with c906c8b1374bb94514b0542ed56a7af2bc3784c2287cfd245f1e7ad22798799d not found: ID does not exist"
Jul 22 02:46:09.013006 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:09.012978    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7x6s"]
Jul 22 02:46:09.021506 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:09.021477    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7x6s"]
Jul 22 02:46:09.757795 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:09.757751    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa2407fa-a66c-42ba-b09f-6349c5c04a26" path="/var/lib/kubelet/pods/aa2407fa-a66c-42ba-b09f-6349c5c04a26/volumes"
Jul 22 02:46:10.166472 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:10.166365    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:46:10.266609 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:10.266577    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:46:22.324633 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:22.324596    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:46:22.424891 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:22.424860    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:46:24.741243 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:24.741197    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:46:24.957227 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:24.957195    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:46:26.407430 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:26.407399    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7k4fx"]
Jul 22 02:46:26.407893 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:26.407773    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa2407fa-a66c-42ba-b09f-6349c5c04a26" containerName="manager"
Jul 22 02:46:26.407893 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:26.407791    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa2407fa-a66c-42ba-b09f-6349c5c04a26" containerName="manager"
Jul 22 02:46:26.407893 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:26.407876    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa2407fa-a66c-42ba-b09f-6349c5c04a26" containerName="manager"
Jul 22 02:46:26.408043 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:26.407996    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:46:26.412382 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:26.412362    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7k4fx"
Jul 22 02:46:26.415115 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:26.415098    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 02:46:26.416383 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:26.416356    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 02:46:26.416487 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:26.416380    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 22 02:46:26.416487 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:26.416356    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-crzfq\""
Jul 22 02:46:26.419793 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:26.419767    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7k4fx"]
Jul 22 02:46:26.501092 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:26.501051    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7k4fx"]
Jul 22 02:46:26.502366 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:26.502340    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3f0fb4a7-8992-4464-b5ef-f067f7a79620-config-file\") pod \"limitador-limitador-64c94fd64f-7k4fx\" (UID: \"3f0fb4a7-8992-4464-b5ef-f067f7a79620\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7k4fx"
Jul 22 02:46:26.502495 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:26.502392    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42pwz\" (UniqueName: \"kubernetes.io/projected/3f0fb4a7-8992-4464-b5ef-f067f7a79620-kube-api-access-42pwz\") pod \"limitador-limitador-64c94fd64f-7k4fx\" (UID: \"3f0fb4a7-8992-4464-b5ef-f067f7a79620\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7k4fx"
Jul 22 02:46:26.516514 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:26.516487    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:46:26.603069 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:26.603040    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3f0fb4a7-8992-4464-b5ef-f067f7a79620-config-file\") pod \"limitador-limitador-64c94fd64f-7k4fx\" (UID: \"3f0fb4a7-8992-4464-b5ef-f067f7a79620\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7k4fx"
Jul 22 02:46:26.603069 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:26.603078    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42pwz\" (UniqueName: \"kubernetes.io/projected/3f0fb4a7-8992-4464-b5ef-f067f7a79620-kube-api-access-42pwz\") pod \"limitador-limitador-64c94fd64f-7k4fx\" (UID: \"3f0fb4a7-8992-4464-b5ef-f067f7a79620\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7k4fx"
Jul 22 02:46:26.603694 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:26.603675    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3f0fb4a7-8992-4464-b5ef-f067f7a79620-config-file\") pod \"limitador-limitador-64c94fd64f-7k4fx\" (UID: \"3f0fb4a7-8992-4464-b5ef-f067f7a79620\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7k4fx"
Jul 22 02:46:26.612952 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:26.612926    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42pwz\" (UniqueName: \"kubernetes.io/projected/3f0fb4a7-8992-4464-b5ef-f067f7a79620-kube-api-access-42pwz\") pod \"limitador-limitador-64c94fd64f-7k4fx\" (UID: \"3f0fb4a7-8992-4464-b5ef-f067f7a79620\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7k4fx"
Jul 22 02:46:26.619084 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:26.619055    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:46:26.723778 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:26.723672    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7k4fx"
Jul 22 02:46:26.860714 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:26.860672    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7k4fx"]
Jul 22 02:46:26.864497 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:46:26.864467    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0fb4a7_8992_4464_b5ef_f067f7a79620.slice/crio-3c828b615e52a4c1f8a913cb65bc481028149b7acc46dbaac0ec3ead11f2a1e5 WatchSource:0}: Error finding container 3c828b615e52a4c1f8a913cb65bc481028149b7acc46dbaac0ec3ead11f2a1e5: Status 404 returned error can't find the container with id 3c828b615e52a4c1f8a913cb65bc481028149b7acc46dbaac0ec3ead11f2a1e5
Jul 22 02:46:27.063306 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:27.063273    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7k4fx" event={"ID":"3f0fb4a7-8992-4464-b5ef-f067f7a79620","Type":"ContainerStarted","Data":"3c828b615e52a4c1f8a913cb65bc481028149b7acc46dbaac0ec3ead11f2a1e5"}
Jul 22 02:46:27.235480 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:27.235439    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:46:27.304033 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:27.303949    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:46:30.076869 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:30.076826    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7k4fx" event={"ID":"3f0fb4a7-8992-4464-b5ef-f067f7a79620","Type":"ContainerStarted","Data":"3839e17967532d5af95355cfe93359077e1d9631167b11b78d03858a2d2e7b1b"}
Jul 22 02:46:30.077858 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:30.076963    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-7k4fx"
Jul 22 02:46:30.095698 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:30.095648    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-7k4fx" podStartSLOduration=1.541497023 podStartE2EDuration="4.095629775s" totalImagesPullingTime="2.554132752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:46:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:46:30.094284632 +0000 UTC m=+550.802713234" watchObservedRunningTime="2026-07-22 02:46:30.095629775 +0000 UTC m=+550.804058376"
Jul 22 02:46:41.081147 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:41.081111    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-7k4fx"
Jul 22 02:46:43.851684 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:43.851649    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7k4fx"]
Jul 22 02:46:43.852129 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:43.851863    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-7k4fx" podUID="3f0fb4a7-8992-4464-b5ef-f067f7a79620" containerName="limitador" containerID="cri-o://3839e17967532d5af95355cfe93359077e1d9631167b11b78d03858a2d2e7b1b" gracePeriod=30
Jul 22 02:46:44.404743 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:44.404716    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7k4fx"
Jul 22 02:46:44.462538 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:44.462442    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3f0fb4a7-8992-4464-b5ef-f067f7a79620-config-file\") pod \"3f0fb4a7-8992-4464-b5ef-f067f7a79620\" (UID: \"3f0fb4a7-8992-4464-b5ef-f067f7a79620\") "
Jul 22 02:46:44.462538 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:44.462510    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42pwz\" (UniqueName: \"kubernetes.io/projected/3f0fb4a7-8992-4464-b5ef-f067f7a79620-kube-api-access-42pwz\") pod \"3f0fb4a7-8992-4464-b5ef-f067f7a79620\" (UID: \"3f0fb4a7-8992-4464-b5ef-f067f7a79620\") "
Jul 22 02:46:44.462817 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:44.462792    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f0fb4a7-8992-4464-b5ef-f067f7a79620-config-file" (OuterVolumeSpecName: "config-file") pod "3f0fb4a7-8992-4464-b5ef-f067f7a79620" (UID: "3f0fb4a7-8992-4464-b5ef-f067f7a79620"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 02:46:44.464775 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:44.464754    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f0fb4a7-8992-4464-b5ef-f067f7a79620-kube-api-access-42pwz" (OuterVolumeSpecName: "kube-api-access-42pwz") pod "3f0fb4a7-8992-4464-b5ef-f067f7a79620" (UID: "3f0fb4a7-8992-4464-b5ef-f067f7a79620"). InnerVolumeSpecName "kube-api-access-42pwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 02:46:44.563866 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:44.563820    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42pwz\" (UniqueName: \"kubernetes.io/projected/3f0fb4a7-8992-4464-b5ef-f067f7a79620-kube-api-access-42pwz\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:46:44.563866 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:44.563858    2577 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3f0fb4a7-8992-4464-b5ef-f067f7a79620-config-file\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:46:45.142447 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:45.142408    2577 generic.go:356] "Generic (PLEG): container finished" podID="3f0fb4a7-8992-4464-b5ef-f067f7a79620" containerID="3839e17967532d5af95355cfe93359077e1d9631167b11b78d03858a2d2e7b1b" exitCode=0
Jul 22 02:46:45.142928 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:45.142457    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7k4fx"
Jul 22 02:46:45.142928 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:45.142477    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7k4fx" event={"ID":"3f0fb4a7-8992-4464-b5ef-f067f7a79620","Type":"ContainerDied","Data":"3839e17967532d5af95355cfe93359077e1d9631167b11b78d03858a2d2e7b1b"}
Jul 22 02:46:45.142928 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:45.142531    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7k4fx" event={"ID":"3f0fb4a7-8992-4464-b5ef-f067f7a79620","Type":"ContainerDied","Data":"3c828b615e52a4c1f8a913cb65bc481028149b7acc46dbaac0ec3ead11f2a1e5"}
Jul 22 02:46:45.142928 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:45.142561    2577 scope.go:117] "RemoveContainer" containerID="3839e17967532d5af95355cfe93359077e1d9631167b11b78d03858a2d2e7b1b"
Jul 22 02:46:45.151672 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:45.151653    2577 scope.go:117] "RemoveContainer" containerID="3839e17967532d5af95355cfe93359077e1d9631167b11b78d03858a2d2e7b1b"
Jul 22 02:46:45.151971 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:46:45.151949    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3839e17967532d5af95355cfe93359077e1d9631167b11b78d03858a2d2e7b1b\": container with ID starting with 3839e17967532d5af95355cfe93359077e1d9631167b11b78d03858a2d2e7b1b not found: ID does not exist" containerID="3839e17967532d5af95355cfe93359077e1d9631167b11b78d03858a2d2e7b1b"
Jul 22 02:46:45.152024 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:45.151985    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3839e17967532d5af95355cfe93359077e1d9631167b11b78d03858a2d2e7b1b"} err="failed to get container status \"3839e17967532d5af95355cfe93359077e1d9631167b11b78d03858a2d2e7b1b\": rpc error: code = NotFound desc = could not find container \"3839e17967532d5af95355cfe93359077e1d9631167b11b78d03858a2d2e7b1b\": container with ID starting with 3839e17967532d5af95355cfe93359077e1d9631167b11b78d03858a2d2e7b1b not found: ID does not exist"
Jul 22 02:46:45.165526 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:45.165496    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7k4fx"]
Jul 22 02:46:45.167982 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:45.167954    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7k4fx"]
Jul 22 02:46:45.756773 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:45.756740    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f0fb4a7-8992-4464-b5ef-f067f7a79620" path="/var/lib/kubelet/pods/3f0fb4a7-8992-4464-b5ef-f067f7a79620/volumes"
Jul 22 02:46:47.681847 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:47.681809    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:46:47.778029 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:47.777983    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:46:48.118888 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:48.118849    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-pkkkf"]
Jul 22 02:46:48.119315 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:48.119300    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f0fb4a7-8992-4464-b5ef-f067f7a79620" containerName="limitador"
Jul 22 02:46:48.119370 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:48.119318    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f0fb4a7-8992-4464-b5ef-f067f7a79620" containerName="limitador"
Jul 22 02:46:48.119415 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:48.119405    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f0fb4a7-8992-4464-b5ef-f067f7a79620" containerName="limitador"
Jul 22 02:46:48.124110 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:48.124085    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pkkkf"
Jul 22 02:46:48.127301 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:48.127273    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 02:46:48.127301 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:48.127294    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 22 02:46:48.128337 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:48.128311    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 02:46:48.128833 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:48.128790    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-spt4j\""
Jul 22 02:46:48.130799 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:48.130775    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-pkkkf"]
Jul 22 02:46:48.151016 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:48.150983    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:46:48.197840 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:48.197799    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9fbx\" (UniqueName: \"kubernetes.io/projected/3e0bd774-2db3-45bc-bac8-11e8782dc1d8-kube-api-access-b9fbx\") pod \"postgres-69fb4594cf-pkkkf\" (UID: \"3e0bd774-2db3-45bc-bac8-11e8782dc1d8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pkkkf"
Jul 22 02:46:48.198012 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:48.197851    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3e0bd774-2db3-45bc-bac8-11e8782dc1d8-data\") pod \"postgres-69fb4594cf-pkkkf\" (UID: \"3e0bd774-2db3-45bc-bac8-11e8782dc1d8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pkkkf"
Jul 22 02:46:48.298609 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:48.298561    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9fbx\" (UniqueName: \"kubernetes.io/projected/3e0bd774-2db3-45bc-bac8-11e8782dc1d8-kube-api-access-b9fbx\") pod \"postgres-69fb4594cf-pkkkf\" (UID: \"3e0bd774-2db3-45bc-bac8-11e8782dc1d8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pkkkf"
Jul 22 02:46:48.298798 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:48.298627    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3e0bd774-2db3-45bc-bac8-11e8782dc1d8-data\") pod \"postgres-69fb4594cf-pkkkf\" (UID: \"3e0bd774-2db3-45bc-bac8-11e8782dc1d8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pkkkf"
Jul 22 02:46:48.299063 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:48.299043    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3e0bd774-2db3-45bc-bac8-11e8782dc1d8-data\") pod \"postgres-69fb4594cf-pkkkf\" (UID: \"3e0bd774-2db3-45bc-bac8-11e8782dc1d8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pkkkf"
Jul 22 02:46:48.308647 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:48.308622    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9fbx\" (UniqueName: \"kubernetes.io/projected/3e0bd774-2db3-45bc-bac8-11e8782dc1d8-kube-api-access-b9fbx\") pod \"postgres-69fb4594cf-pkkkf\" (UID: \"3e0bd774-2db3-45bc-bac8-11e8782dc1d8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pkkkf"
Jul 22 02:46:48.438224 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:48.438135    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pkkkf"
Jul 22 02:46:48.574694 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:48.574655    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-pkkkf"]
Jul 22 02:46:48.577537 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:46:48.577510    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e0bd774_2db3_45bc_bac8_11e8782dc1d8.slice/crio-130e757665ab40472e9ee7c854ba04b15f65e64d2a1cf03698974c2b5df16666 WatchSource:0}: Error finding container 130e757665ab40472e9ee7c854ba04b15f65e64d2a1cf03698974c2b5df16666: Status 404 returned error can't find the container with id 130e757665ab40472e9ee7c854ba04b15f65e64d2a1cf03698974c2b5df16666
Jul 22 02:46:49.159128 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:49.159091    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pkkkf" event={"ID":"3e0bd774-2db3-45bc-bac8-11e8782dc1d8","Type":"ContainerStarted","Data":"130e757665ab40472e9ee7c854ba04b15f65e64d2a1cf03698974c2b5df16666"}
Jul 22 02:46:54.184611 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:54.184569    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pkkkf" event={"ID":"3e0bd774-2db3-45bc-bac8-11e8782dc1d8","Type":"ContainerStarted","Data":"371ed72ecf6dcb08f78d75c5f1e631a3be24b213fe4d42fba5a201041172cf4d"}
Jul 22 02:46:54.185010 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:54.184679    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pkkkf"
Jul 22 02:46:54.203454 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:54.203396    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pkkkf" podStartSLOduration=0.671710524 podStartE2EDuration="6.203380266s" totalImagesPullingTime="5.531669742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:46:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:46:54.201954275 +0000 UTC m=+574.910382902" watchObservedRunningTime="2026-07-22 02:46:54.203380266 +0000 UTC m=+574.911808866"
Jul 22 02:46:56.172633 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:46:56.172588    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:47:00.220006 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:00.219972    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pkkkf"
Jul 22 02:47:00.553070 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:00.553034    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:47:01.128408 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:01.128375    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:47:07.807296 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:07.807225    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:47:07.825687 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:07.825648    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54c45d7698-h7jts"]
Jul 22 02:47:07.833045 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:07.833017    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54c45d7698-h7jts"
Jul 22 02:47:07.836293 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:07.836237    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 02:47:07.836613 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:07.836594    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 02:47:07.836778 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:07.836757    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9k7nc\""
Jul 22 02:47:07.844775 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:07.844750    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54c45d7698-h7jts"]
Jul 22 02:47:07.868618 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:07.868544    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a994a9e-c0ec-4036-8311-ff27f10b84e4-webhook-cert\") pod \"maas-controller-54c45d7698-h7jts\" (UID: \"8a994a9e-c0ec-4036-8311-ff27f10b84e4\") " pod="opendatahub/maas-controller-54c45d7698-h7jts"
Jul 22 02:47:07.868864 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:07.868629    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwf47\" (UniqueName: \"kubernetes.io/projected/8a994a9e-c0ec-4036-8311-ff27f10b84e4-kube-api-access-wwf47\") pod \"maas-controller-54c45d7698-h7jts\" (UID: \"8a994a9e-c0ec-4036-8311-ff27f10b84e4\") " pod="opendatahub/maas-controller-54c45d7698-h7jts"
Jul 22 02:47:07.907704 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:07.907673    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:47:07.969885 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:07.969852    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwf47\" (UniqueName: \"kubernetes.io/projected/8a994a9e-c0ec-4036-8311-ff27f10b84e4-kube-api-access-wwf47\") pod \"maas-controller-54c45d7698-h7jts\" (UID: \"8a994a9e-c0ec-4036-8311-ff27f10b84e4\") " pod="opendatahub/maas-controller-54c45d7698-h7jts"
Jul 22 02:47:07.970055 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:07.969910    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a994a9e-c0ec-4036-8311-ff27f10b84e4-webhook-cert\") pod \"maas-controller-54c45d7698-h7jts\" (UID: \"8a994a9e-c0ec-4036-8311-ff27f10b84e4\") " pod="opendatahub/maas-controller-54c45d7698-h7jts"
Jul 22 02:47:07.970055 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:47:07.970026    2577 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 22 02:47:07.970146 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:47:07.970087    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a994a9e-c0ec-4036-8311-ff27f10b84e4-webhook-cert podName:8a994a9e-c0ec-4036-8311-ff27f10b84e4 nodeName:}" failed. No retries permitted until 2026-07-22 02:47:08.47007027 +0000 UTC m=+589.178498848 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/8a994a9e-c0ec-4036-8311-ff27f10b84e4-webhook-cert") pod "maas-controller-54c45d7698-h7jts" (UID: "8a994a9e-c0ec-4036-8311-ff27f10b84e4") : secret "maas-controller-webhook-cert" not found
Jul 22 02:47:07.976955 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:07.976926    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:47:07.979642 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:07.979608    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwf47\" (UniqueName: \"kubernetes.io/projected/8a994a9e-c0ec-4036-8311-ff27f10b84e4-kube-api-access-wwf47\") pod \"maas-controller-54c45d7698-h7jts\" (UID: \"8a994a9e-c0ec-4036-8311-ff27f10b84e4\") " pod="opendatahub/maas-controller-54c45d7698-h7jts"
Jul 22 02:47:08.005104 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:08.005074    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-744f66f85b-9tj2p"]
Jul 22 02:47:08.008518 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:08.008496    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-744f66f85b-9tj2p"
Jul 22 02:47:08.019371 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:08.019342    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-744f66f85b-9tj2p"]
Jul 22 02:47:08.059142 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:08.059061    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:47:08.070354 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:08.070329    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70-webhook-cert\") pod \"maas-controller-744f66f85b-9tj2p\" (UID: \"c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70\") " pod="opendatahub/maas-controller-744f66f85b-9tj2p"
Jul 22 02:47:08.070486 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:08.070386    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zccnm\" (UniqueName: \"kubernetes.io/projected/c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70-kube-api-access-zccnm\") pod \"maas-controller-744f66f85b-9tj2p\" (UID: \"c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70\") " pod="opendatahub/maas-controller-744f66f85b-9tj2p"
Jul 22 02:47:08.170805 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:08.170769    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70-webhook-cert\") pod \"maas-controller-744f66f85b-9tj2p\" (UID: \"c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70\") " pod="opendatahub/maas-controller-744f66f85b-9tj2p"
Jul 22 02:47:08.171030 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:08.170861    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zccnm\" (UniqueName: \"kubernetes.io/projected/c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70-kube-api-access-zccnm\") pod \"maas-controller-744f66f85b-9tj2p\" (UID: \"c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70\") " pod="opendatahub/maas-controller-744f66f85b-9tj2p"
Jul 22 02:47:08.173610 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:08.173585    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70-webhook-cert\") pod \"maas-controller-744f66f85b-9tj2p\" (UID: \"c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70\") " pod="opendatahub/maas-controller-744f66f85b-9tj2p"
Jul 22 02:47:08.179689 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:08.179661    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zccnm\" (UniqueName: \"kubernetes.io/projected/c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70-kube-api-access-zccnm\") pod \"maas-controller-744f66f85b-9tj2p\" (UID: \"c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70\") " pod="opendatahub/maas-controller-744f66f85b-9tj2p"
Jul 22 02:47:08.321224 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:08.321116    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-744f66f85b-9tj2p"
Jul 22 02:47:08.455554 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:08.455510    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-744f66f85b-9tj2p"]
Jul 22 02:47:08.458352 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:47:08.458326    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc772fa7c_e45c_4c3b_b59a_6dc6f1c03d70.slice/crio-ec4ed645bfc5ff3d2e65f52f987f5d2cf34e2a0ad1d32c09ae541a8ecf2b6b60 WatchSource:0}: Error finding container ec4ed645bfc5ff3d2e65f52f987f5d2cf34e2a0ad1d32c09ae541a8ecf2b6b60: Status 404 returned error can't find the container with id ec4ed645bfc5ff3d2e65f52f987f5d2cf34e2a0ad1d32c09ae541a8ecf2b6b60
Jul 22 02:47:08.474353 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:08.474321    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a994a9e-c0ec-4036-8311-ff27f10b84e4-webhook-cert\") pod \"maas-controller-54c45d7698-h7jts\" (UID: \"8a994a9e-c0ec-4036-8311-ff27f10b84e4\") " pod="opendatahub/maas-controller-54c45d7698-h7jts"
Jul 22 02:47:08.476752 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:08.476732    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a994a9e-c0ec-4036-8311-ff27f10b84e4-webhook-cert\") pod \"maas-controller-54c45d7698-h7jts\" (UID: \"8a994a9e-c0ec-4036-8311-ff27f10b84e4\") " pod="opendatahub/maas-controller-54c45d7698-h7jts"
Jul 22 02:47:08.743998 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:08.743957    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54c45d7698-h7jts"
Jul 22 02:47:08.880520 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:08.880380    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54c45d7698-h7jts"]
Jul 22 02:47:08.882991 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:47:08.882962    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a994a9e_c0ec_4036_8311_ff27f10b84e4.slice/crio-95490da4f99f22c9bc94650e27d4d60de88ce41e789757057c141a4025ab8ffc WatchSource:0}: Error finding container 95490da4f99f22c9bc94650e27d4d60de88ce41e789757057c141a4025ab8ffc: Status 404 returned error can't find the container with id 95490da4f99f22c9bc94650e27d4d60de88ce41e789757057c141a4025ab8ffc
Jul 22 02:47:09.250402 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:09.250359    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54c45d7698-h7jts" event={"ID":"8a994a9e-c0ec-4036-8311-ff27f10b84e4","Type":"ContainerStarted","Data":"95490da4f99f22c9bc94650e27d4d60de88ce41e789757057c141a4025ab8ffc"}
Jul 22 02:47:09.252871 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:09.252837    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-744f66f85b-9tj2p" event={"ID":"c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70","Type":"ContainerStarted","Data":"ec4ed645bfc5ff3d2e65f52f987f5d2cf34e2a0ad1d32c09ae541a8ecf2b6b60"}
Jul 22 02:47:11.113439 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:11.113392    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:47:11.208675 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:11.208577    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:47:11.264879 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:11.264836    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54c45d7698-h7jts" event={"ID":"8a994a9e-c0ec-4036-8311-ff27f10b84e4","Type":"ContainerStarted","Data":"df774ef943aad3d86c673341daf305791b86d76228dfe1197a75358239f3e9c3"}
Jul 22 02:47:11.265066 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:11.264943    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54c45d7698-h7jts"
Jul 22 02:47:11.266875 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:11.266850    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-744f66f85b-9tj2p" event={"ID":"c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70","Type":"ContainerStarted","Data":"77590e1f6612114927e09fa3df8579a2f399adfa0f1c505ed9ad9ba14059d71d"}
Jul 22 02:47:11.267033 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:11.266916    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-744f66f85b-9tj2p"
Jul 22 02:47:11.288300 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:11.288225    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54c45d7698-h7jts" podStartSLOduration=2.259789081 podStartE2EDuration="4.288207293s" totalImagesPullingTime="2.028418212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:47:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:47:11.28723778 +0000 UTC m=+591.995666381" watchObservedRunningTime="2026-07-22 02:47:11.288207293 +0000 UTC m=+591.996635933"
Jul 22 02:47:11.306840 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:11.306784    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-744f66f85b-9tj2p" podStartSLOduration=1.8604947250000001 podStartE2EDuration="4.306767417s" totalImagesPullingTime="2.446272692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:47:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:47:11.304950018 +0000 UTC m=+592.013378618" watchObservedRunningTime="2026-07-22 02:47:11.306767417 +0000 UTC m=+592.015196017"
Jul 22 02:47:19.622530 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:19.622504    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqngf_6461ea33-ff4c-48c5-8c29-b4026c2f67b0/ovn-acl-logging/0.log"
Jul 22 02:47:19.625443 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:19.625420    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqngf_6461ea33-ff4c-48c5-8c29-b4026c2f67b0/ovn-acl-logging/0.log"
Jul 22 02:47:22.272724 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:22.272690    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54c45d7698-h7jts"
Jul 22 02:47:22.275111 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:22.272770    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-744f66f85b-9tj2p"
Jul 22 02:47:22.386158 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:22.386122    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54c45d7698-h7jts"]
Jul 22 02:47:22.386406 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:22.386354    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-54c45d7698-h7jts" podUID="8a994a9e-c0ec-4036-8311-ff27f10b84e4" containerName="manager" containerID="cri-o://df774ef943aad3d86c673341daf305791b86d76228dfe1197a75358239f3e9c3" gracePeriod=30
Jul 22 02:47:22.635116 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:22.635085    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54c45d7698-h7jts"
Jul 22 02:47:22.695328 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:22.695270    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a994a9e-c0ec-4036-8311-ff27f10b84e4-webhook-cert\") pod \"8a994a9e-c0ec-4036-8311-ff27f10b84e4\" (UID: \"8a994a9e-c0ec-4036-8311-ff27f10b84e4\") "
Jul 22 02:47:22.695513 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:22.695369    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwf47\" (UniqueName: \"kubernetes.io/projected/8a994a9e-c0ec-4036-8311-ff27f10b84e4-kube-api-access-wwf47\") pod \"8a994a9e-c0ec-4036-8311-ff27f10b84e4\" (UID: \"8a994a9e-c0ec-4036-8311-ff27f10b84e4\") "
Jul 22 02:47:22.697705 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:22.697676    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a994a9e-c0ec-4036-8311-ff27f10b84e4-kube-api-access-wwf47" (OuterVolumeSpecName: "kube-api-access-wwf47") pod "8a994a9e-c0ec-4036-8311-ff27f10b84e4" (UID: "8a994a9e-c0ec-4036-8311-ff27f10b84e4"). InnerVolumeSpecName "kube-api-access-wwf47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 02:47:22.697785 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:22.697684    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a994a9e-c0ec-4036-8311-ff27f10b84e4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8a994a9e-c0ec-4036-8311-ff27f10b84e4" (UID: "8a994a9e-c0ec-4036-8311-ff27f10b84e4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:47:22.797186 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:22.797108    2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a994a9e-c0ec-4036-8311-ff27f10b84e4-webhook-cert\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:47:22.797186 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:22.797142    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwf47\" (UniqueName: \"kubernetes.io/projected/8a994a9e-c0ec-4036-8311-ff27f10b84e4-kube-api-access-wwf47\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:47:23.317437 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:23.317397    2577 generic.go:356] "Generic (PLEG): container finished" podID="8a994a9e-c0ec-4036-8311-ff27f10b84e4" containerID="df774ef943aad3d86c673341daf305791b86d76228dfe1197a75358239f3e9c3" exitCode=0
Jul 22 02:47:23.317942 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:23.317451    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54c45d7698-h7jts"
Jul 22 02:47:23.317942 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:23.317476    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54c45d7698-h7jts" event={"ID":"8a994a9e-c0ec-4036-8311-ff27f10b84e4","Type":"ContainerDied","Data":"df774ef943aad3d86c673341daf305791b86d76228dfe1197a75358239f3e9c3"}
Jul 22 02:47:23.317942 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:23.317529    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54c45d7698-h7jts" event={"ID":"8a994a9e-c0ec-4036-8311-ff27f10b84e4","Type":"ContainerDied","Data":"95490da4f99f22c9bc94650e27d4d60de88ce41e789757057c141a4025ab8ffc"}
Jul 22 02:47:23.317942 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:23.317551    2577 scope.go:117] "RemoveContainer" containerID="df774ef943aad3d86c673341daf305791b86d76228dfe1197a75358239f3e9c3"
Jul 22 02:47:23.326305 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:23.326282    2577 scope.go:117] "RemoveContainer" containerID="df774ef943aad3d86c673341daf305791b86d76228dfe1197a75358239f3e9c3"
Jul 22 02:47:23.326610 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:47:23.326593    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df774ef943aad3d86c673341daf305791b86d76228dfe1197a75358239f3e9c3\": container with ID starting with df774ef943aad3d86c673341daf305791b86d76228dfe1197a75358239f3e9c3 not found: ID does not exist" containerID="df774ef943aad3d86c673341daf305791b86d76228dfe1197a75358239f3e9c3"
Jul 22 02:47:23.326662 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:23.326619    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df774ef943aad3d86c673341daf305791b86d76228dfe1197a75358239f3e9c3"} err="failed to get container status \"df774ef943aad3d86c673341daf305791b86d76228dfe1197a75358239f3e9c3\": rpc error: code = NotFound desc = could not find container \"df774ef943aad3d86c673341daf305791b86d76228dfe1197a75358239f3e9c3\": container with ID starting with df774ef943aad3d86c673341daf305791b86d76228dfe1197a75358239f3e9c3 not found: ID does not exist"
Jul 22 02:47:23.340570 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:23.340539    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54c45d7698-h7jts"]
Jul 22 02:47:23.346055 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:23.346024    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54c45d7698-h7jts"]
Jul 22 02:47:23.757104 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:23.757068    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a994a9e-c0ec-4036-8311-ff27f10b84e4" path="/var/lib/kubelet/pods/8a994a9e-c0ec-4036-8311-ff27f10b84e4/volumes"
Jul 22 02:47:35.764794 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:35.764732    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:47:36.975091 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:36.975034    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:47:43.816405 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:43.816321    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:47:43.955799 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:43.955765    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:47:44.511149 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:44.511114    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:47:44.622901 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:44.622861    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-566f76d668-rrwnr"]
Jul 22 02:47:44.623292 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:44.623247    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a994a9e-c0ec-4036-8311-ff27f10b84e4" containerName="manager"
Jul 22 02:47:44.623351 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:44.623294    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a994a9e-c0ec-4036-8311-ff27f10b84e4" containerName="manager"
Jul 22 02:47:44.623351 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:44.623348    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a994a9e-c0ec-4036-8311-ff27f10b84e4" containerName="manager"
Jul 22 02:47:44.631396 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:44.631372    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-566f76d668-rrwnr"
Jul 22 02:47:44.635448 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:44.635421    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 22 02:47:44.642901 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:44.642874    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-566f76d668-rrwnr"]
Jul 22 02:47:44.667629 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:44.667597    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:47:44.792547 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:44.792467    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q94np\" (UniqueName: \"kubernetes.io/projected/b1509f41-e33b-4c20-b7f1-9e38ad1a14b7-kube-api-access-q94np\") pod \"maas-api-566f76d668-rrwnr\" (UID: \"b1509f41-e33b-4c20-b7f1-9e38ad1a14b7\") " pod="odh-ai-gateway-infra/maas-api-566f76d668-rrwnr"
Jul 22 02:47:44.792547 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:44.792508    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1509f41-e33b-4c20-b7f1-9e38ad1a14b7-maas-api-tls\") pod \"maas-api-566f76d668-rrwnr\" (UID: \"b1509f41-e33b-4c20-b7f1-9e38ad1a14b7\") " pod="odh-ai-gateway-infra/maas-api-566f76d668-rrwnr"
Jul 22 02:47:44.792547 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:44.792539    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1509f41-e33b-4c20-b7f1-9e38ad1a14b7-openshift-service-ca\") pod \"maas-api-566f76d668-rrwnr\" (UID: \"b1509f41-e33b-4c20-b7f1-9e38ad1a14b7\") " pod="odh-ai-gateway-infra/maas-api-566f76d668-rrwnr"
Jul 22 02:47:44.893145 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:44.893115    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q94np\" (UniqueName: \"kubernetes.io/projected/b1509f41-e33b-4c20-b7f1-9e38ad1a14b7-kube-api-access-q94np\") pod \"maas-api-566f76d668-rrwnr\" (UID: \"b1509f41-e33b-4c20-b7f1-9e38ad1a14b7\") " pod="odh-ai-gateway-infra/maas-api-566f76d668-rrwnr"
Jul 22 02:47:44.893145 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:44.893150    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1509f41-e33b-4c20-b7f1-9e38ad1a14b7-maas-api-tls\") pod \"maas-api-566f76d668-rrwnr\" (UID: \"b1509f41-e33b-4c20-b7f1-9e38ad1a14b7\") " pod="odh-ai-gateway-infra/maas-api-566f76d668-rrwnr"
Jul 22 02:47:44.893709 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:44.893214    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1509f41-e33b-4c20-b7f1-9e38ad1a14b7-openshift-service-ca\") pod \"maas-api-566f76d668-rrwnr\" (UID: \"b1509f41-e33b-4c20-b7f1-9e38ad1a14b7\") " pod="odh-ai-gateway-infra/maas-api-566f76d668-rrwnr"
Jul 22 02:47:44.893981 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:44.893957    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1509f41-e33b-4c20-b7f1-9e38ad1a14b7-openshift-service-ca\") pod \"maas-api-566f76d668-rrwnr\" (UID: \"b1509f41-e33b-4c20-b7f1-9e38ad1a14b7\") " pod="odh-ai-gateway-infra/maas-api-566f76d668-rrwnr"
Jul 22 02:47:44.895770 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:44.895748    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1509f41-e33b-4c20-b7f1-9e38ad1a14b7-maas-api-tls\") pod \"maas-api-566f76d668-rrwnr\" (UID: \"b1509f41-e33b-4c20-b7f1-9e38ad1a14b7\") " pod="odh-ai-gateway-infra/maas-api-566f76d668-rrwnr"
Jul 22 02:47:44.914901 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:44.914866    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q94np\" (UniqueName: \"kubernetes.io/projected/b1509f41-e33b-4c20-b7f1-9e38ad1a14b7-kube-api-access-q94np\") pod \"maas-api-566f76d668-rrwnr\" (UID: \"b1509f41-e33b-4c20-b7f1-9e38ad1a14b7\") " pod="odh-ai-gateway-infra/maas-api-566f76d668-rrwnr"
Jul 22 02:47:44.942729 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:44.942697    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-566f76d668-rrwnr"
Jul 22 02:47:45.105890 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.105855    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:47:45.119315 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.119280    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-566f76d668-rrwnr"]
Jul 22 02:47:45.123189 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:47:45.123151    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1509f41_e33b_4c20_b7f1_9e38ad1a14b7.slice/crio-83a187534a070e7c07b23fbd29b8db9558645df99d7d8bf05ff298ebfb5cb6d9 WatchSource:0}: Error finding container 83a187534a070e7c07b23fbd29b8db9558645df99d7d8bf05ff298ebfb5cb6d9: Status 404 returned error can't find the container with id 83a187534a070e7c07b23fbd29b8db9558645df99d7d8bf05ff298ebfb5cb6d9
Jul 22 02:47:45.202817 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.202788    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:47:45.206707 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.206680    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-4sf9b"]
Jul 22 02:47:45.212092 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.212068    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-4sf9b"
Jul 22 02:47:45.215101 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.215080    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 22 02:47:45.231836 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.231807    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-4sf9b"]
Jul 22 02:47:45.243211 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.243169    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-4qnmv"]
Jul 22 02:47:45.247205 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.247184    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-4qnmv"
Jul 22 02:47:45.250447 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.250426    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-xzqtm\""
Jul 22 02:47:45.258907 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.258881    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-4qnmv"]
Jul 22 02:47:45.296846 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.296810    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/421f17b9-33b6-4d58-82ce-ba029b3d94b6-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-4sf9b\" (UID: \"421f17b9-33b6-4d58-82ce-ba029b3d94b6\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-4sf9b"
Jul 22 02:47:45.297024 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.296862    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltzl6\" (UniqueName: \"kubernetes.io/projected/421f17b9-33b6-4d58-82ce-ba029b3d94b6-kube-api-access-ltzl6\") pod \"payload-pre-processing-7677b774bb-4sf9b\" (UID: \"421f17b9-33b6-4d58-82ce-ba029b3d94b6\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-4sf9b"
Jul 22 02:47:45.397843 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.397762    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4jwg\" (UniqueName: \"kubernetes.io/projected/f66920e1-bdd0-4168-85ed-d3744af1fb5f-kube-api-access-z4jwg\") pod \"payload-processing-5bf47cd988-4qnmv\" (UID: \"f66920e1-bdd0-4168-85ed-d3744af1fb5f\") " pod="openshift-ingress/payload-processing-5bf47cd988-4qnmv"
Jul 22 02:47:45.397843 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.397817    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f66920e1-bdd0-4168-85ed-d3744af1fb5f-plugins-config-volume\") pod \"payload-processing-5bf47cd988-4qnmv\" (UID: \"f66920e1-bdd0-4168-85ed-d3744af1fb5f\") " pod="openshift-ingress/payload-processing-5bf47cd988-4qnmv"
Jul 22 02:47:45.398058 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.397871    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/421f17b9-33b6-4d58-82ce-ba029b3d94b6-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-4sf9b\" (UID: \"421f17b9-33b6-4d58-82ce-ba029b3d94b6\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-4sf9b"
Jul 22 02:47:45.398058 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.397950    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltzl6\" (UniqueName: \"kubernetes.io/projected/421f17b9-33b6-4d58-82ce-ba029b3d94b6-kube-api-access-ltzl6\") pod \"payload-pre-processing-7677b774bb-4sf9b\" (UID: \"421f17b9-33b6-4d58-82ce-ba029b3d94b6\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-4sf9b"
Jul 22 02:47:45.398606 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.398581    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/421f17b9-33b6-4d58-82ce-ba029b3d94b6-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-4sf9b\" (UID: \"421f17b9-33b6-4d58-82ce-ba029b3d94b6\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-4sf9b"
Jul 22 02:47:45.402197 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.402166    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-566f76d668-rrwnr" event={"ID":"b1509f41-e33b-4c20-b7f1-9e38ad1a14b7","Type":"ContainerStarted","Data":"83a187534a070e7c07b23fbd29b8db9558645df99d7d8bf05ff298ebfb5cb6d9"}
Jul 22 02:47:45.407301 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.407245    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltzl6\" (UniqueName: \"kubernetes.io/projected/421f17b9-33b6-4d58-82ce-ba029b3d94b6-kube-api-access-ltzl6\") pod \"payload-pre-processing-7677b774bb-4sf9b\" (UID: \"421f17b9-33b6-4d58-82ce-ba029b3d94b6\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-4sf9b"
Jul 22 02:47:45.499384 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.499349    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f66920e1-bdd0-4168-85ed-d3744af1fb5f-plugins-config-volume\") pod \"payload-processing-5bf47cd988-4qnmv\" (UID: \"f66920e1-bdd0-4168-85ed-d3744af1fb5f\") " pod="openshift-ingress/payload-processing-5bf47cd988-4qnmv"
Jul 22 02:47:45.499558 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.499436    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4jwg\" (UniqueName: \"kubernetes.io/projected/f66920e1-bdd0-4168-85ed-d3744af1fb5f-kube-api-access-z4jwg\") pod \"payload-processing-5bf47cd988-4qnmv\" (UID: \"f66920e1-bdd0-4168-85ed-d3744af1fb5f\") " pod="openshift-ingress/payload-processing-5bf47cd988-4qnmv"
Jul 22 02:47:45.500139 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.500117    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f66920e1-bdd0-4168-85ed-d3744af1fb5f-plugins-config-volume\") pod \"payload-processing-5bf47cd988-4qnmv\" (UID: \"f66920e1-bdd0-4168-85ed-d3744af1fb5f\") " pod="openshift-ingress/payload-processing-5bf47cd988-4qnmv"
Jul 22 02:47:45.508741 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.508712    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4jwg\" (UniqueName: \"kubernetes.io/projected/f66920e1-bdd0-4168-85ed-d3744af1fb5f-kube-api-access-z4jwg\") pod \"payload-processing-5bf47cd988-4qnmv\" (UID: \"f66920e1-bdd0-4168-85ed-d3744af1fb5f\") " pod="openshift-ingress/payload-processing-5bf47cd988-4qnmv"
Jul 22 02:47:45.523589 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.523562    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-4sf9b"
Jul 22 02:47:45.558587 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.558551    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-4qnmv"
Jul 22 02:47:45.675171 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.675089    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-4sf9b"]
Jul 22 02:47:45.680832 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:47:45.680804    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod421f17b9_33b6_4d58_82ce_ba029b3d94b6.slice/crio-13fe79454b8fb55b1058b5f916a590d7e9e3ccae8f5a47f6c5ac3ba1d2aa15c3 WatchSource:0}: Error finding container 13fe79454b8fb55b1058b5f916a590d7e9e3ccae8f5a47f6c5ac3ba1d2aa15c3: Status 404 returned error can't find the container with id 13fe79454b8fb55b1058b5f916a590d7e9e3ccae8f5a47f6c5ac3ba1d2aa15c3
Jul 22 02:47:45.708620 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:45.708596    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-4qnmv"]
Jul 22 02:47:45.711002 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:47:45.710977    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf66920e1_bdd0_4168_85ed_d3744af1fb5f.slice/crio-a681c0eed2f45bfd818fb61d5bcdbb2686830057012f3efdc4605e14e90df586 WatchSource:0}: Error finding container a681c0eed2f45bfd818fb61d5bcdbb2686830057012f3efdc4605e14e90df586: Status 404 returned error can't find the container with id a681c0eed2f45bfd818fb61d5bcdbb2686830057012f3efdc4605e14e90df586
Jul 22 02:47:46.428131 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:46.428028    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-4qnmv" event={"ID":"f66920e1-bdd0-4168-85ed-d3744af1fb5f","Type":"ContainerStarted","Data":"a681c0eed2f45bfd818fb61d5bcdbb2686830057012f3efdc4605e14e90df586"}
Jul 22 02:47:46.434323 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:46.434281    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-4sf9b" event={"ID":"421f17b9-33b6-4d58-82ce-ba029b3d94b6","Type":"ContainerStarted","Data":"13fe79454b8fb55b1058b5f916a590d7e9e3ccae8f5a47f6c5ac3ba1d2aa15c3"}
Jul 22 02:47:47.442211 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:47.442122    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-566f76d668-rrwnr" event={"ID":"b1509f41-e33b-4c20-b7f1-9e38ad1a14b7","Type":"ContainerStarted","Data":"49253312d3a0e151a332cc3e905cad408b4078537fd5646c2136d78af5642f55"}
Jul 22 02:47:47.442685 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:47.442455    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-566f76d668-rrwnr"
Jul 22 02:47:47.466402 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:47.466338    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-566f76d668-rrwnr" podStartSLOduration=1.466904867 podStartE2EDuration="3.466315142s" totalImagesPullingTime="1.999410275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:47:47.463047371 +0000 UTC m=+628.171475972" watchObservedRunningTime="2026-07-22 02:47:47.466315142 +0000 UTC m=+628.174743743"
Jul 22 02:47:48.448038 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:48.447989    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-4sf9b" event={"ID":"421f17b9-33b6-4d58-82ce-ba029b3d94b6","Type":"ContainerStarted","Data":"da4b6133efa5fd938e479a5f973e5637e00d38901e9aa363731f09caa47c47c4"}
Jul 22 02:47:48.448545 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:48.448122    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-4sf9b"
Jul 22 02:47:48.449646 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:48.449606    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-4qnmv" event={"ID":"f66920e1-bdd0-4168-85ed-d3744af1fb5f","Type":"ContainerStarted","Data":"70af09248320f7b5f7a92f71a23c31b2a2030976050d5f97eda218b5c707ddc9"}
Jul 22 02:47:48.449945 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:48.449929    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-4qnmv"
Jul 22 02:47:48.468416 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:48.468358    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-4sf9b" podStartSLOduration=0.88672577 podStartE2EDuration="3.468339032s" totalImagesPullingTime="2.581613262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:47:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:47:48.467319205 +0000 UTC m=+629.175747824" watchObservedRunningTime="2026-07-22 02:47:48.468339032 +0000 UTC m=+629.176767635"
Jul 22 02:47:48.485587 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:48.485534    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-4qnmv" podStartSLOduration=0.927570487 podStartE2EDuration="3.485515457s" totalImagesPullingTime="2.55794497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:47:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:47:48.484376421 +0000 UTC m=+629.192805022" watchObservedRunningTime="2026-07-22 02:47:48.485515457 +0000 UTC m=+629.193944058"
Jul 22 02:47:53.455914 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:53.455885    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-566f76d668-rrwnr"
Jul 22 02:47:54.645401 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:54.645343    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:47:54.919594 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:54.919460    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:47:59.456735 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:59.456698    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-4sf9b"
Jul 22 02:47:59.457119 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:47:59.456772    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-4qnmv"
Jul 22 02:48:01.541302 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:01.541273    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:48:04.180664 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.180630    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"]
Jul 22 02:48:04.185632 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.185604    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"
Jul 22 02:48:04.190592 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.190565    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 22 02:48:04.190754 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.190623    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 22 02:48:04.191996 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.191973    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 22 02:48:04.192149 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.192011    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xsxlk\""
Jul 22 02:48:04.196886 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.196853    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"]
Jul 22 02:48:04.217811 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.217779    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:48:04.273093 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.273049    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2192276f-6bb2-4292-8374-fe91f2d3e551-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c\" (UID: \"2192276f-6bb2-4292-8374-fe91f2d3e551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"
Jul 22 02:48:04.273360 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.273101    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2192276f-6bb2-4292-8374-fe91f2d3e551-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c\" (UID: \"2192276f-6bb2-4292-8374-fe91f2d3e551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"
Jul 22 02:48:04.273360 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.273185    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf4qr\" (UniqueName: \"kubernetes.io/projected/2192276f-6bb2-4292-8374-fe91f2d3e551-kube-api-access-qf4qr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c\" (UID: \"2192276f-6bb2-4292-8374-fe91f2d3e551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"
Jul 22 02:48:04.273360 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.273214    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2192276f-6bb2-4292-8374-fe91f2d3e551-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c\" (UID: \"2192276f-6bb2-4292-8374-fe91f2d3e551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"
Jul 22 02:48:04.273360 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.273236    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2192276f-6bb2-4292-8374-fe91f2d3e551-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c\" (UID: \"2192276f-6bb2-4292-8374-fe91f2d3e551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"
Jul 22 02:48:04.273360 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.273326    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2192276f-6bb2-4292-8374-fe91f2d3e551-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c\" (UID: \"2192276f-6bb2-4292-8374-fe91f2d3e551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"
Jul 22 02:48:04.374222 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.374186    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2192276f-6bb2-4292-8374-fe91f2d3e551-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c\" (UID: \"2192276f-6bb2-4292-8374-fe91f2d3e551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"
Jul 22 02:48:04.374435 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.374283    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf4qr\" (UniqueName: \"kubernetes.io/projected/2192276f-6bb2-4292-8374-fe91f2d3e551-kube-api-access-qf4qr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c\" (UID: \"2192276f-6bb2-4292-8374-fe91f2d3e551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"
Jul 22 02:48:04.374435 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.374315    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2192276f-6bb2-4292-8374-fe91f2d3e551-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c\" (UID: \"2192276f-6bb2-4292-8374-fe91f2d3e551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"
Jul 22 02:48:04.374435 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.374339    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2192276f-6bb2-4292-8374-fe91f2d3e551-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c\" (UID: \"2192276f-6bb2-4292-8374-fe91f2d3e551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"
Jul 22 02:48:04.374435 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.374389    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2192276f-6bb2-4292-8374-fe91f2d3e551-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c\" (UID: \"2192276f-6bb2-4292-8374-fe91f2d3e551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"
Jul 22 02:48:04.374652 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.374440    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2192276f-6bb2-4292-8374-fe91f2d3e551-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c\" (UID: \"2192276f-6bb2-4292-8374-fe91f2d3e551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"
Jul 22 02:48:04.374766 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.374741    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2192276f-6bb2-4292-8374-fe91f2d3e551-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c\" (UID: \"2192276f-6bb2-4292-8374-fe91f2d3e551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"
Jul 22 02:48:04.374833 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.374805    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2192276f-6bb2-4292-8374-fe91f2d3e551-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c\" (UID: \"2192276f-6bb2-4292-8374-fe91f2d3e551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"
Jul 22 02:48:04.375099 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.375056    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2192276f-6bb2-4292-8374-fe91f2d3e551-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c\" (UID: \"2192276f-6bb2-4292-8374-fe91f2d3e551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"
Jul 22 02:48:04.376620 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.376593    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2192276f-6bb2-4292-8374-fe91f2d3e551-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c\" (UID: \"2192276f-6bb2-4292-8374-fe91f2d3e551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"
Jul 22 02:48:04.376903 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.376885    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2192276f-6bb2-4292-8374-fe91f2d3e551-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c\" (UID: \"2192276f-6bb2-4292-8374-fe91f2d3e551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"
Jul 22 02:48:04.387565 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.387536    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf4qr\" (UniqueName: \"kubernetes.io/projected/2192276f-6bb2-4292-8374-fe91f2d3e551-kube-api-access-qf4qr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c\" (UID: \"2192276f-6bb2-4292-8374-fe91f2d3e551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"
Jul 22 02:48:04.496400 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.496369    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"
Jul 22 02:48:04.647078 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:04.647051    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"]
Jul 22 02:48:04.649786 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:48:04.649745    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2192276f_6bb2_4292_8374_fe91f2d3e551.slice/crio-e82752d463d3e29c0bd6b9109a86f6dddb30a5bbbaf2093282e7b735d1c78e9e WatchSource:0}: Error finding container e82752d463d3e29c0bd6b9109a86f6dddb30a5bbbaf2093282e7b735d1c78e9e: Status 404 returned error can't find the container with id e82752d463d3e29c0bd6b9109a86f6dddb30a5bbbaf2093282e7b735d1c78e9e
Jul 22 02:48:05.526827 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:05.526783    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c" event={"ID":"2192276f-6bb2-4292-8374-fe91f2d3e551","Type":"ContainerStarted","Data":"e82752d463d3e29c0bd6b9109a86f6dddb30a5bbbaf2093282e7b735d1c78e9e"}
Jul 22 02:48:06.532860 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:06.532827    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c" event={"ID":"2192276f-6bb2-4292-8374-fe91f2d3e551","Type":"ContainerStarted","Data":"d75386b99855430d33a5bbd748171b5aa596e6df8dbcd282c4bf77e517cabd66"}
Jul 22 02:48:06.562984 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:06.562915    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c" podStartSLOduration=1.560689674 podStartE2EDuration="2.562891899s" totalImagesPullingTime="1.002202225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:48:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:48:06.562850883 +0000 UTC m=+647.271279484" watchObservedRunningTime="2026-07-22 02:48:06.562891899 +0000 UTC m=+647.271320502"
Jul 22 02:48:08.574982 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:08.574944    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:48:14.497377 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:14.497322    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"
Jul 22 02:48:14.497802 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:14.497419    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"
Jul 22 02:48:14.510064 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:14.510030    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"
Jul 22 02:48:14.579849 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:14.579818    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c"
Jul 22 02:48:24.931634 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:24.931598    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"]
Jul 22 02:48:24.938170 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:24.938148    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"
Jul 22 02:48:24.946077 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:24.946053    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 22 02:48:24.987230 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:24.986940    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"]
Jul 22 02:48:25.058484 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:25.058416    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:48:25.062603 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:25.062580    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d126cd5b-bfde-426e-86d9-82884a7dfc53-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-skh4m\" (UID: \"d126cd5b-bfde-426e-86d9-82884a7dfc53\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"
Jul 22 02:48:25.062687 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:25.062643    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d126cd5b-bfde-426e-86d9-82884a7dfc53-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-skh4m\" (UID: \"d126cd5b-bfde-426e-86d9-82884a7dfc53\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"
Jul 22 02:48:25.062727 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:25.062692    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d126cd5b-bfde-426e-86d9-82884a7dfc53-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-skh4m\" (UID: \"d126cd5b-bfde-426e-86d9-82884a7dfc53\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"
Jul 22 02:48:25.062727 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:25.062709    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d126cd5b-bfde-426e-86d9-82884a7dfc53-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-skh4m\" (UID: \"d126cd5b-bfde-426e-86d9-82884a7dfc53\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"
Jul 22 02:48:25.062810 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:25.062792    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d126cd5b-bfde-426e-86d9-82884a7dfc53-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-skh4m\" (UID: \"d126cd5b-bfde-426e-86d9-82884a7dfc53\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"
Jul 22 02:48:25.062845 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:25.062821    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nnth\" (UniqueName: \"kubernetes.io/projected/d126cd5b-bfde-426e-86d9-82884a7dfc53-kube-api-access-2nnth\") pod \"e2e-trlp-test-simulated-kserve-598466548d-skh4m\" (UID: \"d126cd5b-bfde-426e-86d9-82884a7dfc53\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"
Jul 22 02:48:25.163382 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:25.163339    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d126cd5b-bfde-426e-86d9-82884a7dfc53-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-skh4m\" (UID: \"d126cd5b-bfde-426e-86d9-82884a7dfc53\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"
Jul 22 02:48:25.163590 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:25.163407    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d126cd5b-bfde-426e-86d9-82884a7dfc53-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-skh4m\" (UID: \"d126cd5b-bfde-426e-86d9-82884a7dfc53\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"
Jul 22 02:48:25.163590 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:25.163458    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d126cd5b-bfde-426e-86d9-82884a7dfc53-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-skh4m\" (UID: \"d126cd5b-bfde-426e-86d9-82884a7dfc53\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"
Jul 22 02:48:25.163590 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:25.163482    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d126cd5b-bfde-426e-86d9-82884a7dfc53-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-skh4m\" (UID: \"d126cd5b-bfde-426e-86d9-82884a7dfc53\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"
Jul 22 02:48:25.163590 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:25.163515    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d126cd5b-bfde-426e-86d9-82884a7dfc53-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-skh4m\" (UID: \"d126cd5b-bfde-426e-86d9-82884a7dfc53\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"
Jul 22 02:48:25.163590 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:25.163540    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nnth\" (UniqueName: \"kubernetes.io/projected/d126cd5b-bfde-426e-86d9-82884a7dfc53-kube-api-access-2nnth\") pod \"e2e-trlp-test-simulated-kserve-598466548d-skh4m\" (UID: \"d126cd5b-bfde-426e-86d9-82884a7dfc53\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"
Jul 22 02:48:25.163892 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:25.163870    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d126cd5b-bfde-426e-86d9-82884a7dfc53-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-skh4m\" (UID: \"d126cd5b-bfde-426e-86d9-82884a7dfc53\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"
Jul 22 02:48:25.163953 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:25.163911    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d126cd5b-bfde-426e-86d9-82884a7dfc53-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-skh4m\" (UID: \"d126cd5b-bfde-426e-86d9-82884a7dfc53\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"
Jul 22 02:48:25.163989 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:25.163949    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d126cd5b-bfde-426e-86d9-82884a7dfc53-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-skh4m\" (UID: \"d126cd5b-bfde-426e-86d9-82884a7dfc53\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"
Jul 22 02:48:25.165864 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:25.165843    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d126cd5b-bfde-426e-86d9-82884a7dfc53-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-skh4m\" (UID: \"d126cd5b-bfde-426e-86d9-82884a7dfc53\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"
Jul 22 02:48:25.166027 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:25.166002    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d126cd5b-bfde-426e-86d9-82884a7dfc53-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-skh4m\" (UID: \"d126cd5b-bfde-426e-86d9-82884a7dfc53\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"
Jul 22 02:48:25.182363 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:25.182290    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nnth\" (UniqueName: \"kubernetes.io/projected/d126cd5b-bfde-426e-86d9-82884a7dfc53-kube-api-access-2nnth\") pod \"e2e-trlp-test-simulated-kserve-598466548d-skh4m\" (UID: \"d126cd5b-bfde-426e-86d9-82884a7dfc53\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"
Jul 22 02:48:25.249044 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:25.249005    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"
Jul 22 02:48:25.407137 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:25.407104    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"]
Jul 22 02:48:25.410125 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:48:25.410094    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd126cd5b_bfde_426e_86d9_82884a7dfc53.slice/crio-e20faad9b211b4fd4e97ed5db607bc2ba53d9700a2c6412009289e104faaf376 WatchSource:0}: Error finding container e20faad9b211b4fd4e97ed5db607bc2ba53d9700a2c6412009289e104faaf376: Status 404 returned error can't find the container with id e20faad9b211b4fd4e97ed5db607bc2ba53d9700a2c6412009289e104faaf376
Jul 22 02:48:25.617811 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:25.617779    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m" event={"ID":"d126cd5b-bfde-426e-86d9-82884a7dfc53","Type":"ContainerStarted","Data":"e20faad9b211b4fd4e97ed5db607bc2ba53d9700a2c6412009289e104faaf376"}
Jul 22 02:48:26.623983 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:26.623950    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m" event={"ID":"d126cd5b-bfde-426e-86d9-82884a7dfc53","Type":"ContainerStarted","Data":"82dea434e6ea56e914ffd6c0642262454d5eb319a941667bd7badbaea14ecbc9"}
Jul 22 02:48:33.805050 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:33.805017    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:48:35.249765 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:35.249728    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"
Jul 22 02:48:35.250166 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:35.249788    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"
Jul 22 02:48:35.262347 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:35.262322    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"
Jul 22 02:48:35.285422 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:35.285367    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m" podStartSLOduration=11.120713699 podStartE2EDuration="11.285349617s" totalImagesPullingTime="164.635918ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:48:26.659536924 +0000 UTC m=+667.367965524" watchObservedRunningTime="2026-07-22 02:48:35.285349617 +0000 UTC m=+675.993778217"
Jul 22 02:48:35.680493 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:35.680406    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-skh4m"
Jul 22 02:48:45.520156 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:45.520114    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"]
Jul 22 02:48:45.523549 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:45.523522    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"
Jul 22 02:48:45.528547 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:45.528523    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 22 02:48:45.548594 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:45.548564    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a582d01b-8d7d-4017-8857-0397f6e96d37-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8s4h\" (UID: \"a582d01b-8d7d-4017-8857-0397f6e96d37\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"
Jul 22 02:48:45.548783 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:45.548619    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a582d01b-8d7d-4017-8857-0397f6e96d37-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8s4h\" (UID: \"a582d01b-8d7d-4017-8857-0397f6e96d37\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"
Jul 22 02:48:45.548783 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:45.548672    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a582d01b-8d7d-4017-8857-0397f6e96d37-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8s4h\" (UID: \"a582d01b-8d7d-4017-8857-0397f6e96d37\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"
Jul 22 02:48:45.548783 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:45.548726    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2tj9\" (UniqueName: \"kubernetes.io/projected/a582d01b-8d7d-4017-8857-0397f6e96d37-kube-api-access-s2tj9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8s4h\" (UID: \"a582d01b-8d7d-4017-8857-0397f6e96d37\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"
Jul 22 02:48:45.548942 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:45.548789    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a582d01b-8d7d-4017-8857-0397f6e96d37-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8s4h\" (UID: \"a582d01b-8d7d-4017-8857-0397f6e96d37\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"
Jul 22 02:48:45.548942 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:45.548861    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a582d01b-8d7d-4017-8857-0397f6e96d37-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8s4h\" (UID: \"a582d01b-8d7d-4017-8857-0397f6e96d37\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"
Jul 22 02:48:45.558938 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:45.558907    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"]
Jul 22 02:48:45.649989 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:45.649945    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a582d01b-8d7d-4017-8857-0397f6e96d37-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8s4h\" (UID: \"a582d01b-8d7d-4017-8857-0397f6e96d37\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"
Jul 22 02:48:45.650189 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:45.650015    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a582d01b-8d7d-4017-8857-0397f6e96d37-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8s4h\" (UID: \"a582d01b-8d7d-4017-8857-0397f6e96d37\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"
Jul 22 02:48:45.650189 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:45.650075    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a582d01b-8d7d-4017-8857-0397f6e96d37-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8s4h\" (UID: \"a582d01b-8d7d-4017-8857-0397f6e96d37\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"
Jul 22 02:48:45.650189 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:45.650120    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a582d01b-8d7d-4017-8857-0397f6e96d37-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8s4h\" (UID: \"a582d01b-8d7d-4017-8857-0397f6e96d37\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"
Jul 22 02:48:45.650189 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:45.650144    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a582d01b-8d7d-4017-8857-0397f6e96d37-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8s4h\" (UID: \"a582d01b-8d7d-4017-8857-0397f6e96d37\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"
Jul 22 02:48:45.650189 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:45.650173    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2tj9\" (UniqueName: \"kubernetes.io/projected/a582d01b-8d7d-4017-8857-0397f6e96d37-kube-api-access-s2tj9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8s4h\" (UID: \"a582d01b-8d7d-4017-8857-0397f6e96d37\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"
Jul 22 02:48:45.650492 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:45.650430    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a582d01b-8d7d-4017-8857-0397f6e96d37-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8s4h\" (UID: \"a582d01b-8d7d-4017-8857-0397f6e96d37\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"
Jul 22 02:48:45.650829 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:45.650693    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a582d01b-8d7d-4017-8857-0397f6e96d37-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8s4h\" (UID: \"a582d01b-8d7d-4017-8857-0397f6e96d37\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"
Jul 22 02:48:45.650829 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:45.650755    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a582d01b-8d7d-4017-8857-0397f6e96d37-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8s4h\" (UID: \"a582d01b-8d7d-4017-8857-0397f6e96d37\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"
Jul 22 02:48:45.652874 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:45.652833    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a582d01b-8d7d-4017-8857-0397f6e96d37-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8s4h\" (UID: \"a582d01b-8d7d-4017-8857-0397f6e96d37\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"
Jul 22 02:48:45.653365 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:45.653346    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a582d01b-8d7d-4017-8857-0397f6e96d37-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8s4h\" (UID: \"a582d01b-8d7d-4017-8857-0397f6e96d37\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"
Jul 22 02:48:45.661681 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:45.661641    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2tj9\" (UniqueName: \"kubernetes.io/projected/a582d01b-8d7d-4017-8857-0397f6e96d37-kube-api-access-s2tj9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v8s4h\" (UID: \"a582d01b-8d7d-4017-8857-0397f6e96d37\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"
Jul 22 02:48:45.686067 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:45.686032    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:48:45.836400 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:45.836307    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"
Jul 22 02:48:45.993786 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:45.993757    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"]
Jul 22 02:48:45.997409 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:48:45.997379    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda582d01b_8d7d_4017_8857_0397f6e96d37.slice/crio-7dc68717eb7132551eb7d6aa8f07e9afb44069558cdd25d66a29a514582a21f0 WatchSource:0}: Error finding container 7dc68717eb7132551eb7d6aa8f07e9afb44069558cdd25d66a29a514582a21f0: Status 404 returned error can't find the container with id 7dc68717eb7132551eb7d6aa8f07e9afb44069558cdd25d66a29a514582a21f0
Jul 22 02:48:45.998714 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:45.998698    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 02:48:46.719754 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:46.719716    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h" event={"ID":"a582d01b-8d7d-4017-8857-0397f6e96d37","Type":"ContainerStarted","Data":"14ba87ec0d0371fbbfdd356f0aa2d173a8e202b990fee3d44717c229a13b0ef0"}
Jul 22 02:48:46.720333 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:46.719775    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h" event={"ID":"a582d01b-8d7d-4017-8857-0397f6e96d37","Type":"ContainerStarted","Data":"7dc68717eb7132551eb7d6aa8f07e9afb44069558cdd25d66a29a514582a21f0"}
Jul 22 02:48:46.755331 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:46.755275    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h" podStartSLOduration=1.5991258940000002 podStartE2EDuration="1.755238518s" totalImagesPullingTime="156.112624ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:48:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:48:46.752908521 +0000 UTC m=+687.461337121" watchObservedRunningTime="2026-07-22 02:48:46.755238518 +0000 UTC m=+687.463667117"
Jul 22 02:48:51.062211 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:51.062181    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:48:53.659598 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:53.659560    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:48:55.836901 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:55.836873    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"
Jul 22 02:48:55.837325 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:55.836936    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"
Jul 22 02:48:55.849606 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:55.849579    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"
Jul 22 02:48:56.779924 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:48:56.779890    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v8s4h"
Jul 22 02:49:04.150502 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:49:04.150464    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:49:04.367929 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:49:04.367896    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:49:12.668228 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:49:12.668135    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:49:12.760027 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:49:12.759994    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:50:11.488329 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:50:11.488273    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:50:11.605532 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:50:11.605489    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:50:12.639977 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:50:12.639915    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:50:12.754177 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:50:12.754143    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:51:05.318804 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:51:05.318768    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-744f66f85b-9tj2p"]
Jul 22 02:51:05.319214 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:51:05.318990    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-744f66f85b-9tj2p" podUID="c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70" containerName="manager" containerID="cri-o://77590e1f6612114927e09fa3df8579a2f399adfa0f1c505ed9ad9ba14059d71d" gracePeriod=30
Jul 22 02:51:05.559392 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:51:05.559363    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-744f66f85b-9tj2p"
Jul 22 02:51:05.647624 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:51:05.647521    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zccnm\" (UniqueName: \"kubernetes.io/projected/c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70-kube-api-access-zccnm\") pod \"c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70\" (UID: \"c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70\") "
Jul 22 02:51:05.647624 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:51:05.647582    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70-webhook-cert\") pod \"c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70\" (UID: \"c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70\") "
Jul 22 02:51:05.649857 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:51:05.649830    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70-kube-api-access-zccnm" (OuterVolumeSpecName: "kube-api-access-zccnm") pod "c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70" (UID: "c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70"). InnerVolumeSpecName "kube-api-access-zccnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 02:51:05.649857 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:51:05.649837    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70" (UID: "c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:51:05.749229 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:51:05.749191    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zccnm\" (UniqueName: \"kubernetes.io/projected/c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70-kube-api-access-zccnm\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:51:05.749229 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:51:05.749221    2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70-webhook-cert\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:51:06.336857 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:51:06.336822    2577 generic.go:356] "Generic (PLEG): container finished" podID="c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70" containerID="77590e1f6612114927e09fa3df8579a2f399adfa0f1c505ed9ad9ba14059d71d" exitCode=0
Jul 22 02:51:06.337303 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:51:06.336874    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-744f66f85b-9tj2p"
Jul 22 02:51:06.337303 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:51:06.336885    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-744f66f85b-9tj2p" event={"ID":"c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70","Type":"ContainerDied","Data":"77590e1f6612114927e09fa3df8579a2f399adfa0f1c505ed9ad9ba14059d71d"}
Jul 22 02:51:06.337303 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:51:06.336935    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-744f66f85b-9tj2p" event={"ID":"c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70","Type":"ContainerDied","Data":"ec4ed645bfc5ff3d2e65f52f987f5d2cf34e2a0ad1d32c09ae541a8ecf2b6b60"}
Jul 22 02:51:06.337303 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:51:06.336965    2577 scope.go:117] "RemoveContainer" containerID="77590e1f6612114927e09fa3df8579a2f399adfa0f1c505ed9ad9ba14059d71d"
Jul 22 02:51:06.345498 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:51:06.345477    2577 scope.go:117] "RemoveContainer" containerID="77590e1f6612114927e09fa3df8579a2f399adfa0f1c505ed9ad9ba14059d71d"
Jul 22 02:51:06.345772 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:51:06.345745    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77590e1f6612114927e09fa3df8579a2f399adfa0f1c505ed9ad9ba14059d71d\": container with ID starting with 77590e1f6612114927e09fa3df8579a2f399adfa0f1c505ed9ad9ba14059d71d not found: ID does not exist" containerID="77590e1f6612114927e09fa3df8579a2f399adfa0f1c505ed9ad9ba14059d71d"
Jul 22 02:51:06.345845 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:51:06.345781    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77590e1f6612114927e09fa3df8579a2f399adfa0f1c505ed9ad9ba14059d71d"} err="failed to get container status \"77590e1f6612114927e09fa3df8579a2f399adfa0f1c505ed9ad9ba14059d71d\": rpc error: code = NotFound desc = could not find container \"77590e1f6612114927e09fa3df8579a2f399adfa0f1c505ed9ad9ba14059d71d\": container with ID starting with 77590e1f6612114927e09fa3df8579a2f399adfa0f1c505ed9ad9ba14059d71d not found: ID does not exist"
Jul 22 02:51:06.357518 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:51:06.357490    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-744f66f85b-9tj2p"]
Jul 22 02:51:06.360235 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:51:06.360209    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-744f66f85b-9tj2p"]
Jul 22 02:51:07.758058 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:51:07.758022    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70" path="/var/lib/kubelet/pods/c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70/volumes"
Jul 22 02:51:08.879109 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:51:08.879054    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:52:07.185813 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:07.185777    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-744f66f85b-lqbcj"]
Jul 22 02:52:07.186306 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:07.186126    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70" containerName="manager"
Jul 22 02:52:07.186306 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:07.186136    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70" containerName="manager"
Jul 22 02:52:07.186306 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:07.186199    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c772fa7c-e45c-4c3b-b59a-6dc6f1c03d70" containerName="manager"
Jul 22 02:52:07.189365 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:07.189349    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-744f66f85b-lqbcj"
Jul 22 02:52:07.192471 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:07.192420    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 02:52:07.192471 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:07.192432    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 02:52:07.192822 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:07.192733    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9k7nc\""
Jul 22 02:52:07.203368 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:07.203344    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-744f66f85b-lqbcj"]
Jul 22 02:52:07.209353 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:07.209326    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8eb470f5-4aa4-42a5-8af7-9dbf264143b4-webhook-cert\") pod \"maas-controller-744f66f85b-lqbcj\" (UID: \"8eb470f5-4aa4-42a5-8af7-9dbf264143b4\") " pod="opendatahub/maas-controller-744f66f85b-lqbcj"
Jul 22 02:52:07.209476 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:07.209361    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmvxq\" (UniqueName: \"kubernetes.io/projected/8eb470f5-4aa4-42a5-8af7-9dbf264143b4-kube-api-access-wmvxq\") pod \"maas-controller-744f66f85b-lqbcj\" (UID: \"8eb470f5-4aa4-42a5-8af7-9dbf264143b4\") " pod="opendatahub/maas-controller-744f66f85b-lqbcj"
Jul 22 02:52:07.310147 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:07.310104    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8eb470f5-4aa4-42a5-8af7-9dbf264143b4-webhook-cert\") pod \"maas-controller-744f66f85b-lqbcj\" (UID: \"8eb470f5-4aa4-42a5-8af7-9dbf264143b4\") " pod="opendatahub/maas-controller-744f66f85b-lqbcj"
Jul 22 02:52:07.310147 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:07.310149    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmvxq\" (UniqueName: \"kubernetes.io/projected/8eb470f5-4aa4-42a5-8af7-9dbf264143b4-kube-api-access-wmvxq\") pod \"maas-controller-744f66f85b-lqbcj\" (UID: \"8eb470f5-4aa4-42a5-8af7-9dbf264143b4\") " pod="opendatahub/maas-controller-744f66f85b-lqbcj"
Jul 22 02:52:07.312907 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:07.312873    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8eb470f5-4aa4-42a5-8af7-9dbf264143b4-webhook-cert\") pod \"maas-controller-744f66f85b-lqbcj\" (UID: \"8eb470f5-4aa4-42a5-8af7-9dbf264143b4\") " pod="opendatahub/maas-controller-744f66f85b-lqbcj"
Jul 22 02:52:07.320662 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:07.320626    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmvxq\" (UniqueName: \"kubernetes.io/projected/8eb470f5-4aa4-42a5-8af7-9dbf264143b4-kube-api-access-wmvxq\") pod \"maas-controller-744f66f85b-lqbcj\" (UID: \"8eb470f5-4aa4-42a5-8af7-9dbf264143b4\") " pod="opendatahub/maas-controller-744f66f85b-lqbcj"
Jul 22 02:52:07.500000 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:07.499957    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-744f66f85b-lqbcj"
Jul 22 02:52:07.653660 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:07.653625    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-744f66f85b-lqbcj"]
Jul 22 02:52:07.656840 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:52:07.656807    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eb470f5_4aa4_42a5_8af7_9dbf264143b4.slice/crio-c9287b7b4135e7727dac0fbc7ab65f4295416ca269c70a4c91c2e7caff929e49 WatchSource:0}: Error finding container c9287b7b4135e7727dac0fbc7ab65f4295416ca269c70a4c91c2e7caff929e49: Status 404 returned error can't find the container with id c9287b7b4135e7727dac0fbc7ab65f4295416ca269c70a4c91c2e7caff929e49
Jul 22 02:52:08.613644 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:08.613607    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-744f66f85b-lqbcj" event={"ID":"8eb470f5-4aa4-42a5-8af7-9dbf264143b4","Type":"ContainerStarted","Data":"bc885b52cd190bbb9c0a91ff258a8d84a80687686c9a8cb4f2306b95a6a21df3"}
Jul 22 02:52:08.614086 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:08.613656    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-744f66f85b-lqbcj" event={"ID":"8eb470f5-4aa4-42a5-8af7-9dbf264143b4","Type":"ContainerStarted","Data":"c9287b7b4135e7727dac0fbc7ab65f4295416ca269c70a4c91c2e7caff929e49"}
Jul 22 02:52:08.614086 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:08.613753    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-744f66f85b-lqbcj"
Jul 22 02:52:08.662032 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:08.661972    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-744f66f85b-lqbcj" podStartSLOduration=1.255447703 podStartE2EDuration="1.661955749s" totalImagesPullingTime="406.508046ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:52:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:52:08.661060964 +0000 UTC m=+889.369489563" watchObservedRunningTime="2026-07-22 02:52:08.661955749 +0000 UTC m=+889.370384348"
Jul 22 02:52:19.620398 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:19.620369    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-744f66f85b-lqbcj"
Jul 22 02:52:19.652899 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:19.652868    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqngf_6461ea33-ff4c-48c5-8c29-b4026c2f67b0/ovn-acl-logging/0.log"
Jul 22 02:52:19.653541 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:19.653518    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqngf_6461ea33-ff4c-48c5-8c29-b4026c2f67b0/ovn-acl-logging/0.log"
Jul 22 02:52:24.166447 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:24.166408    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:52:24.275422 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:24.275380    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-744f66f85b-lqbcj"]
Jul 22 02:52:24.275677 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:24.275641    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-744f66f85b-lqbcj" podUID="8eb470f5-4aa4-42a5-8af7-9dbf264143b4" containerName="manager" containerID="cri-o://bc885b52cd190bbb9c0a91ff258a8d84a80687686c9a8cb4f2306b95a6a21df3" gracePeriod=30
Jul 22 02:52:24.524055 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:24.524032    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-744f66f85b-lqbcj"
Jul 22 02:52:24.676395 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:24.676357    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8eb470f5-4aa4-42a5-8af7-9dbf264143b4-webhook-cert\") pod \"8eb470f5-4aa4-42a5-8af7-9dbf264143b4\" (UID: \"8eb470f5-4aa4-42a5-8af7-9dbf264143b4\") "
Jul 22 02:52:24.676586 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:24.676444    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmvxq\" (UniqueName: \"kubernetes.io/projected/8eb470f5-4aa4-42a5-8af7-9dbf264143b4-kube-api-access-wmvxq\") pod \"8eb470f5-4aa4-42a5-8af7-9dbf264143b4\" (UID: \"8eb470f5-4aa4-42a5-8af7-9dbf264143b4\") "
Jul 22 02:52:24.678710 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:24.678676    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eb470f5-4aa4-42a5-8af7-9dbf264143b4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8eb470f5-4aa4-42a5-8af7-9dbf264143b4" (UID: "8eb470f5-4aa4-42a5-8af7-9dbf264143b4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:52:24.678823 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:24.678771    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eb470f5-4aa4-42a5-8af7-9dbf264143b4-kube-api-access-wmvxq" (OuterVolumeSpecName: "kube-api-access-wmvxq") pod "8eb470f5-4aa4-42a5-8af7-9dbf264143b4" (UID: "8eb470f5-4aa4-42a5-8af7-9dbf264143b4"). InnerVolumeSpecName "kube-api-access-wmvxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 02:52:24.686382 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:24.686352    2577 generic.go:356] "Generic (PLEG): container finished" podID="8eb470f5-4aa4-42a5-8af7-9dbf264143b4" containerID="bc885b52cd190bbb9c0a91ff258a8d84a80687686c9a8cb4f2306b95a6a21df3" exitCode=0
Jul 22 02:52:24.686501 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:24.686409    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-744f66f85b-lqbcj"
Jul 22 02:52:24.686501 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:24.686445    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-744f66f85b-lqbcj" event={"ID":"8eb470f5-4aa4-42a5-8af7-9dbf264143b4","Type":"ContainerDied","Data":"bc885b52cd190bbb9c0a91ff258a8d84a80687686c9a8cb4f2306b95a6a21df3"}
Jul 22 02:52:24.686575 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:24.686510    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-744f66f85b-lqbcj" event={"ID":"8eb470f5-4aa4-42a5-8af7-9dbf264143b4","Type":"ContainerDied","Data":"c9287b7b4135e7727dac0fbc7ab65f4295416ca269c70a4c91c2e7caff929e49"}
Jul 22 02:52:24.686575 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:24.686541    2577 scope.go:117] "RemoveContainer" containerID="bc885b52cd190bbb9c0a91ff258a8d84a80687686c9a8cb4f2306b95a6a21df3"
Jul 22 02:52:24.696679 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:24.696657    2577 scope.go:117] "RemoveContainer" containerID="bc885b52cd190bbb9c0a91ff258a8d84a80687686c9a8cb4f2306b95a6a21df3"
Jul 22 02:52:24.696973 ip-10-0-143-160 kubenswrapper[2577]: E0722 02:52:24.696957    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc885b52cd190bbb9c0a91ff258a8d84a80687686c9a8cb4f2306b95a6a21df3\": container with ID starting with bc885b52cd190bbb9c0a91ff258a8d84a80687686c9a8cb4f2306b95a6a21df3 not found: ID does not exist" containerID="bc885b52cd190bbb9c0a91ff258a8d84a80687686c9a8cb4f2306b95a6a21df3"
Jul 22 02:52:24.697021 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:24.696981    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc885b52cd190bbb9c0a91ff258a8d84a80687686c9a8cb4f2306b95a6a21df3"} err="failed to get container status \"bc885b52cd190bbb9c0a91ff258a8d84a80687686c9a8cb4f2306b95a6a21df3\": rpc error: code = NotFound desc = could not find container \"bc885b52cd190bbb9c0a91ff258a8d84a80687686c9a8cb4f2306b95a6a21df3\": container with ID starting with bc885b52cd190bbb9c0a91ff258a8d84a80687686c9a8cb4f2306b95a6a21df3 not found: ID does not exist"
Jul 22 02:52:24.708716 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:24.708681    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-744f66f85b-lqbcj"]
Jul 22 02:52:24.714309 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:24.714284    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-744f66f85b-lqbcj"]
Jul 22 02:52:24.777403 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:24.777363    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmvxq\" (UniqueName: \"kubernetes.io/projected/8eb470f5-4aa4-42a5-8af7-9dbf264143b4-kube-api-access-wmvxq\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:52:24.777403 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:24.777394    2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8eb470f5-4aa4-42a5-8af7-9dbf264143b4-webhook-cert\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 02:52:25.384923 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:25.384893    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:52:25.491160 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:25.491127    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-744f66f85b-kvjz8"]
Jul 22 02:52:25.491526 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:25.491513    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eb470f5-4aa4-42a5-8af7-9dbf264143b4" containerName="manager"
Jul 22 02:52:25.491577 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:25.491528    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eb470f5-4aa4-42a5-8af7-9dbf264143b4" containerName="manager"
Jul 22 02:52:25.491613 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:25.491597    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8eb470f5-4aa4-42a5-8af7-9dbf264143b4" containerName="manager"
Jul 22 02:52:25.495786 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:25.495768    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-744f66f85b-kvjz8"
Jul 22 02:52:25.498530 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:25.498509    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 02:52:25.499714 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:25.499699    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 02:52:25.499714 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:25.499708    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9k7nc\""
Jul 22 02:52:25.504315 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:25.504290    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-744f66f85b-kvjz8"]
Jul 22 02:52:25.583388 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:25.583351    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgkdg\" (UniqueName: \"kubernetes.io/projected/3f0c15c1-c901-4cb5-9216-409d882032c5-kube-api-access-fgkdg\") pod \"maas-controller-744f66f85b-kvjz8\" (UID: \"3f0c15c1-c901-4cb5-9216-409d882032c5\") " pod="opendatahub/maas-controller-744f66f85b-kvjz8"
Jul 22 02:52:25.583572 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:25.583434    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f0c15c1-c901-4cb5-9216-409d882032c5-webhook-cert\") pod \"maas-controller-744f66f85b-kvjz8\" (UID: \"3f0c15c1-c901-4cb5-9216-409d882032c5\") " pod="opendatahub/maas-controller-744f66f85b-kvjz8"
Jul 22 02:52:25.684108 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:25.684023    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f0c15c1-c901-4cb5-9216-409d882032c5-webhook-cert\") pod \"maas-controller-744f66f85b-kvjz8\" (UID: \"3f0c15c1-c901-4cb5-9216-409d882032c5\") " pod="opendatahub/maas-controller-744f66f85b-kvjz8"
Jul 22 02:52:25.684108 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:25.684072    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgkdg\" (UniqueName: \"kubernetes.io/projected/3f0c15c1-c901-4cb5-9216-409d882032c5-kube-api-access-fgkdg\") pod \"maas-controller-744f66f85b-kvjz8\" (UID: \"3f0c15c1-c901-4cb5-9216-409d882032c5\") " pod="opendatahub/maas-controller-744f66f85b-kvjz8"
Jul 22 02:52:25.686684 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:25.686657    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f0c15c1-c901-4cb5-9216-409d882032c5-webhook-cert\") pod \"maas-controller-744f66f85b-kvjz8\" (UID: \"3f0c15c1-c901-4cb5-9216-409d882032c5\") " pod="opendatahub/maas-controller-744f66f85b-kvjz8"
Jul 22 02:52:25.693243 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:25.693218    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgkdg\" (UniqueName: \"kubernetes.io/projected/3f0c15c1-c901-4cb5-9216-409d882032c5-kube-api-access-fgkdg\") pod \"maas-controller-744f66f85b-kvjz8\" (UID: \"3f0c15c1-c901-4cb5-9216-409d882032c5\") " pod="opendatahub/maas-controller-744f66f85b-kvjz8"
Jul 22 02:52:25.757194 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:25.757145    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8eb470f5-4aa4-42a5-8af7-9dbf264143b4" path="/var/lib/kubelet/pods/8eb470f5-4aa4-42a5-8af7-9dbf264143b4/volumes"
Jul 22 02:52:25.807506 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:25.807474    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-744f66f85b-kvjz8"
Jul 22 02:52:25.951638 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:25.951543    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-744f66f85b-kvjz8"]
Jul 22 02:52:25.954556 ip-10-0-143-160 kubenswrapper[2577]: W0722 02:52:25.954526    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0c15c1_c901_4cb5_9216_409d882032c5.slice/crio-12f33835d81626a9f04b480fb58404360ab6c0304bce233d3845ac10238c228a WatchSource:0}: Error finding container 12f33835d81626a9f04b480fb58404360ab6c0304bce233d3845ac10238c228a: Status 404 returned error can't find the container with id 12f33835d81626a9f04b480fb58404360ab6c0304bce233d3845ac10238c228a
Jul 22 02:52:26.707417 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:26.707321    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-744f66f85b-kvjz8" event={"ID":"3f0c15c1-c901-4cb5-9216-409d882032c5","Type":"ContainerStarted","Data":"bb07bbe6fde7f5bd3c9447f304a3e917b5b2425a3c7e0b71ebddc5f1dc0fe580"}
Jul 22 02:52:26.707417 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:26.707402    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-744f66f85b-kvjz8" event={"ID":"3f0c15c1-c901-4cb5-9216-409d882032c5","Type":"ContainerStarted","Data":"12f33835d81626a9f04b480fb58404360ab6c0304bce233d3845ac10238c228a"}
Jul 22 02:52:26.707860 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:26.707478    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-744f66f85b-kvjz8"
Jul 22 02:52:26.730172 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:26.730117    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-744f66f85b-kvjz8" podStartSLOduration=1.378259893 podStartE2EDuration="1.730097646s" totalImagesPullingTime="351.837753ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:52:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:52:26.728743539 +0000 UTC m=+907.437172144" watchObservedRunningTime="2026-07-22 02:52:26.730097646 +0000 UTC m=+907.438526246"
Jul 22 02:52:37.714926 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:37.714892    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-744f66f85b-kvjz8"
Jul 22 02:52:58.957833 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:52:58.957798    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:53:00.122880 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:53:00.122840    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:53:05.908563 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:53:05.908527    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:53:06.030459 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:53:06.030424    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:53:06.149997 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:53:06.149962    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:53:06.306883 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:53:06.306853    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:53:06.420028 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:53:06.420000    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:53:12.336916 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:53:12.336876    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:53:12.440624 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:53:12.440588    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:54:13.763043 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:54:13.763001    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:54:13.863558 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:54:13.863485    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:57:07.225025 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:57:07.224990    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:57:10.026183 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:57:10.026144    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:57:10.090446 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:57:10.090417    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:57:19.681049 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:57:19.681016    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqngf_6461ea33-ff4c-48c5-8c29-b4026c2f67b0/ovn-acl-logging/0.log"
Jul 22 02:57:19.681965 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:57:19.681946    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqngf_6461ea33-ff4c-48c5-8c29-b4026c2f67b0/ovn-acl-logging/0.log"
Jul 22 02:58:35.126908 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:58:35.126871    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:59:29.018468 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:59:29.018402    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 02:59:29.122101 ip-10-0-143-160 kubenswrapper[2577]: I0722 02:59:29.122068    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:00:41.296866 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:00:41.296803    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:01:13.594238 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:01:13.594206    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:01:38.166447 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:01:38.166413    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:01:39.741269 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:01:39.741218    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:02:19.707439 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:02:19.707395    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqngf_6461ea33-ff4c-48c5-8c29-b4026c2f67b0/ovn-acl-logging/0.log"
Jul 22 03:02:19.710180 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:02:19.710161    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqngf_6461ea33-ff4c-48c5-8c29-b4026c2f67b0/ovn-acl-logging/0.log"
Jul 22 03:04:47.244800 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:04:47.244709    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:05:05.538714 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:05.538672    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:05:08.551141 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:08.551110    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:05:08.786054 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:08.786017    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:05:08.975377 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:08.975285    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:05:14.222735 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:14.222688    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:05:14.321514 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:14.321477    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:05:15.175528 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:15.175488    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:05:15.245878 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:15.245849    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:05:15.448882 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:15.448792    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:05:15.746988 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:15.746955    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:05:16.021994 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:16.021887    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:05:18.572585 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:18.572550    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:05:18.652558 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:18.652520    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:05:18.653222 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:18.653200    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs"]
Jul 22 03:05:18.656678 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:18.656660    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs"
Jul 22 03:05:18.659587 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:18.659567    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-f8xd9\""
Jul 22 03:05:18.659812 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:18.659797    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-c22b602d-serving-cert\""
Jul 22 03:05:18.666458 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:18.666432    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs"]
Jul 22 03:05:18.682441 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:18.682409    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/843a40fe-4f2f-4b2f-82bf-58beaccd59a5-maas-api-tls\") pod \"maas-api-e2e-ait-c22b602d-698688b9f8-98tjs\" (UID: \"843a40fe-4f2f-4b2f-82bf-58beaccd59a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs"
Jul 22 03:05:18.682621 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:18.682465    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psfh2\" (UniqueName: \"kubernetes.io/projected/843a40fe-4f2f-4b2f-82bf-58beaccd59a5-kube-api-access-psfh2\") pod \"maas-api-e2e-ait-c22b602d-698688b9f8-98tjs\" (UID: \"843a40fe-4f2f-4b2f-82bf-58beaccd59a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs"
Jul 22 03:05:18.682621 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:18.682575    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/843a40fe-4f2f-4b2f-82bf-58beaccd59a5-openshift-service-ca\") pod \"maas-api-e2e-ait-c22b602d-698688b9f8-98tjs\" (UID: \"843a40fe-4f2f-4b2f-82bf-58beaccd59a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs"
Jul 22 03:05:18.717204 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:18.717170    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:05:18.783412 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:18.783372    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psfh2\" (UniqueName: \"kubernetes.io/projected/843a40fe-4f2f-4b2f-82bf-58beaccd59a5-kube-api-access-psfh2\") pod \"maas-api-e2e-ait-c22b602d-698688b9f8-98tjs\" (UID: \"843a40fe-4f2f-4b2f-82bf-58beaccd59a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs"
Jul 22 03:05:18.783593 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:18.783443    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/843a40fe-4f2f-4b2f-82bf-58beaccd59a5-openshift-service-ca\") pod \"maas-api-e2e-ait-c22b602d-698688b9f8-98tjs\" (UID: \"843a40fe-4f2f-4b2f-82bf-58beaccd59a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs"
Jul 22 03:05:18.783593 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:18.783520    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/843a40fe-4f2f-4b2f-82bf-58beaccd59a5-maas-api-tls\") pod \"maas-api-e2e-ait-c22b602d-698688b9f8-98tjs\" (UID: \"843a40fe-4f2f-4b2f-82bf-58beaccd59a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs"
Jul 22 03:05:18.783668 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:05:18.783632    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-serving-cert: secret "maas-api-e2e-ait-c22b602d-serving-cert" not found
Jul 22 03:05:18.783724 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:05:18.783712    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/843a40fe-4f2f-4b2f-82bf-58beaccd59a5-maas-api-tls podName:843a40fe-4f2f-4b2f-82bf-58beaccd59a5 nodeName:}" failed. No retries permitted until 2026-07-22 03:05:19.283691375 +0000 UTC m=+1679.992119976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/843a40fe-4f2f-4b2f-82bf-58beaccd59a5-maas-api-tls") pod "maas-api-e2e-ait-c22b602d-698688b9f8-98tjs" (UID: "843a40fe-4f2f-4b2f-82bf-58beaccd59a5") : secret "maas-api-e2e-ait-c22b602d-serving-cert" not found
Jul 22 03:05:18.784148 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:18.784128    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/843a40fe-4f2f-4b2f-82bf-58beaccd59a5-openshift-service-ca\") pod \"maas-api-e2e-ait-c22b602d-698688b9f8-98tjs\" (UID: \"843a40fe-4f2f-4b2f-82bf-58beaccd59a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs"
Jul 22 03:05:18.792339 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:18.792314    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psfh2\" (UniqueName: \"kubernetes.io/projected/843a40fe-4f2f-4b2f-82bf-58beaccd59a5-kube-api-access-psfh2\") pod \"maas-api-e2e-ait-c22b602d-698688b9f8-98tjs\" (UID: \"843a40fe-4f2f-4b2f-82bf-58beaccd59a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs"
Jul 22 03:05:18.868840 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:18.868749    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:05:19.288638 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:19.288594    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/843a40fe-4f2f-4b2f-82bf-58beaccd59a5-maas-api-tls\") pod \"maas-api-e2e-ait-c22b602d-698688b9f8-98tjs\" (UID: \"843a40fe-4f2f-4b2f-82bf-58beaccd59a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs"
Jul 22 03:05:19.291238 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:19.291204    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/843a40fe-4f2f-4b2f-82bf-58beaccd59a5-maas-api-tls\") pod \"maas-api-e2e-ait-c22b602d-698688b9f8-98tjs\" (UID: \"843a40fe-4f2f-4b2f-82bf-58beaccd59a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs"
Jul 22 03:05:19.311244 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:19.311207    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:05:19.410677 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:19.410645    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:05:19.569309 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:19.569192    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs"
Jul 22 03:05:19.721156 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:19.721128    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs"]
Jul 22 03:05:19.724208 ip-10-0-143-160 kubenswrapper[2577]: W0722 03:05:19.724182    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod843a40fe_4f2f_4b2f_82bf_58beaccd59a5.slice/crio-040821e02880f6b0e24d2b8bca85898bde59c02f468501b1b36089c4653f8fa1 WatchSource:0}: Error finding container 040821e02880f6b0e24d2b8bca85898bde59c02f468501b1b36089c4653f8fa1: Status 404 returned error can't find the container with id 040821e02880f6b0e24d2b8bca85898bde59c02f468501b1b36089c4653f8fa1
Jul 22 03:05:19.725631 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:19.725608    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 03:05:20.166901 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:20.166866    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs" event={"ID":"843a40fe-4f2f-4b2f-82bf-58beaccd59a5","Type":"ContainerStarted","Data":"040821e02880f6b0e24d2b8bca85898bde59c02f468501b1b36089c4653f8fa1"}
Jul 22 03:05:21.175593 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:21.175545    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs" event={"ID":"843a40fe-4f2f-4b2f-82bf-58beaccd59a5","Type":"ContainerStarted","Data":"ba28a3f078c7c9aa1350ef43a77c043e659363897687a8d32518a7b26c0ec6d2"}
Jul 22 03:05:21.176016 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:21.175680    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs"
Jul 22 03:05:21.198727 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:21.198671    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs" podStartSLOduration=2.617798594 podStartE2EDuration="3.1986537s" totalImagesPullingTime="580.855106ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:05:21.197328044 +0000 UTC m=+1681.905756649" watchObservedRunningTime="2026-07-22 03:05:21.1986537 +0000 UTC m=+1681.907082350"
Jul 22 03:05:27.185540 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:27.185509    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs"
Jul 22 03:05:54.850551 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:54.850465    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs"]
Jul 22 03:05:54.851121 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:54.850688    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs" podUID="843a40fe-4f2f-4b2f-82bf-58beaccd59a5" containerName="maas-api" containerID="cri-o://ba28a3f078c7c9aa1350ef43a77c043e659363897687a8d32518a7b26c0ec6d2" gracePeriod=30
Jul 22 03:05:54.903706 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:54.903673    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:05:55.094850 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:55.094821    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs"
Jul 22 03:05:55.116474 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:55.116389    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psfh2\" (UniqueName: \"kubernetes.io/projected/843a40fe-4f2f-4b2f-82bf-58beaccd59a5-kube-api-access-psfh2\") pod \"843a40fe-4f2f-4b2f-82bf-58beaccd59a5\" (UID: \"843a40fe-4f2f-4b2f-82bf-58beaccd59a5\") "
Jul 22 03:05:55.116474 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:55.116456    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/843a40fe-4f2f-4b2f-82bf-58beaccd59a5-openshift-service-ca\") pod \"843a40fe-4f2f-4b2f-82bf-58beaccd59a5\" (UID: \"843a40fe-4f2f-4b2f-82bf-58beaccd59a5\") "
Jul 22 03:05:55.116689 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:55.116503    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/843a40fe-4f2f-4b2f-82bf-58beaccd59a5-maas-api-tls\") pod \"843a40fe-4f2f-4b2f-82bf-58beaccd59a5\" (UID: \"843a40fe-4f2f-4b2f-82bf-58beaccd59a5\") "
Jul 22 03:05:55.116833 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:55.116809    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/843a40fe-4f2f-4b2f-82bf-58beaccd59a5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "843a40fe-4f2f-4b2f-82bf-58beaccd59a5" (UID: "843a40fe-4f2f-4b2f-82bf-58beaccd59a5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:05:55.119175 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:55.119097    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/843a40fe-4f2f-4b2f-82bf-58beaccd59a5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "843a40fe-4f2f-4b2f-82bf-58beaccd59a5" (UID: "843a40fe-4f2f-4b2f-82bf-58beaccd59a5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:05:55.119175 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:55.119090    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/843a40fe-4f2f-4b2f-82bf-58beaccd59a5-kube-api-access-psfh2" (OuterVolumeSpecName: "kube-api-access-psfh2") pod "843a40fe-4f2f-4b2f-82bf-58beaccd59a5" (UID: "843a40fe-4f2f-4b2f-82bf-58beaccd59a5"). InnerVolumeSpecName "kube-api-access-psfh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:05:55.217279 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:55.217237    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/843a40fe-4f2f-4b2f-82bf-58beaccd59a5-maas-api-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:05:55.217279 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:55.217277    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psfh2\" (UniqueName: \"kubernetes.io/projected/843a40fe-4f2f-4b2f-82bf-58beaccd59a5-kube-api-access-psfh2\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:05:55.217279 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:55.217295    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/843a40fe-4f2f-4b2f-82bf-58beaccd59a5-openshift-service-ca\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:05:55.331267 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:55.331216    2577 generic.go:356] "Generic (PLEG): container finished" podID="843a40fe-4f2f-4b2f-82bf-58beaccd59a5" containerID="ba28a3f078c7c9aa1350ef43a77c043e659363897687a8d32518a7b26c0ec6d2" exitCode=0
Jul 22 03:05:55.331451 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:55.331293    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs"
Jul 22 03:05:55.331451 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:55.331296    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs" event={"ID":"843a40fe-4f2f-4b2f-82bf-58beaccd59a5","Type":"ContainerDied","Data":"ba28a3f078c7c9aa1350ef43a77c043e659363897687a8d32518a7b26c0ec6d2"}
Jul 22 03:05:55.331451 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:55.331370    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs" event={"ID":"843a40fe-4f2f-4b2f-82bf-58beaccd59a5","Type":"ContainerDied","Data":"040821e02880f6b0e24d2b8bca85898bde59c02f468501b1b36089c4653f8fa1"}
Jul 22 03:05:55.331451 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:55.331391    2577 scope.go:117] "RemoveContainer" containerID="ba28a3f078c7c9aa1350ef43a77c043e659363897687a8d32518a7b26c0ec6d2"
Jul 22 03:05:55.346645 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:55.346623    2577 scope.go:117] "RemoveContainer" containerID="ba28a3f078c7c9aa1350ef43a77c043e659363897687a8d32518a7b26c0ec6d2"
Jul 22 03:05:55.346963 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:05:55.346943    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba28a3f078c7c9aa1350ef43a77c043e659363897687a8d32518a7b26c0ec6d2\": container with ID starting with ba28a3f078c7c9aa1350ef43a77c043e659363897687a8d32518a7b26c0ec6d2 not found: ID does not exist" containerID="ba28a3f078c7c9aa1350ef43a77c043e659363897687a8d32518a7b26c0ec6d2"
Jul 22 03:05:55.347018 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:55.346973    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba28a3f078c7c9aa1350ef43a77c043e659363897687a8d32518a7b26c0ec6d2"} err="failed to get container status \"ba28a3f078c7c9aa1350ef43a77c043e659363897687a8d32518a7b26c0ec6d2\": rpc error: code = NotFound desc = could not find container \"ba28a3f078c7c9aa1350ef43a77c043e659363897687a8d32518a7b26c0ec6d2\": container with ID starting with ba28a3f078c7c9aa1350ef43a77c043e659363897687a8d32518a7b26c0ec6d2 not found: ID does not exist"
Jul 22 03:05:55.362474 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:55.362443    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs"]
Jul 22 03:05:55.366284 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:55.366234    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c22b602d-698688b9f8-98tjs"]
Jul 22 03:05:55.757359 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:55.757326    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="843a40fe-4f2f-4b2f-82bf-58beaccd59a5" path="/var/lib/kubelet/pods/843a40fe-4f2f-4b2f-82bf-58beaccd59a5/volumes"
Jul 22 03:05:59.190392 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:59.190340    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:05:59.354301 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:59.354246    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:05:59.597919 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:59.597878    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:05:59.842769 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:59.842734    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:05:59.944014 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:05:59.943934    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:06:00.193057 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:00.193018    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:06:00.428365 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:00.428334    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:06:00.602756 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:00.602719    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:06:02.981586 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:02.980457    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:06:03.131710 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:03.131673    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx"]
Jul 22 03:06:03.132042 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:03.132030    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="843a40fe-4f2f-4b2f-82bf-58beaccd59a5" containerName="maas-api"
Jul 22 03:06:03.132094 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:03.132043    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="843a40fe-4f2f-4b2f-82bf-58beaccd59a5" containerName="maas-api"
Jul 22 03:06:03.132132 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:03.132108    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="843a40fe-4f2f-4b2f-82bf-58beaccd59a5" containerName="maas-api"
Jul 22 03:06:03.136870 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:03.136851    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx"
Jul 22 03:06:03.139942 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:03.139921    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-7c53861a-serving-cert\""
Jul 22 03:06:03.140771 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:03.140748    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-f8xd9\""
Jul 22 03:06:03.149234 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:03.149203    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx"]
Jul 22 03:06:03.189351 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:03.189309    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66b76b53-9200-48a7-a856-13a6e76c257b-openshift-service-ca\") pod \"maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx\" (UID: \"66b76b53-9200-48a7-a856-13a6e76c257b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx"
Jul 22 03:06:03.189534 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:03.189411    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8tvn\" (UniqueName: \"kubernetes.io/projected/66b76b53-9200-48a7-a856-13a6e76c257b-kube-api-access-t8tvn\") pod \"maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx\" (UID: \"66b76b53-9200-48a7-a856-13a6e76c257b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx"
Jul 22 03:06:03.189534 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:03.189453    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66b76b53-9200-48a7-a856-13a6e76c257b-maas-api-tls\") pod \"maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx\" (UID: \"66b76b53-9200-48a7-a856-13a6e76c257b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx"
Jul 22 03:06:03.201817 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:03.201787    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:06:03.290896 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:03.290855    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66b76b53-9200-48a7-a856-13a6e76c257b-openshift-service-ca\") pod \"maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx\" (UID: \"66b76b53-9200-48a7-a856-13a6e76c257b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx"
Jul 22 03:06:03.291087 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:03.290932    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8tvn\" (UniqueName: \"kubernetes.io/projected/66b76b53-9200-48a7-a856-13a6e76c257b-kube-api-access-t8tvn\") pod \"maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx\" (UID: \"66b76b53-9200-48a7-a856-13a6e76c257b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx"
Jul 22 03:06:03.291087 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:03.290957    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66b76b53-9200-48a7-a856-13a6e76c257b-maas-api-tls\") pod \"maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx\" (UID: \"66b76b53-9200-48a7-a856-13a6e76c257b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx"
Jul 22 03:06:03.291087 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:06:03.291069    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-serving-cert: secret "maas-api-e2e-migrate-7c53861a-serving-cert" not found
Jul 22 03:06:03.291198 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:06:03.291138    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66b76b53-9200-48a7-a856-13a6e76c257b-maas-api-tls podName:66b76b53-9200-48a7-a856-13a6e76c257b nodeName:}" failed. No retries permitted until 2026-07-22 03:06:03.791119818 +0000 UTC m=+1724.499548397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/66b76b53-9200-48a7-a856-13a6e76c257b-maas-api-tls") pod "maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx" (UID: "66b76b53-9200-48a7-a856-13a6e76c257b") : secret "maas-api-e2e-migrate-7c53861a-serving-cert" not found
Jul 22 03:06:03.291700 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:03.291681    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66b76b53-9200-48a7-a856-13a6e76c257b-openshift-service-ca\") pod \"maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx\" (UID: \"66b76b53-9200-48a7-a856-13a6e76c257b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx"
Jul 22 03:06:03.309469 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:03.309433    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8tvn\" (UniqueName: \"kubernetes.io/projected/66b76b53-9200-48a7-a856-13a6e76c257b-kube-api-access-t8tvn\") pod \"maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx\" (UID: \"66b76b53-9200-48a7-a856-13a6e76c257b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx"
Jul 22 03:06:03.795825 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:03.795787    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66b76b53-9200-48a7-a856-13a6e76c257b-maas-api-tls\") pod \"maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx\" (UID: \"66b76b53-9200-48a7-a856-13a6e76c257b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx"
Jul 22 03:06:03.798501 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:03.798466    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66b76b53-9200-48a7-a856-13a6e76c257b-maas-api-tls\") pod \"maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx\" (UID: \"66b76b53-9200-48a7-a856-13a6e76c257b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx"
Jul 22 03:06:03.876408 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:03.876375    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:06:04.048434 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:04.048340    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx"
Jul 22 03:06:04.145013 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:04.144985    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:06:04.201047 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:04.201011    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx"]
Jul 22 03:06:04.205151 ip-10-0-143-160 kubenswrapper[2577]: W0722 03:06:04.205122    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66b76b53_9200_48a7_a856_13a6e76c257b.slice/crio-9f01c8533a8397df64249207c1967c0955445cdb911ec5f46ddec484beff52e4 WatchSource:0}: Error finding container 9f01c8533a8397df64249207c1967c0955445cdb911ec5f46ddec484beff52e4: Status 404 returned error can't find the container with id 9f01c8533a8397df64249207c1967c0955445cdb911ec5f46ddec484beff52e4
Jul 22 03:06:04.259571 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:04.259534    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:06:04.374660 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:04.374572    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx" event={"ID":"66b76b53-9200-48a7-a856-13a6e76c257b","Type":"ContainerStarted","Data":"9f01c8533a8397df64249207c1967c0955445cdb911ec5f46ddec484beff52e4"}
Jul 22 03:06:05.381193 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:05.381151    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx" event={"ID":"66b76b53-9200-48a7-a856-13a6e76c257b","Type":"ContainerStarted","Data":"3ff3c30637007b787b7d78d09741c6ecdf7e5c70a15bdd6a443e85ad8d7c43bc"}
Jul 22 03:06:05.381647 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:05.381275    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx"
Jul 22 03:06:05.411479 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:05.411421    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx" podStartSLOduration=2.00743923 podStartE2EDuration="2.411402695s" totalImagesPullingTime="403.963465ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:06:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:06:05.41136573 +0000 UTC m=+1726.119794330" watchObservedRunningTime="2026-07-22 03:06:05.411402695 +0000 UTC m=+1726.119831294"
Jul 22 03:06:11.392005 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:11.391975    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx"
Jul 22 03:06:38.538152 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:38.538122    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx"]
Jul 22 03:06:38.538584 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:38.538379    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx" podUID="66b76b53-9200-48a7-a856-13a6e76c257b" containerName="maas-api" containerID="cri-o://3ff3c30637007b787b7d78d09741c6ecdf7e5c70a15bdd6a443e85ad8d7c43bc" gracePeriod=30
Jul 22 03:06:38.566888 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:38.566853    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:06:38.790485 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:38.790414    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx"
Jul 22 03:06:38.908117 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:38.908081    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8tvn\" (UniqueName: \"kubernetes.io/projected/66b76b53-9200-48a7-a856-13a6e76c257b-kube-api-access-t8tvn\") pod \"66b76b53-9200-48a7-a856-13a6e76c257b\" (UID: \"66b76b53-9200-48a7-a856-13a6e76c257b\") "
Jul 22 03:06:38.908354 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:38.908141    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66b76b53-9200-48a7-a856-13a6e76c257b-openshift-service-ca\") pod \"66b76b53-9200-48a7-a856-13a6e76c257b\" (UID: \"66b76b53-9200-48a7-a856-13a6e76c257b\") "
Jul 22 03:06:38.908354 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:38.908186    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66b76b53-9200-48a7-a856-13a6e76c257b-maas-api-tls\") pod \"66b76b53-9200-48a7-a856-13a6e76c257b\" (UID: \"66b76b53-9200-48a7-a856-13a6e76c257b\") "
Jul 22 03:06:38.908543 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:38.908516    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66b76b53-9200-48a7-a856-13a6e76c257b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "66b76b53-9200-48a7-a856-13a6e76c257b" (UID: "66b76b53-9200-48a7-a856-13a6e76c257b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:06:38.910428 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:38.910401    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66b76b53-9200-48a7-a856-13a6e76c257b-kube-api-access-t8tvn" (OuterVolumeSpecName: "kube-api-access-t8tvn") pod "66b76b53-9200-48a7-a856-13a6e76c257b" (UID: "66b76b53-9200-48a7-a856-13a6e76c257b"). InnerVolumeSpecName "kube-api-access-t8tvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:06:38.910523 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:38.910490    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66b76b53-9200-48a7-a856-13a6e76c257b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "66b76b53-9200-48a7-a856-13a6e76c257b" (UID: "66b76b53-9200-48a7-a856-13a6e76c257b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:06:39.009024 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:39.008975    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8tvn\" (UniqueName: \"kubernetes.io/projected/66b76b53-9200-48a7-a856-13a6e76c257b-kube-api-access-t8tvn\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:06:39.009024 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:39.009014    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66b76b53-9200-48a7-a856-13a6e76c257b-openshift-service-ca\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:06:39.009024 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:39.009029    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66b76b53-9200-48a7-a856-13a6e76c257b-maas-api-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:06:39.537815 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:39.537773    2577 generic.go:356] "Generic (PLEG): container finished" podID="66b76b53-9200-48a7-a856-13a6e76c257b" containerID="3ff3c30637007b787b7d78d09741c6ecdf7e5c70a15bdd6a443e85ad8d7c43bc" exitCode=0
Jul 22 03:06:39.538023 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:39.537823    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx"
Jul 22 03:06:39.538023 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:39.537861    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx" event={"ID":"66b76b53-9200-48a7-a856-13a6e76c257b","Type":"ContainerDied","Data":"3ff3c30637007b787b7d78d09741c6ecdf7e5c70a15bdd6a443e85ad8d7c43bc"}
Jul 22 03:06:39.538023 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:39.537916    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx" event={"ID":"66b76b53-9200-48a7-a856-13a6e76c257b","Type":"ContainerDied","Data":"9f01c8533a8397df64249207c1967c0955445cdb911ec5f46ddec484beff52e4"}
Jul 22 03:06:39.538023 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:39.537940    2577 scope.go:117] "RemoveContainer" containerID="3ff3c30637007b787b7d78d09741c6ecdf7e5c70a15bdd6a443e85ad8d7c43bc"
Jul 22 03:06:39.547460 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:39.547443    2577 scope.go:117] "RemoveContainer" containerID="3ff3c30637007b787b7d78d09741c6ecdf7e5c70a15bdd6a443e85ad8d7c43bc"
Jul 22 03:06:39.547755 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:06:39.547735    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ff3c30637007b787b7d78d09741c6ecdf7e5c70a15bdd6a443e85ad8d7c43bc\": container with ID starting with 3ff3c30637007b787b7d78d09741c6ecdf7e5c70a15bdd6a443e85ad8d7c43bc not found: ID does not exist" containerID="3ff3c30637007b787b7d78d09741c6ecdf7e5c70a15bdd6a443e85ad8d7c43bc"
Jul 22 03:06:39.547801 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:39.547765    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ff3c30637007b787b7d78d09741c6ecdf7e5c70a15bdd6a443e85ad8d7c43bc"} err="failed to get container status \"3ff3c30637007b787b7d78d09741c6ecdf7e5c70a15bdd6a443e85ad8d7c43bc\": rpc error: code = NotFound desc = could not find container \"3ff3c30637007b787b7d78d09741c6ecdf7e5c70a15bdd6a443e85ad8d7c43bc\": container with ID starting with 3ff3c30637007b787b7d78d09741c6ecdf7e5c70a15bdd6a443e85ad8d7c43bc not found: ID does not exist"
Jul 22 03:06:39.563900 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:39.563874    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx"]
Jul 22 03:06:39.567625 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:39.567600    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7c53861a-7f8f58b6f6-zk7hx"]
Jul 22 03:06:39.757469 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:39.757432    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66b76b53-9200-48a7-a856-13a6e76c257b" path="/var/lib/kubelet/pods/66b76b53-9200-48a7-a856-13a6e76c257b/volumes"
Jul 22 03:06:43.115868 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:43.115833    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:06:43.397441 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:43.397286    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:06:43.605750 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:43.605712    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:06:43.948620 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:43.948586    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:06:44.307648 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:44.307617    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:06:44.560870 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:44.560784    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:06:47.292959 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:47.292923    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:06:47.460555 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:47.460523    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29"]
Jul 22 03:06:47.460889 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:47.460876    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66b76b53-9200-48a7-a856-13a6e76c257b" containerName="maas-api"
Jul 22 03:06:47.460936 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:47.460891    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="66b76b53-9200-48a7-a856-13a6e76c257b" containerName="maas-api"
Jul 22 03:06:47.460971 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:47.460958    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="66b76b53-9200-48a7-a856-13a6e76c257b" containerName="maas-api"
Jul 22 03:06:47.465366 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:47.465342    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29"
Jul 22 03:06:47.468719 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:47.468692    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-b3e829f9-serving-cert\""
Jul 22 03:06:47.468884 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:47.468749    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-f8xd9\""
Jul 22 03:06:47.471358 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:47.471328    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc2lz\" (UniqueName: \"kubernetes.io/projected/c89a56e5-40d6-45ed-a809-cec2ff01c7ca-kube-api-access-gc2lz\") pod \"maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29\" (UID: \"c89a56e5-40d6-45ed-a809-cec2ff01c7ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29"
Jul 22 03:06:47.471508 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:47.471403    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c89a56e5-40d6-45ed-a809-cec2ff01c7ca-openshift-service-ca\") pod \"maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29\" (UID: \"c89a56e5-40d6-45ed-a809-cec2ff01c7ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29"
Jul 22 03:06:47.471508 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:47.471454    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c89a56e5-40d6-45ed-a809-cec2ff01c7ca-maas-api-tls\") pod \"maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29\" (UID: \"c89a56e5-40d6-45ed-a809-cec2ff01c7ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29"
Jul 22 03:06:47.486919 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:47.486884    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29"]
Jul 22 03:06:47.572044 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:47.571939    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c89a56e5-40d6-45ed-a809-cec2ff01c7ca-openshift-service-ca\") pod \"maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29\" (UID: \"c89a56e5-40d6-45ed-a809-cec2ff01c7ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29"
Jul 22 03:06:47.572044 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:47.572010    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c89a56e5-40d6-45ed-a809-cec2ff01c7ca-maas-api-tls\") pod \"maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29\" (UID: \"c89a56e5-40d6-45ed-a809-cec2ff01c7ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29"
Jul 22 03:06:47.572316 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:47.572108    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc2lz\" (UniqueName: \"kubernetes.io/projected/c89a56e5-40d6-45ed-a809-cec2ff01c7ca-kube-api-access-gc2lz\") pod \"maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29\" (UID: \"c89a56e5-40d6-45ed-a809-cec2ff01c7ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29"
Jul 22 03:06:47.572316 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:06:47.572135    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-serving-cert: secret "maas-api-e2e-ait-b3e829f9-serving-cert" not found
Jul 22 03:06:47.572316 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:06:47.572228    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c89a56e5-40d6-45ed-a809-cec2ff01c7ca-maas-api-tls podName:c89a56e5-40d6-45ed-a809-cec2ff01c7ca nodeName:}" failed. No retries permitted until 2026-07-22 03:06:48.072204491 +0000 UTC m=+1768.780633072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c89a56e5-40d6-45ed-a809-cec2ff01c7ca-maas-api-tls") pod "maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29" (UID: "c89a56e5-40d6-45ed-a809-cec2ff01c7ca") : secret "maas-api-e2e-ait-b3e829f9-serving-cert" not found
Jul 22 03:06:47.572729 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:47.572711    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c89a56e5-40d6-45ed-a809-cec2ff01c7ca-openshift-service-ca\") pod \"maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29\" (UID: \"c89a56e5-40d6-45ed-a809-cec2ff01c7ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29"
Jul 22 03:06:47.592049 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:47.592016    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc2lz\" (UniqueName: \"kubernetes.io/projected/c89a56e5-40d6-45ed-a809-cec2ff01c7ca-kube-api-access-gc2lz\") pod \"maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29\" (UID: \"c89a56e5-40d6-45ed-a809-cec2ff01c7ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29"
Jul 22 03:06:47.633573 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:47.633538    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:06:47.843366 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:47.843275    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:06:48.076071 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:48.076033    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c89a56e5-40d6-45ed-a809-cec2ff01c7ca-maas-api-tls\") pod \"maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29\" (UID: \"c89a56e5-40d6-45ed-a809-cec2ff01c7ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29"
Jul 22 03:06:48.078902 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:48.078877    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c89a56e5-40d6-45ed-a809-cec2ff01c7ca-maas-api-tls\") pod \"maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29\" (UID: \"c89a56e5-40d6-45ed-a809-cec2ff01c7ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29"
Jul 22 03:06:48.375920 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:48.375882    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29"
Jul 22 03:06:48.402589 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:48.402559    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:06:48.534983 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:48.534951    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29"]
Jul 22 03:06:48.538857 ip-10-0-143-160 kubenswrapper[2577]: W0722 03:06:48.538812    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc89a56e5_40d6_45ed_a809_cec2ff01c7ca.slice/crio-b779b74a3f014fd6845006011a89a9d69648711bfc731d1b07787d1269e7933d WatchSource:0}: Error finding container b779b74a3f014fd6845006011a89a9d69648711bfc731d1b07787d1269e7933d: Status 404 returned error can't find the container with id b779b74a3f014fd6845006011a89a9d69648711bfc731d1b07787d1269e7933d
Jul 22 03:06:48.579910 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:48.579877    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29" event={"ID":"c89a56e5-40d6-45ed-a809-cec2ff01c7ca","Type":"ContainerStarted","Data":"b779b74a3f014fd6845006011a89a9d69648711bfc731d1b07787d1269e7933d"}
Jul 22 03:06:48.723755 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:48.723667    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:06:49.585930 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:49.585885    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29" event={"ID":"c89a56e5-40d6-45ed-a809-cec2ff01c7ca","Type":"ContainerStarted","Data":"00a5a07415b22980899366a958cda4d868f230e62ae22420ef0383bd828fc4ec"}
Jul 22 03:06:49.586349 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:49.585971    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29"
Jul 22 03:06:49.613810 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:49.613750    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29" podStartSLOduration=2.23403861 podStartE2EDuration="2.613733424s" totalImagesPullingTime="379.694814ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:06:49.613034641 +0000 UTC m=+1770.321463242" watchObservedRunningTime="2026-07-22 03:06:49.613733424 +0000 UTC m=+1770.322162024"
Jul 22 03:06:55.596801 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:06:55.596773    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29"
Jul 22 03:07:19.733602 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:19.733575    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqngf_6461ea33-ff4c-48c5-8c29-b4026c2f67b0/ovn-acl-logging/0.log"
Jul 22 03:07:19.737735 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:19.737716    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqngf_6461ea33-ff4c-48c5-8c29-b4026c2f67b0/ovn-acl-logging/0.log"
Jul 22 03:07:23.383161 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:23.383128    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29"]
Jul 22 03:07:23.383570 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:23.383400    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29" podUID="c89a56e5-40d6-45ed-a809-cec2ff01c7ca" containerName="maas-api" containerID="cri-o://00a5a07415b22980899366a958cda4d868f230e62ae22420ef0383bd828fc4ec" gracePeriod=30
Jul 22 03:07:23.415236 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:23.415192    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:23.635383 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:23.635312    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29"
Jul 22 03:07:23.744932 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:23.744897    2577 generic.go:356] "Generic (PLEG): container finished" podID="c89a56e5-40d6-45ed-a809-cec2ff01c7ca" containerID="00a5a07415b22980899366a958cda4d868f230e62ae22420ef0383bd828fc4ec" exitCode=0
Jul 22 03:07:23.745119 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:23.744947    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29"
Jul 22 03:07:23.745119 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:23.744980    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29" event={"ID":"c89a56e5-40d6-45ed-a809-cec2ff01c7ca","Type":"ContainerDied","Data":"00a5a07415b22980899366a958cda4d868f230e62ae22420ef0383bd828fc4ec"}
Jul 22 03:07:23.745119 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:23.745033    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29" event={"ID":"c89a56e5-40d6-45ed-a809-cec2ff01c7ca","Type":"ContainerDied","Data":"b779b74a3f014fd6845006011a89a9d69648711bfc731d1b07787d1269e7933d"}
Jul 22 03:07:23.745119 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:23.745055    2577 scope.go:117] "RemoveContainer" containerID="00a5a07415b22980899366a958cda4d868f230e62ae22420ef0383bd828fc4ec"
Jul 22 03:07:23.754797 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:23.754780    2577 scope.go:117] "RemoveContainer" containerID="00a5a07415b22980899366a958cda4d868f230e62ae22420ef0383bd828fc4ec"
Jul 22 03:07:23.755089 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:07:23.755070    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00a5a07415b22980899366a958cda4d868f230e62ae22420ef0383bd828fc4ec\": container with ID starting with 00a5a07415b22980899366a958cda4d868f230e62ae22420ef0383bd828fc4ec not found: ID does not exist" containerID="00a5a07415b22980899366a958cda4d868f230e62ae22420ef0383bd828fc4ec"
Jul 22 03:07:23.755146 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:23.755104    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00a5a07415b22980899366a958cda4d868f230e62ae22420ef0383bd828fc4ec"} err="failed to get container status \"00a5a07415b22980899366a958cda4d868f230e62ae22420ef0383bd828fc4ec\": rpc error: code = NotFound desc = could not find container \"00a5a07415b22980899366a958cda4d868f230e62ae22420ef0383bd828fc4ec\": container with ID starting with 00a5a07415b22980899366a958cda4d868f230e62ae22420ef0383bd828fc4ec not found: ID does not exist"
Jul 22 03:07:23.798566 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:23.798528    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gc2lz\" (UniqueName: \"kubernetes.io/projected/c89a56e5-40d6-45ed-a809-cec2ff01c7ca-kube-api-access-gc2lz\") pod \"c89a56e5-40d6-45ed-a809-cec2ff01c7ca\" (UID: \"c89a56e5-40d6-45ed-a809-cec2ff01c7ca\") "
Jul 22 03:07:23.798726 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:23.798619    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c89a56e5-40d6-45ed-a809-cec2ff01c7ca-openshift-service-ca\") pod \"c89a56e5-40d6-45ed-a809-cec2ff01c7ca\" (UID: \"c89a56e5-40d6-45ed-a809-cec2ff01c7ca\") "
Jul 22 03:07:23.798773 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:23.798745    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c89a56e5-40d6-45ed-a809-cec2ff01c7ca-maas-api-tls\") pod \"c89a56e5-40d6-45ed-a809-cec2ff01c7ca\" (UID: \"c89a56e5-40d6-45ed-a809-cec2ff01c7ca\") "
Jul 22 03:07:23.798910 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:23.798892    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c89a56e5-40d6-45ed-a809-cec2ff01c7ca-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c89a56e5-40d6-45ed-a809-cec2ff01c7ca" (UID: "c89a56e5-40d6-45ed-a809-cec2ff01c7ca"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:07:23.799027 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:23.799012    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c89a56e5-40d6-45ed-a809-cec2ff01c7ca-openshift-service-ca\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:07:23.800810 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:23.800785    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c89a56e5-40d6-45ed-a809-cec2ff01c7ca-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c89a56e5-40d6-45ed-a809-cec2ff01c7ca" (UID: "c89a56e5-40d6-45ed-a809-cec2ff01c7ca"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:07:23.800905 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:23.800860    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c89a56e5-40d6-45ed-a809-cec2ff01c7ca-kube-api-access-gc2lz" (OuterVolumeSpecName: "kube-api-access-gc2lz") pod "c89a56e5-40d6-45ed-a809-cec2ff01c7ca" (UID: "c89a56e5-40d6-45ed-a809-cec2ff01c7ca"). InnerVolumeSpecName "kube-api-access-gc2lz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:07:23.900237 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:23.900151    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c89a56e5-40d6-45ed-a809-cec2ff01c7ca-maas-api-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:07:23.900237 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:23.900181    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gc2lz\" (UniqueName: \"kubernetes.io/projected/c89a56e5-40d6-45ed-a809-cec2ff01c7ca-kube-api-access-gc2lz\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:07:24.069168 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:24.069131    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29"]
Jul 22 03:07:24.073193 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:24.073168    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b3e829f9-847c9c85f7-dtz29"]
Jul 22 03:07:25.757144 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:25.757109    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c89a56e5-40d6-45ed-a809-cec2ff01c7ca" path="/var/lib/kubelet/pods/c89a56e5-40d6-45ed-a809-cec2ff01c7ca/volumes"
Jul 22 03:07:28.786024 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:28.785986    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:29.237893 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:29.237791    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:29.470019 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:29.469979    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:29.680641 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:29.680601    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:29.985655 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:29.985573    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:30.229980 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:30.229948    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:32.303747 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:32.303672    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:32.426887 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:32.426855    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:32.502814 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:32.502776    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b"]
Jul 22 03:07:32.503137 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:32.503124    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c89a56e5-40d6-45ed-a809-cec2ff01c7ca" containerName="maas-api"
Jul 22 03:07:32.503182 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:32.503139    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c89a56e5-40d6-45ed-a809-cec2ff01c7ca" containerName="maas-api"
Jul 22 03:07:32.503216 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:32.503198    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c89a56e5-40d6-45ed-a809-cec2ff01c7ca" containerName="maas-api"
Jul 22 03:07:32.507599 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:32.507579    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b"
Jul 22 03:07:32.511356 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:32.511326    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-f3673a9a-serving-cert\""
Jul 22 03:07:32.511501 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:32.511449    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-f8xd9\""
Jul 22 03:07:32.524374 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:32.524345    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b"]
Jul 22 03:07:32.576498 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:32.576417    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:32.667336 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:32.667300    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:32.680524 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:32.680496    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70526b4a-271c-43e2-a28b-0f6f4747336c-openshift-service-ca\") pod \"maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b\" (UID: \"70526b4a-271c-43e2-a28b-0f6f4747336c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b"
Jul 22 03:07:32.680624 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:32.680539    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70526b4a-271c-43e2-a28b-0f6f4747336c-maas-api-tls\") pod \"maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b\" (UID: \"70526b4a-271c-43e2-a28b-0f6f4747336c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b"
Jul 22 03:07:32.680624 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:32.680587    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzpvr\" (UniqueName: \"kubernetes.io/projected/70526b4a-271c-43e2-a28b-0f6f4747336c-kube-api-access-nzpvr\") pod \"maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b\" (UID: \"70526b4a-271c-43e2-a28b-0f6f4747336c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b"
Jul 22 03:07:32.781846 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:32.781809    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzpvr\" (UniqueName: \"kubernetes.io/projected/70526b4a-271c-43e2-a28b-0f6f4747336c-kube-api-access-nzpvr\") pod \"maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b\" (UID: \"70526b4a-271c-43e2-a28b-0f6f4747336c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b"
Jul 22 03:07:32.782042 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:32.781882    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70526b4a-271c-43e2-a28b-0f6f4747336c-openshift-service-ca\") pod \"maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b\" (UID: \"70526b4a-271c-43e2-a28b-0f6f4747336c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b"
Jul 22 03:07:32.782042 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:32.781916    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70526b4a-271c-43e2-a28b-0f6f4747336c-maas-api-tls\") pod \"maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b\" (UID: \"70526b4a-271c-43e2-a28b-0f6f4747336c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b"
Jul 22 03:07:32.782575 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:32.782554    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70526b4a-271c-43e2-a28b-0f6f4747336c-openshift-service-ca\") pod \"maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b\" (UID: \"70526b4a-271c-43e2-a28b-0f6f4747336c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b"
Jul 22 03:07:32.784597 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:32.784576    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70526b4a-271c-43e2-a28b-0f6f4747336c-maas-api-tls\") pod \"maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b\" (UID: \"70526b4a-271c-43e2-a28b-0f6f4747336c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b"
Jul 22 03:07:32.790856 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:32.790829    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzpvr\" (UniqueName: \"kubernetes.io/projected/70526b4a-271c-43e2-a28b-0f6f4747336c-kube-api-access-nzpvr\") pod \"maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b\" (UID: \"70526b4a-271c-43e2-a28b-0f6f4747336c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b"
Jul 22 03:07:32.817630 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:32.817582    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b"
Jul 22 03:07:32.966644 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:32.966609    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b"]
Jul 22 03:07:32.969918 ip-10-0-143-160 kubenswrapper[2577]: W0722 03:07:32.969888    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70526b4a_271c_43e2_a28b_0f6f4747336c.slice/crio-0045f308b884fc3852e988ebda3e6ffe6b8b9f65ed6a9005b70549ca50a20195 WatchSource:0}: Error finding container 0045f308b884fc3852e988ebda3e6ffe6b8b9f65ed6a9005b70549ca50a20195: Status 404 returned error can't find the container with id 0045f308b884fc3852e988ebda3e6ffe6b8b9f65ed6a9005b70549ca50a20195
Jul 22 03:07:33.109890 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:33.109792    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:33.206793 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:33.206748    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:33.794803 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:33.794771    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b" event={"ID":"70526b4a-271c-43e2-a28b-0f6f4747336c","Type":"ContainerStarted","Data":"77dd83cfb407f1555f1b985e8ea5e1b6e488300aca71b10c858018319d5b3d65"}
Jul 22 03:07:33.795304 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:33.794828    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b" event={"ID":"70526b4a-271c-43e2-a28b-0f6f4747336c","Type":"ContainerStarted","Data":"0045f308b884fc3852e988ebda3e6ffe6b8b9f65ed6a9005b70549ca50a20195"}
Jul 22 03:07:33.795304 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:33.794888    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b"
Jul 22 03:07:33.816706 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:33.816644    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b" podStartSLOduration=1.374766749 podStartE2EDuration="1.816624097s" totalImagesPullingTime="441.857348ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:07:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:07:33.815818593 +0000 UTC m=+1814.524247193" watchObservedRunningTime="2026-07-22 03:07:33.816624097 +0000 UTC m=+1814.525052698"
Jul 22 03:07:39.805679 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:39.805649    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b"
Jul 22 03:07:46.148307 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:46.148263    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:46.855042 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:46.855006    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:52.927563 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:52.927530    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:54.740340 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:54.740298    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:54.839602 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:07:54.839564    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:08:07.597942 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:07.597895    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b"]
Jul 22 03:08:07.598423 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:07.598177    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b" podUID="70526b4a-271c-43e2-a28b-0f6f4747336c" containerName="maas-api" containerID="cri-o://77dd83cfb407f1555f1b985e8ea5e1b6e488300aca71b10c858018319d5b3d65" gracePeriod=30
Jul 22 03:08:07.628166 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:07.628126    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:08:07.842874 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:07.842849    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b"
Jul 22 03:08:07.954493 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:07.954390    2577 generic.go:356] "Generic (PLEG): container finished" podID="70526b4a-271c-43e2-a28b-0f6f4747336c" containerID="77dd83cfb407f1555f1b985e8ea5e1b6e488300aca71b10c858018319d5b3d65" exitCode=0
Jul 22 03:08:07.954493 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:07.954430    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b" event={"ID":"70526b4a-271c-43e2-a28b-0f6f4747336c","Type":"ContainerDied","Data":"77dd83cfb407f1555f1b985e8ea5e1b6e488300aca71b10c858018319d5b3d65"}
Jul 22 03:08:07.954493 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:07.954437    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b"
Jul 22 03:08:07.954493 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:07.954479    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b" event={"ID":"70526b4a-271c-43e2-a28b-0f6f4747336c","Type":"ContainerDied","Data":"0045f308b884fc3852e988ebda3e6ffe6b8b9f65ed6a9005b70549ca50a20195"}
Jul 22 03:08:07.954790 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:07.954503    2577 scope.go:117] "RemoveContainer" containerID="77dd83cfb407f1555f1b985e8ea5e1b6e488300aca71b10c858018319d5b3d65"
Jul 22 03:08:07.963093 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:07.963073    2577 scope.go:117] "RemoveContainer" containerID="77dd83cfb407f1555f1b985e8ea5e1b6e488300aca71b10c858018319d5b3d65"
Jul 22 03:08:07.963345 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:08:07.963318    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77dd83cfb407f1555f1b985e8ea5e1b6e488300aca71b10c858018319d5b3d65\": container with ID starting with 77dd83cfb407f1555f1b985e8ea5e1b6e488300aca71b10c858018319d5b3d65 not found: ID does not exist" containerID="77dd83cfb407f1555f1b985e8ea5e1b6e488300aca71b10c858018319d5b3d65"
Jul 22 03:08:07.963394 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:07.963363    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77dd83cfb407f1555f1b985e8ea5e1b6e488300aca71b10c858018319d5b3d65"} err="failed to get container status \"77dd83cfb407f1555f1b985e8ea5e1b6e488300aca71b10c858018319d5b3d65\": rpc error: code = NotFound desc = could not find container \"77dd83cfb407f1555f1b985e8ea5e1b6e488300aca71b10c858018319d5b3d65\": container with ID starting with 77dd83cfb407f1555f1b985e8ea5e1b6e488300aca71b10c858018319d5b3d65 not found: ID does not exist"
Jul 22 03:08:07.998469 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:07.998436    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70526b4a-271c-43e2-a28b-0f6f4747336c-openshift-service-ca\") pod \"70526b4a-271c-43e2-a28b-0f6f4747336c\" (UID: \"70526b4a-271c-43e2-a28b-0f6f4747336c\") "
Jul 22 03:08:07.998469 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:07.998470    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70526b4a-271c-43e2-a28b-0f6f4747336c-maas-api-tls\") pod \"70526b4a-271c-43e2-a28b-0f6f4747336c\" (UID: \"70526b4a-271c-43e2-a28b-0f6f4747336c\") "
Jul 22 03:08:07.998703 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:07.998502    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzpvr\" (UniqueName: \"kubernetes.io/projected/70526b4a-271c-43e2-a28b-0f6f4747336c-kube-api-access-nzpvr\") pod \"70526b4a-271c-43e2-a28b-0f6f4747336c\" (UID: \"70526b4a-271c-43e2-a28b-0f6f4747336c\") "
Jul 22 03:08:07.998848 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:07.998823    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70526b4a-271c-43e2-a28b-0f6f4747336c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "70526b4a-271c-43e2-a28b-0f6f4747336c" (UID: "70526b4a-271c-43e2-a28b-0f6f4747336c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:08:08.000816 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:08.000789    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70526b4a-271c-43e2-a28b-0f6f4747336c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "70526b4a-271c-43e2-a28b-0f6f4747336c" (UID: "70526b4a-271c-43e2-a28b-0f6f4747336c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:08:08.000988 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:08.000972    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70526b4a-271c-43e2-a28b-0f6f4747336c-kube-api-access-nzpvr" (OuterVolumeSpecName: "kube-api-access-nzpvr") pod "70526b4a-271c-43e2-a28b-0f6f4747336c" (UID: "70526b4a-271c-43e2-a28b-0f6f4747336c"). InnerVolumeSpecName "kube-api-access-nzpvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:08:08.099533 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:08.099481    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70526b4a-271c-43e2-a28b-0f6f4747336c-openshift-service-ca\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:08:08.099533 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:08.099529    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70526b4a-271c-43e2-a28b-0f6f4747336c-maas-api-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:08:08.099533 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:08.099541    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzpvr\" (UniqueName: \"kubernetes.io/projected/70526b4a-271c-43e2-a28b-0f6f4747336c-kube-api-access-nzpvr\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:08:08.278660 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:08.278628    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b"]
Jul 22 03:08:08.285339 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:08.285311    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f3673a9a-857bfd7494-7tg5b"]
Jul 22 03:08:09.757089 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:09.757050    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70526b4a-271c-43e2-a28b-0f6f4747336c" path="/var/lib/kubelet/pods/70526b4a-271c-43e2-a28b-0f6f4747336c/volumes"
Jul 22 03:08:12.232480 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:12.232444    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:08:12.461804 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:12.461776    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:08:12.629060 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:12.629019    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:08:13.140321 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:13.140286    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:08:13.284650 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:13.284620    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:08:13.419666 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:13.419577    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:08:14.744112 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:14.744078    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:08:21.653492 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:21.653452    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:08:21.764222 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:21.764182    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:08:21.870850 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:21.870816    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:08:21.963802 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:21.963715    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:08:22.374926 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:22.374891    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:08:48.338357 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:48.338271    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:08:54.855554 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:54.855516    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:08:54.965961 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:54.965913    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:08:55.060277 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:08:55.060223    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:10.954919 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:10.954884    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:17.487528 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:17.487485    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:17.555485 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:17.555453    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:17.643500 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:17.643468    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:17.740940 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:17.740915    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:28.226311 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:28.226277    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:29.003509 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:29.003475    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:36.509722 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:36.509680    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:36.633720 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:36.633685    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:36.726587 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:36.726555    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:36.825570 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:36.825481    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:37.627657 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:37.627620    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:37.723009 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:37.722945    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:37.823779 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:37.823750    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:39.387547 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:39.387512    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:45.605980 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:45.605942    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:45.672832 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:45.672747    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:46.275925 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:46.275881    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:53.146222 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:53.146176    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:54.651213 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:54.651178    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:56.728547 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:56.728510    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:56.817063 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:56.817021    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:56.818215 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:56.818190    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5"]
Jul 22 03:09:56.818571 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:56.818559    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70526b4a-271c-43e2-a28b-0f6f4747336c" containerName="maas-api"
Jul 22 03:09:56.818615 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:56.818574    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="70526b4a-271c-43e2-a28b-0f6f4747336c" containerName="maas-api"
Jul 22 03:09:56.818651 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:56.818629    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="70526b4a-271c-43e2-a28b-0f6f4747336c" containerName="maas-api"
Jul 22 03:09:56.821478 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:56.821463    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5"
Jul 22 03:09:56.824499 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:56.824475    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-30037ff3-serving-cert\""
Jul 22 03:09:56.824654 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:56.824533    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-f8xd9\""
Jul 22 03:09:56.834450 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:56.834427    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5"]
Jul 22 03:09:56.884843 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:56.884812    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:56.905957 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:56.905920    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp56t\" (UniqueName: \"kubernetes.io/projected/87539a56-de22-4b69-98d0-9669af280818-kube-api-access-bp56t\") pod \"maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5\" (UID: \"87539a56-de22-4b69-98d0-9669af280818\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5"
Jul 22 03:09:56.906139 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:56.906032    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87539a56-de22-4b69-98d0-9669af280818-maas-api-tls\") pod \"maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5\" (UID: \"87539a56-de22-4b69-98d0-9669af280818\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5"
Jul 22 03:09:56.906139 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:56.906058    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87539a56-de22-4b69-98d0-9669af280818-openshift-service-ca\") pod \"maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5\" (UID: \"87539a56-de22-4b69-98d0-9669af280818\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5"
Jul 22 03:09:57.007098 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:57.007057    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87539a56-de22-4b69-98d0-9669af280818-maas-api-tls\") pod \"maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5\" (UID: \"87539a56-de22-4b69-98d0-9669af280818\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5"
Jul 22 03:09:57.007098 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:57.007092    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87539a56-de22-4b69-98d0-9669af280818-openshift-service-ca\") pod \"maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5\" (UID: \"87539a56-de22-4b69-98d0-9669af280818\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5"
Jul 22 03:09:57.007343 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:57.007153    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp56t\" (UniqueName: \"kubernetes.io/projected/87539a56-de22-4b69-98d0-9669af280818-kube-api-access-bp56t\") pod \"maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5\" (UID: \"87539a56-de22-4b69-98d0-9669af280818\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5"
Jul 22 03:09:57.007343 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:09:57.007209    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-serving-cert: secret "maas-api-e2e-mt-30037ff3-serving-cert" not found
Jul 22 03:09:57.007343 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:09:57.007300    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87539a56-de22-4b69-98d0-9669af280818-maas-api-tls podName:87539a56-de22-4b69-98d0-9669af280818 nodeName:}" failed. No retries permitted until 2026-07-22 03:09:57.507283339 +0000 UTC m=+1958.215711917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/87539a56-de22-4b69-98d0-9669af280818-maas-api-tls") pod "maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5" (UID: "87539a56-de22-4b69-98d0-9669af280818") : secret "maas-api-e2e-mt-30037ff3-serving-cert" not found
Jul 22 03:09:57.007846 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:57.007828    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87539a56-de22-4b69-98d0-9669af280818-openshift-service-ca\") pod \"maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5\" (UID: \"87539a56-de22-4b69-98d0-9669af280818\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5"
Jul 22 03:09:57.018753 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:57.018722    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp56t\" (UniqueName: \"kubernetes.io/projected/87539a56-de22-4b69-98d0-9669af280818-kube-api-access-bp56t\") pod \"maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5\" (UID: \"87539a56-de22-4b69-98d0-9669af280818\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5"
Jul 22 03:09:57.344647 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:57.344520    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:57.490970 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:57.490926    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:57.512455 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:57.512427    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87539a56-de22-4b69-98d0-9669af280818-maas-api-tls\") pod \"maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5\" (UID: \"87539a56-de22-4b69-98d0-9669af280818\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5"
Jul 22 03:09:57.515194 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:57.515164    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87539a56-de22-4b69-98d0-9669af280818-maas-api-tls\") pod \"maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5\" (UID: \"87539a56-de22-4b69-98d0-9669af280818\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5"
Jul 22 03:09:57.590942 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:57.590913    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:09:57.733155 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:57.733061    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5"
Jul 22 03:09:57.878457 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:57.878388    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5"]
Jul 22 03:09:57.880825 ip-10-0-143-160 kubenswrapper[2577]: W0722 03:09:57.880792    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87539a56_de22_4b69_98d0_9669af280818.slice/crio-864a08f2681d2121c28cd918fdc8f44a861011c11f8214759e3d93d215cc2135 WatchSource:0}: Error finding container 864a08f2681d2121c28cd918fdc8f44a861011c11f8214759e3d93d215cc2135: Status 404 returned error can't find the container with id 864a08f2681d2121c28cd918fdc8f44a861011c11f8214759e3d93d215cc2135
Jul 22 03:09:58.461889 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:58.461848    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5" event={"ID":"87539a56-de22-4b69-98d0-9669af280818","Type":"ContainerStarted","Data":"8470082da62d5de4af8dce3edb716ff2de021f86fd889f688a938790a57a1137"}
Jul 22 03:09:58.462052 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:58.461916    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5" event={"ID":"87539a56-de22-4b69-98d0-9669af280818","Type":"ContainerStarted","Data":"864a08f2681d2121c28cd918fdc8f44a861011c11f8214759e3d93d215cc2135"}
Jul 22 03:09:58.462052 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:58.461946    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5"
Jul 22 03:09:58.482880 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:09:58.482821    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5" podStartSLOduration=2.0850785 podStartE2EDuration="2.482803964s" totalImagesPullingTime="397.725464ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:09:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:09:58.480806681 +0000 UTC m=+1959.189235282" watchObservedRunningTime="2026-07-22 03:09:58.482803964 +0000 UTC m=+1959.191232563"
Jul 22 03:10:01.143641 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:01.143599    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:01.688888 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:01.688850    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:01.803412 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:01.803377    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:01.893202 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:01.893170    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:02.267432 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:02.267397    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:04.472152 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:04.472124    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5"
Jul 22 03:10:08.278670 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:08.278637    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:08.506862 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:08.506826    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:19.042218 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:19.042129    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5"]
Jul 22 03:10:19.043110 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:19.043072    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5" podUID="87539a56-de22-4b69-98d0-9669af280818" containerName="maas-api" containerID="cri-o://8470082da62d5de4af8dce3edb716ff2de021f86fd889f688a938790a57a1137" gracePeriod=30
Jul 22 03:10:19.065485 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:19.065447    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:19.299491 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:19.299418    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5"
Jul 22 03:10:19.424396 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:19.424357    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bp56t\" (UniqueName: \"kubernetes.io/projected/87539a56-de22-4b69-98d0-9669af280818-kube-api-access-bp56t\") pod \"87539a56-de22-4b69-98d0-9669af280818\" (UID: \"87539a56-de22-4b69-98d0-9669af280818\") "
Jul 22 03:10:19.424589 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:19.424417    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87539a56-de22-4b69-98d0-9669af280818-maas-api-tls\") pod \"87539a56-de22-4b69-98d0-9669af280818\" (UID: \"87539a56-de22-4b69-98d0-9669af280818\") "
Jul 22 03:10:19.424635 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:19.424582    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87539a56-de22-4b69-98d0-9669af280818-openshift-service-ca\") pod \"87539a56-de22-4b69-98d0-9669af280818\" (UID: \"87539a56-de22-4b69-98d0-9669af280818\") "
Jul 22 03:10:19.424934 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:19.424899    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87539a56-de22-4b69-98d0-9669af280818-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "87539a56-de22-4b69-98d0-9669af280818" (UID: "87539a56-de22-4b69-98d0-9669af280818"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:10:19.426663 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:19.426641    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87539a56-de22-4b69-98d0-9669af280818-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "87539a56-de22-4b69-98d0-9669af280818" (UID: "87539a56-de22-4b69-98d0-9669af280818"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:10:19.426753 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:19.426720    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87539a56-de22-4b69-98d0-9669af280818-kube-api-access-bp56t" (OuterVolumeSpecName: "kube-api-access-bp56t") pod "87539a56-de22-4b69-98d0-9669af280818" (UID: "87539a56-de22-4b69-98d0-9669af280818"). InnerVolumeSpecName "kube-api-access-bp56t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:10:19.525419 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:19.525375    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87539a56-de22-4b69-98d0-9669af280818-openshift-service-ca\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:10:19.525419 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:19.525408    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bp56t\" (UniqueName: \"kubernetes.io/projected/87539a56-de22-4b69-98d0-9669af280818-kube-api-access-bp56t\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:10:19.525419 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:19.525422    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87539a56-de22-4b69-98d0-9669af280818-maas-api-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:10:19.560236 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:19.560140    2577 generic.go:356] "Generic (PLEG): container finished" podID="87539a56-de22-4b69-98d0-9669af280818" containerID="8470082da62d5de4af8dce3edb716ff2de021f86fd889f688a938790a57a1137" exitCode=0
Jul 22 03:10:19.560236 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:19.560188    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5"
Jul 22 03:10:19.560236 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:19.560203    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5" event={"ID":"87539a56-de22-4b69-98d0-9669af280818","Type":"ContainerDied","Data":"8470082da62d5de4af8dce3edb716ff2de021f86fd889f688a938790a57a1137"}
Jul 22 03:10:19.560478 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:19.560273    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5" event={"ID":"87539a56-de22-4b69-98d0-9669af280818","Type":"ContainerDied","Data":"864a08f2681d2121c28cd918fdc8f44a861011c11f8214759e3d93d215cc2135"}
Jul 22 03:10:19.560478 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:19.560283    2577 scope.go:117] "RemoveContainer" containerID="8470082da62d5de4af8dce3edb716ff2de021f86fd889f688a938790a57a1137"
Jul 22 03:10:19.569076 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:19.569059    2577 scope.go:117] "RemoveContainer" containerID="8470082da62d5de4af8dce3edb716ff2de021f86fd889f688a938790a57a1137"
Jul 22 03:10:19.569363 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:10:19.569342    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8470082da62d5de4af8dce3edb716ff2de021f86fd889f688a938790a57a1137\": container with ID starting with 8470082da62d5de4af8dce3edb716ff2de021f86fd889f688a938790a57a1137 not found: ID does not exist" containerID="8470082da62d5de4af8dce3edb716ff2de021f86fd889f688a938790a57a1137"
Jul 22 03:10:19.569448 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:19.569371    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8470082da62d5de4af8dce3edb716ff2de021f86fd889f688a938790a57a1137"} err="failed to get container status \"8470082da62d5de4af8dce3edb716ff2de021f86fd889f688a938790a57a1137\": rpc error: code = NotFound desc = could not find container \"8470082da62d5de4af8dce3edb716ff2de021f86fd889f688a938790a57a1137\": container with ID starting with 8470082da62d5de4af8dce3edb716ff2de021f86fd889f688a938790a57a1137 not found: ID does not exist"
Jul 22 03:10:19.582424 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:19.582396    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5"]
Jul 22 03:10:19.585971 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:19.585947    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-30037ff3-5bff6bb798-hfvh5"]
Jul 22 03:10:19.757488 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:19.757456    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87539a56-de22-4b69-98d0-9669af280818" path="/var/lib/kubelet/pods/87539a56-de22-4b69-98d0-9669af280818/volumes"
Jul 22 03:10:23.710302 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:23.710261    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:24.093932 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:24.093902    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:30.139344 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:30.139309    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:30.238488 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:30.238453    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:30.409001 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:30.408923    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:30.654476 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:30.654445    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:30.824501 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:30.824466    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:30.914942 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:30.914911    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:31.014967 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:31.014934    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:36.992154 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:36.992121    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:37.068286 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:37.068222    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:37.182302 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:37.182273    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:37.377159 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:37.377062    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:43.312785 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:43.312751    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:43.412506 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:43.412472    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:50.119280 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:50.119235    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:50.436475 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:50.436393    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:50.760630 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:50.760601    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:52.934711 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:52.934673    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:53.027419 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:53.027383    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:53.028324 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:53.028303    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x"]
Jul 22 03:10:53.028693 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:53.028681    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87539a56-de22-4b69-98d0-9669af280818" containerName="maas-api"
Jul 22 03:10:53.028732 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:53.028694    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="87539a56-de22-4b69-98d0-9669af280818" containerName="maas-api"
Jul 22 03:10:53.028770 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:53.028754    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="87539a56-de22-4b69-98d0-9669af280818" containerName="maas-api"
Jul 22 03:10:53.031820 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:53.031798    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x"
Jul 22 03:10:53.034749 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:53.034730    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-e1c7132e-serving-cert\""
Jul 22 03:10:53.034969 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:53.034956    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-f8xd9\""
Jul 22 03:10:53.045906 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:53.045881    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x"]
Jul 22 03:10:53.116010 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:53.115971    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hqg9\" (UniqueName: \"kubernetes.io/projected/7a50c866-2b5f-419e-ba14-6e693343a423-kube-api-access-7hqg9\") pod \"maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x\" (UID: \"7a50c866-2b5f-419e-ba14-6e693343a423\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x"
Jul 22 03:10:53.116211 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:53.116069    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a50c866-2b5f-419e-ba14-6e693343a423-openshift-service-ca\") pod \"maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x\" (UID: \"7a50c866-2b5f-419e-ba14-6e693343a423\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x"
Jul 22 03:10:53.116211 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:53.116176    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a50c866-2b5f-419e-ba14-6e693343a423-maas-api-tls\") pod \"maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x\" (UID: \"7a50c866-2b5f-419e-ba14-6e693343a423\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x"
Jul 22 03:10:53.120992 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:53.120967    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:53.217450 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:53.217357    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a50c866-2b5f-419e-ba14-6e693343a423-openshift-service-ca\") pod \"maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x\" (UID: \"7a50c866-2b5f-419e-ba14-6e693343a423\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x"
Jul 22 03:10:53.217450 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:53.217419    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a50c866-2b5f-419e-ba14-6e693343a423-maas-api-tls\") pod \"maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x\" (UID: \"7a50c866-2b5f-419e-ba14-6e693343a423\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x"
Jul 22 03:10:53.217650 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:53.217482    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hqg9\" (UniqueName: \"kubernetes.io/projected/7a50c866-2b5f-419e-ba14-6e693343a423-kube-api-access-7hqg9\") pod \"maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x\" (UID: \"7a50c866-2b5f-419e-ba14-6e693343a423\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x"
Jul 22 03:10:53.217650 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:10:53.217593    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-serving-cert: secret "maas-api-e2e-mt-e1c7132e-serving-cert" not found
Jul 22 03:10:53.217715 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:10:53.217680    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a50c866-2b5f-419e-ba14-6e693343a423-maas-api-tls podName:7a50c866-2b5f-419e-ba14-6e693343a423 nodeName:}" failed. No retries permitted until 2026-07-22 03:10:53.717663253 +0000 UTC m=+2014.426091831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7a50c866-2b5f-419e-ba14-6e693343a423-maas-api-tls") pod "maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x" (UID: "7a50c866-2b5f-419e-ba14-6e693343a423") : secret "maas-api-e2e-mt-e1c7132e-serving-cert" not found
Jul 22 03:10:53.218083 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:53.218064    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a50c866-2b5f-419e-ba14-6e693343a423-openshift-service-ca\") pod \"maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x\" (UID: \"7a50c866-2b5f-419e-ba14-6e693343a423\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x"
Jul 22 03:10:53.227444 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:53.227412    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hqg9\" (UniqueName: \"kubernetes.io/projected/7a50c866-2b5f-419e-ba14-6e693343a423-kube-api-access-7hqg9\") pod \"maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x\" (UID: \"7a50c866-2b5f-419e-ba14-6e693343a423\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x"
Jul 22 03:10:53.569494 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:53.569452    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:53.668974 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:53.668941    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:10:53.722744 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:53.722703    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a50c866-2b5f-419e-ba14-6e693343a423-maas-api-tls\") pod \"maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x\" (UID: \"7a50c866-2b5f-419e-ba14-6e693343a423\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x"
Jul 22 03:10:53.725687 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:53.725653    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a50c866-2b5f-419e-ba14-6e693343a423-maas-api-tls\") pod \"maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x\" (UID: \"7a50c866-2b5f-419e-ba14-6e693343a423\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x"
Jul 22 03:10:53.942838 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:53.942735    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x"
Jul 22 03:10:54.095121 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:54.095085    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x"]
Jul 22 03:10:54.098433 ip-10-0-143-160 kubenswrapper[2577]: W0722 03:10:54.098404    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a50c866_2b5f_419e_ba14_6e693343a423.slice/crio-1dd3df38d2d4e957803a2c309898f1433bbdc47f03c248150f77dab53f935e5d WatchSource:0}: Error finding container 1dd3df38d2d4e957803a2c309898f1433bbdc47f03c248150f77dab53f935e5d: Status 404 returned error can't find the container with id 1dd3df38d2d4e957803a2c309898f1433bbdc47f03c248150f77dab53f935e5d
Jul 22 03:10:54.100141 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:54.100123    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 03:10:54.720464 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:54.720370    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x" event={"ID":"7a50c866-2b5f-419e-ba14-6e693343a423","Type":"ContainerStarted","Data":"db53f9782ee5b5050fa5b20d77bae0900835b9c770602997c257afffb1521703"}
Jul 22 03:10:54.720464 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:54.720433    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x" event={"ID":"7a50c866-2b5f-419e-ba14-6e693343a423","Type":"ContainerStarted","Data":"1dd3df38d2d4e957803a2c309898f1433bbdc47f03c248150f77dab53f935e5d"}
Jul 22 03:10:54.720658 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:54.720521    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x"
Jul 22 03:10:54.740361 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:54.740304    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x" podStartSLOduration=1.4066199209999999 podStartE2EDuration="1.740285061s" totalImagesPullingTime="333.66514ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:10:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:10:54.73876929 +0000 UTC m=+2015.447197891" watchObservedRunningTime="2026-07-22 03:10:54.740285061 +0000 UTC m=+2015.448713660"
Jul 22 03:10:57.399069 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:10:57.399035    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:11:00.731919 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:11:00.731889    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x"
Jul 22 03:11:11.356765 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:11:11.356724    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:11:46.771115 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:11:46.770870    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x"]
Jul 22 03:11:46.772074 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:11:46.772015    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x" podUID="7a50c866-2b5f-419e-ba14-6e693343a423" containerName="maas-api" containerID="cri-o://db53f9782ee5b5050fa5b20d77bae0900835b9c770602997c257afffb1521703" gracePeriod=30
Jul 22 03:11:46.791587 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:11:46.791561    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:11:46.971516 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:11:46.971484    2577 generic.go:356] "Generic (PLEG): container finished" podID="7a50c866-2b5f-419e-ba14-6e693343a423" containerID="db53f9782ee5b5050fa5b20d77bae0900835b9c770602997c257afffb1521703" exitCode=0
Jul 22 03:11:46.971696 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:11:46.971547    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x" event={"ID":"7a50c866-2b5f-419e-ba14-6e693343a423","Type":"ContainerDied","Data":"db53f9782ee5b5050fa5b20d77bae0900835b9c770602997c257afffb1521703"}
Jul 22 03:11:47.024765 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:11:47.024691    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x"
Jul 22 03:11:47.116097 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:11:47.116064    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hqg9\" (UniqueName: \"kubernetes.io/projected/7a50c866-2b5f-419e-ba14-6e693343a423-kube-api-access-7hqg9\") pod \"7a50c866-2b5f-419e-ba14-6e693343a423\" (UID: \"7a50c866-2b5f-419e-ba14-6e693343a423\") "
Jul 22 03:11:47.116315 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:11:47.116141    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a50c866-2b5f-419e-ba14-6e693343a423-openshift-service-ca\") pod \"7a50c866-2b5f-419e-ba14-6e693343a423\" (UID: \"7a50c866-2b5f-419e-ba14-6e693343a423\") "
Jul 22 03:11:47.116315 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:11:47.116160    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a50c866-2b5f-419e-ba14-6e693343a423-maas-api-tls\") pod \"7a50c866-2b5f-419e-ba14-6e693343a423\" (UID: \"7a50c866-2b5f-419e-ba14-6e693343a423\") "
Jul 22 03:11:47.116576 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:11:47.116552    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a50c866-2b5f-419e-ba14-6e693343a423-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7a50c866-2b5f-419e-ba14-6e693343a423" (UID: "7a50c866-2b5f-419e-ba14-6e693343a423"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:11:47.118488 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:11:47.118466    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a50c866-2b5f-419e-ba14-6e693343a423-kube-api-access-7hqg9" (OuterVolumeSpecName: "kube-api-access-7hqg9") pod "7a50c866-2b5f-419e-ba14-6e693343a423" (UID: "7a50c866-2b5f-419e-ba14-6e693343a423"). InnerVolumeSpecName "kube-api-access-7hqg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:11:47.118550 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:11:47.118520    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a50c866-2b5f-419e-ba14-6e693343a423-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7a50c866-2b5f-419e-ba14-6e693343a423" (UID: "7a50c866-2b5f-419e-ba14-6e693343a423"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:11:47.216925 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:11:47.216886    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a50c866-2b5f-419e-ba14-6e693343a423-openshift-service-ca\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:11:47.216925 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:11:47.216917    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a50c866-2b5f-419e-ba14-6e693343a423-maas-api-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:11:47.216925 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:11:47.216926    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hqg9\" (UniqueName: \"kubernetes.io/projected/7a50c866-2b5f-419e-ba14-6e693343a423-kube-api-access-7hqg9\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:11:47.977609 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:11:47.977578    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x"
Jul 22 03:11:47.978054 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:11:47.977620    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x" event={"ID":"7a50c866-2b5f-419e-ba14-6e693343a423","Type":"ContainerDied","Data":"1dd3df38d2d4e957803a2c309898f1433bbdc47f03c248150f77dab53f935e5d"}
Jul 22 03:11:47.978054 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:11:47.977681    2577 scope.go:117] "RemoveContainer" containerID="db53f9782ee5b5050fa5b20d77bae0900835b9c770602997c257afffb1521703"
Jul 22 03:11:47.995608 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:11:47.995582    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x"]
Jul 22 03:11:47.999048 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:11:47.999023    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e1c7132e-7578495b7f-gjl4x"]
Jul 22 03:11:49.758460 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:11:49.758421    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a50c866-2b5f-419e-ba14-6e693343a423" path="/var/lib/kubelet/pods/7a50c866-2b5f-419e-ba14-6e693343a423/volumes"
Jul 22 03:11:51.439115 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:11:51.439069    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:11:53.646743 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:11:53.646708    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:11:58.670370 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:11:58.670328    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:12:19.763645 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:12:19.763614    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqngf_6461ea33-ff4c-48c5-8c29-b4026c2f67b0/ovn-acl-logging/0.log"
Jul 22 03:12:19.768208 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:12:19.768184    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqngf_6461ea33-ff4c-48c5-8c29-b4026c2f67b0/ovn-acl-logging/0.log"
Jul 22 03:12:34.915918 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:12:34.915882    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:12:35.963132 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:12:35.963093    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:12:41.743483 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:12:41.743456    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:12:47.132387 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:12:47.132352    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:12:47.231606 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:12:47.231574    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:12:56.981307 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:12:56.981276    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:12:57.047402 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:12:57.047365    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:12:57.301732 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:12:57.301688    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:12:57.525746 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:12:57.525712    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:12:58.602502 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:12:58.602464    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:12:58.705525 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:12:58.705489    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:12:58.807550 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:12:58.807507    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:12:59.545134 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:12:59.545098    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:12:59.643082 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:12:59.643051    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:12:59.743182 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:12:59.743146    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:13:01.123055 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:01.123018    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:13:07.269235 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:07.269203    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:13:07.342180 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:07.342146    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:13:07.961027 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:07.960989    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:13:09.685281 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:09.685228    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:13:14.958148 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:14.958116    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:13:15.070465 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:15.070434    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:13:15.172001 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:15.171968    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:13:25.672107 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:25.672033    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:13:26.048851 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:26.048818    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:13:46.979672 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:46.979637    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:13:53.464115 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:53.464071    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:13:53.564929 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:53.564893    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:13:53.817283 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:53.817212    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:13:54.141865 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:54.141783    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:13:54.358680 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:54.358644    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:13:56.943871 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:56.943834    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:13:57.038446 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:57.038412    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:13:57.127850 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:57.127817    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s"]
Jul 22 03:13:57.128237 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:57.128220    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a50c866-2b5f-419e-ba14-6e693343a423" containerName="maas-api"
Jul 22 03:13:57.128351 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:57.128240    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a50c866-2b5f-419e-ba14-6e693343a423" containerName="maas-api"
Jul 22 03:13:57.128409 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:57.128385    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a50c866-2b5f-419e-ba14-6e693343a423" containerName="maas-api"
Jul 22 03:13:57.131383 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:57.131356    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s"
Jul 22 03:13:57.134544 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:57.134509    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-f8xd9\""
Jul 22 03:13:57.134694 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:57.134679    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-9ded6d-serving-cert\""
Jul 22 03:13:57.141385 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:57.141346    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s"]
Jul 22 03:13:57.158435 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:57.158383    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:13:57.290481 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:57.290431    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e023d83a-79c5-4a24-a0ea-d0701692c00a-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s\" (UID: \"e023d83a-79c5-4a24-a0ea-d0701692c00a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s"
Jul 22 03:13:57.290481 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:57.290484    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e023d83a-79c5-4a24-a0ea-d0701692c00a-maas-api-tls\") pod \"maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s\" (UID: \"e023d83a-79c5-4a24-a0ea-d0701692c00a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s"
Jul 22 03:13:57.290765 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:57.290628    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64rvr\" (UniqueName: \"kubernetes.io/projected/e023d83a-79c5-4a24-a0ea-d0701692c00a-kube-api-access-64rvr\") pod \"maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s\" (UID: \"e023d83a-79c5-4a24-a0ea-d0701692c00a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s"
Jul 22 03:13:57.316361 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:57.316327    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:13:57.391968 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:57.391925    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64rvr\" (UniqueName: \"kubernetes.io/projected/e023d83a-79c5-4a24-a0ea-d0701692c00a-kube-api-access-64rvr\") pod \"maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s\" (UID: \"e023d83a-79c5-4a24-a0ea-d0701692c00a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s"
Jul 22 03:13:57.392162 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:57.391998    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e023d83a-79c5-4a24-a0ea-d0701692c00a-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s\" (UID: \"e023d83a-79c5-4a24-a0ea-d0701692c00a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s"
Jul 22 03:13:57.392162 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:57.392034    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e023d83a-79c5-4a24-a0ea-d0701692c00a-maas-api-tls\") pod \"maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s\" (UID: \"e023d83a-79c5-4a24-a0ea-d0701692c00a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s"
Jul 22 03:13:57.392707 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:57.392688    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e023d83a-79c5-4a24-a0ea-d0701692c00a-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s\" (UID: \"e023d83a-79c5-4a24-a0ea-d0701692c00a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s"
Jul 22 03:13:57.394908 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:57.394887    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e023d83a-79c5-4a24-a0ea-d0701692c00a-maas-api-tls\") pod \"maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s\" (UID: \"e023d83a-79c5-4a24-a0ea-d0701692c00a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s"
Jul 22 03:13:57.400931 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:57.400900    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64rvr\" (UniqueName: \"kubernetes.io/projected/e023d83a-79c5-4a24-a0ea-d0701692c00a-kube-api-access-64rvr\") pod \"maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s\" (UID: \"e023d83a-79c5-4a24-a0ea-d0701692c00a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s"
Jul 22 03:13:57.442942 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:57.442854    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s"
Jul 22 03:13:57.591155 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:57.591011    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s"]
Jul 22 03:13:57.593547 ip-10-0-143-160 kubenswrapper[2577]: W0722 03:13:57.593517    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode023d83a_79c5_4a24_a0ea_d0701692c00a.slice/crio-18841a7d873fc828fe3142a31a0273ffbdbedff738f187ba7539576bae5f2f68 WatchSource:0}: Error finding container 18841a7d873fc828fe3142a31a0273ffbdbedff738f187ba7539576bae5f2f68: Status 404 returned error can't find the container with id 18841a7d873fc828fe3142a31a0273ffbdbedff738f187ba7539576bae5f2f68
Jul 22 03:13:57.612467 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:57.612436    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:13:57.710566 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:57.710529    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:13:58.560364 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:58.560327    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s" event={"ID":"e023d83a-79c5-4a24-a0ea-d0701692c00a","Type":"ContainerStarted","Data":"5f8e2500367fd0a042dc0b76e755ff66b89930bcb40979edb00bd2dad5c14b21"}
Jul 22 03:13:58.560763 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:58.560381    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s" event={"ID":"e023d83a-79c5-4a24-a0ea-d0701692c00a","Type":"ContainerStarted","Data":"18841a7d873fc828fe3142a31a0273ffbdbedff738f187ba7539576bae5f2f68"}
Jul 22 03:13:58.560763 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:58.560434    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s"
Jul 22 03:13:58.578817 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:13:58.578757    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s" podStartSLOduration=1.11914353 podStartE2EDuration="1.578738779s" totalImagesPullingTime="459.595249ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:13:58.577164157 +0000 UTC m=+2199.285592758" watchObservedRunningTime="2026-07-22 03:13:58.578738779 +0000 UTC m=+2199.287167379"
Jul 22 03:14:01.487490 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:01.487458    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:14:01.828199 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:01.828164    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:14:02.297095 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:02.297043    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:14:02.497069 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:02.497040    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:14:04.572119 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:04.572088    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s"
Jul 22 03:14:05.124058 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:05.124026    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:14:05.245367 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:05.245332    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:14:05.246318 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:05.246294    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69"]
Jul 22 03:14:05.249939 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:05.249920    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69"
Jul 22 03:14:05.259367 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:05.259207    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-fec108-serving-cert\""
Jul 22 03:14:05.265965 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:05.265940    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69"]
Jul 22 03:14:05.359127 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:05.359099    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:14:05.363388 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:05.363363    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/490f29c6-2221-4bea-8a5a-5c25f2efde0d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69\" (UID: \"490f29c6-2221-4bea-8a5a-5c25f2efde0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69"
Jul 22 03:14:05.363508 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:05.363403    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/490f29c6-2221-4bea-8a5a-5c25f2efde0d-maas-api-tls\") pod \"maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69\" (UID: \"490f29c6-2221-4bea-8a5a-5c25f2efde0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69"
Jul 22 03:14:05.363552 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:05.363531    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2hdp\" (UniqueName: \"kubernetes.io/projected/490f29c6-2221-4bea-8a5a-5c25f2efde0d-kube-api-access-t2hdp\") pod \"maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69\" (UID: \"490f29c6-2221-4bea-8a5a-5c25f2efde0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69"
Jul 22 03:14:05.464791 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:05.464697    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2hdp\" (UniqueName: \"kubernetes.io/projected/490f29c6-2221-4bea-8a5a-5c25f2efde0d-kube-api-access-t2hdp\") pod \"maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69\" (UID: \"490f29c6-2221-4bea-8a5a-5c25f2efde0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69"
Jul 22 03:14:05.464791 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:05.464743    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/490f29c6-2221-4bea-8a5a-5c25f2efde0d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69\" (UID: \"490f29c6-2221-4bea-8a5a-5c25f2efde0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69"
Jul 22 03:14:05.464791 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:05.464778    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/490f29c6-2221-4bea-8a5a-5c25f2efde0d-maas-api-tls\") pod \"maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69\" (UID: \"490f29c6-2221-4bea-8a5a-5c25f2efde0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69"
Jul 22 03:14:05.465046 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:14:05.464929    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-serving-cert: secret "maas-api-e2e-inf-b-fec108-serving-cert" not found
Jul 22 03:14:05.465046 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:14:05.464998    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/490f29c6-2221-4bea-8a5a-5c25f2efde0d-maas-api-tls podName:490f29c6-2221-4bea-8a5a-5c25f2efde0d nodeName:}" failed. No retries permitted until 2026-07-22 03:14:05.964980757 +0000 UTC m=+2206.673409339 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/490f29c6-2221-4bea-8a5a-5c25f2efde0d-maas-api-tls") pod "maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69" (UID: "490f29c6-2221-4bea-8a5a-5c25f2efde0d") : secret "maas-api-e2e-inf-b-fec108-serving-cert" not found
Jul 22 03:14:05.465473 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:05.465456    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/490f29c6-2221-4bea-8a5a-5c25f2efde0d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69\" (UID: \"490f29c6-2221-4bea-8a5a-5c25f2efde0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69"
Jul 22 03:14:05.476002 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:05.475971    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2hdp\" (UniqueName: \"kubernetes.io/projected/490f29c6-2221-4bea-8a5a-5c25f2efde0d-kube-api-access-t2hdp\") pod \"maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69\" (UID: \"490f29c6-2221-4bea-8a5a-5c25f2efde0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69"
Jul 22 03:14:05.672601 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:05.672557    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:14:05.833849 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:05.833814    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:14:05.936974 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:05.936940    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:14:05.970584 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:05.970543    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/490f29c6-2221-4bea-8a5a-5c25f2efde0d-maas-api-tls\") pod \"maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69\" (UID: \"490f29c6-2221-4bea-8a5a-5c25f2efde0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69"
Jul 22 03:14:05.973148 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:05.973126    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/490f29c6-2221-4bea-8a5a-5c25f2efde0d-maas-api-tls\") pod \"maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69\" (UID: \"490f29c6-2221-4bea-8a5a-5c25f2efde0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69"
Jul 22 03:14:06.164928 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:06.164837    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69"
Jul 22 03:14:06.311274 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:06.311132    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69"]
Jul 22 03:14:06.313632 ip-10-0-143-160 kubenswrapper[2577]: W0722 03:14:06.313603    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod490f29c6_2221_4bea_8a5a_5c25f2efde0d.slice/crio-4e208a0e6891208a706ed7855acb3ecbfe0acc7f07985428c3c744b837d10f74 WatchSource:0}: Error finding container 4e208a0e6891208a706ed7855acb3ecbfe0acc7f07985428c3c744b837d10f74: Status 404 returned error can't find the container with id 4e208a0e6891208a706ed7855acb3ecbfe0acc7f07985428c3c744b837d10f74
Jul 22 03:14:06.597181 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:06.597148    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69" event={"ID":"490f29c6-2221-4bea-8a5a-5c25f2efde0d","Type":"ContainerStarted","Data":"4e208a0e6891208a706ed7855acb3ecbfe0acc7f07985428c3c744b837d10f74"}
Jul 22 03:14:07.603215 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:07.603173    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69" event={"ID":"490f29c6-2221-4bea-8a5a-5c25f2efde0d","Type":"ContainerStarted","Data":"7b9bfdb9814f4bc3bda50e120847bc55c78fd702021210063e743327a7f00875"}
Jul 22 03:14:07.603662 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:07.603283    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69"
Jul 22 03:14:07.624336 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:07.624281    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69" podStartSLOduration=2.246107777 podStartE2EDuration="2.624245295s" totalImagesPullingTime="378.137518ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:14:07.623645393 +0000 UTC m=+2208.332073995" watchObservedRunningTime="2026-07-22 03:14:07.624245295 +0000 UTC m=+2208.332673897"
Jul 22 03:14:09.529723 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:09.529684    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:14:13.613506 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:13.613477    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69"
Jul 22 03:14:17.399754 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:17.399720    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:14:19.299584 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:19.299546    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:14:19.397946 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:19.397914    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:14:26.596505 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:26.596472    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:14:26.696483 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:26.696451    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:14:58.271126 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:14:58.271085    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:15:03.678048 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:15:03.678013    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:15:49.580830 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:15:49.580798    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:15:50.571538 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:15:50.571506    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:15:51.191437 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:15:51.191392    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:15:51.292439 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:15:51.292404    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:01.045187 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:01.045148    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s"]
Jul 22 03:16:01.045777 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:01.045445    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s" podUID="e023d83a-79c5-4a24-a0ea-d0701692c00a" containerName="maas-api" containerID="cri-o://5f8e2500367fd0a042dc0b76e755ff66b89930bcb40979edb00bd2dad5c14b21" gracePeriod=30
Jul 22 03:16:01.070617 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:01.070590    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:01.300043 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:01.299980    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s"
Jul 22 03:16:01.314946 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:01.314921    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64rvr\" (UniqueName: \"kubernetes.io/projected/e023d83a-79c5-4a24-a0ea-d0701692c00a-kube-api-access-64rvr\") pod \"e023d83a-79c5-4a24-a0ea-d0701692c00a\" (UID: \"e023d83a-79c5-4a24-a0ea-d0701692c00a\") "
Jul 22 03:16:01.315068 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:01.314962    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e023d83a-79c5-4a24-a0ea-d0701692c00a-openshift-service-ca\") pod \"e023d83a-79c5-4a24-a0ea-d0701692c00a\" (UID: \"e023d83a-79c5-4a24-a0ea-d0701692c00a\") "
Jul 22 03:16:01.315068 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:01.314997    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e023d83a-79c5-4a24-a0ea-d0701692c00a-maas-api-tls\") pod \"e023d83a-79c5-4a24-a0ea-d0701692c00a\" (UID: \"e023d83a-79c5-4a24-a0ea-d0701692c00a\") "
Jul 22 03:16:01.315366 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:01.315344    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e023d83a-79c5-4a24-a0ea-d0701692c00a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e023d83a-79c5-4a24-a0ea-d0701692c00a" (UID: "e023d83a-79c5-4a24-a0ea-d0701692c00a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:16:01.317274 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:01.317231    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e023d83a-79c5-4a24-a0ea-d0701692c00a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e023d83a-79c5-4a24-a0ea-d0701692c00a" (UID: "e023d83a-79c5-4a24-a0ea-d0701692c00a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:16:01.317410 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:01.317340    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e023d83a-79c5-4a24-a0ea-d0701692c00a-kube-api-access-64rvr" (OuterVolumeSpecName: "kube-api-access-64rvr") pod "e023d83a-79c5-4a24-a0ea-d0701692c00a" (UID: "e023d83a-79c5-4a24-a0ea-d0701692c00a"). InnerVolumeSpecName "kube-api-access-64rvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:16:01.415764 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:01.415726    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e023d83a-79c5-4a24-a0ea-d0701692c00a-maas-api-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:16:01.415764 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:01.415759    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64rvr\" (UniqueName: \"kubernetes.io/projected/e023d83a-79c5-4a24-a0ea-d0701692c00a-kube-api-access-64rvr\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:16:01.415764 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:01.415769    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e023d83a-79c5-4a24-a0ea-d0701692c00a-openshift-service-ca\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:16:02.112509 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:02.112420    2577 generic.go:356] "Generic (PLEG): container finished" podID="e023d83a-79c5-4a24-a0ea-d0701692c00a" containerID="5f8e2500367fd0a042dc0b76e755ff66b89930bcb40979edb00bd2dad5c14b21" exitCode=0
Jul 22 03:16:02.112509 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:02.112470    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s"
Jul 22 03:16:02.112947 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:02.112511    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s" event={"ID":"e023d83a-79c5-4a24-a0ea-d0701692c00a","Type":"ContainerDied","Data":"5f8e2500367fd0a042dc0b76e755ff66b89930bcb40979edb00bd2dad5c14b21"}
Jul 22 03:16:02.112947 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:02.112567    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s" event={"ID":"e023d83a-79c5-4a24-a0ea-d0701692c00a","Type":"ContainerDied","Data":"18841a7d873fc828fe3142a31a0273ffbdbedff738f187ba7539576bae5f2f68"}
Jul 22 03:16:02.112947 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:02.112597    2577 scope.go:117] "RemoveContainer" containerID="5f8e2500367fd0a042dc0b76e755ff66b89930bcb40979edb00bd2dad5c14b21"
Jul 22 03:16:02.121410 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:02.121388    2577 scope.go:117] "RemoveContainer" containerID="5f8e2500367fd0a042dc0b76e755ff66b89930bcb40979edb00bd2dad5c14b21"
Jul 22 03:16:02.121665 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:16:02.121647    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f8e2500367fd0a042dc0b76e755ff66b89930bcb40979edb00bd2dad5c14b21\": container with ID starting with 5f8e2500367fd0a042dc0b76e755ff66b89930bcb40979edb00bd2dad5c14b21 not found: ID does not exist" containerID="5f8e2500367fd0a042dc0b76e755ff66b89930bcb40979edb00bd2dad5c14b21"
Jul 22 03:16:02.121706 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:02.121676    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f8e2500367fd0a042dc0b76e755ff66b89930bcb40979edb00bd2dad5c14b21"} err="failed to get container status \"5f8e2500367fd0a042dc0b76e755ff66b89930bcb40979edb00bd2dad5c14b21\": rpc error: code = NotFound desc = could not find container \"5f8e2500367fd0a042dc0b76e755ff66b89930bcb40979edb00bd2dad5c14b21\": container with ID starting with 5f8e2500367fd0a042dc0b76e755ff66b89930bcb40979edb00bd2dad5c14b21 not found: ID does not exist"
Jul 22 03:16:02.130993 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:02.130960    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s"]
Jul 22 03:16:02.134204 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:02.134184    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9ded6d-6f947dc6d8-rpv2s"]
Jul 22 03:16:03.757307 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:03.757275    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e023d83a-79c5-4a24-a0ea-d0701692c00a" path="/var/lib/kubelet/pods/e023d83a-79c5-4a24-a0ea-d0701692c00a/volumes"
Jul 22 03:16:05.739480 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:05.739447    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:06.121869 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:06.121838    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:12.238202 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:12.238120    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:12.349766 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:12.349730    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:12.574972 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:12.574943    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:12.768020 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:12.767987    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:13.598236 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:13.598199    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:13.697074 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:13.697039    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:23.251531 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:23.251500    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69"]
Jul 22 03:16:23.252015 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:23.251714    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69" podUID="490f29c6-2221-4bea-8a5a-5c25f2efde0d" containerName="maas-api" containerID="cri-o://7b9bfdb9814f4bc3bda50e120847bc55c78fd702021210063e743327a7f00875" gracePeriod=30
Jul 22 03:16:23.274207 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:23.274177    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:23.509308 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:23.509228    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69"
Jul 22 03:16:23.621629 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:23.621591    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/490f29c6-2221-4bea-8a5a-5c25f2efde0d-maas-api-tls\") pod \"490f29c6-2221-4bea-8a5a-5c25f2efde0d\" (UID: \"490f29c6-2221-4bea-8a5a-5c25f2efde0d\") "
Jul 22 03:16:23.621827 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:23.621685    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2hdp\" (UniqueName: \"kubernetes.io/projected/490f29c6-2221-4bea-8a5a-5c25f2efde0d-kube-api-access-t2hdp\") pod \"490f29c6-2221-4bea-8a5a-5c25f2efde0d\" (UID: \"490f29c6-2221-4bea-8a5a-5c25f2efde0d\") "
Jul 22 03:16:23.621827 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:23.621725    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/490f29c6-2221-4bea-8a5a-5c25f2efde0d-openshift-service-ca\") pod \"490f29c6-2221-4bea-8a5a-5c25f2efde0d\" (UID: \"490f29c6-2221-4bea-8a5a-5c25f2efde0d\") "
Jul 22 03:16:23.622172 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:23.622143    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/490f29c6-2221-4bea-8a5a-5c25f2efde0d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "490f29c6-2221-4bea-8a5a-5c25f2efde0d" (UID: "490f29c6-2221-4bea-8a5a-5c25f2efde0d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:16:23.623908 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:23.623877    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/490f29c6-2221-4bea-8a5a-5c25f2efde0d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "490f29c6-2221-4bea-8a5a-5c25f2efde0d" (UID: "490f29c6-2221-4bea-8a5a-5c25f2efde0d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:16:23.623908 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:23.623882    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/490f29c6-2221-4bea-8a5a-5c25f2efde0d-kube-api-access-t2hdp" (OuterVolumeSpecName: "kube-api-access-t2hdp") pod "490f29c6-2221-4bea-8a5a-5c25f2efde0d" (UID: "490f29c6-2221-4bea-8a5a-5c25f2efde0d"). InnerVolumeSpecName "kube-api-access-t2hdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:16:23.722587 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:23.722537    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2hdp\" (UniqueName: \"kubernetes.io/projected/490f29c6-2221-4bea-8a5a-5c25f2efde0d-kube-api-access-t2hdp\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:16:23.722587 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:23.722581    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/490f29c6-2221-4bea-8a5a-5c25f2efde0d-openshift-service-ca\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:16:23.722587 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:23.722594    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/490f29c6-2221-4bea-8a5a-5c25f2efde0d-maas-api-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:16:24.215777 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:24.215689    2577 generic.go:356] "Generic (PLEG): container finished" podID="490f29c6-2221-4bea-8a5a-5c25f2efde0d" containerID="7b9bfdb9814f4bc3bda50e120847bc55c78fd702021210063e743327a7f00875" exitCode=0
Jul 22 03:16:24.215777 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:24.215736    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69"
Jul 22 03:16:24.215997 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:24.215777    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69" event={"ID":"490f29c6-2221-4bea-8a5a-5c25f2efde0d","Type":"ContainerDied","Data":"7b9bfdb9814f4bc3bda50e120847bc55c78fd702021210063e743327a7f00875"}
Jul 22 03:16:24.215997 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:24.215830    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69" event={"ID":"490f29c6-2221-4bea-8a5a-5c25f2efde0d","Type":"ContainerDied","Data":"4e208a0e6891208a706ed7855acb3ecbfe0acc7f07985428c3c744b837d10f74"}
Jul 22 03:16:24.215997 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:24.215852    2577 scope.go:117] "RemoveContainer" containerID="7b9bfdb9814f4bc3bda50e120847bc55c78fd702021210063e743327a7f00875"
Jul 22 03:16:24.226451 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:24.226391    2577 scope.go:117] "RemoveContainer" containerID="7b9bfdb9814f4bc3bda50e120847bc55c78fd702021210063e743327a7f00875"
Jul 22 03:16:24.226851 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:16:24.226827    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b9bfdb9814f4bc3bda50e120847bc55c78fd702021210063e743327a7f00875\": container with ID starting with 7b9bfdb9814f4bc3bda50e120847bc55c78fd702021210063e743327a7f00875 not found: ID does not exist" containerID="7b9bfdb9814f4bc3bda50e120847bc55c78fd702021210063e743327a7f00875"
Jul 22 03:16:24.226901 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:24.226862    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b9bfdb9814f4bc3bda50e120847bc55c78fd702021210063e743327a7f00875"} err="failed to get container status \"7b9bfdb9814f4bc3bda50e120847bc55c78fd702021210063e743327a7f00875\": rpc error: code = NotFound desc = could not find container \"7b9bfdb9814f4bc3bda50e120847bc55c78fd702021210063e743327a7f00875\": container with ID starting with 7b9bfdb9814f4bc3bda50e120847bc55c78fd702021210063e743327a7f00875 not found: ID does not exist"
Jul 22 03:16:24.232105 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:24.232078    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69"]
Jul 22 03:16:24.235796 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:24.235773    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fec108-84fd6c98d4-fgx69"]
Jul 22 03:16:25.757335 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:25.757302    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="490f29c6-2221-4bea-8a5a-5c25f2efde0d" path="/var/lib/kubelet/pods/490f29c6-2221-4bea-8a5a-5c25f2efde0d/volumes"
Jul 22 03:16:27.925841 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:27.925809    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:28.313531 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:28.313494    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:28.581125 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:28.581026    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:28.635862 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:28.635828    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:34.455696 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:34.455660    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:34.517884 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:34.517847    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:34.730682 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:34.730583    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:34.966112 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:34.966077    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:35.305851 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:35.305823    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:35.614019 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:35.613941    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:35.996566 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:35.996535    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:38.922782 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:38.922743    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:39.023210 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.023168    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:39.029363 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.029301    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s"]
Jul 22 03:16:39.029850 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.029816    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="490f29c6-2221-4bea-8a5a-5c25f2efde0d" containerName="maas-api"
Jul 22 03:16:39.029850 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.029847    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="490f29c6-2221-4bea-8a5a-5c25f2efde0d" containerName="maas-api"
Jul 22 03:16:39.029850 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.029858    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e023d83a-79c5-4a24-a0ea-d0701692c00a" containerName="maas-api"
Jul 22 03:16:39.030080 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.029864    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e023d83a-79c5-4a24-a0ea-d0701692c00a" containerName="maas-api"
Jul 22 03:16:39.030080 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.029938    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="490f29c6-2221-4bea-8a5a-5c25f2efde0d" containerName="maas-api"
Jul 22 03:16:39.030080 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.029949    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e023d83a-79c5-4a24-a0ea-d0701692c00a" containerName="maas-api"
Jul 22 03:16:39.034351 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.034329    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s"
Jul 22 03:16:39.037366 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.037341    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-34fcb8-serving-cert\""
Jul 22 03:16:39.037366 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.037350    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-f8xd9\""
Jul 22 03:16:39.042631 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.042602    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s"]
Jul 22 03:16:39.074430 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.074398    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02970cf0-cd73-4977-a6ab-93e46722565b-maas-api-tls\") pod \"maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s\" (UID: \"02970cf0-cd73-4977-a6ab-93e46722565b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s"
Jul 22 03:16:39.074600 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.074455    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02970cf0-cd73-4977-a6ab-93e46722565b-openshift-service-ca\") pod \"maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s\" (UID: \"02970cf0-cd73-4977-a6ab-93e46722565b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s"
Jul 22 03:16:39.074600 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.074495    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92hgq\" (UniqueName: \"kubernetes.io/projected/02970cf0-cd73-4977-a6ab-93e46722565b-kube-api-access-92hgq\") pod \"maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s\" (UID: \"02970cf0-cd73-4977-a6ab-93e46722565b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s"
Jul 22 03:16:39.121907 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.121878    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:39.175438 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.175338    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92hgq\" (UniqueName: \"kubernetes.io/projected/02970cf0-cd73-4977-a6ab-93e46722565b-kube-api-access-92hgq\") pod \"maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s\" (UID: \"02970cf0-cd73-4977-a6ab-93e46722565b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s"
Jul 22 03:16:39.175684 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.175480    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02970cf0-cd73-4977-a6ab-93e46722565b-maas-api-tls\") pod \"maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s\" (UID: \"02970cf0-cd73-4977-a6ab-93e46722565b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s"
Jul 22 03:16:39.175684 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.175521    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02970cf0-cd73-4977-a6ab-93e46722565b-openshift-service-ca\") pod \"maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s\" (UID: \"02970cf0-cd73-4977-a6ab-93e46722565b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s"
Jul 22 03:16:39.175779 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:16:39.175703    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-serving-cert: secret "maas-api-e2e-api-a-34fcb8-serving-cert" not found
Jul 22 03:16:39.175779 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:16:39.175774    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02970cf0-cd73-4977-a6ab-93e46722565b-maas-api-tls podName:02970cf0-cd73-4977-a6ab-93e46722565b nodeName:}" failed. No retries permitted until 2026-07-22 03:16:39.67575945 +0000 UTC m=+2360.384188028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/02970cf0-cd73-4977-a6ab-93e46722565b-maas-api-tls") pod "maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s" (UID: "02970cf0-cd73-4977-a6ab-93e46722565b") : secret "maas-api-e2e-api-a-34fcb8-serving-cert" not found
Jul 22 03:16:39.176173 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.176156    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02970cf0-cd73-4977-a6ab-93e46722565b-openshift-service-ca\") pod \"maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s\" (UID: \"02970cf0-cd73-4977-a6ab-93e46722565b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s"
Jul 22 03:16:39.185404 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.185369    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92hgq\" (UniqueName: \"kubernetes.io/projected/02970cf0-cd73-4977-a6ab-93e46722565b-kube-api-access-92hgq\") pod \"maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s\" (UID: \"02970cf0-cd73-4977-a6ab-93e46722565b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s"
Jul 22 03:16:39.296345 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.296308    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:39.678921 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.678890    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02970cf0-cd73-4977-a6ab-93e46722565b-maas-api-tls\") pod \"maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s\" (UID: \"02970cf0-cd73-4977-a6ab-93e46722565b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s"
Jul 22 03:16:39.681847 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.681816    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02970cf0-cd73-4977-a6ab-93e46722565b-maas-api-tls\") pod \"maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s\" (UID: \"02970cf0-cd73-4977-a6ab-93e46722565b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s"
Jul 22 03:16:39.709821 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.709784    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:39.804206 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.804170    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:39.946000 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:39.945905    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s"
Jul 22 03:16:40.092545 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:40.092511    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s"]
Jul 22 03:16:40.095174 ip-10-0-143-160 kubenswrapper[2577]: W0722 03:16:40.095144    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02970cf0_cd73_4977_a6ab_93e46722565b.slice/crio-5a581d8cc5e2de2c71185c2f7e4104d008e9c0cafe3e621cf39acd19fbf8ae37 WatchSource:0}: Error finding container 5a581d8cc5e2de2c71185c2f7e4104d008e9c0cafe3e621cf39acd19fbf8ae37: Status 404 returned error can't find the container with id 5a581d8cc5e2de2c71185c2f7e4104d008e9c0cafe3e621cf39acd19fbf8ae37
Jul 22 03:16:40.096680 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:40.096660    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 03:16:40.289304 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:40.289242    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s" event={"ID":"02970cf0-cd73-4977-a6ab-93e46722565b","Type":"ContainerStarted","Data":"5a581d8cc5e2de2c71185c2f7e4104d008e9c0cafe3e621cf39acd19fbf8ae37"}
Jul 22 03:16:41.298790 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:41.298751    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s" event={"ID":"02970cf0-cd73-4977-a6ab-93e46722565b","Type":"ContainerStarted","Data":"c6de88f3b57020af3ba209adacfc11f5a3c5c6cc7d307fcc7507bd54688598c8"}
Jul 22 03:16:41.299297 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:41.298840    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s"
Jul 22 03:16:41.321963 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:41.321907    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s" podStartSLOduration=1.844509317 podStartE2EDuration="2.321889384s" totalImagesPullingTime="477.380067ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:16:41.321024423 +0000 UTC m=+2362.029453036" watchObservedRunningTime="2026-07-22 03:16:41.321889384 +0000 UTC m=+2362.030317984"
Jul 22 03:16:43.339696 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:43.339657    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:43.807420 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:43.807382    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:44.109244 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:44.109145    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:44.498364 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:44.498324    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:46.881226 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:46.881187    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:46.986011 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:46.985984    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:47.201068 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:47.200980    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw"]
Jul 22 03:16:47.204668 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:47.204643    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw"
Jul 22 03:16:47.207824 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:47.207799    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-8dba71-serving-cert\""
Jul 22 03:16:47.224737 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:47.224706    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw"]
Jul 22 03:16:47.243231 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:47.243200    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/716c7420-18f5-4b27-9dc5-210b053579e7-maas-api-tls\") pod \"maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw\" (UID: \"716c7420-18f5-4b27-9dc5-210b053579e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw"
Jul 22 03:16:47.243443 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:47.243290    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/716c7420-18f5-4b27-9dc5-210b053579e7-openshift-service-ca\") pod \"maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw\" (UID: \"716c7420-18f5-4b27-9dc5-210b053579e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw"
Jul 22 03:16:47.243443 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:47.243402    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wh75\" (UniqueName: \"kubernetes.io/projected/716c7420-18f5-4b27-9dc5-210b053579e7-kube-api-access-5wh75\") pod \"maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw\" (UID: \"716c7420-18f5-4b27-9dc5-210b053579e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw"
Jul 22 03:16:47.267506 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:47.267475    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:47.309112 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:47.309083    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s"
Jul 22 03:16:47.344355 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:47.344315    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/716c7420-18f5-4b27-9dc5-210b053579e7-openshift-service-ca\") pod \"maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw\" (UID: \"716c7420-18f5-4b27-9dc5-210b053579e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw"
Jul 22 03:16:47.344539 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:47.344393    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wh75\" (UniqueName: \"kubernetes.io/projected/716c7420-18f5-4b27-9dc5-210b053579e7-kube-api-access-5wh75\") pod \"maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw\" (UID: \"716c7420-18f5-4b27-9dc5-210b053579e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw"
Jul 22 03:16:47.344539 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:47.344458    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/716c7420-18f5-4b27-9dc5-210b053579e7-maas-api-tls\") pod \"maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw\" (UID: \"716c7420-18f5-4b27-9dc5-210b053579e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw"
Jul 22 03:16:47.344789 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:16:47.344726    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-serving-cert: secret "maas-api-e2e-api-b-8dba71-serving-cert" not found
Jul 22 03:16:47.344851 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:16:47.344819    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/716c7420-18f5-4b27-9dc5-210b053579e7-maas-api-tls podName:716c7420-18f5-4b27-9dc5-210b053579e7 nodeName:}" failed. No retries permitted until 2026-07-22 03:16:47.84478727 +0000 UTC m=+2368.553215879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/716c7420-18f5-4b27-9dc5-210b053579e7-maas-api-tls") pod "maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw" (UID: "716c7420-18f5-4b27-9dc5-210b053579e7") : secret "maas-api-e2e-api-b-8dba71-serving-cert" not found
Jul 22 03:16:47.345051 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:47.345014    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/716c7420-18f5-4b27-9dc5-210b053579e7-openshift-service-ca\") pod \"maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw\" (UID: \"716c7420-18f5-4b27-9dc5-210b053579e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw"
Jul 22 03:16:47.367240 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:47.367205    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wh75\" (UniqueName: \"kubernetes.io/projected/716c7420-18f5-4b27-9dc5-210b053579e7-kube-api-access-5wh75\") pod \"maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw\" (UID: \"716c7420-18f5-4b27-9dc5-210b053579e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw"
Jul 22 03:16:47.848681 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:47.848647    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/716c7420-18f5-4b27-9dc5-210b053579e7-maas-api-tls\") pod \"maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw\" (UID: \"716c7420-18f5-4b27-9dc5-210b053579e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw"
Jul 22 03:16:47.848881 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:16:47.848771    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-serving-cert: secret "maas-api-e2e-api-b-8dba71-serving-cert" not found
Jul 22 03:16:47.848881 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:16:47.848828    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/716c7420-18f5-4b27-9dc5-210b053579e7-maas-api-tls podName:716c7420-18f5-4b27-9dc5-210b053579e7 nodeName:}" failed. No retries permitted until 2026-07-22 03:16:48.848814035 +0000 UTC m=+2369.557242618 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/716c7420-18f5-4b27-9dc5-210b053579e7-maas-api-tls") pod "maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw" (UID: "716c7420-18f5-4b27-9dc5-210b053579e7") : secret "maas-api-e2e-api-b-8dba71-serving-cert" not found
Jul 22 03:16:47.884262 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:47.884227    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:47.985491 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:47.985459    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:48.091675 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:48.091635    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:48.859105 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:48.859058    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/716c7420-18f5-4b27-9dc5-210b053579e7-maas-api-tls\") pod \"maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw\" (UID: \"716c7420-18f5-4b27-9dc5-210b053579e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw"
Jul 22 03:16:48.861932 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:48.861906    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/716c7420-18f5-4b27-9dc5-210b053579e7-maas-api-tls\") pod \"maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw\" (UID: \"716c7420-18f5-4b27-9dc5-210b053579e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw"
Jul 22 03:16:49.015220 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:49.015170    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw"
Jul 22 03:16:49.156700 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:49.156672    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw"]
Jul 22 03:16:49.159455 ip-10-0-143-160 kubenswrapper[2577]: W0722 03:16:49.159427    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod716c7420_18f5_4b27_9dc5_210b053579e7.slice/crio-8a58e1d7f9f8d939465d9537fa0bc70382deafaadb2561bd6e33d8972e18081d WatchSource:0}: Error finding container 8a58e1d7f9f8d939465d9537fa0bc70382deafaadb2561bd6e33d8972e18081d: Status 404 returned error can't find the container with id 8a58e1d7f9f8d939465d9537fa0bc70382deafaadb2561bd6e33d8972e18081d
Jul 22 03:16:49.336662 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:49.336625    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw" event={"ID":"716c7420-18f5-4b27-9dc5-210b053579e7","Type":"ContainerStarted","Data":"8a58e1d7f9f8d939465d9537fa0bc70382deafaadb2561bd6e33d8972e18081d"}
Jul 22 03:16:50.342631 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:50.342594    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw" event={"ID":"716c7420-18f5-4b27-9dc5-210b053579e7","Type":"ContainerStarted","Data":"2f41b093f7d86dca1be337b42ec8f53fb710ccc22b4d2dcd08cf6da0bde489c3"}
Jul 22 03:16:50.343125 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:50.342742    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw"
Jul 22 03:16:50.361499 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:50.361417    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw" podStartSLOduration=3.010224571 podStartE2EDuration="3.361396907s" totalImagesPullingTime="351.172336ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:16:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:16:50.361056367 +0000 UTC m=+2371.069484968" watchObservedRunningTime="2026-07-22 03:16:50.361396907 +0000 UTC m=+2371.069825507"
Jul 22 03:16:51.378009 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:51.377972    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:56.352545 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:56.352514    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw"
Jul 22 03:16:59.832181 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:59.832146    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:16:59.934246 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:16:59.934209    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:08.730703 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:08.730664    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:08.831120 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:08.831082    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:09.851398 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:09.851362    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:09.951948 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:09.951916    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:15.082191 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:15.082151    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s"]
Jul 22 03:17:15.082685 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:15.082439    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s" podUID="02970cf0-cd73-4977-a6ab-93e46722565b" containerName="maas-api" containerID="cri-o://c6de88f3b57020af3ba209adacfc11f5a3c5c6cc7d307fcc7507bd54688598c8" gracePeriod=30
Jul 22 03:17:15.104000 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:15.103967    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:15.343732 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:15.343668    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s"
Jul 22 03:17:15.410223 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:15.410188    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92hgq\" (UniqueName: \"kubernetes.io/projected/02970cf0-cd73-4977-a6ab-93e46722565b-kube-api-access-92hgq\") pod \"02970cf0-cd73-4977-a6ab-93e46722565b\" (UID: \"02970cf0-cd73-4977-a6ab-93e46722565b\") "
Jul 22 03:17:15.410467 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:15.410320    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02970cf0-cd73-4977-a6ab-93e46722565b-maas-api-tls\") pod \"02970cf0-cd73-4977-a6ab-93e46722565b\" (UID: \"02970cf0-cd73-4977-a6ab-93e46722565b\") "
Jul 22 03:17:15.410467 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:15.410370    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02970cf0-cd73-4977-a6ab-93e46722565b-openshift-service-ca\") pod \"02970cf0-cd73-4977-a6ab-93e46722565b\" (UID: \"02970cf0-cd73-4977-a6ab-93e46722565b\") "
Jul 22 03:17:15.410762 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:15.410725    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02970cf0-cd73-4977-a6ab-93e46722565b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "02970cf0-cd73-4977-a6ab-93e46722565b" (UID: "02970cf0-cd73-4977-a6ab-93e46722565b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:17:15.412465 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:15.412434    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02970cf0-cd73-4977-a6ab-93e46722565b-kube-api-access-92hgq" (OuterVolumeSpecName: "kube-api-access-92hgq") pod "02970cf0-cd73-4977-a6ab-93e46722565b" (UID: "02970cf0-cd73-4977-a6ab-93e46722565b"). InnerVolumeSpecName "kube-api-access-92hgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:17:15.412565 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:15.412506    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02970cf0-cd73-4977-a6ab-93e46722565b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "02970cf0-cd73-4977-a6ab-93e46722565b" (UID: "02970cf0-cd73-4977-a6ab-93e46722565b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:17:15.457670 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:15.457638    2577 generic.go:356] "Generic (PLEG): container finished" podID="02970cf0-cd73-4977-a6ab-93e46722565b" containerID="c6de88f3b57020af3ba209adacfc11f5a3c5c6cc7d307fcc7507bd54688598c8" exitCode=0
Jul 22 03:17:15.457855 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:15.457683    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s"
Jul 22 03:17:15.457855 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:15.457741    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s" event={"ID":"02970cf0-cd73-4977-a6ab-93e46722565b","Type":"ContainerDied","Data":"c6de88f3b57020af3ba209adacfc11f5a3c5c6cc7d307fcc7507bd54688598c8"}
Jul 22 03:17:15.457855 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:15.457787    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s" event={"ID":"02970cf0-cd73-4977-a6ab-93e46722565b","Type":"ContainerDied","Data":"5a581d8cc5e2de2c71185c2f7e4104d008e9c0cafe3e621cf39acd19fbf8ae37"}
Jul 22 03:17:15.457855 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:15.457815    2577 scope.go:117] "RemoveContainer" containerID="c6de88f3b57020af3ba209adacfc11f5a3c5c6cc7d307fcc7507bd54688598c8"
Jul 22 03:17:15.468534 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:15.468516    2577 scope.go:117] "RemoveContainer" containerID="c6de88f3b57020af3ba209adacfc11f5a3c5c6cc7d307fcc7507bd54688598c8"
Jul 22 03:17:15.476077 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:17:15.475505    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6de88f3b57020af3ba209adacfc11f5a3c5c6cc7d307fcc7507bd54688598c8\": container with ID starting with c6de88f3b57020af3ba209adacfc11f5a3c5c6cc7d307fcc7507bd54688598c8 not found: ID does not exist" containerID="c6de88f3b57020af3ba209adacfc11f5a3c5c6cc7d307fcc7507bd54688598c8"
Jul 22 03:17:15.476077 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:15.475556    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6de88f3b57020af3ba209adacfc11f5a3c5c6cc7d307fcc7507bd54688598c8"} err="failed to get container status \"c6de88f3b57020af3ba209adacfc11f5a3c5c6cc7d307fcc7507bd54688598c8\": rpc error: code = NotFound desc = could not find container \"c6de88f3b57020af3ba209adacfc11f5a3c5c6cc7d307fcc7507bd54688598c8\": container with ID starting with c6de88f3b57020af3ba209adacfc11f5a3c5c6cc7d307fcc7507bd54688598c8 not found: ID does not exist"
Jul 22 03:17:15.480848 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:15.480818    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s"]
Jul 22 03:17:15.486715 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:15.486689    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-34fcb8-5448dccb9-s8p7s"]
Jul 22 03:17:15.511757 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:15.511727    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02970cf0-cd73-4977-a6ab-93e46722565b-maas-api-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:17:15.511757 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:15.511753    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02970cf0-cd73-4977-a6ab-93e46722565b-openshift-service-ca\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:17:15.511928 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:15.511766    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92hgq\" (UniqueName: \"kubernetes.io/projected/02970cf0-cd73-4977-a6ab-93e46722565b-kube-api-access-92hgq\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:17:15.757726 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:15.757683    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02970cf0-cd73-4977-a6ab-93e46722565b" path="/var/lib/kubelet/pods/02970cf0-cd73-4977-a6ab-93e46722565b/volumes"
Jul 22 03:17:19.407601 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:19.407565    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:19.778818 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:19.778786    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:19.790031 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:19.790006    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqngf_6461ea33-ff4c-48c5-8c29-b4026c2f67b0/ovn-acl-logging/0.log"
Jul 22 03:17:19.795468 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:19.795446    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqngf_6461ea33-ff4c-48c5-8c29-b4026c2f67b0/ovn-acl-logging/0.log"
Jul 22 03:17:22.796300 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:22.796240    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:25.939174 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:25.939146    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:26.004507 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:26.004476    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:26.221187 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:26.221104    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:26.438853 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:26.438806    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:27.199237 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:27.199200    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:27.300937 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:27.300898    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:35.592570 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:35.592534    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:35.646073 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:35.646041    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:42.125372 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:42.125278    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw"]
Jul 22 03:17:42.125787 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:42.125516    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw" podUID="716c7420-18f5-4b27-9dc5-210b053579e7" containerName="maas-api" containerID="cri-o://2f41b093f7d86dca1be337b42ec8f53fb710ccc22b4d2dcd08cf6da0bde489c3" gracePeriod=30
Jul 22 03:17:42.160186 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:42.160134    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:42.392865 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:42.392841    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw"
Jul 22 03:17:42.443915 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:42.443880    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/716c7420-18f5-4b27-9dc5-210b053579e7-openshift-service-ca\") pod \"716c7420-18f5-4b27-9dc5-210b053579e7\" (UID: \"716c7420-18f5-4b27-9dc5-210b053579e7\") "
Jul 22 03:17:42.444102 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:42.443928    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/716c7420-18f5-4b27-9dc5-210b053579e7-maas-api-tls\") pod \"716c7420-18f5-4b27-9dc5-210b053579e7\" (UID: \"716c7420-18f5-4b27-9dc5-210b053579e7\") "
Jul 22 03:17:42.444102 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:42.444049    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wh75\" (UniqueName: \"kubernetes.io/projected/716c7420-18f5-4b27-9dc5-210b053579e7-kube-api-access-5wh75\") pod \"716c7420-18f5-4b27-9dc5-210b053579e7\" (UID: \"716c7420-18f5-4b27-9dc5-210b053579e7\") "
Jul 22 03:17:42.444357 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:42.444331    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/716c7420-18f5-4b27-9dc5-210b053579e7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "716c7420-18f5-4b27-9dc5-210b053579e7" (UID: "716c7420-18f5-4b27-9dc5-210b053579e7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:17:42.446215 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:42.446188    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/716c7420-18f5-4b27-9dc5-210b053579e7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "716c7420-18f5-4b27-9dc5-210b053579e7" (UID: "716c7420-18f5-4b27-9dc5-210b053579e7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:17:42.446215 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:42.446207    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/716c7420-18f5-4b27-9dc5-210b053579e7-kube-api-access-5wh75" (OuterVolumeSpecName: "kube-api-access-5wh75") pod "716c7420-18f5-4b27-9dc5-210b053579e7" (UID: "716c7420-18f5-4b27-9dc5-210b053579e7"). InnerVolumeSpecName "kube-api-access-5wh75". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:17:42.545563 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:42.545528    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wh75\" (UniqueName: \"kubernetes.io/projected/716c7420-18f5-4b27-9dc5-210b053579e7-kube-api-access-5wh75\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:17:42.545563 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:42.545561    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/716c7420-18f5-4b27-9dc5-210b053579e7-openshift-service-ca\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:17:42.545769 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:42.545574    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/716c7420-18f5-4b27-9dc5-210b053579e7-maas-api-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:17:42.588190 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:42.588160    2577 generic.go:356] "Generic (PLEG): container finished" podID="716c7420-18f5-4b27-9dc5-210b053579e7" containerID="2f41b093f7d86dca1be337b42ec8f53fb710ccc22b4d2dcd08cf6da0bde489c3" exitCode=0
Jul 22 03:17:42.588410 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:42.588206    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw"
Jul 22 03:17:42.588410 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:42.588246    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw" event={"ID":"716c7420-18f5-4b27-9dc5-210b053579e7","Type":"ContainerDied","Data":"2f41b093f7d86dca1be337b42ec8f53fb710ccc22b4d2dcd08cf6da0bde489c3"}
Jul 22 03:17:42.588410 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:42.588319    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw" event={"ID":"716c7420-18f5-4b27-9dc5-210b053579e7","Type":"ContainerDied","Data":"8a58e1d7f9f8d939465d9537fa0bc70382deafaadb2561bd6e33d8972e18081d"}
Jul 22 03:17:42.588410 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:42.588345    2577 scope.go:117] "RemoveContainer" containerID="2f41b093f7d86dca1be337b42ec8f53fb710ccc22b4d2dcd08cf6da0bde489c3"
Jul 22 03:17:42.597414 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:42.597391    2577 scope.go:117] "RemoveContainer" containerID="2f41b093f7d86dca1be337b42ec8f53fb710ccc22b4d2dcd08cf6da0bde489c3"
Jul 22 03:17:42.597757 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:17:42.597735    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f41b093f7d86dca1be337b42ec8f53fb710ccc22b4d2dcd08cf6da0bde489c3\": container with ID starting with 2f41b093f7d86dca1be337b42ec8f53fb710ccc22b4d2dcd08cf6da0bde489c3 not found: ID does not exist" containerID="2f41b093f7d86dca1be337b42ec8f53fb710ccc22b4d2dcd08cf6da0bde489c3"
Jul 22 03:17:42.597853 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:42.597767    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f41b093f7d86dca1be337b42ec8f53fb710ccc22b4d2dcd08cf6da0bde489c3"} err="failed to get container status \"2f41b093f7d86dca1be337b42ec8f53fb710ccc22b4d2dcd08cf6da0bde489c3\": rpc error: code = NotFound desc = could not find container \"2f41b093f7d86dca1be337b42ec8f53fb710ccc22b4d2dcd08cf6da0bde489c3\": container with ID starting with 2f41b093f7d86dca1be337b42ec8f53fb710ccc22b4d2dcd08cf6da0bde489c3 not found: ID does not exist"
Jul 22 03:17:42.616496 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:42.616460    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw"]
Jul 22 03:17:42.619651 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:42.619623    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8dba71-58f78d56cc-rrrdw"]
Jul 22 03:17:43.756808 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:43.756773    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="716c7420-18f5-4b27-9dc5-210b053579e7" path="/var/lib/kubelet/pods/716c7420-18f5-4b27-9dc5-210b053579e7/volumes"
Jul 22 03:17:46.754374 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:46.754329    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:47.129435 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:47.129333    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:47.900459 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:47.900423    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:47.997121 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:47.997092    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:53.500429 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:53.500392    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:53.601920 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:53.601884    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:53.817207 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:53.817121    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:54.016396 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:54.016362    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:54.421235 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:54.421197    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:54.723125 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:54.723030    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:54.957978 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:54.957942    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:57.325881 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:57.325851    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:57.411814 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:57.411778    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:57.539022 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:57.538968    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9"]
Jul 22 03:17:57.539503 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:57.539482    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716c7420-18f5-4b27-9dc5-210b053579e7" containerName="maas-api"
Jul 22 03:17:57.539604 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:57.539509    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="716c7420-18f5-4b27-9dc5-210b053579e7" containerName="maas-api"
Jul 22 03:17:57.539604 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:57.539555    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02970cf0-cd73-4977-a6ab-93e46722565b" containerName="maas-api"
Jul 22 03:17:57.539604 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:57.539564    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="02970cf0-cd73-4977-a6ab-93e46722565b" containerName="maas-api"
Jul 22 03:17:57.539731 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:57.539721    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="716c7420-18f5-4b27-9dc5-210b053579e7" containerName="maas-api"
Jul 22 03:17:57.539789 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:57.539740    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="02970cf0-cd73-4977-a6ab-93e46722565b" containerName="maas-api"
Jul 22 03:17:57.542701 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:57.542685    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9"
Jul 22 03:17:57.546076 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:57.546052    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-72501c-serving-cert\""
Jul 22 03:17:57.546076 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:57.546064    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-f8xd9\""
Jul 22 03:17:57.553952 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:57.553926    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9"]
Jul 22 03:17:57.576014 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:57.575933    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:57.680130 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:57.680094    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmm6x\" (UniqueName: \"kubernetes.io/projected/ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba-kube-api-access-cmm6x\") pod \"maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9\" (UID: \"ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9"
Jul 22 03:17:57.680130 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:57.680135    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba-maas-api-tls\") pod \"maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9\" (UID: \"ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9"
Jul 22 03:17:57.680409 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:57.680159    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba-openshift-service-ca\") pod \"maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9\" (UID: \"ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9"
Jul 22 03:17:57.781013 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:57.780975    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmm6x\" (UniqueName: \"kubernetes.io/projected/ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba-kube-api-access-cmm6x\") pod \"maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9\" (UID: \"ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9"
Jul 22 03:17:57.781013 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:57.781015    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba-maas-api-tls\") pod \"maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9\" (UID: \"ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9"
Jul 22 03:17:57.781331 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:57.781044    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba-openshift-service-ca\") pod \"maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9\" (UID: \"ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9"
Jul 22 03:17:57.781697 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:57.781674    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba-openshift-service-ca\") pod \"maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9\" (UID: \"ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9"
Jul 22 03:17:57.783615 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:57.783597    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba-maas-api-tls\") pod \"maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9\" (UID: \"ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9"
Jul 22 03:17:57.791431 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:57.791410    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmm6x\" (UniqueName: \"kubernetes.io/projected/ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba-kube-api-access-cmm6x\") pod \"maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9\" (UID: \"ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9"
Jul 22 03:17:57.812099 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:57.812073    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:57.853213 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:57.853128    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9"
Jul 22 03:17:58.000097 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:58.000070    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9"]
Jul 22 03:17:58.002212 ip-10-0-143-160 kubenswrapper[2577]: W0722 03:17:58.002187    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba9cb7e6_9c0f_49bc_85c2_673cc9af33ba.slice/crio-8c57af011d724334396ab5602ff41b7c9f95572271db1cb7b6f734039416e0d4 WatchSource:0}: Error finding container 8c57af011d724334396ab5602ff41b7c9f95572271db1cb7b6f734039416e0d4: Status 404 returned error can't find the container with id 8c57af011d724334396ab5602ff41b7c9f95572271db1cb7b6f734039416e0d4
Jul 22 03:17:58.226229 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:58.226134    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:58.326999 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:58.326975    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:17:58.670715 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:58.670679    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9" event={"ID":"ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba","Type":"ContainerStarted","Data":"077b3a79f6d1765be0f2140f2e13b54f72c5fd72ea9417e5d5870fd8a233e8e8"}
Jul 22 03:17:58.670911 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:58.670759    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9" event={"ID":"ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba","Type":"ContainerStarted","Data":"8c57af011d724334396ab5602ff41b7c9f95572271db1cb7b6f734039416e0d4"}
Jul 22 03:17:58.670911 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:58.670816    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9"
Jul 22 03:17:58.691442 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:17:58.691388    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9" podStartSLOduration=1.380247569 podStartE2EDuration="1.691372521s" totalImagesPullingTime="311.124952ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:17:58.688641389 +0000 UTC m=+2439.397069989" watchObservedRunningTime="2026-07-22 03:17:58.691372521 +0000 UTC m=+2439.399801120"
Jul 22 03:18:01.853947 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:01.853914    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:18:02.155292 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:02.155182    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:18:02.520847 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:02.520813    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:18:02.670196 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:02.670159    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:18:04.682733 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:04.682706    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9"
Jul 22 03:18:05.417205 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:05.417170    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:18:05.517516 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:05.517481    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:18:05.523693 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:05.523663    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t"]
Jul 22 03:18:05.527468 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:05.527445    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t"
Jul 22 03:18:05.530503 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:05.530481    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-e9ef33-serving-cert\""
Jul 22 03:18:05.541176 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:05.541150    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t"]
Jul 22 03:18:05.615977 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:05.615933    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:18:05.653244 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:05.653201    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5aa90b0b-ce88-48c3-8944-4e0121a61c5e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t\" (UID: \"5aa90b0b-ce88-48c3-8944-4e0121a61c5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t"
Jul 22 03:18:05.653455 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:05.653330    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn29b\" (UniqueName: \"kubernetes.io/projected/5aa90b0b-ce88-48c3-8944-4e0121a61c5e-kube-api-access-jn29b\") pod \"maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t\" (UID: \"5aa90b0b-ce88-48c3-8944-4e0121a61c5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t"
Jul 22 03:18:05.653455 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:05.653394    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5aa90b0b-ce88-48c3-8944-4e0121a61c5e-maas-api-tls\") pod \"maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t\" (UID: \"5aa90b0b-ce88-48c3-8944-4e0121a61c5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t"
Jul 22 03:18:05.754122 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:05.754092    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn29b\" (UniqueName: \"kubernetes.io/projected/5aa90b0b-ce88-48c3-8944-4e0121a61c5e-kube-api-access-jn29b\") pod \"maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t\" (UID: \"5aa90b0b-ce88-48c3-8944-4e0121a61c5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t"
Jul 22 03:18:05.754600 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:05.754133    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5aa90b0b-ce88-48c3-8944-4e0121a61c5e-maas-api-tls\") pod \"maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t\" (UID: \"5aa90b0b-ce88-48c3-8944-4e0121a61c5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t"
Jul 22 03:18:05.754600 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:05.754182    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5aa90b0b-ce88-48c3-8944-4e0121a61c5e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t\" (UID: \"5aa90b0b-ce88-48c3-8944-4e0121a61c5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t"
Jul 22 03:18:05.754600 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:18:05.754338    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-serving-cert: secret "maas-api-e2e-shared-b-e9ef33-serving-cert" not found
Jul 22 03:18:05.754600 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:18:05.754429    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa90b0b-ce88-48c3-8944-4e0121a61c5e-maas-api-tls podName:5aa90b0b-ce88-48c3-8944-4e0121a61c5e nodeName:}" failed. No retries permitted until 2026-07-22 03:18:06.254404135 +0000 UTC m=+2446.962832712 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5aa90b0b-ce88-48c3-8944-4e0121a61c5e-maas-api-tls") pod "maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t" (UID: "5aa90b0b-ce88-48c3-8944-4e0121a61c5e") : secret "maas-api-e2e-shared-b-e9ef33-serving-cert" not found
Jul 22 03:18:05.754900 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:05.754880    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5aa90b0b-ce88-48c3-8944-4e0121a61c5e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t\" (UID: \"5aa90b0b-ce88-48c3-8944-4e0121a61c5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t"
Jul 22 03:18:05.769369 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:05.769343    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn29b\" (UniqueName: \"kubernetes.io/projected/5aa90b0b-ce88-48c3-8944-4e0121a61c5e-kube-api-access-jn29b\") pod \"maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t\" (UID: \"5aa90b0b-ce88-48c3-8944-4e0121a61c5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t"
Jul 22 03:18:06.237090 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:06.237002    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:18:06.259150 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:06.259113    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5aa90b0b-ce88-48c3-8944-4e0121a61c5e-maas-api-tls\") pod \"maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t\" (UID: \"5aa90b0b-ce88-48c3-8944-4e0121a61c5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t"
Jul 22 03:18:06.259360 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:18:06.259281    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-serving-cert: secret "maas-api-e2e-shared-b-e9ef33-serving-cert" not found
Jul 22 03:18:06.259457 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:18:06.259364    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa90b0b-ce88-48c3-8944-4e0121a61c5e-maas-api-tls podName:5aa90b0b-ce88-48c3-8944-4e0121a61c5e nodeName:}" failed. No retries permitted until 2026-07-22 03:18:07.259343255 +0000 UTC m=+2447.967771835 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5aa90b0b-ce88-48c3-8944-4e0121a61c5e-maas-api-tls") pod "maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t" (UID: "5aa90b0b-ce88-48c3-8944-4e0121a61c5e") : secret "maas-api-e2e-shared-b-e9ef33-serving-cert" not found
Jul 22 03:18:06.335538 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:06.335496    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:18:06.439613 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:06.439573    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:18:07.268636 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:07.268591    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5aa90b0b-ce88-48c3-8944-4e0121a61c5e-maas-api-tls\") pod \"maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t\" (UID: \"5aa90b0b-ce88-48c3-8944-4e0121a61c5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t"
Jul 22 03:18:07.271267 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:07.271230    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5aa90b0b-ce88-48c3-8944-4e0121a61c5e-maas-api-tls\") pod \"maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t\" (UID: \"5aa90b0b-ce88-48c3-8944-4e0121a61c5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t"
Jul 22 03:18:07.340202 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:07.340158    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t"
Jul 22 03:18:07.484075 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:07.484051    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t"]
Jul 22 03:18:07.486615 ip-10-0-143-160 kubenswrapper[2577]: W0722 03:18:07.486589    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aa90b0b_ce88_48c3_8944_4e0121a61c5e.slice/crio-b819f03034e37f299ee8ca32541dcd4ba4c9b6d8440ea53e0b63c1c8320cef98 WatchSource:0}: Error finding container b819f03034e37f299ee8ca32541dcd4ba4c9b6d8440ea53e0b63c1c8320cef98: Status 404 returned error can't find the container with id b819f03034e37f299ee8ca32541dcd4ba4c9b6d8440ea53e0b63c1c8320cef98
Jul 22 03:18:07.712180 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:07.712094    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t" event={"ID":"5aa90b0b-ce88-48c3-8944-4e0121a61c5e","Type":"ContainerStarted","Data":"b819f03034e37f299ee8ca32541dcd4ba4c9b6d8440ea53e0b63c1c8320cef98"}
Jul 22 03:18:08.717998 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:08.717964    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t" event={"ID":"5aa90b0b-ce88-48c3-8944-4e0121a61c5e","Type":"ContainerStarted","Data":"5f2be1bb478e436a49c9c8f2d31268f4ef86a0e547b0e9271dc4df2caba40c50"}
Jul 22 03:18:08.718436 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:08.718032    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t"
Jul 22 03:18:08.740840 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:08.740790    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t" podStartSLOduration=3.435299673 podStartE2EDuration="3.740770955s" totalImagesPullingTime="305.471282ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:18:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:18:08.738559277 +0000 UTC m=+2449.446987878" watchObservedRunningTime="2026-07-22 03:18:08.740770955 +0000 UTC m=+2449.449199555"
Jul 22 03:18:09.813815 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:09.813772    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:18:14.734429 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:14.734400    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t"
Jul 22 03:18:20.051704 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:20.051670    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:18:20.151788 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:20.151754    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:18:20.983392 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:20.983356    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:18:27.074514 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:27.074473    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:18:27.168983 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:27.168934    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:18:49.212940 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:49.212903    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:18:52.539599 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:18:52.539558    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:20:44.533674 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:20:44.533564    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:20:45.595811 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:20:45.595765    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:20:47.650095 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:20:47.650051    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:21:32.837746 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:21:32.837709    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:21:43.805239 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:21:43.805206    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:22:19.819196 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:22:19.819117    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqngf_6461ea33-ff4c-48c5-8c29-b4026c2f67b0/ovn-acl-logging/0.log"
Jul 22 03:22:19.826552 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:22:19.826531    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mqngf_6461ea33-ff4c-48c5-8c29-b4026c2f67b0/ovn-acl-logging/0.log"
Jul 22 03:22:26.129198 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:22:26.129159    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:22:34.920362 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:22:34.920326    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:22:35.820987 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:22:35.820951    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:22:39.308099 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:22:39.308063    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:22:49.065529 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:22:49.065493    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:22:49.165993 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:22:49.165958    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:23:14.415805 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:23:14.415767    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:23:20.806317 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:23:20.806275    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:23:20.904614 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:23:20.904575    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:23:27.896640 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:23:27.896598    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:23:27.995720 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:23:27.995666    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:23:47.449611 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:23:47.449521    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:23:48.411098 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:23:48.411026    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:24:08.002269 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:08.002220    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:24:08.182771 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:08.182733    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:24:09.408855 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:09.408809    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:24:09.470758 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:09.470720    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:24:17.739717 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:17.739678    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9"]
Jul 22 03:24:17.740147 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:17.739956    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9" podUID="ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba" containerName="maas-api" containerID="cri-o://077b3a79f6d1765be0f2140f2e13b54f72c5fd72ea9417e5d5870fd8a233e8e8" gracePeriod=30
Jul 22 03:24:17.775974 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:17.775941    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:24:17.995053 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:17.995026    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9"
Jul 22 03:24:18.156303 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:18.156231    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba-maas-api-tls\") pod \"ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba\" (UID: \"ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba\") "
Jul 22 03:24:18.156492 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:18.156358    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba-openshift-service-ca\") pod \"ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba\" (UID: \"ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba\") "
Jul 22 03:24:18.156492 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:18.156411    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmm6x\" (UniqueName: \"kubernetes.io/projected/ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba-kube-api-access-cmm6x\") pod \"ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba\" (UID: \"ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba\") "
Jul 22 03:24:18.156732 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:18.156705    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba" (UID: "ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:24:18.158621 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:18.158596    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba" (UID: "ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:24:18.158734 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:18.158712    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba-kube-api-access-cmm6x" (OuterVolumeSpecName: "kube-api-access-cmm6x") pod "ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba" (UID: "ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba"). InnerVolumeSpecName "kube-api-access-cmm6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:24:18.257370 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:18.257235    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba-maas-api-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:24:18.257370 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:18.257304    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba-openshift-service-ca\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:24:18.257370 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:18.257314    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmm6x\" (UniqueName: \"kubernetes.io/projected/ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba-kube-api-access-cmm6x\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:24:18.421155 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:18.421117    2577 generic.go:356] "Generic (PLEG): container finished" podID="ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba" containerID="077b3a79f6d1765be0f2140f2e13b54f72c5fd72ea9417e5d5870fd8a233e8e8" exitCode=0
Jul 22 03:24:18.421155 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:18.421157    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9"
Jul 22 03:24:18.421442 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:18.421201    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9" event={"ID":"ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba","Type":"ContainerDied","Data":"077b3a79f6d1765be0f2140f2e13b54f72c5fd72ea9417e5d5870fd8a233e8e8"}
Jul 22 03:24:18.421442 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:18.421289    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9" event={"ID":"ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba","Type":"ContainerDied","Data":"8c57af011d724334396ab5602ff41b7c9f95572271db1cb7b6f734039416e0d4"}
Jul 22 03:24:18.421442 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:18.421319    2577 scope.go:117] "RemoveContainer" containerID="077b3a79f6d1765be0f2140f2e13b54f72c5fd72ea9417e5d5870fd8a233e8e8"
Jul 22 03:24:18.430368 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:18.430346    2577 scope.go:117] "RemoveContainer" containerID="077b3a79f6d1765be0f2140f2e13b54f72c5fd72ea9417e5d5870fd8a233e8e8"
Jul 22 03:24:18.430658 ip-10-0-143-160 kubenswrapper[2577]: E0722 03:24:18.430637    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"077b3a79f6d1765be0f2140f2e13b54f72c5fd72ea9417e5d5870fd8a233e8e8\": container with ID starting with 077b3a79f6d1765be0f2140f2e13b54f72c5fd72ea9417e5d5870fd8a233e8e8 not found: ID does not exist" containerID="077b3a79f6d1765be0f2140f2e13b54f72c5fd72ea9417e5d5870fd8a233e8e8"
Jul 22 03:24:18.430700 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:18.430667    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"077b3a79f6d1765be0f2140f2e13b54f72c5fd72ea9417e5d5870fd8a233e8e8"} err="failed to get container status \"077b3a79f6d1765be0f2140f2e13b54f72c5fd72ea9417e5d5870fd8a233e8e8\": rpc error: code = NotFound desc = could not find container \"077b3a79f6d1765be0f2140f2e13b54f72c5fd72ea9417e5d5870fd8a233e8e8\": container with ID starting with 077b3a79f6d1765be0f2140f2e13b54f72c5fd72ea9417e5d5870fd8a233e8e8 not found: ID does not exist"
Jul 22 03:24:18.444182 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:18.444149    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9"]
Jul 22 03:24:18.447890 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:18.447864    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-72501c-6dc8749bc6-79nq9"]
Jul 22 03:24:19.757563 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:19.757530    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba" path="/var/lib/kubelet/pods/ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba/volumes"
Jul 22 03:24:22.366031 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:22.365993    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:24:22.772659 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:22.772625    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:24:29.170075 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:29.170040    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:24:29.240245 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:29.240167    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:24:29.453603 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:29.453508    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:24:29.675318 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:29.675273    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:24:30.717956 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:30.717925    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:24:30.822744 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:30.822705    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:24:40.346371 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:40.346333    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t"]
Jul 22 03:24:40.346985 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:40.346569    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t" podUID="5aa90b0b-ce88-48c3-8944-4e0121a61c5e" containerName="maas-api" containerID="cri-o://5f2be1bb478e436a49c9c8f2d31268f4ef86a0e547b0e9271dc4df2caba40c50" gracePeriod=30
Jul 22 03:24:40.381511 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:40.381444    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:24:40.522942 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:40.522915    2577 generic.go:356] "Generic (PLEG): container finished" podID="5aa90b0b-ce88-48c3-8944-4e0121a61c5e" containerID="5f2be1bb478e436a49c9c8f2d31268f4ef86a0e547b0e9271dc4df2caba40c50" exitCode=0
Jul 22 03:24:40.523083 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:40.522983    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t" event={"ID":"5aa90b0b-ce88-48c3-8944-4e0121a61c5e","Type":"ContainerDied","Data":"5f2be1bb478e436a49c9c8f2d31268f4ef86a0e547b0e9271dc4df2caba40c50"}
Jul 22 03:24:40.596110 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:40.596085    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t"
Jul 22 03:24:40.650211 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:40.650127    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jn29b\" (UniqueName: \"kubernetes.io/projected/5aa90b0b-ce88-48c3-8944-4e0121a61c5e-kube-api-access-jn29b\") pod \"5aa90b0b-ce88-48c3-8944-4e0121a61c5e\" (UID: \"5aa90b0b-ce88-48c3-8944-4e0121a61c5e\") "
Jul 22 03:24:40.650211 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:40.650220    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5aa90b0b-ce88-48c3-8944-4e0121a61c5e-openshift-service-ca\") pod \"5aa90b0b-ce88-48c3-8944-4e0121a61c5e\" (UID: \"5aa90b0b-ce88-48c3-8944-4e0121a61c5e\") "
Jul 22 03:24:40.650473 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:40.650317    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5aa90b0b-ce88-48c3-8944-4e0121a61c5e-maas-api-tls\") pod \"5aa90b0b-ce88-48c3-8944-4e0121a61c5e\" (UID: \"5aa90b0b-ce88-48c3-8944-4e0121a61c5e\") "
Jul 22 03:24:40.650538 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:40.650518    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aa90b0b-ce88-48c3-8944-4e0121a61c5e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5aa90b0b-ce88-48c3-8944-4e0121a61c5e" (UID: "5aa90b0b-ce88-48c3-8944-4e0121a61c5e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:24:40.652484 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:40.652459    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aa90b0b-ce88-48c3-8944-4e0121a61c5e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5aa90b0b-ce88-48c3-8944-4e0121a61c5e" (UID: "5aa90b0b-ce88-48c3-8944-4e0121a61c5e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:24:40.652484 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:40.652465    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aa90b0b-ce88-48c3-8944-4e0121a61c5e-kube-api-access-jn29b" (OuterVolumeSpecName: "kube-api-access-jn29b") pod "5aa90b0b-ce88-48c3-8944-4e0121a61c5e" (UID: "5aa90b0b-ce88-48c3-8944-4e0121a61c5e"). InnerVolumeSpecName "kube-api-access-jn29b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:24:40.751147 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:40.751107    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5aa90b0b-ce88-48c3-8944-4e0121a61c5e-maas-api-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:24:40.751147 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:40.751142    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jn29b\" (UniqueName: \"kubernetes.io/projected/5aa90b0b-ce88-48c3-8944-4e0121a61c5e-kube-api-access-jn29b\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:24:40.751147 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:40.751152    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5aa90b0b-ce88-48c3-8944-4e0121a61c5e-openshift-service-ca\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Jul 22 03:24:41.529065 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:41.529029    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t" event={"ID":"5aa90b0b-ce88-48c3-8944-4e0121a61c5e","Type":"ContainerDied","Data":"b819f03034e37f299ee8ca32541dcd4ba4c9b6d8440ea53e0b63c1c8320cef98"}
Jul 22 03:24:41.529065 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:41.529061    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t"
Jul 22 03:24:41.529608 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:41.529095    2577 scope.go:117] "RemoveContainer" containerID="5f2be1bb478e436a49c9c8f2d31268f4ef86a0e547b0e9271dc4df2caba40c50"
Jul 22 03:24:41.552006 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:41.551974    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t"]
Jul 22 03:24:41.555342 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:41.555319    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e9ef33-77cc46d4bd-j6p9t"]
Jul 22 03:24:41.757460 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:41.757428    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5aa90b0b-ce88-48c3-8944-4e0121a61c5e" path="/var/lib/kubelet/pods/5aa90b0b-ce88-48c3-8944-4e0121a61c5e/volumes"
Jul 22 03:24:44.882561 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:44.882520    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:24:45.314862 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:45.314824    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:24:51.785824 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:51.785775    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:24:51.880080 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:51.880040    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:24:52.060936 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:52.060849    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:24:52.299577 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:52.299523    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:24:58.466784 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:58.466746    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-744f66f85b-kvjz8_3f0c15c1-c901-4cb5-9216-409d882032c5/manager/0.log"
Jul 22 03:24:59.073894 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:59.073867    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk_3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e/copy-manifests/0.log"
Jul 22 03:24:59.092325 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:59.092297    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk_3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e/manager/0.log"
Jul 22 03:24:59.445321 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:59.445215    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-566f76d668-rrwnr_b1509f41-e33b-4c20-b7f1-9e38ad1a14b7/maas-api/0.log"
Jul 22 03:24:59.781848 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:24:59.781820    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-pkkkf_3e0bd774-2db3-45bc-bac8-11e8782dc1d8/postgres/0.log"
Jul 22 03:25:02.433624 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:02.433591    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hb57g_c5e7361b-aa83-4fd4-87a8-c23098be0392/discovery/0.log"
Jul 22 03:25:02.907368 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:02.907336    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-4sf9b_421f17b9-33b6-4d58-82ce-ba029b3d94b6/payload-pre-processing/0.log"
Jul 22 03:25:03.031554 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:03.031455    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-4qnmv_f66920e1-bdd0-4168-85ed-d3744af1fb5f/payload-processing/0.log"
Jul 22 03:25:03.495873 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:03.495845    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-trs6c_2192276f-6bb2-4292-8374-fe91f2d3e551/main/0.log"
Jul 22 03:25:03.720802 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:03.720763    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-skh4m_d126cd5b-bfde-426e-86d9-82884a7dfc53/main/0.log"
Jul 22 03:25:03.951740 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:03.951652    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-v8s4h_a582d01b-8d7d-4017-8857-0397f6e96d37/main/0.log"
Jul 22 03:25:09.222858 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:09.222823    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:25:09.301026 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:09.300990    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log" limit=1024
Jul 22 03:25:12.409056 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:12.408978    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cjz5v_58f296ac-da6c-473e-8c58-49fa164804f5/global-pull-secret-syncer/0.log"
Jul 22 03:25:12.570539 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:12.570507    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7mqzz_f97aea05-b7fe-4242-b768-6daf68120ccd/konnectivity-agent/0.log"
Jul 22 03:25:12.736345 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:12.736237    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-160.ec2.internal_760279d9ea477286e4f5ad9a50c57ba5/haproxy/0.log"
Jul 22 03:25:20.999547 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:20.999510    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-fjcsj_22f72727-dcff-475b-826d-200a3890b33e/kube-state-metrics/0.log"
Jul 22 03:25:21.015750 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:21.015719    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-fjcsj_22f72727-dcff-475b-826d-200a3890b33e/kube-rbac-proxy-main/0.log"
Jul 22 03:25:21.037480 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:21.037453    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-fjcsj_22f72727-dcff-475b-826d-200a3890b33e/kube-rbac-proxy-self/0.log"
Jul 22 03:25:21.220713 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:21.220620    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n529t_c2f05d08-dad3-42e1-a2a1-c1ab639992f0/node-exporter/0.log"
Jul 22 03:25:21.240749 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:21.240723    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n529t_c2f05d08-dad3-42e1-a2a1-c1ab639992f0/kube-rbac-proxy/0.log"
Jul 22 03:25:21.261320 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:21.261291    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n529t_c2f05d08-dad3-42e1-a2a1-c1ab639992f0/init-textfile/0.log"
Jul 22 03:25:21.383769 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:21.383736    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-gz495_93bf60cb-40d7-48f9-a3dd-3044119c410f/kube-rbac-proxy-main/0.log"
Jul 22 03:25:21.407485 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:21.407457    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-gz495_93bf60cb-40d7-48f9-a3dd-3044119c410f/kube-rbac-proxy-self/0.log"
Jul 22 03:25:21.437457 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:21.437432    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-gz495_93bf60cb-40d7-48f9-a3dd-3044119c410f/openshift-state-metrics/0.log"
Jul 22 03:25:21.472197 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:21.472106    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c2059c5f-6fc1-48ca-adda-b09314ac92bd/prometheus/0.log"
Jul 22 03:25:21.498422 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:21.498394    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c2059c5f-6fc1-48ca-adda-b09314ac92bd/config-reloader/0.log"
Jul 22 03:25:21.520162 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:21.520133    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c2059c5f-6fc1-48ca-adda-b09314ac92bd/thanos-sidecar/0.log"
Jul 22 03:25:21.541565 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:21.541536    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c2059c5f-6fc1-48ca-adda-b09314ac92bd/kube-rbac-proxy-web/0.log"
Jul 22 03:25:21.563165 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:21.563137    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c2059c5f-6fc1-48ca-adda-b09314ac92bd/kube-rbac-proxy/0.log"
Jul 22 03:25:21.585110 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:21.585086    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c2059c5f-6fc1-48ca-adda-b09314ac92bd/kube-rbac-proxy-thanos/0.log"
Jul 22 03:25:21.607726 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:21.607694    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c2059c5f-6fc1-48ca-adda-b09314ac92bd/init-config-reloader/0.log"
Jul 22 03:25:23.385742 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.385702    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gzxjk/perf-node-gather-daemonset-ps6rm"]
Jul 22 03:25:23.386135 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.386047    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aa90b0b-ce88-48c3-8944-4e0121a61c5e" containerName="maas-api"
Jul 22 03:25:23.386135 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.386058    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aa90b0b-ce88-48c3-8944-4e0121a61c5e" containerName="maas-api"
Jul 22 03:25:23.386135 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.386072    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba" containerName="maas-api"
Jul 22 03:25:23.386135 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.386078    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba" containerName="maas-api"
Jul 22 03:25:23.386317 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.386141    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5aa90b0b-ce88-48c3-8944-4e0121a61c5e" containerName="maas-api"
Jul 22 03:25:23.386317 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.386153    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba9cb7e6-9c0f-49bc-85c2-673cc9af33ba" containerName="maas-api"
Jul 22 03:25:23.390672 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.390649    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-ps6rm"
Jul 22 03:25:23.395220 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.395195    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gzxjk\"/\"kube-root-ca.crt\""
Jul 22 03:25:23.395332 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.395236    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gzxjk\"/\"openshift-service-ca.crt\""
Jul 22 03:25:23.395425 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.395400    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gzxjk\"/\"default-dockercfg-k4hhd\""
Jul 22 03:25:23.402109 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.402087    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gzxjk/perf-node-gather-daemonset-ps6rm"]
Jul 22 03:25:23.444281 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.444215    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2eed7884-8135-48d4-9e51-ceaaa2d1d85a-proc\") pod \"perf-node-gather-daemonset-ps6rm\" (UID: \"2eed7884-8135-48d4-9e51-ceaaa2d1d85a\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-ps6rm"
Jul 22 03:25:23.444450 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.444332    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2eed7884-8135-48d4-9e51-ceaaa2d1d85a-lib-modules\") pod \"perf-node-gather-daemonset-ps6rm\" (UID: \"2eed7884-8135-48d4-9e51-ceaaa2d1d85a\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-ps6rm"
Jul 22 03:25:23.444450 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.444364    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vvv6\" (UniqueName: \"kubernetes.io/projected/2eed7884-8135-48d4-9e51-ceaaa2d1d85a-kube-api-access-2vvv6\") pod \"perf-node-gather-daemonset-ps6rm\" (UID: \"2eed7884-8135-48d4-9e51-ceaaa2d1d85a\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-ps6rm"
Jul 22 03:25:23.444450 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.444391    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2eed7884-8135-48d4-9e51-ceaaa2d1d85a-sys\") pod \"perf-node-gather-daemonset-ps6rm\" (UID: \"2eed7884-8135-48d4-9e51-ceaaa2d1d85a\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-ps6rm"
Jul 22 03:25:23.444555 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.444448    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2eed7884-8135-48d4-9e51-ceaaa2d1d85a-podres\") pod \"perf-node-gather-daemonset-ps6rm\" (UID: \"2eed7884-8135-48d4-9e51-ceaaa2d1d85a\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-ps6rm"
Jul 22 03:25:23.545699 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.545660    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2eed7884-8135-48d4-9e51-ceaaa2d1d85a-proc\") pod \"perf-node-gather-daemonset-ps6rm\" (UID: \"2eed7884-8135-48d4-9e51-ceaaa2d1d85a\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-ps6rm"
Jul 22 03:25:23.545914 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.545726    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2eed7884-8135-48d4-9e51-ceaaa2d1d85a-lib-modules\") pod \"perf-node-gather-daemonset-ps6rm\" (UID: \"2eed7884-8135-48d4-9e51-ceaaa2d1d85a\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-ps6rm"
Jul 22 03:25:23.545914 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.545748    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vvv6\" (UniqueName: \"kubernetes.io/projected/2eed7884-8135-48d4-9e51-ceaaa2d1d85a-kube-api-access-2vvv6\") pod \"perf-node-gather-daemonset-ps6rm\" (UID: \"2eed7884-8135-48d4-9e51-ceaaa2d1d85a\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-ps6rm"
Jul 22 03:25:23.545914 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.545772    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2eed7884-8135-48d4-9e51-ceaaa2d1d85a-sys\") pod \"perf-node-gather-daemonset-ps6rm\" (UID: \"2eed7884-8135-48d4-9e51-ceaaa2d1d85a\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-ps6rm"
Jul 22 03:25:23.545914 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.545804    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2eed7884-8135-48d4-9e51-ceaaa2d1d85a-proc\") pod \"perf-node-gather-daemonset-ps6rm\" (UID: \"2eed7884-8135-48d4-9e51-ceaaa2d1d85a\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-ps6rm"
Jul 22 03:25:23.545914 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.545796    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2eed7884-8135-48d4-9e51-ceaaa2d1d85a-podres\") pod \"perf-node-gather-daemonset-ps6rm\" (UID: \"2eed7884-8135-48d4-9e51-ceaaa2d1d85a\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-ps6rm"
Jul 22 03:25:23.545914 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.545874    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2eed7884-8135-48d4-9e51-ceaaa2d1d85a-sys\") pod \"perf-node-gather-daemonset-ps6rm\" (UID: \"2eed7884-8135-48d4-9e51-ceaaa2d1d85a\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-ps6rm"
Jul 22 03:25:23.545914 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.545885    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2eed7884-8135-48d4-9e51-ceaaa2d1d85a-podres\") pod \"perf-node-gather-daemonset-ps6rm\" (UID: \"2eed7884-8135-48d4-9e51-ceaaa2d1d85a\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-ps6rm"
Jul 22 03:25:23.546173 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.545953    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2eed7884-8135-48d4-9e51-ceaaa2d1d85a-lib-modules\") pod \"perf-node-gather-daemonset-ps6rm\" (UID: \"2eed7884-8135-48d4-9e51-ceaaa2d1d85a\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-ps6rm"
Jul 22 03:25:23.555400 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.555377    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vvv6\" (UniqueName: \"kubernetes.io/projected/2eed7884-8135-48d4-9e51-ceaaa2d1d85a-kube-api-access-2vvv6\") pod \"perf-node-gather-daemonset-ps6rm\" (UID: \"2eed7884-8135-48d4-9e51-ceaaa2d1d85a\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-ps6rm"
Jul 22 03:25:23.701124 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.701029    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-ps6rm"
Jul 22 03:25:23.850402 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:23.850376    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gzxjk/perf-node-gather-daemonset-ps6rm"]
Jul 22 03:25:23.852639 ip-10-0-143-160 kubenswrapper[2577]: W0722 03:25:23.852601    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2eed7884_8135_48d4_9e51_ceaaa2d1d85a.slice/crio-e8fa20467bb18717ab7dc865f2d006661b382a2b5c50ea8c31b831e5d0d4750f WatchSource:0}: Error finding container e8fa20467bb18717ab7dc865f2d006661b382a2b5c50ea8c31b831e5d0d4750f: Status 404 returned error can't find the container with id e8fa20467bb18717ab7dc865f2d006661b382a2b5c50ea8c31b831e5d0d4750f
Jul 22 03:25:24.718476 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:24.718441    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-ps6rm" event={"ID":"2eed7884-8135-48d4-9e51-ceaaa2d1d85a","Type":"ContainerStarted","Data":"19a3e0b7a2d4f0c34a00287050d5c14ab01d31f012ee37ac98fae49c25849ff4"}
Jul 22 03:25:24.718888 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:24.718495    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-ps6rm" event={"ID":"2eed7884-8135-48d4-9e51-ceaaa2d1d85a","Type":"ContainerStarted","Data":"e8fa20467bb18717ab7dc865f2d006661b382a2b5c50ea8c31b831e5d0d4750f"}
Jul 22 03:25:24.718888 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:24.718525    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-ps6rm"
Jul 22 03:25:24.738881 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:24.738828    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-ps6rm" podStartSLOduration=1.738810216 podStartE2EDuration="1.738810216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:25:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:25:24.738680798 +0000 UTC m=+2885.447109397" watchObservedRunningTime="2026-07-22 03:25:24.738810216 +0000 UTC m=+2885.447238816"
Jul 22 03:25:26.392273 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:26.392226    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rzqqh_6dd99316-c6d8-40d8-ba60-e1e01b9b8622/dns/0.log"
Jul 22 03:25:26.427280 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:26.427243    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rzqqh_6dd99316-c6d8-40d8-ba60-e1e01b9b8622/kube-rbac-proxy/0.log"
Jul 22 03:25:26.582680 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:26.582651    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m59jm_f451c68d-e137-4c8e-854b-441da8def534/dns-node-resolver/0.log"
Jul 22 03:25:27.217712 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:27.217675    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2fr65_3fb4dd6b-d6d7-409a-a6a3-a2f11d2a3375/node-ca/0.log"
Jul 22 03:25:28.629107 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:28.629077    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hb57g_c5e7361b-aa83-4fd4-87a8-c23098be0392/discovery/0.log"
Jul 22 03:25:28.773420 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:28.773385    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-4sf9b_421f17b9-33b6-4d58-82ce-ba029b3d94b6/payload-pre-processing/0.log"
Jul 22 03:25:28.874938 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:28.874903    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-4qnmv_f66920e1-bdd0-4168-85ed-d3744af1fb5f/payload-processing/0.log"
Jul 22 03:25:29.710166 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:29.710130    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5n9x9_72707ca0-ba6e-415d-beb5-ba8599c6ddc8/serve-healthcheck-canary/0.log"
Jul 22 03:25:30.323559 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:30.323528    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dxwdl_344515fb-2b59-406b-98a1-da9975ccea10/kube-rbac-proxy/0.log"
Jul 22 03:25:30.348173 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:30.348140    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dxwdl_344515fb-2b59-406b-98a1-da9975ccea10/exporter/0.log"
Jul 22 03:25:30.371697 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:30.371660    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dxwdl_344515fb-2b59-406b-98a1-da9975ccea10/extractor/0.log"
Jul 22 03:25:30.733331 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:30.733228    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-ps6rm"
Jul 22 03:25:33.406628 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:33.406540    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-744f66f85b-kvjz8_3f0c15c1-c901-4cb5-9216-409d882032c5/manager/0.log"
Jul 22 03:25:33.883834 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:33.883792    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk_3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e/manager/0.log"
Jul 22 03:25:33.900956 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:33.900926    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b96c6dbc5-wbzkk_3c1ec41b-c381-4cfc-b228-a8d6cb3d9a5e/copy-manifests/0.log"
Jul 22 03:25:34.574733 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:34.574701    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hb57g_c5e7361b-aa83-4fd4-87a8-c23098be0392/discovery/0.log"
Jul 22 03:25:34.678570 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:34.678529    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-4sf9b_421f17b9-33b6-4d58-82ce-ba029b3d94b6/payload-pre-processing/0.log"
Jul 22 03:25:34.713840 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:34.713751    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-4qnmv_f66920e1-bdd0-4168-85ed-d3744af1fb5f/payload-processing/0.log"
Jul 22 03:25:35.221488 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:35.221455    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d897679c6-g5gvd_58051ede-7ae7-432b-b661-2a64f3defb8c/manager/0.log"
Jul 22 03:25:36.214919 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:36.214886    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hb57g_c5e7361b-aa83-4fd4-87a8-c23098be0392/discovery/0.log"
Jul 22 03:25:36.333647 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:36.333602    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-4sf9b_421f17b9-33b6-4d58-82ce-ba029b3d94b6/payload-pre-processing/0.log"
Jul 22 03:25:36.368093 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:36.368056    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-4qnmv_f66920e1-bdd0-4168-85ed-d3744af1fb5f/payload-processing/0.log"
Jul 22 03:25:40.420236 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:40.420206    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-6cmnw_9ab2392f-bdf8-41ec-b9e9-373cb374ea1f/migrator/0.log"
Jul 22 03:25:40.442650 ip-10-0-143-160 kubenswrapper[2577]: I0722 03:25:40.442591    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-6cmnw_9ab2392f-bdf8-41ec-b9e9-373cb374ea1f/graceful-termination/0.log"