Jul 22 11:49:47.487891 ip-10-0-132-166 systemd[1]: Starting Kubernetes Kubelet...
Jul 22 11:49:48.035378 ip-10-0-132-166 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 11:49:48.035378 ip-10-0-132-166 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 22 11:49:48.035378 ip-10-0-132-166 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 11:49:48.035378 ip-10-0-132-166 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 22 11:49:48.035378 ip-10-0-132-166 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 11:49:48.035378 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.992992    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 22 11:49:48.035378 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996815    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 11:49:48.035378 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996827    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 11:49:48.035378 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996831    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 11:49:48.035378 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996834    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 11:49:48.035378 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996837    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 11:49:48.035378 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996840    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 11:49:48.035378 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996843    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 11:49:48.035378 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996847    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 11:49:48.043162 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996850    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 11:49:48.043162 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996852    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 11:49:48.043162 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996855    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 11:49:48.043162 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996858    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 11:49:48.043162 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996861    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 11:49:48.043162 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996864    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 11:49:48.043162 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996867    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 11:49:48.043162 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996869    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 11:49:48.043162 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996872    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 11:49:48.043162 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996875    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 11:49:48.043162 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996878    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 11:49:48.043162 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996882    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 11:49:48.043162 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996884    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 11:49:48.043162 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996888    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 11:49:48.043162 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996890    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 11:49:48.043162 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996893    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 11:49:48.043162 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996896    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 11:49:48.043162 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996899    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 11:49:48.043162 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996901    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 11:49:48.043162 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996904    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 11:49:48.044029 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996906    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 11:49:48.044029 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996910    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 11:49:48.044029 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996914    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 11:49:48.044029 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996917    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 11:49:48.044029 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996920    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 11:49:48.044029 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996922    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 11:49:48.044029 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996925    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 11:49:48.044029 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996927    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 11:49:48.044029 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996930    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 11:49:48.044029 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996932    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 11:49:48.044029 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996936    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 11:49:48.044029 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996940    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 11:49:48.044029 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996943    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 11:49:48.044029 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996946    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 11:49:48.044029 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996949    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 11:49:48.044029 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996951    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 11:49:48.044029 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996955    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 11:49:48.044029 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996959    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 11:49:48.044029 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996961    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 11:49:48.044928 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996964    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 11:49:48.044928 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996967    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 11:49:48.044928 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996970    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 11:49:48.044928 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996974    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 11:49:48.044928 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996977    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 11:49:48.044928 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996980    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 11:49:48.044928 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996984    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 11:49:48.044928 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996986    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 11:49:48.044928 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996989    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 11:49:48.044928 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996992    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 11:49:48.044928 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996995    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 11:49:48.044928 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.996998    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 11:49:48.044928 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997001    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 11:49:48.044928 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997003    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 11:49:48.044928 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997006    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 11:49:48.044928 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997008    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 11:49:48.044928 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997011    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 11:49:48.044928 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997013    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 11:49:48.044928 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997016    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 11:49:48.044928 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997019    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 11:49:48.046050 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997022    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 11:49:48.046050 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997024    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 11:49:48.046050 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997030    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 11:49:48.046050 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997033    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 11:49:48.046050 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997036    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 11:49:48.046050 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997038    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 11:49:48.046050 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997041    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 11:49:48.046050 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997043    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 11:49:48.046050 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997046    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 11:49:48.046050 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997049    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 11:49:48.046050 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997051    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 11:49:48.046050 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997054    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 11:49:48.046050 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997057    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 11:49:48.046050 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997060    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 11:49:48.046050 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997063    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 11:49:48.046050 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997066    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 11:49:48.046050 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997068    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 11:49:48.046050 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997071    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 11:49:48.046050 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997074    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 11:49:48.046935 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997077    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 11:49:48.046935 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997080    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 11:49:48.046935 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997082    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 11:49:48.046935 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997085    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 11:49:48.046935 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997087    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 11:49:48.046935 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997090    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 11:49:48.046935 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997092    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 11:49:48.046935 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997095    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 11:49:48.046935 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997098    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 11:49:48.046935 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997100    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 11:49:48.046935 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997103    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 11:49:48.046935 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997107    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 11:49:48.046935 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997109    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 11:49:48.046935 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997816    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 11:49:48.046935 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997823    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 11:49:48.046935 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997826    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 11:49:48.046935 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997830    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 11:49:48.046935 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997832    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 11:49:48.046935 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997835    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 11:49:48.046935 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997838    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 11:49:48.047834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997841    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 11:49:48.047834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997843    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 11:49:48.047834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997846    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 11:49:48.047834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997849    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 11:49:48.047834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997853    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 11:49:48.047834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997857    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 11:49:48.047834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997859    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 11:49:48.047834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997862    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 11:49:48.047834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997865    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 11:49:48.047834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997868    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 11:49:48.047834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997871    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 11:49:48.047834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997873    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 11:49:48.047834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997876    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 11:49:48.047834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997879    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 11:49:48.047834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997881    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 11:49:48.047834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997884    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 11:49:48.047834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997886    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 11:49:48.047834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997889    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 11:49:48.047834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997891    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 11:49:48.048951 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997894    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 11:49:48.048951 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997896    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 11:49:48.048951 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997901    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 11:49:48.048951 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997905    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 11:49:48.048951 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997908    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 11:49:48.048951 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997911    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 11:49:48.048951 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997914    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 11:49:48.048951 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997917    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 11:49:48.048951 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997919    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 11:49:48.048951 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997922    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 11:49:48.048951 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997925    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 11:49:48.048951 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997927    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 11:49:48.048951 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997930    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 11:49:48.048951 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997933    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 11:49:48.048951 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997935    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 11:49:48.048951 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997938    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 11:49:48.048951 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997940    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 11:49:48.048951 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997943    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 11:49:48.048951 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997945    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 11:49:48.049834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997948    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 11:49:48.049834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997951    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 11:49:48.049834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997955    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 11:49:48.049834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997957    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 11:49:48.049834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997960    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 11:49:48.049834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997963    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 11:49:48.049834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997966    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 11:49:48.049834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997969    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 11:49:48.049834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997971    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 11:49:48.049834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997974    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 11:49:48.049834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997977    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 11:49:48.049834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997980    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 11:49:48.049834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997984    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 11:49:48.049834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997987    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 11:49:48.049834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997990    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 11:49:48.049834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997992    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 11:49:48.049834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997995    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 11:49:48.049834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.997998    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 11:49:48.049834 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998000    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 11:49:48.050922 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998006    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 11:49:48.050922 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998015    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 11:49:48.050922 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998018    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 11:49:48.050922 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998021    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 11:49:48.050922 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998023    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 11:49:48.050922 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998026    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 11:49:48.050922 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998028    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 11:49:48.050922 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998031    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 11:49:48.050922 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998034    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 11:49:48.050922 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998036    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 11:49:48.050922 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998039    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 11:49:48.050922 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998041    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 11:49:48.050922 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998044    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 11:49:48.050922 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998046    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 11:49:48.050922 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998049    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 11:49:48.050922 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998051    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 11:49:48.050922 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998054    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 11:49:48.050922 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998056    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 11:49:48.050922 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998059    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 11:49:48.050922 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998061    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 11:49:48.051802 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998064    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 11:49:48.051802 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998067    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 11:49:48.051802 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998069    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 11:49:48.051802 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998072    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 11:49:48.051802 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998074    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 11:49:48.051802 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998077    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 11:49:48.051802 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998080    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 11:49:48.051802 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998082    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 11:49:48.051802 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998084    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 11:49:48.051802 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998087    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 11:49:48.051802 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998089    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 11:49:48.051802 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998092    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 11:49:48.051802 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998095    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 11:49:48.051802 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998103    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 11:49:48.051802 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998106    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 11:49:48.051802 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998502    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 11:49:48.051802 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998513    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 11:49:48.051802 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998516    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 11:49:48.051802 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998519    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 11:49:48.051802 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998522    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 11:49:48.052909 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998525    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 11:49:48.052909 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998527    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 11:49:48.052909 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998530    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 11:49:48.052909 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998533    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 11:49:48.052909 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998535    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 11:49:48.052909 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998538    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 11:49:48.052909 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998541    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 11:49:48.052909 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998543    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 11:49:48.052909 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998546    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 11:49:48.052909 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998549    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 11:49:48.052909 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998552    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 11:49:48.052909 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998554    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 11:49:48.052909 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998557    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 11:49:48.052909 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998559    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 11:49:48.052909 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998562    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 11:49:48.052909 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998565    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 11:49:48.052909 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998568    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 11:49:48.052909 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998571    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 11:49:48.052909 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998573    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 11:49:48.052909 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998576    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 11:49:48.053785 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998579    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 11:49:48.053785 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998581    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 11:49:48.053785 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998584    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 11:49:48.053785 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998586    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 11:49:48.053785 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998589    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 11:49:48.053785 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998597    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 11:49:48.053785 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998600    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 11:49:48.053785 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998602    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 11:49:48.053785 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998605    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 11:49:48.053785 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998607    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 11:49:48.053785 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998612    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 11:49:48.053785 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998631    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 11:49:48.053785 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998635    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 11:49:48.053785 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998638    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 11:49:48.053785 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998641    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 11:49:48.053785 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998643    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 11:49:48.053785 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998646    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 11:49:48.053785 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998649    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 11:49:48.053785 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998651    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 11:49:48.053785 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998654    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 11:49:48.054905 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998657    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 11:49:48.054905 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998659    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 11:49:48.054905 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998662    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 11:49:48.054905 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998665    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 11:49:48.054905 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998668    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 11:49:48.054905 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998670    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 11:49:48.054905 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998673    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 11:49:48.054905 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998676    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 11:49:48.054905 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998678    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 11:49:48.054905 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998681    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 11:49:48.054905 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998683    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 11:49:48.054905 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998686    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 11:49:48.054905 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998689    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 11:49:48.054905 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998691    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 11:49:48.054905 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998694    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 11:49:48.054905 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998696    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 11:49:48.054905 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998699    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 11:49:48.054905 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998701    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 11:49:48.054905 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998709    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 11:49:48.054905 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998712    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 11:49:48.056008 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998715    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 11:49:48.056008 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998717    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 11:49:48.056008 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998720    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 11:49:48.056008 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998723    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 11:49:48.056008 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998726    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 11:49:48.056008 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998728    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 11:49:48.056008 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998731    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 11:49:48.056008 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998733    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 11:49:48.056008 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998739    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 11:49:48.056008 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998742    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 11:49:48.056008 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998745    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 11:49:48.056008 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998747    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 11:49:48.056008 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998750    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 11:49:48.056008 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998752    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 11:49:48.056008 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998755    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 11:49:48.056008 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998758    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 11:49:48.056008 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998761    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 11:49:48.056008 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998763    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 11:49:48.056008 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998766    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 11:49:48.056889 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998770    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 11:49:48.056889 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998773    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 11:49:48.056889 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998777    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 11:49:48.056889 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998780    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 11:49:48.056889 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998784    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 11:49:48.056889 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998787    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 11:49:48.056889 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998790    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 11:49:48.056889 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998793    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 11:49:48.056889 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998795    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 11:49:48.056889 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998798    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 11:49:48.056889 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998801    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 11:49:48.056889 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998803    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 11:49:48.056889 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998813    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 11:49:48.056889 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998816    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 11:49:48.056889 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.998818    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 11:49:48.056889 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.998894    2558 flags.go:64] FLAG: --address="0.0.0.0"
Jul 22 11:49:48.056889 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.998904    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 22 11:49:48.056889 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.998914    2558 flags.go:64] FLAG: --anonymous-auth="true"
Jul 22 11:49:48.056889 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.998921    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 22 11:49:48.056889 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.998925    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 22 11:49:48.057777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.998929    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 22 11:49:48.057777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.998935    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 22 11:49:48.057777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.998940    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 22 11:49:48.057777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.998943    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 22 11:49:48.057777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.998946    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 22 11:49:48.057777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.998949    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 22 11:49:48.057777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.998953    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 22 11:49:48.057777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.998955    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 22 11:49:48.057777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.998958    2558 flags.go:64] FLAG: --cgroup-root=""
Jul 22 11:49:48.057777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.998962    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 22 11:49:48.057777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.998965    2558 flags.go:64] FLAG: --client-ca-file=""
Jul 22 11:49:48.057777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.998967    2558 flags.go:64] FLAG: --cloud-provider="external"
Jul 22 11:49:48.057777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.998970    2558 flags.go:64] FLAG: --cluster-dns="[]"
Jul 22 11:49:48.057777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.998978    2558 flags.go:64] FLAG: --cluster-domain=""
Jul 22 11:49:48.057777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.998981    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 22 11:49:48.057777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.998986    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 22 11:49:48.057777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.998990    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 22 11:49:48.057777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.998993    2558 flags.go:64] FLAG: --container-log-max-files="5"
Jul 22 11:49:48.057777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.998997    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 22 11:49:48.057777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999000    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 22 11:49:48.057777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999004    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 22 11:49:48.057777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999007    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 22 11:49:48.057777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999010    2558 flags.go:64] FLAG: --contention-profiling="false"
Jul 22 11:49:48.057777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999013    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 22 11:49:48.058888 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999016    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 22 11:49:48.058888 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999025    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 22 11:49:48.058888 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999028    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 22 11:49:48.058888 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999032    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 22 11:49:48.058888 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999035    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 22 11:49:48.058888 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999039    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 22 11:49:48.058888 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999041    2558 flags.go:64] FLAG: --enable-load-reader="false"
Jul 22 11:49:48.058888 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999045    2558 flags.go:64] FLAG: --enable-server="true"
Jul 22 11:49:48.058888 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999047    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 22 11:49:48.058888 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999055    2558 flags.go:64] FLAG: --event-burst="100"
Jul 22 11:49:48.058888 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999058    2558 flags.go:64] FLAG: --event-qps="50"
Jul 22 11:49:48.058888 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999061    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 22 11:49:48.058888 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999065    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 22 11:49:48.058888 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999068    2558 flags.go:64] FLAG: --eviction-hard=""
Jul 22 11:49:48.058888 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999071    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 22 11:49:48.058888 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999075    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 22 11:49:48.058888 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999078    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 22 11:49:48.058888 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999081    2558 flags.go:64] FLAG: --eviction-soft=""
Jul 22 11:49:48.058888 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999084    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 22 11:49:48.058888 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999087    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 22 11:49:48.058888 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999089    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 22 11:49:48.058888 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999093    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 22 11:49:48.058888 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999096    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 22 11:49:48.058888 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999100    2558 flags.go:64] FLAG: --fail-swap-on="true"
Jul 22 11:49:48.058888 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999103    2558 flags.go:64] FLAG: --feature-gates=""
Jul 22 11:49:48.060025 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999107    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 22 11:49:48.060025 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999110    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 22 11:49:48.060025 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999113    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 22 11:49:48.060025 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999116    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 22 11:49:48.060025 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999119    2558 flags.go:64] FLAG: --healthz-port="10248"
Jul 22 11:49:48.060025 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999122    2558 flags.go:64] FLAG: --help="false"
Jul 22 11:49:48.060025 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999124    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-132-166.ec2.internal"
Jul 22 11:49:48.060025 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999127    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 22 11:49:48.060025 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999131    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 22 11:49:48.060025 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999139    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 22 11:49:48.060025 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999143    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 22 11:49:48.060025 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999146    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 22 11:49:48.060025 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999149    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 22 11:49:48.060025 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999152    2558 flags.go:64] FLAG: --image-service-endpoint=""
Jul 22 11:49:48.060025 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999155    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 22 11:49:48.060025 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999158    2558 flags.go:64] FLAG: --kube-api-burst="100"
Jul 22 11:49:48.060025 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999162    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 22 11:49:48.060025 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999165    2558 flags.go:64] FLAG: --kube-api-qps="50"
Jul 22 11:49:48.060025 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999168    2558 flags.go:64] FLAG: --kube-reserved=""
Jul 22 11:49:48.060025 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999171    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 22 11:49:48.060025 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999174    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 22 11:49:48.060025 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999177    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 22 11:49:48.060025 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999180    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 22 11:49:48.060025 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999183    2558 flags.go:64] FLAG: --lock-file=""
Jul 22 11:49:48.061165 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999186    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 22 11:49:48.061165 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999189    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 22 11:49:48.061165 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999191    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 22 11:49:48.061165 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999197    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 22 11:49:48.061165 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999199    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 22 11:49:48.061165 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999202    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 22 11:49:48.061165 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999209    2558 flags.go:64] FLAG: --logging-format="text"
Jul 22 11:49:48.061165 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999212    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 22 11:49:48.061165 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999215    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 22 11:49:48.061165 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999218    2558 flags.go:64] FLAG: --manifest-url=""
Jul 22 11:49:48.061165 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999220    2558 flags.go:64] FLAG: --manifest-url-header=""
Jul 22 11:49:48.061165 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999225    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 22 11:49:48.061165 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999228    2558 flags.go:64] FLAG: --max-open-files="1000000"
Jul 22 11:49:48.061165 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999233    2558 flags.go:64] FLAG: --max-pods="110"
Jul 22 11:49:48.061165 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999236    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 22 11:49:48.061165 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999239    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 22 11:49:48.061165 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999241    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 22 11:49:48.061165 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999244    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 22 11:49:48.061165 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999253    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 22 11:49:48.061165 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999256    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 22 11:49:48.061165 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999259    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 22 11:49:48.061165 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999272    2558 flags.go:64] FLAG: --node-status-max-images="50"
Jul 22 11:49:48.061165 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999275    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 22 11:49:48.061165 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999278    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 22 11:49:48.061165 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999282    2558 flags.go:64] FLAG: --pod-cidr=""
Jul 22 11:49:48.062256 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999285    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 22 11:49:48.062256 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999291    2558 flags.go:64] FLAG: --pod-manifest-path=""
Jul 22 11:49:48.062256 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999293    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 22 11:49:48.062256 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999297    2558 flags.go:64] FLAG: --pods-per-core="0"
Jul 22 11:49:48.062256 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999299    2558 flags.go:64] FLAG: --port="10250"
Jul 22 11:49:48.062256 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999302    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 22 11:49:48.062256 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999305    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b2e7df5707c6256d"
Jul 22 11:49:48.062256 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999308    2558 flags.go:64] FLAG: --qos-reserved=""
Jul 22 11:49:48.062256 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999311    2558 flags.go:64] FLAG: --read-only-port="10255"
Jul 22 11:49:48.062256 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999314    2558 flags.go:64] FLAG: --register-node="true"
Jul 22 11:49:48.062256 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999317    2558 flags.go:64] FLAG: --register-with-taints=""
Jul 22 11:49:48.062256 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999325    2558 flags.go:64] FLAG: --registry-burst="10"
Jul 22 11:49:48.062256 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999328    2558 flags.go:64] FLAG: --registry-qps="5"
Jul 22 11:49:48.062256 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999332    2558 flags.go:64] FLAG: --reserved-cpus=""
Jul 22 11:49:48.062256 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999335    2558 flags.go:64] FLAG: --reserved-memory=""
Jul 22 11:49:48.062256 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999338    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 22 11:49:48.062256 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999341    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 22 11:49:48.062256 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999344    2558 flags.go:64] FLAG: --rotate-certificates="false"
Jul 22 11:49:48.062256 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999347    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 22 11:49:48.062256 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999350    2558 flags.go:64] FLAG: --runonce="false"
Jul 22 11:49:48.062256 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999353    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 22 11:49:48.062256 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999356    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 22 11:49:48.062256 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999359    2558 flags.go:64] FLAG: --seccomp-default="false"
Jul 22 11:49:48.062256 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999362    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 22 11:49:48.062256 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999365    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 22 11:49:48.122629 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999368    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 22 11:49:48.122629 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999379    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 22 11:49:48.122629 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999382    2558 flags.go:64] FLAG: --storage-driver-password="root"
Jul 22 11:49:48.122629 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999385    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 22 11:49:48.122629 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999387    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 22 11:49:48.122629 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999390    2558 flags.go:64] FLAG: --storage-driver-user="root"
Jul 22 11:49:48.122629 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999393    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 22 11:49:48.122629 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999398    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 22 11:49:48.122629 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999401    2558 flags.go:64] FLAG: --system-cgroups=""
Jul 22 11:49:48.122629 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999404    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 22 11:49:48.122629 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999409    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 22 11:49:48.122629 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999412    2558 flags.go:64] FLAG: --tls-cert-file=""
Jul 22 11:49:48.122629 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999415    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 22 11:49:48.122629 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999422    2558 flags.go:64] FLAG: --tls-min-version=""
Jul 22 11:49:48.122629 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999425    2558 flags.go:64] FLAG: --tls-private-key-file=""
Jul 22 11:49:48.122629 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999427    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 22 11:49:48.122629 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999430    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 22 11:49:48.122629 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999433    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 22 11:49:48.122629 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999436    2558 flags.go:64] FLAG: --v="2"
Jul 22 11:49:48.122629 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999440    2558 flags.go:64] FLAG: --version="false"
Jul 22 11:49:48.122629 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999446    2558 flags.go:64] FLAG: --vmodule=""
Jul 22 11:49:48.122629 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999450    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 22 11:49:48.122629 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:47.999453    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 22 11:49:48.122629 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999590    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 11:49:48.122629 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999593    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 11:49:48.076261 ip-10-0-132-166 systemd[1]: Started Kubernetes Kubelet.
Jul 22 11:49:48.124016 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999597    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 11:49:48.124016 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999600    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 11:49:48.124016 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999603    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 11:49:48.124016 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999606    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 11:49:48.124016 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999609    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 11:49:48.124016 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999612    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 11:49:48.124016 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999628    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 11:49:48.124016 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999631    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 11:49:48.124016 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999634    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 11:49:48.124016 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999639    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 11:49:48.124016 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999642    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 11:49:48.124016 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999645    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 11:49:48.124016 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999648    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 11:49:48.124016 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999651    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 11:49:48.124016 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999655    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 11:49:48.124016 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999658    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 11:49:48.124016 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999662    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 11:49:48.124016 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999665    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 11:49:48.124016 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999669    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 11:49:48.131351 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999672    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 11:49:48.131351 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999674    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 11:49:48.131351 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999677    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 11:49:48.131351 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999680    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 11:49:48.131351 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999683    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 11:49:48.131351 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999685    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 11:49:48.131351 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999688    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 11:49:48.131351 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999691    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 11:49:48.131351 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999696    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 11:49:48.131351 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999699    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 11:49:48.131351 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999702    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 11:49:48.131351 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999705    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 11:49:48.131351 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999708    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 11:49:48.131351 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999711    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 11:49:48.131351 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999713    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 11:49:48.131351 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999716    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 11:49:48.131351 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999719    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 11:49:48.131351 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999722    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 11:49:48.131351 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999724    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 11:49:48.131351 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999727    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 11:49:48.132482 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999729    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 11:49:48.132482 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999732    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 11:49:48.132482 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999735    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 11:49:48.132482 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999738    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 11:49:48.132482 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999740    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 11:49:48.132482 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999743    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 11:49:48.132482 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999745    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 11:49:48.132482 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999749    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 11:49:48.132482 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999752    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 11:49:48.132482 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999755    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 11:49:48.132482 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999757    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 11:49:48.132482 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999760    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 11:49:48.132482 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999762    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 11:49:48.132482 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999765    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 11:49:48.132482 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999767    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 11:49:48.132482 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999770    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 11:49:48.132482 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999773    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 11:49:48.132482 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999775    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 11:49:48.132482 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999778    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 11:49:48.132482 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999781    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 11:49:48.133553 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999785    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 11:49:48.133553 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999788    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 11:49:48.133553 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999790    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 11:49:48.133553 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999793    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 11:49:48.133553 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999795    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 11:49:48.133553 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999798    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 11:49:48.133553 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999801    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 11:49:48.133553 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999803    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 11:49:48.133553 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999806    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 11:49:48.133553 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999808    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 11:49:48.133553 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999811    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 11:49:48.133553 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999814    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 11:49:48.133553 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999817    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 11:49:48.133553 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999819    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 11:49:48.133553 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999822    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 11:49:48.133553 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999824    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 11:49:48.133553 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999827    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 11:49:48.133553 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999830    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 11:49:48.133553 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999832    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 11:49:48.133553 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999836    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 11:49:48.134687 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999839    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 11:49:48.134687 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999842    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 11:49:48.134687 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999844    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 11:49:48.134687 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999847    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 11:49:48.134687 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999850    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 11:49:48.134687 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999852    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 11:49:48.134687 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999855    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 11:49:48.134687 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999857    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 11:49:48.134687 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999860    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 11:49:48.134687 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999863    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 11:49:48.134687 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999865    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 11:49:48.134687 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999868    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 11:49:48.134687 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999872    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 11:49:48.134687 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999875    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 11:49:48.134687 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999878    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 11:49:48.134687 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999880    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 11:49:48.134687 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999884    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 11:49:48.134687 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:47.999887    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 11:49:48.135528 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.000402    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 11:49:48.135528 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.009645    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 22 11:49:48.135528 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.009662    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 22 11:49:48.135528 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.010517    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 22 11:49:48.135528 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.010542    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 22 11:49:48.135528 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010765    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 11:49:48.135528 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010872    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 11:49:48.135528 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010876    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 11:49:48.135528 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010880    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 11:49:48.135528 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010884    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 11:49:48.135528 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010887    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 11:49:48.135528 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010890    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 11:49:48.135528 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010893    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 11:49:48.135528 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010896    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 11:49:48.135528 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010899    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 11:49:48.136374 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010902    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 11:49:48.136374 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010905    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 11:49:48.136374 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010911    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 11:49:48.136374 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010915    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 11:49:48.136374 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010919    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 11:49:48.136374 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010922    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 11:49:48.136374 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010925    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 11:49:48.136374 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010928    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 11:49:48.136374 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010931    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 11:49:48.136374 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010934    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 11:49:48.136374 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010937    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 11:49:48.136374 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010940    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 11:49:48.136374 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010942    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 11:49:48.136374 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010945    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 11:49:48.136374 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010948    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 11:49:48.136374 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010951    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 11:49:48.136374 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010953    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 11:49:48.136374 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010956    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 11:49:48.136374 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010959    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 11:49:48.136374 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010961    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 11:49:48.137428 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010964    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 11:49:48.137428 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010967    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 11:49:48.137428 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010976    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 11:49:48.137428 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010979    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 11:49:48.137428 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010982    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 11:49:48.137428 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010989    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 11:49:48.137428 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010992    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 11:49:48.137428 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010995    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 11:49:48.137428 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.010998    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 11:49:48.137428 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011002    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 11:49:48.137428 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011005    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 11:49:48.137428 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011008    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 11:49:48.137428 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011011    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 11:49:48.137428 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011014    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 11:49:48.137428 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011017    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 11:49:48.137428 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011020    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 11:49:48.137428 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011023    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 11:49:48.137428 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011026    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 11:49:48.137428 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011029    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 11:49:48.138508 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011032    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 11:49:48.138508 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011035    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 11:49:48.138508 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011038    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 11:49:48.138508 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011041    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 11:49:48.138508 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011044    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 11:49:48.138508 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011047    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 11:49:48.138508 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011049    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 11:49:48.138508 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011052    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 11:49:48.138508 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011055    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 11:49:48.138508 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011058    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 11:49:48.138508 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011060    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 11:49:48.138508 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011063    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 11:49:48.138508 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011065    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 11:49:48.138508 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011068    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 11:49:48.138508 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011071    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 11:49:48.138508 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011075    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 11:49:48.138508 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011079    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 11:49:48.138508 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011082    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 11:49:48.138508 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011086    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 11:49:48.139514 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011089    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 11:49:48.139514 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011091    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 11:49:48.139514 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011094    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 11:49:48.139514 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011096    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 11:49:48.139514 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011099    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 11:49:48.139514 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011101    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 11:49:48.139514 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011104    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 11:49:48.139514 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011106    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 11:49:48.139514 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011109    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 11:49:48.139514 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011112    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 11:49:48.139514 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011115    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 11:49:48.139514 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011121    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 11:49:48.139514 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011123    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 11:49:48.139514 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011126    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 11:49:48.139514 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011129    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 11:49:48.139514 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011132    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 11:49:48.139514 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011134    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 11:49:48.139514 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011137    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 11:49:48.139514 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011139    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 11:49:48.139514 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011142    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 11:49:48.140382 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011144    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 11:49:48.140382 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011147    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 11:49:48.140382 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011149    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 11:49:48.140382 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011152    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 11:49:48.140382 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011154    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 11:49:48.140382 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011157    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 11:49:48.140382 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011159    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 11:49:48.140382 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011162    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 11:49:48.140382 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011165    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 11:49:48.140382 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011168    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 11:49:48.140382 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011170    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 11:49:48.140382 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.011177    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 11:49:48.140382 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011292    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 11:49:48.140382 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011297    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 11:49:48.140382 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011300    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 11:49:48.141026 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011303    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 11:49:48.141026 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011306    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 11:49:48.141026 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011309    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 11:49:48.141026 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011312    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 11:49:48.141026 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011315    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 11:49:48.141026 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011317    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 11:49:48.141026 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011320    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 11:49:48.141026 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011323    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 11:49:48.141026 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011325    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 11:49:48.141026 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011329    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 11:49:48.141026 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011332    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 11:49:48.141026 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011334    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 11:49:48.141026 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011337    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 11:49:48.141026 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011340    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 11:49:48.141026 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011342    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 11:49:48.141026 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011345    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 11:49:48.141026 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011348    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 11:49:48.141026 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011350    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 11:49:48.141026 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011353    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 11:49:48.141026 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011355    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 11:49:48.141881 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011358    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 11:49:48.141881 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011361    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 11:49:48.141881 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011363    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 11:49:48.141881 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011366    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 11:49:48.141881 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011369    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 11:49:48.141881 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011372    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 11:49:48.141881 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011374    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 11:49:48.141881 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011377    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 11:49:48.141881 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011381    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 11:49:48.141881 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011384    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 11:49:48.141881 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011386    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 11:49:48.141881 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011389    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 11:49:48.141881 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011391    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 11:49:48.141881 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011394    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 11:49:48.141881 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011396    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 11:49:48.141881 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011399    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 11:49:48.141881 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011402    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 11:49:48.141881 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011405    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 11:49:48.141881 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011407    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 11:49:48.141881 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011410    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 11:49:48.142750 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011412    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 11:49:48.142750 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011416    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 11:49:48.142750 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011419    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 11:49:48.142750 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011422    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 11:49:48.142750 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011424    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 11:49:48.142750 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011427    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 11:49:48.142750 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011431    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 11:49:48.142750 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011434    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 11:49:48.142750 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011437    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 11:49:48.142750 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011440    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 11:49:48.142750 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011443    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 11:49:48.142750 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011446    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 11:49:48.142750 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011448    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 11:49:48.142750 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011451    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 11:49:48.142750 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011455    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 11:49:48.142750 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011458    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 11:49:48.142750 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011461    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 11:49:48.142750 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011464    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 11:49:48.142750 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011467    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 11:49:48.143593 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011470    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 11:49:48.143593 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011474    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 11:49:48.143593 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011477    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 11:49:48.143593 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011479    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 11:49:48.143593 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011482    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 11:49:48.143593 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011485    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 11:49:48.143593 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011487    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 11:49:48.143593 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011490    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 11:49:48.143593 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011492    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 11:49:48.143593 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011495    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 11:49:48.143593 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011498    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 11:49:48.143593 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011500    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 11:49:48.143593 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011503    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 11:49:48.143593 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011506    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 11:49:48.143593 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011509    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 11:49:48.143593 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011512    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 11:49:48.143593 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011516    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 11:49:48.143593 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011518    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 11:49:48.143593 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011521    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 11:49:48.143593 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011523    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 11:49:48.144456 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011526    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 11:49:48.144456 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011528    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 11:49:48.144456 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011531    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 11:49:48.144456 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011533    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 11:49:48.144456 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011536    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 11:49:48.144456 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011539    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 11:49:48.144456 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011541    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 11:49:48.144456 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011544    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 11:49:48.144456 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011546    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 11:49:48.144456 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011549    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 11:49:48.144456 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011552    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 11:49:48.144456 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011554    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 11:49:48.144456 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011557    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 11:49:48.144456 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011561    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 11:49:48.144456 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011565    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 11:49:48.144456 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011568    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 11:49:48.144456 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:48.011571    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 11:49:48.145317 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.011576    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 11:49:48.145317 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.011695    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 22 11:49:48.145317 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.013639    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 22 11:49:48.145317 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.014997    2558 server.go:1019] "Starting client certificate rotation"
Jul 22 11:49:48.145317 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.015098    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 11:49:48.145317 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.015140    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 11:49:48.145317 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.017424    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 11:49:48.145317 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.019819    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 11:49:48.145317 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.030995    2558 log.go:25] "Validated CRI v1 runtime API"
Jul 22 11:49:48.145317 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.032915    2558 log.go:25] "Validated CRI v1 image API"
Jul 22 11:49:48.145317 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.034588    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 22 11:49:48.145317 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.036811    2558 fs.go:135] Filesystem UUIDs: map[00c76b77-47b5-44b2-88fb-e25670f3ca66:/dev/nvme0n1p3 6fb6b6aa-6f62-402c-a1c6-48a0dbb2b370:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 22 11:49:48.145962 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.036830    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 22 11:49:48.146164 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.041104    2558 manager.go:216] Machine: {Timestamp:2026-07-22 11:49:48.040640785 +0000 UTC m=+0.407156020 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099675 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2eabf8705645523415b34ca0daae40 SystemUUID:ec2eabf8-7056-4552-3415-b34ca0daae40 BootID:30ff287e-e239-4989-9113-373da4178eb1 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f3:93:c0:ff:23 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f3:93:c0:ff:23 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:37:0c:b1:50:9d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 22 11:49:48.146164 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.041198    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 22 11:49:48.146164 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.041300    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 22 11:49:48.146164 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.042279    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 22 11:49:48.146164 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.042301    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-166.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 22 11:49:48.146164 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.043581    2558 topology_manager.go:138] "Creating topology manager with none policy"
Jul 22 11:49:48.146164 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.043590    2558 container_manager_linux.go:309] "Creating device plugin manager"
Jul 22 11:49:48.146164 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.043599    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.044228    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.045429    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.047961    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.048071    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.048727    2558 kubelet.go:486] "Attempting to sync node with API server"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.048741    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.048754    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.048764    2558 kubelet.go:398] "Adding apiserver pod source"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.048773    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.049048    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.049063    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.052502    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.054585    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.054612    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.055813    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.055826    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.055832    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.055838    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.055847    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.055852    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.056223    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.056229    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.056237    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.056242    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.056250    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.056257    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.056994    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.057000    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.073564    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.074764    2558 server.go:1268] "Started kubelet"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.075047    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.086289    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.086352    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.086431    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ll8gb"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.086645    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ll8gb"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.087157    2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-166.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.088415    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:48.090334    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-166.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 22 11:49:48.146642 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:48.090334    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 22 11:49:48.148370 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.090863    2558 server.go:310] "Adding debug handlers to kubelet server"
Jul 22 11:49:48.148370 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.095631    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 22 11:49:48.148370 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.095681    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 22 11:49:48.148370 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:48.095972    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-166.ec2.internal\" not found"
Jul 22 11:49:48.148370 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.096403    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 22 11:49:48.148370 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.096436    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 22 11:49:48.148370 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.096407    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 22 11:49:48.148370 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.096579    2558 reconstruct.go:97] "Volume reconstruction finished"
Jul 22 11:49:48.148370 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.096587    2558 reconciler.go:29] "Reconciler: start to sync state"
Jul 22 11:49:48.148370 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.100221    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 11:49:48.148370 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.103595    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 11:49:48.148370 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:48.104646    2558 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-166.ec2.internal\" not found" node="ip-10-0-132-166.ec2.internal"
Jul 22 11:49:48.237969 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.156866    2558 factory.go:55] Registering systemd factory
Jul 22 11:49:48.237969 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.156883    2558 factory.go:223] Registration of the systemd container factory successfully
Jul 22 11:49:48.237969 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.157126    2558 factory.go:153] Registering CRI-O factory
Jul 22 11:49:48.237969 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.157141    2558 factory.go:223] Registration of the crio container factory successfully
Jul 22 11:49:48.237969 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.157204    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 22 11:49:48.237969 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.157231    2558 factory.go:103] Registering Raw factory
Jul 22 11:49:48.237969 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.157243    2558 manager.go:1196] Started watching for new ooms in manager
Jul 22 11:49:48.237969 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.157841    2558 manager.go:349] Starting recovery of all containers
Jul 22 11:49:48.237969 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.191879    2558 manager.go:354] Recovery completed
Jul 22 11:49:48.237969 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:48.196166    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-166.ec2.internal\" not found"
Jul 22 11:49:48.237969 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.198404    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 11:49:48.237969 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.201285    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 11:49:48.237969 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.201315    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 11:49:48.237969 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.201328    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-166.ec2.internal" event="NodeHasSufficientPID"
Jul 22 11:49:48.237969 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.201863    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 22 11:49:48.237969 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.201871    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 22 11:49:48.237969 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.201874    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 11:49:48.237969 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.201888    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 11:49:48.237969 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.202564    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 11:49:48.237969 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.202588    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 11:49:48.237969 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.202602    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-166.ec2.internal" event="NodeHasSufficientPID"
Jul 22 11:49:48.237969 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.203472    2558 policy_none.go:49] "None policy: Start"
Jul 22 11:49:48.237969 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.203492    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 22 11:49:48.237969 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.203504    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 22 11:49:48.237969 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.204730    2558 policy_none.go:47] "Start"
Jul 22 11:49:48.341103 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.272539    2558 manager.go:337] "Starting Device Plugin manager"
Jul 22 11:49:48.341103 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:48.272806    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 22 11:49:48.341103 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.272821    2558 server.go:87] "Starting device plugin registration server"
Jul 22 11:49:48.341103 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.273251    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 22 11:49:48.341103 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.273264    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 22 11:49:48.341103 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.273742    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 22 11:49:48.341103 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.273844    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 22 11:49:48.341103 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.273855    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 22 11:49:48.341103 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:48.274234    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 22 11:49:48.341103 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:48.274275    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-166.ec2.internal\" not found"
Jul 22 11:49:48.418057 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.374253    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 11:49:48.418057 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.375454    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 11:49:48.418057 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.375493    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 11:49:48.418057 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.375507    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-166.ec2.internal" event="NodeHasSufficientPID"
Jul 22 11:49:48.418057 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.375550    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-166.ec2.internal"
Jul 22 11:49:48.418057 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.383295    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-166.ec2.internal"
Jul 22 11:49:48.418057 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:48.383321    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-166.ec2.internal\": node \"ip-10-0-132-166.ec2.internal\" not found"
Jul 22 11:49:48.418057 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:48.402648    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-166.ec2.internal\" not found"
Jul 22 11:49:48.507641 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.438926    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 22 11:49:48.507641 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.440368    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 22 11:49:48.507641 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.440409    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 22 11:49:48.507641 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.440434    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 22 11:49:48.507641 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:48.440477    2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 22 11:49:48.507641 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.443216    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 11:49:48.507641 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:48.503550    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-166.ec2.internal\" not found"
Jul 22 11:49:48.638150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.541652    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-166.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-166.ec2.internal"]
Jul 22 11:49:48.638150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.541723    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 11:49:48.638150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.543347    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 11:49:48.638150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.543378    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 11:49:48.638150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.543391    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-166.ec2.internal" event="NodeHasSufficientPID"
Jul 22 11:49:48.638150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.545839    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 11:49:48.638150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.546640    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-166.ec2.internal"
Jul 22 11:49:48.638150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.546675    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 11:49:48.638150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.546791    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 11:49:48.638150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.546818    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 11:49:48.638150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.546836    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-166.ec2.internal" event="NodeHasSufficientPID"
Jul 22 11:49:48.638150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.547381    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 11:49:48.638150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.547408    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 11:49:48.638150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.547424    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-166.ec2.internal" event="NodeHasSufficientPID"
Jul 22 11:49:48.638150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.547950    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-166.ec2.internal"
Jul 22 11:49:48.638150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.547980    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 11:49:48.638150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.548801    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 11:49:48.638150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.548829    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 11:49:48.638150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.548843    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-166.ec2.internal" event="NodeHasSufficientPID"
Jul 22 11:49:48.638150 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:48.576320    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-166.ec2.internal\" not found" node="ip-10-0-132-166.ec2.internal"
Jul 22 11:49:48.638150 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:48.581488    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-166.ec2.internal\" not found" node="ip-10-0-132-166.ec2.internal"
Jul 22 11:49:48.638150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.599789    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/991e2f0d770ef3fd3920051d94b0f78f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-166.ec2.internal\" (UID: \"991e2f0d770ef3fd3920051d94b0f78f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-166.ec2.internal"
Jul 22 11:49:48.638150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.599812    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/991e2f0d770ef3fd3920051d94b0f78f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-166.ec2.internal\" (UID: \"991e2f0d770ef3fd3920051d94b0f78f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-166.ec2.internal"
Jul 22 11:49:48.638150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.599831    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f52713c0287a28d2385b478ed125ac34-config\") pod \"kube-apiserver-proxy-ip-10-0-132-166.ec2.internal\" (UID: \"f52713c0287a28d2385b478ed125ac34\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-166.ec2.internal"
Jul 22 11:49:48.638150 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:48.604201    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-166.ec2.internal\" not found"
Jul 22 11:49:48.793335 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.700066    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/991e2f0d770ef3fd3920051d94b0f78f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-166.ec2.internal\" (UID: \"991e2f0d770ef3fd3920051d94b0f78f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-166.ec2.internal"
Jul 22 11:49:48.793335 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.700118    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/991e2f0d770ef3fd3920051d94b0f78f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-166.ec2.internal\" (UID: \"991e2f0d770ef3fd3920051d94b0f78f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-166.ec2.internal"
Jul 22 11:49:48.793335 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.700138    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f52713c0287a28d2385b478ed125ac34-config\") pod \"kube-apiserver-proxy-ip-10-0-132-166.ec2.internal\" (UID: \"f52713c0287a28d2385b478ed125ac34\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-166.ec2.internal"
Jul 22 11:49:48.793335 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.700158    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/991e2f0d770ef3fd3920051d94b0f78f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-166.ec2.internal\" (UID: \"991e2f0d770ef3fd3920051d94b0f78f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-166.ec2.internal"
Jul 22 11:49:48.793335 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.700179    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/991e2f0d770ef3fd3920051d94b0f78f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-166.ec2.internal\" (UID: \"991e2f0d770ef3fd3920051d94b0f78f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-166.ec2.internal"
Jul 22 11:49:48.793335 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.700165    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f52713c0287a28d2385b478ed125ac34-config\") pod \"kube-apiserver-proxy-ip-10-0-132-166.ec2.internal\" (UID: \"f52713c0287a28d2385b478ed125ac34\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-166.ec2.internal"
Jul 22 11:49:48.793335 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:48.704431    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-166.ec2.internal\" not found"
Jul 22 11:49:48.943610 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:48.805508    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-166.ec2.internal\" not found"
Jul 22 11:49:48.943610 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.883719    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-166.ec2.internal"
Jul 22 11:49:48.943610 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:48.884828    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-166.ec2.internal"
Jul 22 11:49:48.943610 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:48.906209    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-166.ec2.internal\" not found"
Jul 22 11:49:49.085362 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:49.006411    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-166.ec2.internal\" not found"
Jul 22 11:49:49.085362 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:49.014071    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 22 11:49:49.085362 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:49.014270    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 11:49:49.085362 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:49.014275    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 11:49:49.085362 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:49.014276    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 11:49:49.216348 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:49.093483    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 11:44:48 +0000 UTC" deadline="2028-01-06 08:41:28.999824485 +0000 UTC"
Jul 22 11:49:49.216348 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:49.093511    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12788h51m39.906316494s"
Jul 22 11:49:49.216348 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:49.106746    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-166.ec2.internal\" not found"
Jul 22 11:49:49.216348 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:49.207876    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-166.ec2.internal\" not found"
Jul 22 11:49:49.308932 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:49.308897    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-166.ec2.internal\" not found"
Jul 22 11:49:49.409936 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:49.409902    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-166.ec2.internal\" not found"
Jul 22 11:49:49.427103 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:49.427077    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 11:49:49.497261 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:49.497234    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-166.ec2.internal"
Jul 22 11:49:49.505878 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:49.505841    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod991e2f0d770ef3fd3920051d94b0f78f.slice/crio-b082c441019c96bfd13dbe4eb1318d5d07d66fcf01833cd312a694570ac2b7e4 WatchSource:0}: Error finding container b082c441019c96bfd13dbe4eb1318d5d07d66fcf01833cd312a694570ac2b7e4: Status 404 returned error can't find the container with id b082c441019c96bfd13dbe4eb1318d5d07d66fcf01833cd312a694570ac2b7e4
Jul 22 11:49:49.506351 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:49.506333    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf52713c0287a28d2385b478ed125ac34.slice/crio-f18cf26a440aaeaea37e7dbaa702e2f2b4391739f70ed796fd5178307ea2e637 WatchSource:0}: Error finding container f18cf26a440aaeaea37e7dbaa702e2f2b4391739f70ed796fd5178307ea2e637: Status 404 returned error can't find the container with id f18cf26a440aaeaea37e7dbaa702e2f2b4391739f70ed796fd5178307ea2e637
Jul 22 11:49:49.512942 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:49.512927    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 11:49:49.513333 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:49.513317    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 11:49:49.513482 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:49.513455    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-166.ec2.internal"
Jul 22 11:49:49.524635 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:49.524617    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 11:49:49.860289 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:49.860204    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 11:49:49.977250 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:49.977218    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 11:49:50.053274 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.053225    2558 apiserver.go:52] "Watching apiserver"
Jul 22 11:49:50.064059 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.064026    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 22 11:49:50.065288 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.065251    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-tqrg6","openshift-image-registry/node-ca-7p2jg","openshift-multus/network-metrics-daemon-7ftqt","openshift-network-diagnostics/network-check-target-j8flw","kube-system/global-pull-secret-syncer-k9p8m","openshift-dns/node-resolver-csd5r","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-166.ec2.internal","openshift-multus/multus-additional-cni-plugins-zx6zg","openshift-multus/multus-qpbnd","openshift-network-operator/iptables-alerter-nb5n5","openshift-ovn-kubernetes/ovnkube-node-f65bz","kube-system/konnectivity-agent-sdh44","kube-system/kube-apiserver-proxy-ip-10-0-132-166.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p"]
Jul 22 11:49:50.068040 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.068016    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nb5n5"
Jul 22 11:49:50.070562 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.070516    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.071902 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.071409    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 22 11:49:50.071902 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.071428    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 22 11:49:50.071902 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.071746    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jxqpl\""
Jul 22 11:49:50.071902 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.071827    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 22 11:49:50.073964 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.073475    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 22 11:49:50.073964 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.073716    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:49:50.073964 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:50.073802    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:49:50.073964 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.073819    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 22 11:49:50.073964 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.073943    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 22 11:49:50.076431 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.075159    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tkf6l\""
Jul 22 11:49:50.076431 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.075424    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 22 11:49:50.076431 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.075652    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 22 11:49:50.076431 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.075911    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 22 11:49:50.078033 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.077913    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:49:50.078033 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:50.077975    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:49:50.079015 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.078275    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:49:50.079015 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:50.078334    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:49:50.081046 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.080351    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-csd5r"
Jul 22 11:49:50.084596 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.082925    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qm6jt\""
Jul 22 11:49:50.084596 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.083169    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 22 11:49:50.084596 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.083456    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 22 11:49:50.084596 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.083684    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.086302 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.085732    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p"
Jul 22 11:49:50.087295 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.086548    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 22 11:49:50.087295 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.087213    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zxp6h\""
Jul 22 11:49:50.088581 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.087502    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 22 11:49:50.088581 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.087539    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 22 11:49:50.088581 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.088212    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 22 11:49:50.088581 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.088547    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 22 11:49:50.088816 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.088800    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 22 11:49:50.089390 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.089053    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7p2jg"
Jul 22 11:49:50.089920 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.089503    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 22 11:49:50.089920 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.089639    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x4x8z\""
Jul 22 11:49:50.092254 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.090911    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.092923 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.092445    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 22 11:49:50.092923 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.092462    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 22 11:49:50.092923 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.092720    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 22 11:49:50.093146 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.093026    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-czj6w\""
Jul 22 11:49:50.093980 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.093590    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zx6zg"
Jul 22 11:49:50.094655 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.094391    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 22 11:49:50.095928 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.095797    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rc6t5\""
Jul 22 11:49:50.096627 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.096420    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 22 11:49:50.096627 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.096523    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sdh44"
Jul 22 11:49:50.097258 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.097151    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 22 11:49:50.097354 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.097299    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6lml9\""
Jul 22 11:49:50.098266 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.098241    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 22 11:49:50.098511 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.098485    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 22 11:49:50.099426 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.099100    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 22 11:49:50.101228 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.101058    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7x88j\""
Jul 22 11:49:50.101228 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.101164    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 22 11:49:50.102329 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.102308    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 22 11:49:50.109225 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109197    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-host-run-k8s-cni-cncf-io\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.109331 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109236    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-etc-kubernetes\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.109331 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109260    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2e166771-d43d-41ec-b850-edb3523ec4b1-device-dir\") pod \"aws-ebs-csi-driver-node-2pz2p\" (UID: \"2e166771-d43d-41ec-b850-edb3523ec4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p"
Jul 22 11:49:50.109331 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109276    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-host-kubelet\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.109331 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109292    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-host-slash\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.109331 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109318    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fc8b4ba-9376-46b3-b29a-5f60380da898-original-pull-secret\") pod \"global-pull-secret-syncer-k9p8m\" (UID: \"4fc8b4ba-9376-46b3-b29a-5f60380da898\") " pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:49:50.109331 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109334    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f527d4c-c096-412f-bebc-3f974fe42dc8-tmp-dir\") pod \"node-resolver-csd5r\" (UID: \"9f527d4c-c096-412f-bebc-3f974fe42dc8\") " pod="openshift-dns/node-resolver-csd5r"
Jul 22 11:49:50.109634 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109349    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-multus-conf-dir\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.109634 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109366    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-etc-sysconfig\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.109634 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109381    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59lsr\" (UniqueName: \"kubernetes.io/projected/cd87b2d4-4ced-4540-9c37-36d9b7b74860-kube-api-access-59lsr\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.109634 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109395    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-run-ovn\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.109634 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109410    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd-system-cni-dir\") pod \"multus-additional-cni-plugins-zx6zg\" (UID: \"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd\") " pod="openshift-multus/multus-additional-cni-plugins-zx6zg"
Jul 22 11:49:50.109634 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109425    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-system-cni-dir\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.109634 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109439    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-cnibin\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.109634 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109468    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-host-run-netns\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.109634 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109485    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-etc-openvswitch\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.109634 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109523    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-run-openvswitch\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.109634 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109539    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e89ec73b-8401-4834-91f6-c6ee13d5dc74-agent-certs\") pod \"konnectivity-agent-sdh44\" (UID: \"e89ec73b-8401-4834-91f6-c6ee13d5dc74\") " pod="kube-system/konnectivity-agent-sdh44"
Jul 22 11:49:50.109634 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109554    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-host-run-netns\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.109634 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109567    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-sys\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.109634 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109581    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-run-systemd\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.110358 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109595    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f1fda4c8-fd99-442c-a5c0-5964027c2fec-ovnkube-script-lib\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.110358 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109611    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-hostroot\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.110358 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109631    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-etc-modprobe-d\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.110358 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109648    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-systemd-units\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.110358 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109678    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f1fda4c8-fd99-442c-a5c0-5964027c2fec-env-overrides\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.110358 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109735    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmdzm\" (UniqueName: \"kubernetes.io/projected/f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd-kube-api-access-vmdzm\") pod \"multus-additional-cni-plugins-zx6zg\" (UID: \"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd\") " pod="openshift-multus/multus-additional-cni-plugins-zx6zg"
Jul 22 11:49:50.110358 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109769    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/12caa2da-758e-4acc-aa20-e2c253c0bbef-iptables-alerter-script\") pod \"iptables-alerter-nb5n5\" (UID: \"12caa2da-758e-4acc-aa20-e2c253c0bbef\") " pod="openshift-network-operator/iptables-alerter-nb5n5"
Jul 22 11:49:50.110358 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109905    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-host-var-lib-cni-multus\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.110358 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109946    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-host-run-multus-certs\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.110358 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.109992    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-etc-kubernetes\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.110358 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110027    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-etc-systemd\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.110358 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110062    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd87b2d4-4ced-4540-9c37-36d9b7b74860-tmp\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.110358 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110091    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-host-run-ovn-kubernetes\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.110358 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110136    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntvpd\" (UniqueName: \"kubernetes.io/projected/55e34c7b-6521-42cf-a952-d08ec5ce5304-kube-api-access-ntvpd\") pod \"network-check-target-j8flw\" (UID: \"55e34c7b-6521-42cf-a952-d08ec5ce5304\") " pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:49:50.111126 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110185    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-host-var-lib-kubelet\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.111126 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110225    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-host\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.111126 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110254    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd-os-release\") pod \"multus-additional-cni-plugins-zx6zg\" (UID: \"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd\") " pod="openshift-multus/multus-additional-cni-plugins-zx6zg"
Jul 22 11:49:50.111126 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110281    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e89ec73b-8401-4834-91f6-c6ee13d5dc74-konnectivity-ca\") pod \"konnectivity-agent-sdh44\" (UID: \"e89ec73b-8401-4834-91f6-c6ee13d5dc74\") " pod="kube-system/konnectivity-agent-sdh44"
Jul 22 11:49:50.111126 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110318    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj7rd\" (UniqueName: \"kubernetes.io/projected/9f527d4c-c096-412f-bebc-3f974fe42dc8-kube-api-access-gj7rd\") pod \"node-resolver-csd5r\" (UID: \"9f527d4c-c096-412f-bebc-3f974fe42dc8\") " pod="openshift-dns/node-resolver-csd5r"
Jul 22 11:49:50.111126 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110349    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2e166771-d43d-41ec-b850-edb3523ec4b1-socket-dir\") pod \"aws-ebs-csi-driver-node-2pz2p\" (UID: \"2e166771-d43d-41ec-b850-edb3523ec4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p"
Jul 22 11:49:50.111126 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110383    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-run\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.111126 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110410    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zx6zg\" (UID: \"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd\") " pod="openshift-multus/multus-additional-cni-plugins-zx6zg"
Jul 22 11:49:50.111126 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110436    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-var-lib-kubelet\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.111126 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110460    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-var-lib-openvswitch\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.111126 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110498    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/120a973f-3054-418e-94f7-0c38939ae63f-host\") pod \"node-ca-7p2jg\" (UID: \"120a973f-3054-418e-94f7-0c38939ae63f\") " pod="openshift-image-registry/node-ca-7p2jg"
Jul 22 11:49:50.111126 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110545    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd-cnibin\") pod \"multus-additional-cni-plugins-zx6zg\" (UID: \"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd\") " pod="openshift-multus/multus-additional-cni-plugins-zx6zg"
Jul 22 11:49:50.111126 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110571    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-multus-socket-dir-parent\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.111126 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110613    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzkjh\" (UniqueName: \"kubernetes.io/projected/bdda6819-cc38-477c-812a-a17e0b071acb-kube-api-access-qzkjh\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.111833 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110659    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2e166771-d43d-41ec-b850-edb3523ec4b1-registration-dir\") pod \"aws-ebs-csi-driver-node-2pz2p\" (UID: \"2e166771-d43d-41ec-b850-edb3523ec4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p"
Jul 22 11:49:50.111833 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110695    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cd87b2d4-4ced-4540-9c37-36d9b7b74860-etc-tuned\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.111833 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110721    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f1fda4c8-fd99-442c-a5c0-5964027c2fec-ovnkube-config\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.111833 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110763    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j5dq\" (UniqueName: \"kubernetes.io/projected/120a973f-3054-418e-94f7-0c38939ae63f-kube-api-access-5j5dq\") pod \"node-ca-7p2jg\" (UID: \"120a973f-3054-418e-94f7-0c38939ae63f\") " pod="openshift-image-registry/node-ca-7p2jg"
Jul 22 11:49:50.111833 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110812    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-multus-cni-dir\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.111833 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110845    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-os-release\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.111833 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110870    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2e166771-d43d-41ec-b850-edb3523ec4b1-sys-fs\") pod \"aws-ebs-csi-driver-node-2pz2p\" (UID: \"2e166771-d43d-41ec-b850-edb3523ec4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p"
Jul 22 11:49:50.111833 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110920    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1fda4c8-fd99-442c-a5c0-5964027c2fec-ovn-node-metrics-cert\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.111833 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110946    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd-cni-binary-copy\") pod \"multus-additional-cni-plugins-zx6zg\" (UID: \"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd\") " pod="openshift-multus/multus-additional-cni-plugins-zx6zg"
Jul 22 11:49:50.111833 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110973    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.111833 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.110998    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-host-var-lib-cni-bin\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.111833 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.111032    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-log-socket\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.111833 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.111078    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-host-cni-netd\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.112532 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.111106    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zx6zg\" (UID: \"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd\") " pod="openshift-multus/multus-additional-cni-plugins-zx6zg"
Jul 22 11:49:50.112532 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.111135    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bdda6819-cc38-477c-812a-a17e0b071acb-cni-binary-copy\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.112532 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.111160    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c4k7\" (UniqueName: \"kubernetes.io/projected/2e166771-d43d-41ec-b850-edb3523ec4b1-kube-api-access-7c4k7\") pod \"aws-ebs-csi-driver-node-2pz2p\" (UID: \"2e166771-d43d-41ec-b850-edb3523ec4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p"
Jul 22 11:49:50.112532 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.111184    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-etc-sysctl-d\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.112532 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.111204    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 11:49:50.112532 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.111206    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-host-cni-bin\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.112532 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.111262    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/120a973f-3054-418e-94f7-0c38939ae63f-serviceca\") pod \"node-ca-7p2jg\" (UID: \"120a973f-3054-418e-94f7-0c38939ae63f\") " pod="openshift-image-registry/node-ca-7p2jg"
Jul 22 11:49:50.112532 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.111287    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7trr\" (UniqueName: \"kubernetes.io/projected/12caa2da-758e-4acc-aa20-e2c253c0bbef-kube-api-access-n7trr\") pod \"iptables-alerter-nb5n5\" (UID: \"12caa2da-758e-4acc-aa20-e2c253c0bbef\") " pod="openshift-network-operator/iptables-alerter-nb5n5"
Jul 22 11:49:50.112532 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.111313    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4fc8b4ba-9376-46b3-b29a-5f60380da898-dbus\") pod \"global-pull-secret-syncer-k9p8m\" (UID: \"4fc8b4ba-9376-46b3-b29a-5f60380da898\") " pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:49:50.112532 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.111338    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9f527d4c-c096-412f-bebc-3f974fe42dc8-hosts-file\") pod \"node-resolver-csd5r\" (UID: \"9f527d4c-c096-412f-bebc-3f974fe42dc8\") " pod="openshift-dns/node-resolver-csd5r"
Jul 22 11:49:50.112532 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.111365    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2e166771-d43d-41ec-b850-edb3523ec4b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2pz2p\" (UID: \"2e166771-d43d-41ec-b850-edb3523ec4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p"
Jul 22 11:49:50.112532 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.111389    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-etc-sysctl-conf\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.112532 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.111413    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-node-log\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.112532 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.111447    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn5br\" (UniqueName: \"kubernetes.io/projected/f1fda4c8-fd99-442c-a5c0-5964027c2fec-kube-api-access-vn5br\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.113259 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.111518    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7rf8\" (UniqueName: \"kubernetes.io/projected/f0be44dc-51ec-49a4-97da-8e3923d9aaae-kube-api-access-q7rf8\") pod \"network-metrics-daemon-7ftqt\" (UID: \"f0be44dc-51ec-49a4-97da-8e3923d9aaae\") " pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:49:50.113259 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.111609    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4fc8b4ba-9376-46b3-b29a-5f60380da898-kubelet-config\") pod \"global-pull-secret-syncer-k9p8m\" (UID: \"4fc8b4ba-9376-46b3-b29a-5f60380da898\") " pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:49:50.113259 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.111737    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bdda6819-cc38-477c-812a-a17e0b071acb-multus-daemon-config\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.113259 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.111784    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2e166771-d43d-41ec-b850-edb3523ec4b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-2pz2p\" (UID: \"2e166771-d43d-41ec-b850-edb3523ec4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p"
Jul 22 11:49:50.113259 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.111812    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-lib-modules\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.113259 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.111838    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0be44dc-51ec-49a4-97da-8e3923d9aaae-metrics-certs\") pod \"network-metrics-daemon-7ftqt\" (UID: \"f0be44dc-51ec-49a4-97da-8e3923d9aaae\") " pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:49:50.113259 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.111875    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zx6zg\" (UID: \"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd\") " pod="openshift-multus/multus-additional-cni-plugins-zx6zg"
Jul 22 11:49:50.113259 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.111902    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12caa2da-758e-4acc-aa20-e2c253c0bbef-host-slash\") pod \"iptables-alerter-nb5n5\" (UID: \"12caa2da-758e-4acc-aa20-e2c253c0bbef\") " pod="openshift-network-operator/iptables-alerter-nb5n5"
Jul 22 11:49:50.138357 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.138329    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ms88s"
Jul 22 11:49:50.148320 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.148273    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ms88s"
Jul 22 11:49:50.212747 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.212712    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-host-run-ovn-kubernetes\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.212931 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.212759    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntvpd\" (UniqueName: \"kubernetes.io/projected/55e34c7b-6521-42cf-a952-d08ec5ce5304-kube-api-access-ntvpd\") pod \"network-check-target-j8flw\" (UID: \"55e34c7b-6521-42cf-a952-d08ec5ce5304\") " pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:49:50.212931 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.212791    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-host-var-lib-kubelet\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.212931 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.212816    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-host\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.212931 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.212842    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd-os-release\") pod \"multus-additional-cni-plugins-zx6zg\" (UID: \"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd\") " pod="openshift-multus/multus-additional-cni-plugins-zx6zg"
Jul 22 11:49:50.212931 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.212846    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-host-run-ovn-kubernetes\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.212931 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.212870    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e89ec73b-8401-4834-91f6-c6ee13d5dc74-konnectivity-ca\") pod \"konnectivity-agent-sdh44\" (UID: \"e89ec73b-8401-4834-91f6-c6ee13d5dc74\") " pod="kube-system/konnectivity-agent-sdh44"
Jul 22 11:49:50.212931 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.212906    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj7rd\" (UniqueName: \"kubernetes.io/projected/9f527d4c-c096-412f-bebc-3f974fe42dc8-kube-api-access-gj7rd\") pod \"node-resolver-csd5r\" (UID: \"9f527d4c-c096-412f-bebc-3f974fe42dc8\") " pod="openshift-dns/node-resolver-csd5r"
Jul 22 11:49:50.213281 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.212958    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2e166771-d43d-41ec-b850-edb3523ec4b1-socket-dir\") pod \"aws-ebs-csi-driver-node-2pz2p\" (UID: \"2e166771-d43d-41ec-b850-edb3523ec4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p"
Jul 22 11:49:50.213281 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.212994    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-run\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.213281 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213030    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd-os-release\") pod \"multus-additional-cni-plugins-zx6zg\" (UID: \"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd\") " pod="openshift-multus/multus-additional-cni-plugins-zx6zg"
Jul 22 11:49:50.213281 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213026    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-host\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.213281 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.212960    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-host-var-lib-kubelet\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.213281 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213055    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zx6zg\" (UID: \"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd\") " pod="openshift-multus/multus-additional-cni-plugins-zx6zg"
Jul 22 11:49:50.213281 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213120    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-var-lib-kubelet\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.213281 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213170    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2e166771-d43d-41ec-b850-edb3523ec4b1-socket-dir\") pod \"aws-ebs-csi-driver-node-2pz2p\" (UID: \"2e166771-d43d-41ec-b850-edb3523ec4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p"
Jul 22 11:49:50.213281 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213176    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-var-lib-openvswitch\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.213281 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213213    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-run\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.213281 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213231    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/120a973f-3054-418e-94f7-0c38939ae63f-host\") pod \"node-ca-7p2jg\" (UID: \"120a973f-3054-418e-94f7-0c38939ae63f\") " pod="openshift-image-registry/node-ca-7p2jg"
Jul 22 11:49:50.213281 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213277    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-var-lib-openvswitch\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.213281 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213285    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd-cnibin\") pod \"multus-additional-cni-plugins-zx6zg\" (UID: \"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd\") " pod="openshift-multus/multus-additional-cni-plugins-zx6zg"
Jul 22 11:49:50.213907 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213302    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-var-lib-kubelet\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.213907 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213319    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd-cnibin\") pod \"multus-additional-cni-plugins-zx6zg\" (UID: \"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd\") " pod="openshift-multus/multus-additional-cni-plugins-zx6zg"
Jul 22 11:49:50.213907 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213322    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-multus-socket-dir-parent\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.213907 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213338    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/120a973f-3054-418e-94f7-0c38939ae63f-host\") pod \"node-ca-7p2jg\" (UID: \"120a973f-3054-418e-94f7-0c38939ae63f\") " pod="openshift-image-registry/node-ca-7p2jg"
Jul 22 11:49:50.213907 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213352    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzkjh\" (UniqueName: \"kubernetes.io/projected/bdda6819-cc38-477c-812a-a17e0b071acb-kube-api-access-qzkjh\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.213907 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213379    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2e166771-d43d-41ec-b850-edb3523ec4b1-registration-dir\") pod \"aws-ebs-csi-driver-node-2pz2p\" (UID: \"2e166771-d43d-41ec-b850-edb3523ec4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p"
Jul 22 11:49:50.213907 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213381    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-multus-socket-dir-parent\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.213907 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213543    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 11:49:50.213907 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213551    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cd87b2d4-4ced-4540-9c37-36d9b7b74860-etc-tuned\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.213907 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213596    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f1fda4c8-fd99-442c-a5c0-5964027c2fec-ovnkube-config\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.213907 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213606    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e89ec73b-8401-4834-91f6-c6ee13d5dc74-konnectivity-ca\") pod \"konnectivity-agent-sdh44\" (UID: \"e89ec73b-8401-4834-91f6-c6ee13d5dc74\") " pod="kube-system/konnectivity-agent-sdh44"
Jul 22 11:49:50.213907 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213643    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j5dq\" (UniqueName: \"kubernetes.io/projected/120a973f-3054-418e-94f7-0c38939ae63f-kube-api-access-5j5dq\") pod \"node-ca-7p2jg\" (UID: \"120a973f-3054-418e-94f7-0c38939ae63f\") " pod="openshift-image-registry/node-ca-7p2jg"
Jul 22 11:49:50.213907 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213671    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-multus-cni-dir\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.213907 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213695    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-os-release\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.213907 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213738    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2e166771-d43d-41ec-b850-edb3523ec4b1-sys-fs\") pod \"aws-ebs-csi-driver-node-2pz2p\" (UID: \"2e166771-d43d-41ec-b850-edb3523ec4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p"
Jul 22 11:49:50.214786 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213771    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-os-release\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.214786 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213766    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1fda4c8-fd99-442c-a5c0-5964027c2fec-ovn-node-metrics-cert\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.214786 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213807    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd-cni-binary-copy\") pod \"multus-additional-cni-plugins-zx6zg\" (UID: \"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd\") " pod="openshift-multus/multus-additional-cni-plugins-zx6zg"
Jul 22 11:49:50.214786 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213835    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.214786 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213848    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zx6zg\" (UID: \"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd\") " pod="openshift-multus/multus-additional-cni-plugins-zx6zg"
Jul 22 11:49:50.214786 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213856    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-multus-cni-dir\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.214786 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213863    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-host-var-lib-cni-bin\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.214786 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213861    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2e166771-d43d-41ec-b850-edb3523ec4b1-sys-fs\") pod \"aws-ebs-csi-driver-node-2pz2p\" (UID: \"2e166771-d43d-41ec-b850-edb3523ec4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p"
Jul 22 11:49:50.214786 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213679    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2e166771-d43d-41ec-b850-edb3523ec4b1-registration-dir\") pod \"aws-ebs-csi-driver-node-2pz2p\" (UID: \"2e166771-d43d-41ec-b850-edb3523ec4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p"
Jul 22 11:49:50.214786 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213902    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-log-socket\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.214786 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.213963    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 22 11:49:50.214786 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.214167    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-log-socket\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.214786 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.214210    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-host-var-lib-cni-bin\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.214786 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.214221    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.214786 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.214388    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-host-cni-netd\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.215568 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.214419    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zx6zg\" (UID: \"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd\") " pod="openshift-multus/multus-additional-cni-plugins-zx6zg"
Jul 22 11:49:50.215568 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.214445    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bdda6819-cc38-477c-812a-a17e0b071acb-cni-binary-copy\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.215568 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.214471    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c4k7\" (UniqueName: \"kubernetes.io/projected/2e166771-d43d-41ec-b850-edb3523ec4b1-kube-api-access-7c4k7\") pod \"aws-ebs-csi-driver-node-2pz2p\" (UID: \"2e166771-d43d-41ec-b850-edb3523ec4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p"
Jul 22 11:49:50.215568 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.214495    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-etc-sysctl-d\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.215568 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.214520    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-host-cni-bin\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.215568 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.214553    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/120a973f-3054-418e-94f7-0c38939ae63f-serviceca\") pod \"node-ca-7p2jg\" (UID: \"120a973f-3054-418e-94f7-0c38939ae63f\") " pod="openshift-image-registry/node-ca-7p2jg"
Jul 22 11:49:50.215568 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.214578    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7trr\" (UniqueName: \"kubernetes.io/projected/12caa2da-758e-4acc-aa20-e2c253c0bbef-kube-api-access-n7trr\") pod \"iptables-alerter-nb5n5\" (UID: \"12caa2da-758e-4acc-aa20-e2c253c0bbef\") " pod="openshift-network-operator/iptables-alerter-nb5n5"
Jul 22 11:49:50.215568 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.214604    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4fc8b4ba-9376-46b3-b29a-5f60380da898-dbus\") pod \"global-pull-secret-syncer-k9p8m\" (UID: \"4fc8b4ba-9376-46b3-b29a-5f60380da898\") " pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:49:50.215568 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.214628    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9f527d4c-c096-412f-bebc-3f974fe42dc8-hosts-file\") pod \"node-resolver-csd5r\" (UID: \"9f527d4c-c096-412f-bebc-3f974fe42dc8\") " pod="openshift-dns/node-resolver-csd5r"
Jul 22 11:49:50.215568 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.214652    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2e166771-d43d-41ec-b850-edb3523ec4b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2pz2p\" (UID: \"2e166771-d43d-41ec-b850-edb3523ec4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p"
Jul 22 11:49:50.215568 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.214676    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-etc-sysctl-conf\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.215568 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.214716    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-node-log\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.215568 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.214742    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn5br\" (UniqueName: \"kubernetes.io/projected/f1fda4c8-fd99-442c-a5c0-5964027c2fec-kube-api-access-vn5br\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.215568 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.214769    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7rf8\" (UniqueName: \"kubernetes.io/projected/f0be44dc-51ec-49a4-97da-8e3923d9aaae-kube-api-access-q7rf8\") pod \"network-metrics-daemon-7ftqt\" (UID: \"f0be44dc-51ec-49a4-97da-8e3923d9aaae\") " pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:49:50.216306 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.214770    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd-cni-binary-copy\") pod \"multus-additional-cni-plugins-zx6zg\" (UID: \"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd\") " pod="openshift-multus/multus-additional-cni-plugins-zx6zg"
Jul 22 11:49:50.216306 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.214795    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4fc8b4ba-9376-46b3-b29a-5f60380da898-kubelet-config\") pod \"global-pull-secret-syncer-k9p8m\" (UID: \"4fc8b4ba-9376-46b3-b29a-5f60380da898\") " pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:49:50.216306 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.214822    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bdda6819-cc38-477c-812a-a17e0b071acb-multus-daemon-config\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.216306 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.214845    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2e166771-d43d-41ec-b850-edb3523ec4b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-2pz2p\" (UID: \"2e166771-d43d-41ec-b850-edb3523ec4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p"
Jul 22 11:49:50.216306 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.214870    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-lib-modules\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.216306 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.214918    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0be44dc-51ec-49a4-97da-8e3923d9aaae-metrics-certs\") pod \"network-metrics-daemon-7ftqt\" (UID: \"f0be44dc-51ec-49a4-97da-8e3923d9aaae\") " pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:49:50.216306 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.214952    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zx6zg\" (UID: \"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd\") " pod="openshift-multus/multus-additional-cni-plugins-zx6zg"
Jul 22 11:49:50.216306 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.214977    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12caa2da-758e-4acc-aa20-e2c253c0bbef-host-slash\") pod \"iptables-alerter-nb5n5\" (UID: \"12caa2da-758e-4acc-aa20-e2c253c0bbef\") " pod="openshift-network-operator/iptables-alerter-nb5n5"
Jul 22 11:49:50.216306 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215020    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-host-run-k8s-cni-cncf-io\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.216306 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215047    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-etc-kubernetes\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.216306 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215071    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2e166771-d43d-41ec-b850-edb3523ec4b1-device-dir\") pod \"aws-ebs-csi-driver-node-2pz2p\" (UID: \"2e166771-d43d-41ec-b850-edb3523ec4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p"
Jul 22 11:49:50.216306 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215103    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-host-kubelet\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.216306 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215108    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-host-cni-netd\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.216306 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215123    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-etc-sysctl-d\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.216931 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215128    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-host-slash\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.216931 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215174    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-host-slash\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.216931 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215215    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fc8b4ba-9376-46b3-b29a-5f60380da898-original-pull-secret\") pod \"global-pull-secret-syncer-k9p8m\" (UID: \"4fc8b4ba-9376-46b3-b29a-5f60380da898\") " pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:49:50.216931 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215247    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4fc8b4ba-9376-46b3-b29a-5f60380da898-dbus\") pod \"global-pull-secret-syncer-k9p8m\" (UID: \"4fc8b4ba-9376-46b3-b29a-5f60380da898\") " pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:49:50.216931 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215254    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f527d4c-c096-412f-bebc-3f974fe42dc8-tmp-dir\") pod \"node-resolver-csd5r\" (UID: \"9f527d4c-c096-412f-bebc-3f974fe42dc8\") " pod="openshift-dns/node-resolver-csd5r"
Jul 22 11:49:50.216931 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215267    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zx6zg\" (UID: \"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd\") " pod="openshift-multus/multus-additional-cni-plugins-zx6zg"
Jul 22 11:49:50.216931 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215307    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9f527d4c-c096-412f-bebc-3f974fe42dc8-hosts-file\") pod \"node-resolver-csd5r\" (UID: \"9f527d4c-c096-412f-bebc-3f974fe42dc8\") " pod="openshift-dns/node-resolver-csd5r"
Jul 22 11:49:50.216931 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215336    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-multus-conf-dir\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.216931 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215383    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-etc-sysconfig\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.216931 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215420    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59lsr\" (UniqueName: \"kubernetes.io/projected/cd87b2d4-4ced-4540-9c37-36d9b7b74860-kube-api-access-59lsr\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.216931 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215455    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-run-ovn\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.216931 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215484    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd-system-cni-dir\") pod \"multus-additional-cni-plugins-zx6zg\" (UID: \"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd\") " pod="openshift-multus/multus-additional-cni-plugins-zx6zg"
Jul 22 11:49:50.216931 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215513    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-system-cni-dir\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.216931 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215540    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-cnibin\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.216931 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215566    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-host-run-netns\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.217592 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215572    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-host-cni-bin\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.217592 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215594    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-etc-openvswitch\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.217592 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215624    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-run-openvswitch\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.217592 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215649    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e89ec73b-8401-4834-91f6-c6ee13d5dc74-agent-certs\") pod \"konnectivity-agent-sdh44\" (UID: \"e89ec73b-8401-4834-91f6-c6ee13d5dc74\") " pod="kube-system/konnectivity-agent-sdh44"
Jul 22 11:49:50.217592 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215675    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-host-run-netns\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.217592 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215715    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-sys\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.217592 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215741    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-run-systemd\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.217592 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215765    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f1fda4c8-fd99-442c-a5c0-5964027c2fec-ovnkube-script-lib\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.217592 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215782    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/120a973f-3054-418e-94f7-0c38939ae63f-serviceca\") pod \"node-ca-7p2jg\" (UID: \"120a973f-3054-418e-94f7-0c38939ae63f\") " pod="openshift-image-registry/node-ca-7p2jg"
Jul 22 11:49:50.217592 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215791    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-hostroot\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.217592 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215823    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-etc-modprobe-d\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.217592 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215843    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-hostroot\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.217592 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215852    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-systemd-units\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.217592 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215891    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f1fda4c8-fd99-442c-a5c0-5964027c2fec-env-overrides\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.217592 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215902    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2e166771-d43d-41ec-b850-edb3523ec4b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2pz2p\" (UID: \"2e166771-d43d-41ec-b850-edb3523ec4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p"
Jul 22 11:49:50.218335 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215919    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmdzm\" (UniqueName: \"kubernetes.io/projected/f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd-kube-api-access-vmdzm\") pod \"multus-additional-cni-plugins-zx6zg\" (UID: \"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd\") " pod="openshift-multus/multus-additional-cni-plugins-zx6zg"
Jul 22 11:49:50.218335 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215957    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/12caa2da-758e-4acc-aa20-e2c253c0bbef-iptables-alerter-script\") pod \"iptables-alerter-nb5n5\" (UID: \"12caa2da-758e-4acc-aa20-e2c253c0bbef\") " pod="openshift-network-operator/iptables-alerter-nb5n5"
Jul 22 11:49:50.218335 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.216002    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-host-var-lib-cni-multus\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.218335 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.216029    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-host-run-multus-certs\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.218335 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.216042    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-etc-sysctl-conf\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.218335 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.216055    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-etc-kubernetes\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.218335 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.216092    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-node-log\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.218335 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.216098    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-etc-systemd\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.218335 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.216119    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bdda6819-cc38-477c-812a-a17e0b071acb-cni-binary-copy\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.218335 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.216210    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-host-var-lib-cni-multus\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.218335 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.216259    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-host-run-multus-certs\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.218335 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.216308    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-etc-kubernetes\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.218335 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.216356    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-etc-systemd\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.218335 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.216393    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4fc8b4ba-9376-46b3-b29a-5f60380da898-kubelet-config\") pod \"global-pull-secret-syncer-k9p8m\" (UID: \"4fc8b4ba-9376-46b3-b29a-5f60380da898\") " pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:49:50.218335 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.216395    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-systemd-units\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.219168 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:50.216468    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 11:49:50.219168 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.216645    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/12caa2da-758e-4acc-aa20-e2c253c0bbef-iptables-alerter-script\") pod \"iptables-alerter-nb5n5\" (UID: \"12caa2da-758e-4acc-aa20-e2c253c0bbef\") " pod="openshift-network-operator/iptables-alerter-nb5n5"
Jul 22 11:49:50.219168 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:50.216677    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fc8b4ba-9376-46b3-b29a-5f60380da898-original-pull-secret podName:4fc8b4ba-9376-46b3-b29a-5f60380da898 nodeName:}" failed. No retries permitted until 2026-07-22 11:49:50.716654313 +0000 UTC m=+3.083169543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fc8b4ba-9376-46b3-b29a-5f60380da898-original-pull-secret") pod "global-pull-secret-syncer-k9p8m" (UID: "4fc8b4ba-9376-46b3-b29a-5f60380da898") : object "kube-system"/"original-pull-secret" not registered
Jul 22 11:49:50.219168 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.216807    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-etc-modprobe-d\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.219168 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.217075    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f1fda4c8-fd99-442c-a5c0-5964027c2fec-env-overrides\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.219168 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.217080    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bdda6819-cc38-477c-812a-a17e0b071acb-multus-daemon-config\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.219168 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.217142    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd-system-cni-dir\") pod \"multus-additional-cni-plugins-zx6zg\" (UID: \"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd\") " pod="openshift-multus/multus-additional-cni-plugins-zx6zg"
Jul 22 11:49:50.219168 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.217191    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-system-cni-dir\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.219168 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.217179    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-etc-kubernetes\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.219168 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.217203    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2e166771-d43d-41ec-b850-edb3523ec4b1-device-dir\") pod \"aws-ebs-csi-driver-node-2pz2p\" (UID: \"2e166771-d43d-41ec-b850-edb3523ec4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p"
Jul 22 11:49:50.219168 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.217245    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-host-kubelet\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.219168 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.217261    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-cnibin\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.219168 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.215539    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f527d4c-c096-412f-bebc-3f974fe42dc8-tmp-dir\") pod \"node-resolver-csd5r\" (UID: \"9f527d4c-c096-412f-bebc-3f974fe42dc8\") " pod="openshift-dns/node-resolver-csd5r"
Jul 22 11:49:50.219168 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.217283    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-multus-conf-dir\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.219168 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.217334    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-etc-sysconfig\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.219941 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.217329    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2e166771-d43d-41ec-b850-edb3523ec4b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-2pz2p\" (UID: \"2e166771-d43d-41ec-b850-edb3523ec4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p"
Jul 22 11:49:50.219941 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.217358    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-host-run-netns\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.219941 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.217406    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-etc-openvswitch\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.219941 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.217439    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-lib-modules\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.219941 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.217451    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-run-openvswitch\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.219941 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.217532    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-host-run-netns\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.219941 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.217572    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-run-systemd\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.219941 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.217579    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1fda4c8-fd99-442c-a5c0-5964027c2fec-run-ovn\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.219941 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.217573    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd87b2d4-4ced-4540-9c37-36d9b7b74860-tmp\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.219941 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.217610    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12caa2da-758e-4acc-aa20-e2c253c0bbef-host-slash\") pod \"iptables-alerter-nb5n5\" (UID: \"12caa2da-758e-4acc-aa20-e2c253c0bbef\") " pod="openshift-network-operator/iptables-alerter-nb5n5"
Jul 22 11:49:50.219941 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:50.217706    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:49:50.219941 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:50.218211    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0be44dc-51ec-49a4-97da-8e3923d9aaae-metrics-certs podName:f0be44dc-51ec-49a4-97da-8e3923d9aaae nodeName:}" failed. No retries permitted until 2026-07-22 11:49:50.718172267 +0000 UTC m=+3.084687499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0be44dc-51ec-49a4-97da-8e3923d9aaae-metrics-certs") pod "network-metrics-daemon-7ftqt" (UID: "f0be44dc-51ec-49a4-97da-8e3923d9aaae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:49:50.219941 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.218744    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bdda6819-cc38-477c-812a-a17e0b071acb-host-run-k8s-cni-cncf-io\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.219941 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.219017    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f1fda4c8-fd99-442c-a5c0-5964027c2fec-ovnkube-config\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.220644 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.219460    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zx6zg\" (UID: \"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd\") " pod="openshift-multus/multus-additional-cni-plugins-zx6zg"
Jul 22 11:49:50.220644 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.220016    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f1fda4c8-fd99-442c-a5c0-5964027c2fec-ovnkube-script-lib\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.220644 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.220095    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd87b2d4-4ced-4540-9c37-36d9b7b74860-sys\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.225259 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.221065    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1fda4c8-fd99-442c-a5c0-5964027c2fec-ovn-node-metrics-cert\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.225259 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:50.224156    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 11:49:50.225259 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:50.224182    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 11:49:50.225259 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:50.224198    2558 projected.go:196] Error preparing data for projected volume kube-api-access-ntvpd for pod openshift-network-diagnostics/network-check-target-j8flw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:49:50.225259 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:50.224276    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55e34c7b-6521-42cf-a952-d08ec5ce5304-kube-api-access-ntvpd podName:55e34c7b-6521-42cf-a952-d08ec5ce5304 nodeName:}" failed. No retries permitted until 2026-07-22 11:49:50.72425976 +0000 UTC m=+3.090774986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ntvpd" (UniqueName: "kubernetes.io/projected/55e34c7b-6521-42cf-a952-d08ec5ce5304-kube-api-access-ntvpd") pod "network-check-target-j8flw" (UID: "55e34c7b-6521-42cf-a952-d08ec5ce5304") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:49:50.228563 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.228539    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7trr\" (UniqueName: \"kubernetes.io/projected/12caa2da-758e-4acc-aa20-e2c253c0bbef-kube-api-access-n7trr\") pod \"iptables-alerter-nb5n5\" (UID: \"12caa2da-758e-4acc-aa20-e2c253c0bbef\") " pod="openshift-network-operator/iptables-alerter-nb5n5"
Jul 22 11:49:50.229778 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.229627    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c4k7\" (UniqueName: \"kubernetes.io/projected/2e166771-d43d-41ec-b850-edb3523ec4b1-kube-api-access-7c4k7\") pod \"aws-ebs-csi-driver-node-2pz2p\" (UID: \"2e166771-d43d-41ec-b850-edb3523ec4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p"
Jul 22 11:49:50.232613 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.232472    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj7rd\" (UniqueName: \"kubernetes.io/projected/9f527d4c-c096-412f-bebc-3f974fe42dc8-kube-api-access-gj7rd\") pod \"node-resolver-csd5r\" (UID: \"9f527d4c-c096-412f-bebc-3f974fe42dc8\") " pod="openshift-dns/node-resolver-csd5r"
Jul 22 11:49:50.233398 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.232875    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cd87b2d4-4ced-4540-9c37-36d9b7b74860-etc-tuned\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.233398 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.233057    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn5br\" (UniqueName: \"kubernetes.io/projected/f1fda4c8-fd99-442c-a5c0-5964027c2fec-kube-api-access-vn5br\") pod \"ovnkube-node-f65bz\" (UID: \"f1fda4c8-fd99-442c-a5c0-5964027c2fec\") " pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.233398 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.233301    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd87b2d4-4ced-4540-9c37-36d9b7b74860-tmp\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.233398 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.233309    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzkjh\" (UniqueName: \"kubernetes.io/projected/bdda6819-cc38-477c-812a-a17e0b071acb-kube-api-access-qzkjh\") pod \"multus-qpbnd\" (UID: \"bdda6819-cc38-477c-812a-a17e0b071acb\") " pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.233644 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.233505    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j5dq\" (UniqueName: \"kubernetes.io/projected/120a973f-3054-418e-94f7-0c38939ae63f-kube-api-access-5j5dq\") pod \"node-ca-7p2jg\" (UID: \"120a973f-3054-418e-94f7-0c38939ae63f\") " pod="openshift-image-registry/node-ca-7p2jg"
Jul 22 11:49:50.234258 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.234226    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59lsr\" (UniqueName: \"kubernetes.io/projected/cd87b2d4-4ced-4540-9c37-36d9b7b74860-kube-api-access-59lsr\") pod \"tuned-tqrg6\" (UID: \"cd87b2d4-4ced-4540-9c37-36d9b7b74860\") " pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.234439 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.234414    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e89ec73b-8401-4834-91f6-c6ee13d5dc74-agent-certs\") pod \"konnectivity-agent-sdh44\" (UID: \"e89ec73b-8401-4834-91f6-c6ee13d5dc74\") " pod="kube-system/konnectivity-agent-sdh44"
Jul 22 11:49:50.235636 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.235611    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmdzm\" (UniqueName: \"kubernetes.io/projected/f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd-kube-api-access-vmdzm\") pod \"multus-additional-cni-plugins-zx6zg\" (UID: \"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd\") " pod="openshift-multus/multus-additional-cni-plugins-zx6zg"
Jul 22 11:49:50.235862 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.235840    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7rf8\" (UniqueName: \"kubernetes.io/projected/f0be44dc-51ec-49a4-97da-8e3923d9aaae-kube-api-access-q7rf8\") pod \"network-metrics-daemon-7ftqt\" (UID: \"f0be44dc-51ec-49a4-97da-8e3923d9aaae\") " pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:49:50.386328 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.386065    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nb5n5"
Jul 22 11:49:50.396197 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:50.396164    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12caa2da_758e_4acc_aa20_e2c253c0bbef.slice/crio-dc0ce2b60c64ec4b797523d079c74d535b718c97e287c79a3d80e5cdf57cdf52 WatchSource:0}: Error finding container dc0ce2b60c64ec4b797523d079c74d535b718c97e287c79a3d80e5cdf57cdf52: Status 404 returned error can't find the container with id dc0ce2b60c64ec4b797523d079c74d535b718c97e287c79a3d80e5cdf57cdf52
Jul 22 11:49:50.397189 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.397164    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:49:50.414100 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.414079    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-csd5r"
Jul 22 11:49:50.419227 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.419206    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qpbnd"
Jul 22 11:49:50.427009 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.426990    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p"
Jul 22 11:49:50.436804 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.436780    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7p2jg"
Jul 22 11:49:50.445148 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.445096    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nb5n5" event={"ID":"12caa2da-758e-4acc-aa20-e2c253c0bbef","Type":"ContainerStarted","Data":"dc0ce2b60c64ec4b797523d079c74d535b718c97e287c79a3d80e5cdf57cdf52"}
Jul 22 11:49:50.445711 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.445692    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tqrg6"
Jul 22 11:49:50.446259 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.446222    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-166.ec2.internal" event={"ID":"f52713c0287a28d2385b478ed125ac34","Type":"ContainerStarted","Data":"f18cf26a440aaeaea37e7dbaa702e2f2b4391739f70ed796fd5178307ea2e637"}
Jul 22 11:49:50.447450 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.447423    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-166.ec2.internal" event={"ID":"991e2f0d770ef3fd3920051d94b0f78f","Type":"ContainerStarted","Data":"b082c441019c96bfd13dbe4eb1318d5d07d66fcf01833cd312a694570ac2b7e4"}
Jul 22 11:49:50.454575 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.454553    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zx6zg"
Jul 22 11:49:50.462451 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.462429    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sdh44"
Jul 22 11:49:50.721815 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.721717    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0be44dc-51ec-49a4-97da-8e3923d9aaae-metrics-certs\") pod \"network-metrics-daemon-7ftqt\" (UID: \"f0be44dc-51ec-49a4-97da-8e3923d9aaae\") " pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:49:50.721815 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.721769    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fc8b4ba-9376-46b3-b29a-5f60380da898-original-pull-secret\") pod \"global-pull-secret-syncer-k9p8m\" (UID: \"4fc8b4ba-9376-46b3-b29a-5f60380da898\") " pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:49:50.722038 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:50.721896    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 11:49:50.722038 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:50.721900    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:49:50.722038 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:50.721970    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fc8b4ba-9376-46b3-b29a-5f60380da898-original-pull-secret podName:4fc8b4ba-9376-46b3-b29a-5f60380da898 nodeName:}" failed. No retries permitted until 2026-07-22 11:49:51.721950408 +0000 UTC m=+4.088465637 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fc8b4ba-9376-46b3-b29a-5f60380da898-original-pull-secret") pod "global-pull-secret-syncer-k9p8m" (UID: "4fc8b4ba-9376-46b3-b29a-5f60380da898") : object "kube-system"/"original-pull-secret" not registered
Jul 22 11:49:50.722038 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:50.721987    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0be44dc-51ec-49a4-97da-8e3923d9aaae-metrics-certs podName:f0be44dc-51ec-49a4-97da-8e3923d9aaae nodeName:}" failed. No retries permitted until 2026-07-22 11:49:51.721980665 +0000 UTC m=+4.088495889 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0be44dc-51ec-49a4-97da-8e3923d9aaae-metrics-certs") pod "network-metrics-daemon-7ftqt" (UID: "f0be44dc-51ec-49a4-97da-8e3923d9aaae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:49:50.823182 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:50.823137    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntvpd\" (UniqueName: \"kubernetes.io/projected/55e34c7b-6521-42cf-a952-d08ec5ce5304-kube-api-access-ntvpd\") pod \"network-check-target-j8flw\" (UID: \"55e34c7b-6521-42cf-a952-d08ec5ce5304\") " pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:49:50.823338 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:50.823300    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 11:49:50.823338 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:50.823320    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 11:49:50.823338 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:50.823330    2558 projected.go:196] Error preparing data for projected volume kube-api-access-ntvpd for pod openshift-network-diagnostics/network-check-target-j8flw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:49:50.823494 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:50.823392    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55e34c7b-6521-42cf-a952-d08ec5ce5304-kube-api-access-ntvpd podName:55e34c7b-6521-42cf-a952-d08ec5ce5304 nodeName:}" failed. No retries permitted until 2026-07-22 11:49:51.823371548 +0000 UTC m=+4.189886771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ntvpd" (UniqueName: "kubernetes.io/projected/55e34c7b-6521-42cf-a952-d08ec5ce5304-kube-api-access-ntvpd") pod "network-check-target-j8flw" (UID: "55e34c7b-6521-42cf-a952-d08ec5ce5304") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:49:51.151776 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:51.151688    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 11:44:50 +0000 UTC" deadline="2028-03-27 10:37:34.7993284 +0000 UTC"
Jul 22 11:49:51.151776 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:51.151719    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14734h47m43.647612955s"
Jul 22 11:49:51.441385 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:51.441305    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:49:51.441563 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:51.441421    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:49:51.441563 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:51.441475    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:49:51.441563 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:51.441545    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:49:51.441760 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:51.441678    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:49:51.441813 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:51.441769    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:49:51.530631 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:51.530589    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd87b2d4_4ced_4540_9c37_36d9b7b74860.slice/crio-04d3fc8c7372f8321296b260f1241f41053ded589d97967e88ebe31b5f35beb3 WatchSource:0}: Error finding container 04d3fc8c7372f8321296b260f1241f41053ded589d97967e88ebe31b5f35beb3: Status 404 returned error can't find the container with id 04d3fc8c7372f8321296b260f1241f41053ded589d97967e88ebe31b5f35beb3
Jul 22 11:49:51.533185 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:51.533070    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode89ec73b_8401_4834_91f6_c6ee13d5dc74.slice/crio-a79fe7a0f97a89ac3060be9ecae582751db35b252672f816af20b1147a813928 WatchSource:0}: Error finding container a79fe7a0f97a89ac3060be9ecae582751db35b252672f816af20b1147a813928: Status 404 returned error can't find the container with id a79fe7a0f97a89ac3060be9ecae582751db35b252672f816af20b1147a813928
Jul 22 11:49:51.536016 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:51.535950    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1fda4c8_fd99_442c_a5c0_5964027c2fec.slice/crio-72061b0f952b1bb766d68de525fc385864c4e0ee0d9ca9240aeb0a792963b0a5 WatchSource:0}: Error finding container 72061b0f952b1bb766d68de525fc385864c4e0ee0d9ca9240aeb0a792963b0a5: Status 404 returned error can't find the container with id 72061b0f952b1bb766d68de525fc385864c4e0ee0d9ca9240aeb0a792963b0a5
Jul 22 11:49:51.537020 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:51.536987    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod120a973f_3054_418e_94f7_0c38939ae63f.slice/crio-d9c1d6c6b017417d71bbf5f5638761c96d3ab76788aa67e2e538f4e736103e69 WatchSource:0}: Error finding container d9c1d6c6b017417d71bbf5f5638761c96d3ab76788aa67e2e538f4e736103e69: Status 404 returned error can't find the container with id d9c1d6c6b017417d71bbf5f5638761c96d3ab76788aa67e2e538f4e736103e69
Jul 22 11:49:51.545052 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:49:51.545024    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdda6819_cc38_477c_812a_a17e0b071acb.slice/crio-fe4cc2b60b0a4886afa5bbe11aeaa67ffc80aa902bfea481246408b6c9636084 WatchSource:0}: Error finding container fe4cc2b60b0a4886afa5bbe11aeaa67ffc80aa902bfea481246408b6c9636084: Status 404 returned error can't find the container with id fe4cc2b60b0a4886afa5bbe11aeaa67ffc80aa902bfea481246408b6c9636084
Jul 22 11:49:51.730739 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:51.730412    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0be44dc-51ec-49a4-97da-8e3923d9aaae-metrics-certs\") pod \"network-metrics-daemon-7ftqt\" (UID: \"f0be44dc-51ec-49a4-97da-8e3923d9aaae\") " pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:49:51.730739 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:51.730618    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:49:51.730739 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:51.730719    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fc8b4ba-9376-46b3-b29a-5f60380da898-original-pull-secret\") pod \"global-pull-secret-syncer-k9p8m\" (UID: \"4fc8b4ba-9376-46b3-b29a-5f60380da898\") " pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:49:51.730975 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:51.730743    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0be44dc-51ec-49a4-97da-8e3923d9aaae-metrics-certs podName:f0be44dc-51ec-49a4-97da-8e3923d9aaae nodeName:}" failed. No retries permitted until 2026-07-22 11:49:53.730719229 +0000 UTC m=+6.097234489 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0be44dc-51ec-49a4-97da-8e3923d9aaae-metrics-certs") pod "network-metrics-daemon-7ftqt" (UID: "f0be44dc-51ec-49a4-97da-8e3923d9aaae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:49:51.730975 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:51.730811    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 11:49:51.730975 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:51.730873    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fc8b4ba-9376-46b3-b29a-5f60380da898-original-pull-secret podName:4fc8b4ba-9376-46b3-b29a-5f60380da898 nodeName:}" failed. No retries permitted until 2026-07-22 11:49:53.73085523 +0000 UTC m=+6.097370471 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fc8b4ba-9376-46b3-b29a-5f60380da898-original-pull-secret") pod "global-pull-secret-syncer-k9p8m" (UID: "4fc8b4ba-9376-46b3-b29a-5f60380da898") : object "kube-system"/"original-pull-secret" not registered
Jul 22 11:49:51.832059 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:51.832019    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntvpd\" (UniqueName: \"kubernetes.io/projected/55e34c7b-6521-42cf-a952-d08ec5ce5304-kube-api-access-ntvpd\") pod \"network-check-target-j8flw\" (UID: \"55e34c7b-6521-42cf-a952-d08ec5ce5304\") " pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:49:51.832208 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:51.832171    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 11:49:51.832208 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:51.832188    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 11:49:51.832208 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:51.832202    2558 projected.go:196] Error preparing data for projected volume kube-api-access-ntvpd for pod openshift-network-diagnostics/network-check-target-j8flw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:49:51.832355 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:51.832265    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55e34c7b-6521-42cf-a952-d08ec5ce5304-kube-api-access-ntvpd podName:55e34c7b-6521-42cf-a952-d08ec5ce5304 nodeName:}" failed. No retries permitted until 2026-07-22 11:49:53.832246549 +0000 UTC m=+6.198761780 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ntvpd" (UniqueName: "kubernetes.io/projected/55e34c7b-6521-42cf-a952-d08ec5ce5304-kube-api-access-ntvpd") pod "network-check-target-j8flw" (UID: "55e34c7b-6521-42cf-a952-d08ec5ce5304") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:49:52.152060 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:52.151884    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 11:44:50 +0000 UTC" deadline="2028-02-12 07:37:25.317497067 +0000 UTC"
Jul 22 11:49:52.152060 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:52.151949    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13675h47m33.165552611s"
Jul 22 11:49:52.466144 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:52.465287    2558 generic.go:356] "Generic (PLEG): container finished" podID="991e2f0d770ef3fd3920051d94b0f78f" containerID="2443f7648208125f1909ce019c688ab5515fbc20f4269dd12c1ce607556feac4" exitCode=0
Jul 22 11:49:52.466144 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:52.465653    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-166.ec2.internal" event={"ID":"991e2f0d770ef3fd3920051d94b0f78f","Type":"ContainerDied","Data":"2443f7648208125f1909ce019c688ab5515fbc20f4269dd12c1ce607556feac4"}
Jul 22 11:49:52.472654 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:52.472426    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qpbnd" event={"ID":"bdda6819-cc38-477c-812a-a17e0b071acb","Type":"ContainerStarted","Data":"fe4cc2b60b0a4886afa5bbe11aeaa67ffc80aa902bfea481246408b6c9636084"}
Jul 22 11:49:52.479899 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:52.479846    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-csd5r" event={"ID":"9f527d4c-c096-412f-bebc-3f974fe42dc8","Type":"ContainerStarted","Data":"47d4ea25221bba6f620dc702083736157ac67ba6e65f65ca5be4cb831827dfc6"}
Jul 22 11:49:52.488121 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:52.488091    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zx6zg" event={"ID":"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd","Type":"ContainerStarted","Data":"42fbc3d877d14c1cbdd25a6fab63c8a831077cadb6152376bcb676da622d3a1b"}
Jul 22 11:49:52.504875 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:52.504842    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tqrg6" event={"ID":"cd87b2d4-4ced-4540-9c37-36d9b7b74860","Type":"ContainerStarted","Data":"04d3fc8c7372f8321296b260f1241f41053ded589d97967e88ebe31b5f35beb3"}
Jul 22 11:49:52.512572 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:52.512540    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p" event={"ID":"2e166771-d43d-41ec-b850-edb3523ec4b1","Type":"ContainerStarted","Data":"85eca91f5dafe2f42e7441f5770642e45d6f6fd00ab8d9835f402eca6ffa92d7"}
Jul 22 11:49:52.519148 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:52.519051    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7p2jg" event={"ID":"120a973f-3054-418e-94f7-0c38939ae63f","Type":"ContainerStarted","Data":"d9c1d6c6b017417d71bbf5f5638761c96d3ab76788aa67e2e538f4e736103e69"}
Jul 22 11:49:52.526409 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:52.526285    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f65bz" event={"ID":"f1fda4c8-fd99-442c-a5c0-5964027c2fec","Type":"ContainerStarted","Data":"72061b0f952b1bb766d68de525fc385864c4e0ee0d9ca9240aeb0a792963b0a5"}
Jul 22 11:49:52.532647 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:52.532613    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sdh44" event={"ID":"e89ec73b-8401-4834-91f6-c6ee13d5dc74","Type":"ContainerStarted","Data":"a79fe7a0f97a89ac3060be9ecae582751db35b252672f816af20b1147a813928"}
Jul 22 11:49:52.538906 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:52.538875    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-166.ec2.internal" event={"ID":"f52713c0287a28d2385b478ed125ac34","Type":"ContainerStarted","Data":"6a0fba32848181047cd982f734ced821af4907ca80bea3c77a8cbc32a1eecdb4"}
Jul 22 11:49:53.441096 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:53.441052    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:49:53.441563 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:53.441181    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:49:53.441731 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:53.441573    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:49:53.441731 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:53.441695    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:49:53.441863 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:53.441762    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:49:53.441863 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:53.441841    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:49:53.753488 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:53.753404    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fc8b4ba-9376-46b3-b29a-5f60380da898-original-pull-secret\") pod \"global-pull-secret-syncer-k9p8m\" (UID: \"4fc8b4ba-9376-46b3-b29a-5f60380da898\") " pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:49:53.753670 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:53.753504    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0be44dc-51ec-49a4-97da-8e3923d9aaae-metrics-certs\") pod \"network-metrics-daemon-7ftqt\" (UID: \"f0be44dc-51ec-49a4-97da-8e3923d9aaae\") " pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:49:53.753670 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:53.753635    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:49:53.753796 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:53.753696    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0be44dc-51ec-49a4-97da-8e3923d9aaae-metrics-certs podName:f0be44dc-51ec-49a4-97da-8e3923d9aaae nodeName:}" failed. No retries permitted until 2026-07-22 11:49:57.753676071 +0000 UTC m=+10.120191308 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0be44dc-51ec-49a4-97da-8e3923d9aaae-metrics-certs") pod "network-metrics-daemon-7ftqt" (UID: "f0be44dc-51ec-49a4-97da-8e3923d9aaae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:49:53.754173 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:53.754064    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 11:49:53.754173 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:53.754115    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fc8b4ba-9376-46b3-b29a-5f60380da898-original-pull-secret podName:4fc8b4ba-9376-46b3-b29a-5f60380da898 nodeName:}" failed. No retries permitted until 2026-07-22 11:49:57.754098962 +0000 UTC m=+10.120614191 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fc8b4ba-9376-46b3-b29a-5f60380da898-original-pull-secret") pod "global-pull-secret-syncer-k9p8m" (UID: "4fc8b4ba-9376-46b3-b29a-5f60380da898") : object "kube-system"/"original-pull-secret" not registered
Jul 22 11:49:53.858584 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:53.857875    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntvpd\" (UniqueName: \"kubernetes.io/projected/55e34c7b-6521-42cf-a952-d08ec5ce5304-kube-api-access-ntvpd\") pod \"network-check-target-j8flw\" (UID: \"55e34c7b-6521-42cf-a952-d08ec5ce5304\") " pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:49:53.858584 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:53.858084    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 11:49:53.858584 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:53.858103    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 11:49:53.858584 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:53.858116    2558 projected.go:196] Error preparing data for projected volume kube-api-access-ntvpd for pod openshift-network-diagnostics/network-check-target-j8flw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:49:53.858584 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:53.858176    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55e34c7b-6521-42cf-a952-d08ec5ce5304-kube-api-access-ntvpd podName:55e34c7b-6521-42cf-a952-d08ec5ce5304 nodeName:}" failed. No retries permitted until 2026-07-22 11:49:57.858154926 +0000 UTC m=+10.224670151 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ntvpd" (UniqueName: "kubernetes.io/projected/55e34c7b-6521-42cf-a952-d08ec5ce5304-kube-api-access-ntvpd") pod "network-check-target-j8flw" (UID: "55e34c7b-6521-42cf-a952-d08ec5ce5304") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:49:55.440874 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:55.440838    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:49:55.441331 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:55.440978    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:49:55.441331 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:55.441149    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:49:55.441331 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:55.441244    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:49:55.441331 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:55.441304    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:49:55.441563 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:55.441373    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:49:57.441559 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:57.441521    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:49:57.442038 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:57.441678    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:49:57.442038 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:57.441691    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:49:57.442038 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:57.441710    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:49:57.442038 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:57.441784    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:49:57.442038 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:57.441901    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:49:57.791879 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:57.791788    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fc8b4ba-9376-46b3-b29a-5f60380da898-original-pull-secret\") pod \"global-pull-secret-syncer-k9p8m\" (UID: \"4fc8b4ba-9376-46b3-b29a-5f60380da898\") " pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:49:57.792046 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:57.791897    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0be44dc-51ec-49a4-97da-8e3923d9aaae-metrics-certs\") pod \"network-metrics-daemon-7ftqt\" (UID: \"f0be44dc-51ec-49a4-97da-8e3923d9aaae\") " pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:49:57.792046 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:57.791961    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 11:49:57.792046 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:57.791995    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:49:57.792046 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:57.792032    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fc8b4ba-9376-46b3-b29a-5f60380da898-original-pull-secret podName:4fc8b4ba-9376-46b3-b29a-5f60380da898 nodeName:}" failed. No retries permitted until 2026-07-22 11:50:05.792010948 +0000 UTC m=+18.158526186 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fc8b4ba-9376-46b3-b29a-5f60380da898-original-pull-secret") pod "global-pull-secret-syncer-k9p8m" (UID: "4fc8b4ba-9376-46b3-b29a-5f60380da898") : object "kube-system"/"original-pull-secret" not registered
Jul 22 11:49:57.792259 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:57.792053    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0be44dc-51ec-49a4-97da-8e3923d9aaae-metrics-certs podName:f0be44dc-51ec-49a4-97da-8e3923d9aaae nodeName:}" failed. No retries permitted until 2026-07-22 11:50:05.792042181 +0000 UTC m=+18.158557406 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0be44dc-51ec-49a4-97da-8e3923d9aaae-metrics-certs") pod "network-metrics-daemon-7ftqt" (UID: "f0be44dc-51ec-49a4-97da-8e3923d9aaae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:49:57.892807 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:57.892770    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntvpd\" (UniqueName: \"kubernetes.io/projected/55e34c7b-6521-42cf-a952-d08ec5ce5304-kube-api-access-ntvpd\") pod \"network-check-target-j8flw\" (UID: \"55e34c7b-6521-42cf-a952-d08ec5ce5304\") " pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:49:57.893005 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:57.892941    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 11:49:57.893005 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:57.892963    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 11:49:57.893005 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:57.892974    2558 projected.go:196] Error preparing data for projected volume kube-api-access-ntvpd for pod openshift-network-diagnostics/network-check-target-j8flw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:49:57.893154 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:57.893058    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55e34c7b-6521-42cf-a952-d08ec5ce5304-kube-api-access-ntvpd podName:55e34c7b-6521-42cf-a952-d08ec5ce5304 nodeName:}" failed. No retries permitted until 2026-07-22 11:50:05.8930372 +0000 UTC m=+18.259552440 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ntvpd" (UniqueName: "kubernetes.io/projected/55e34c7b-6521-42cf-a952-d08ec5ce5304-kube-api-access-ntvpd") pod "network-check-target-j8flw" (UID: "55e34c7b-6521-42cf-a952-d08ec5ce5304") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:49:59.441395 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:59.441302    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:49:59.441864 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:59.441484    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:49:59.441864 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:59.441732    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:49:59.441864 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:59.441833    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:49:59.442047 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:49:59.441889    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:49:59.442047 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:49:59.441957    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:50:01.440709 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:01.440676    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:01.441116 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:01.440684    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:01.441116 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:01.440819    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:50:01.441116 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:01.440684    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:01.441116 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:01.440925    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:50:01.441116 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:01.441006    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:50:03.440845 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:03.440814    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:03.441292 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:03.440828    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:03.441292 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:03.440919    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:50:03.441292 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:03.440930    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:03.441292 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:03.441015    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:50:03.441292 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:03.441060    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:50:05.441462 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:05.441390    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:05.441462 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:05.441407    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:05.441462 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:05.441407    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:05.442102 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:05.441528    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:50:05.442102 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:05.441602    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:50:05.442102 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:05.441683    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:50:05.852002 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:05.851916    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0be44dc-51ec-49a4-97da-8e3923d9aaae-metrics-certs\") pod \"network-metrics-daemon-7ftqt\" (UID: \"f0be44dc-51ec-49a4-97da-8e3923d9aaae\") " pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:05.852002 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:05.851970    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fc8b4ba-9376-46b3-b29a-5f60380da898-original-pull-secret\") pod \"global-pull-secret-syncer-k9p8m\" (UID: \"4fc8b4ba-9376-46b3-b29a-5f60380da898\") " pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:05.852270 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:05.852089    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 11:50:05.852270 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:05.852090    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:50:05.852270 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:05.852147    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fc8b4ba-9376-46b3-b29a-5f60380da898-original-pull-secret podName:4fc8b4ba-9376-46b3-b29a-5f60380da898 nodeName:}" failed. No retries permitted until 2026-07-22 11:50:21.852129263 +0000 UTC m=+34.218644484 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fc8b4ba-9376-46b3-b29a-5f60380da898-original-pull-secret") pod "global-pull-secret-syncer-k9p8m" (UID: "4fc8b4ba-9376-46b3-b29a-5f60380da898") : object "kube-system"/"original-pull-secret" not registered
Jul 22 11:50:05.852270 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:05.852165    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0be44dc-51ec-49a4-97da-8e3923d9aaae-metrics-certs podName:f0be44dc-51ec-49a4-97da-8e3923d9aaae nodeName:}" failed. No retries permitted until 2026-07-22 11:50:21.852157344 +0000 UTC m=+34.218672565 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0be44dc-51ec-49a4-97da-8e3923d9aaae-metrics-certs") pod "network-metrics-daemon-7ftqt" (UID: "f0be44dc-51ec-49a4-97da-8e3923d9aaae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:50:05.952446 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:05.952414    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntvpd\" (UniqueName: \"kubernetes.io/projected/55e34c7b-6521-42cf-a952-d08ec5ce5304-kube-api-access-ntvpd\") pod \"network-check-target-j8flw\" (UID: \"55e34c7b-6521-42cf-a952-d08ec5ce5304\") " pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:05.952645 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:05.952607    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 11:50:05.952717 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:05.952656    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 11:50:05.952717 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:05.952673    2558 projected.go:196] Error preparing data for projected volume kube-api-access-ntvpd for pod openshift-network-diagnostics/network-check-target-j8flw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:50:05.952805 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:05.952734    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55e34c7b-6521-42cf-a952-d08ec5ce5304-kube-api-access-ntvpd podName:55e34c7b-6521-42cf-a952-d08ec5ce5304 nodeName:}" failed. No retries permitted until 2026-07-22 11:50:21.95271529 +0000 UTC m=+34.319230511 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ntvpd" (UniqueName: "kubernetes.io/projected/55e34c7b-6521-42cf-a952-d08ec5ce5304-kube-api-access-ntvpd") pod "network-check-target-j8flw" (UID: "55e34c7b-6521-42cf-a952-d08ec5ce5304") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:50:07.440910 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:07.440875    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:07.441365 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:07.440981    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:07.441365 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:07.440994    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:50:07.441365 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:07.441015    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:07.441365 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:07.441106    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:50:07.441365 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:07.441187    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:50:09.441015 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:09.440983    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:09.441363 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:09.441026    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:09.441363 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:09.441029    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:09.441363 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:09.441107    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:50:09.441363 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:09.441221    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:50:09.441363 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:09.441303    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:50:10.591129 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:10.590954    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-166.ec2.internal" event={"ID":"991e2f0d770ef3fd3920051d94b0f78f","Type":"ContainerStarted","Data":"19ee7e5b41a4cdcfbb45333cd3a191148f49a3efca506e68b98b85dfb295bb69"}
Jul 22 11:50:10.592419 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:10.592391    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qpbnd" event={"ID":"bdda6819-cc38-477c-812a-a17e0b071acb","Type":"ContainerStarted","Data":"ab052a2aa5485223578d1a7a87aeb9fdd377bb97675c7659fa3c365d9e0efdca"}
Jul 22 11:50:10.593674 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:10.593653    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-csd5r" event={"ID":"9f527d4c-c096-412f-bebc-3f974fe42dc8","Type":"ContainerStarted","Data":"5996eafe6bf57fd8faecf7956a3e00e9e0516ded583695d7ec8a2bec8be8124c"}
Jul 22 11:50:10.594981 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:10.594960    2558 generic.go:356] "Generic (PLEG): container finished" podID="f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd" containerID="e237b8f36a1031b2c29d6c79822acf3e6fefe3b728a783f66df4327ec24890be" exitCode=0
Jul 22 11:50:10.595077 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:10.595028    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zx6zg" event={"ID":"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd","Type":"ContainerDied","Data":"e237b8f36a1031b2c29d6c79822acf3e6fefe3b728a783f66df4327ec24890be"}
Jul 22 11:50:10.596454 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:10.596438    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tqrg6" event={"ID":"cd87b2d4-4ced-4540-9c37-36d9b7b74860","Type":"ContainerStarted","Data":"9decdba5fbcd814d9c5e8211fd6af0ab5b27e45b3d2e0ef1ea6d9eee99c79bd8"}
Jul 22 11:50:10.597876 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:10.597849    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p" event={"ID":"2e166771-d43d-41ec-b850-edb3523ec4b1","Type":"ContainerStarted","Data":"6c13bf2582d865e975924e24d6c4c402d3cdfa0fe498569ba143eb52eef77069"}
Jul 22 11:50:10.599247 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:10.599218    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7p2jg" event={"ID":"120a973f-3054-418e-94f7-0c38939ae63f","Type":"ContainerStarted","Data":"6090bcd25578b3892969aa07f3496d8492861c0ebe2b34b5bf4db38f79c22dd7"}
Jul 22 11:50:10.600774 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:10.600753    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sdh44" event={"ID":"e89ec73b-8401-4834-91f6-c6ee13d5dc74","Type":"ContainerStarted","Data":"61afd8353940f683a9f20dcab2244bdaa50890b6269877f0f530b148c962a5da"}
Jul 22 11:50:10.612199 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:10.612138    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-166.ec2.internal" podStartSLOduration=21.612125749 podStartE2EDuration="21.612125749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 11:49:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:49:52.558610008 +0000 UTC m=+4.925125257" watchObservedRunningTime="2026-07-22 11:50:10.612125749 +0000 UTC m=+22.978641057"
Jul 22 11:50:10.612472 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:10.612448    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-166.ec2.internal" podStartSLOduration=21.61244202 podStartE2EDuration="21.61244202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 11:49:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:50:10.610797471 +0000 UTC m=+22.977312716" watchObservedRunningTime="2026-07-22 11:50:10.61244202 +0000 UTC m=+22.978957264"
Jul 22 11:50:10.642926 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:10.642881    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-csd5r" podStartSLOduration=9.100468889 podStartE2EDuration="22.642865128s" totalImagesPullingTime="13.542396239s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 11:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:50:10.642628468 +0000 UTC m=+23.009143704" watchObservedRunningTime="2026-07-22 11:50:10.642865128 +0000 UTC m=+23.009380373"
Jul 22 11:50:10.672667 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:10.672629    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qpbnd" podStartSLOduration=4.391026716 podStartE2EDuration="22.672604385s" totalImagesPullingTime="18.281577669s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 11:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:50:10.672450061 +0000 UTC m=+23.038965304" watchObservedRunningTime="2026-07-22 11:50:10.672604385 +0000 UTC m=+23.039119628"
Jul 22 11:50:10.696512 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:10.696466    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7p2jg" podStartSLOduration=4.4461223610000005 podStartE2EDuration="22.696450382s" totalImagesPullingTime="18.250328021s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 11:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:50:10.696172494 +0000 UTC m=+23.062687738" watchObservedRunningTime="2026-07-22 11:50:10.696450382 +0000 UTC m=+23.062965626"
Jul 22 11:50:10.758253 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:10.758166    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tqrg6" podStartSLOduration=4.498722633 podStartE2EDuration="22.75814886s" totalImagesPullingTime="18.259426227s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 11:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:50:10.721758183 +0000 UTC m=+23.088273426" watchObservedRunningTime="2026-07-22 11:50:10.75814886 +0000 UTC m=+23.124664101"
Jul 22 11:50:10.781319 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:10.781273    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sdh44" podStartSLOduration=4.52643761 podStartE2EDuration="22.781257779s" totalImagesPullingTime="18.254820169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:50:10.780915967 +0000 UTC m=+23.147431212" watchObservedRunningTime="2026-07-22 11:50:10.781257779 +0000 UTC m=+23.147773024"
Jul 22 11:50:11.441411 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:11.441165    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:11.441654 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:11.441175    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:11.441654 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:11.441533    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:50:11.441654 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:11.441193    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:11.441791 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:11.441652    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:50:11.441791 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:11.441698    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:50:11.606764 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:11.606666    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f65bz" event={"ID":"f1fda4c8-fd99-442c-a5c0-5964027c2fec","Type":"ContainerStarted","Data":"8086131c748e93691f9ecafaa2afcfd2fc008c07e906f5f4dabff2d5ec5bdce1"}
Jul 22 11:50:11.607340 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:11.606766    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f65bz" event={"ID":"f1fda4c8-fd99-442c-a5c0-5964027c2fec","Type":"ContainerStarted","Data":"1da3506da6b39aedc78c37ab0124b2593b85507d5edf92c750d99cca05db4cc0"}
Jul 22 11:50:11.607340 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:11.606817    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f65bz" event={"ID":"f1fda4c8-fd99-442c-a5c0-5964027c2fec","Type":"ContainerStarted","Data":"04c1663c00c2933a2b420760148da466b45ce6fcd89edb6a8c7c5ffc25341bd6"}
Jul 22 11:50:11.607340 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:11.606864    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f65bz" event={"ID":"f1fda4c8-fd99-442c-a5c0-5964027c2fec","Type":"ContainerStarted","Data":"ad552725fd7c1085b1ca00dc306ab955cbbc47f76560802e93df07ac69902476"}
Jul 22 11:50:11.607340 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:11.606911    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f65bz" event={"ID":"f1fda4c8-fd99-442c-a5c0-5964027c2fec","Type":"ContainerStarted","Data":"a1386bd97c3bd5f7ed7ce662907c9ea27fcc4401aff9409b129deee55176af1b"}
Jul 22 11:50:11.607340 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:11.606957    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f65bz" event={"ID":"f1fda4c8-fd99-442c-a5c0-5964027c2fec","Type":"ContainerStarted","Data":"656d474b577553c12cf9ed965d2d29577ddafa8694ccfc6eca3a144d29df835c"}
Jul 22 11:50:11.608289 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:11.608262    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nb5n5" event={"ID":"12caa2da-758e-4acc-aa20-e2c253c0bbef","Type":"ContainerStarted","Data":"c7816b98945d0176612796bfe44cf73a074c4698d74a2b2f8f78f21ba94ab404"}
Jul 22 11:50:11.952753 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:11.952718    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 22 11:50:12.286430 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:12.286290    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T11:50:11.952746681Z","UUID":"7bcfd13b-6a40-43d0-8394-02d118de6dce","Handler":null,"Name":"","Endpoint":""}
Jul 22 11:50:12.288128 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:12.288097    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 22 11:50:12.288240 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:12.288143    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 22 11:50:12.410698 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:12.410662    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sdh44"
Jul 22 11:50:12.411464 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:12.411441    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sdh44"
Jul 22 11:50:12.443885 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:12.443827    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nb5n5" podStartSLOduration=5.443526523 podStartE2EDuration="24.44380686s" totalImagesPullingTime="19.000280337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 11:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:50:11.629733772 +0000 UTC m=+23.996249015" watchObservedRunningTime="2026-07-22 11:50:12.44380686 +0000 UTC m=+24.810322105"
Jul 22 11:50:12.612845 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:12.612765    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p" event={"ID":"2e166771-d43d-41ec-b850-edb3523ec4b1","Type":"ContainerStarted","Data":"31c03751f1b1ccbcb551e1f88a7145f17d1c9310da7bb4b3eb9cfcd20fbda1e9"}
Jul 22 11:50:12.613291 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:12.613095    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sdh44"
Jul 22 11:50:12.613591 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:12.613569    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sdh44"
Jul 22 11:50:13.441230 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:13.441203    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:13.441230 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:13.441225    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:13.441230 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:13.441240    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:13.441516 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:13.441325    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:50:13.441516 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:13.441408    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:50:13.441516 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:13.441504    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:50:15.440954 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:15.440760    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:15.441884 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:15.440760    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:15.441884 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:15.441050    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:50:15.441884 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:15.440793    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:15.441884 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:15.441103    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:50:15.441884 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:15.441190    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:50:15.623060 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:15.623024    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f65bz" event={"ID":"f1fda4c8-fd99-442c-a5c0-5964027c2fec","Type":"ContainerStarted","Data":"0927e67ea9b7e5d17c509eadb8139c4e0c0786cfca04ca3c76ab9bca4f2bb956"}
Jul 22 11:50:15.624521 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:15.624496    2558 generic.go:356] "Generic (PLEG): container finished" podID="f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd" containerID="50e372725d1b485f2369d675608e4c5533bf03852d8db55c2129309fdfb85e48" exitCode=0
Jul 22 11:50:15.624628 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:15.624567    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zx6zg" event={"ID":"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd","Type":"ContainerDied","Data":"50e372725d1b485f2369d675608e4c5533bf03852d8db55c2129309fdfb85e48"}
Jul 22 11:50:15.626561 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:15.626540    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p" event={"ID":"2e166771-d43d-41ec-b850-edb3523ec4b1","Type":"ContainerStarted","Data":"be1cbbe01d656e404ec0ba6498589aaf9ee6d7cf04dce955eefd9c770395d091"}
Jul 22 11:50:17.441180 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:17.440984    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:17.441762 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:17.440992    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:17.441762 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:17.441253    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:50:17.441762 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:17.440993    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:17.441762 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:17.441321    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:50:17.441762 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:17.441445    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:50:17.633510 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:17.633475    2558 generic.go:356] "Generic (PLEG): container finished" podID="f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd" containerID="bd1fb2e527e428cd557bdc5c62e6e2d9dda6f5c5e5206010314b8ee7df560a68" exitCode=0
Jul 22 11:50:17.633721 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:17.633562    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zx6zg" event={"ID":"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd","Type":"ContainerDied","Data":"bd1fb2e527e428cd557bdc5c62e6e2d9dda6f5c5e5206010314b8ee7df560a68"}
Jul 22 11:50:17.637199 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:17.637175    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f65bz" event={"ID":"f1fda4c8-fd99-442c-a5c0-5964027c2fec","Type":"ContainerStarted","Data":"9514ea2f37b07d08d25a9eda9875a8ad0164449899ffbd13e07cfd03e77e3203"}
Jul 22 11:50:17.637444 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:17.637413    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:50:17.637543 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:17.637521    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:50:17.637636 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:17.637574    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:50:17.652703 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:17.652678    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:50:17.652829 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:17.652808    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:50:17.665314 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:17.665278    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2pz2p" podStartSLOduration=6.9573592909999995 podStartE2EDuration="29.665266553s" totalImagesPullingTime="22.707907262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 11:49:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:50:15.67023697 +0000 UTC m=+28.036752214" watchObservedRunningTime="2026-07-22 11:50:17.665266553 +0000 UTC m=+30.031781797"
Jul 22 11:50:17.694080 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:17.693997    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-f65bz" podStartSLOduration=10.723675452 podStartE2EDuration="29.693981793s" totalImagesPullingTime="18.970306341s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 11:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:50:17.692536654 +0000 UTC m=+30.059051898" watchObservedRunningTime="2026-07-22 11:50:17.693981793 +0000 UTC m=+30.060497037"
Jul 22 11:50:19.276634 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:19.276405    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k9p8m"]
Jul 22 11:50:19.277092 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:19.276756    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:19.277092 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:19.276847    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:50:19.280030 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:19.280007    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j8flw"]
Jul 22 11:50:19.280164 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:19.280115    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:19.280261 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:19.280231    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:50:19.280869 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:19.280848    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7ftqt"]
Jul 22 11:50:19.280978 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:19.280960    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:19.281085 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:19.281070    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:50:19.643865 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:19.643823    2558 generic.go:356] "Generic (PLEG): container finished" podID="f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd" containerID="4d843430440a03ae31d4620d99d40457c98853cc960e557c2708c14193122aa3" exitCode=0
Jul 22 11:50:19.644027 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:19.643906    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zx6zg" event={"ID":"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd","Type":"ContainerDied","Data":"4d843430440a03ae31d4620d99d40457c98853cc960e557c2708c14193122aa3"}
Jul 22 11:50:20.425147 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:20.425112    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-csd5r_9f527d4c-c096-412f-bebc-3f974fe42dc8/dns-node-resolver/0.log"
Jul 22 11:50:21.441273 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:21.441231    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:21.441753 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:21.441254    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:21.441753 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:21.441361    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:50:21.441753 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:21.441420    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:21.441753 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:21.441522    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:50:21.441753 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:21.441600    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:50:21.592831 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:21.592797    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7p2jg_120a973f-3054-418e-94f7-0c38939ae63f/node-ca/0.log"
Jul 22 11:50:21.873630 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:21.873589    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0be44dc-51ec-49a4-97da-8e3923d9aaae-metrics-certs\") pod \"network-metrics-daemon-7ftqt\" (UID: \"f0be44dc-51ec-49a4-97da-8e3923d9aaae\") " pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:21.873820 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:21.873643    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fc8b4ba-9376-46b3-b29a-5f60380da898-original-pull-secret\") pod \"global-pull-secret-syncer-k9p8m\" (UID: \"4fc8b4ba-9376-46b3-b29a-5f60380da898\") " pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:21.873820 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:21.873773    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:50:21.873934 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:21.873854    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0be44dc-51ec-49a4-97da-8e3923d9aaae-metrics-certs podName:f0be44dc-51ec-49a4-97da-8e3923d9aaae nodeName:}" failed. No retries permitted until 2026-07-22 11:50:53.873835213 +0000 UTC m=+66.240350452 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0be44dc-51ec-49a4-97da-8e3923d9aaae-metrics-certs") pod "network-metrics-daemon-7ftqt" (UID: "f0be44dc-51ec-49a4-97da-8e3923d9aaae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:50:21.873934 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:21.873777    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 11:50:21.873934 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:21.873924    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fc8b4ba-9376-46b3-b29a-5f60380da898-original-pull-secret podName:4fc8b4ba-9376-46b3-b29a-5f60380da898 nodeName:}" failed. No retries permitted until 2026-07-22 11:50:53.873908828 +0000 UTC m=+66.240424052 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fc8b4ba-9376-46b3-b29a-5f60380da898-original-pull-secret") pod "global-pull-secret-syncer-k9p8m" (UID: "4fc8b4ba-9376-46b3-b29a-5f60380da898") : object "kube-system"/"original-pull-secret" not registered
Jul 22 11:50:21.974378 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:21.974343    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntvpd\" (UniqueName: \"kubernetes.io/projected/55e34c7b-6521-42cf-a952-d08ec5ce5304-kube-api-access-ntvpd\") pod \"network-check-target-j8flw\" (UID: \"55e34c7b-6521-42cf-a952-d08ec5ce5304\") " pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:21.974550 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:21.974529    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 11:50:21.974611 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:21.974558    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 11:50:21.974611 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:21.974571    2558 projected.go:196] Error preparing data for projected volume kube-api-access-ntvpd for pod openshift-network-diagnostics/network-check-target-j8flw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:50:21.974750 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:21.974649    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55e34c7b-6521-42cf-a952-d08ec5ce5304-kube-api-access-ntvpd podName:55e34c7b-6521-42cf-a952-d08ec5ce5304 nodeName:}" failed. No retries permitted until 2026-07-22 11:50:53.974612168 +0000 UTC m=+66.341127403 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ntvpd" (UniqueName: "kubernetes.io/projected/55e34c7b-6521-42cf-a952-d08ec5ce5304-kube-api-access-ntvpd") pod "network-check-target-j8flw" (UID: "55e34c7b-6521-42cf-a952-d08ec5ce5304") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:50:23.440849 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:23.440812    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:23.440849 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:23.440835    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:23.441692 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:23.440857    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:23.441692 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:23.440943    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:50:23.441692 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:23.441029    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:50:23.441692 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:23.441130    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:50:24.656779 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:24.656747    2558 generic.go:356] "Generic (PLEG): container finished" podID="f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd" containerID="a6357ac2596ee7d6590aa3df40b21d641dfb6ac02757df5c4c9ce8d41ce695cc" exitCode=0
Jul 22 11:50:24.657301 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:24.656807    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zx6zg" event={"ID":"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd","Type":"ContainerDied","Data":"a6357ac2596ee7d6590aa3df40b21d641dfb6ac02757df5c4c9ce8d41ce695cc"}
Jul 22 11:50:25.441076 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:25.441051    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:25.441215 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:25.441052    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:25.441215 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:25.441145    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:50:25.441301 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:25.441051    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:25.441660 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:25.441640    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:50:25.441700 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:25.441680    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:50:25.661900 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:25.661862    2558 generic.go:356] "Generic (PLEG): container finished" podID="f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd" containerID="cd8af325a1b1af01c1ace009f230efba0ad883328b271d71e993f080bef20f58" exitCode=0
Jul 22 11:50:25.662315 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:25.661927    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zx6zg" event={"ID":"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd","Type":"ContainerDied","Data":"cd8af325a1b1af01c1ace009f230efba0ad883328b271d71e993f080bef20f58"}
Jul 22 11:50:26.667248 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:26.667042    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zx6zg" event={"ID":"f5747bb7-3f07-40d2-b8d5-07bb0e5e2edd","Type":"ContainerStarted","Data":"2b930c4568a7b203e5b88c5fc5c96a8494dbb5278e48a3d2582243be55e08602"}
Jul 22 11:50:26.697308 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:26.697260    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zx6zg" podStartSLOduration=9.609088525 podStartE2EDuration="38.69723308s" totalImagesPullingTime="29.088144555s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 11:49:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:50:26.695735781 +0000 UTC m=+39.062251026" watchObservedRunningTime="2026-07-22 11:50:26.69723308 +0000 UTC m=+39.063748323"
Jul 22 11:50:27.441382 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:27.441351    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:27.441585 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:27.441456    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:27.441585 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:27.441466    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:50:27.441585 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:27.441485    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:27.441585 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:27.441551    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:50:27.441833 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:27.441626    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:50:29.441133 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:29.441076    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:29.441133 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:29.441130    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:29.441545 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:29.441131    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:29.441545 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:29.441212    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:50:29.441545 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:29.441328    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:50:29.441545 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:29.441411    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:50:31.440781 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:31.440747    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:31.441200 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:31.440747    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:31.441200 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:31.440864    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:50:31.441200 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:31.440752    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:31.441200 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:31.440922    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:50:31.441200 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:31.441016    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:50:33.441500 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:33.441469    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:33.441882 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:33.441569    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:33.441882 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:33.441577    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:33.441882 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:33.441569    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:50:33.441882 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:33.441670    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:50:33.441882 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:33.441724    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:50:35.441380 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:35.441350    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:35.441770 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:35.441388    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:35.441770 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:35.441360    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:35.441770 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:35.441474    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:50:35.441770 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:35.441529    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:50:35.441770 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:35.441611    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:50:37.440946 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:37.440912    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:37.440946 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:37.440934    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:37.441367 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:37.440912    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:37.441367 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:37.441027    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:50:37.441367 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:37.441094    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:50:37.441367 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:37.441163    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:50:39.441595 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:39.441556    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:39.441595 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:39.441583    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:39.441595 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:39.441585    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:39.442159 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:39.441672    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:50:39.442159 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:39.441725    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:50:39.442159 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:39.441789    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:50:41.441188 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:41.441148    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:41.441653 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:41.441164    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:41.441653 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:41.441293    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:41.441653 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:41.441260    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:50:41.441653 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:41.441355    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:50:41.441653 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:41.441407    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:50:43.441212 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:43.441178    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:43.441212 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:43.441211    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:43.441778 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:43.441282    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:50:43.441778 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:43.441335    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:43.441778 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:43.441423    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:50:43.441778 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:43.441526    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:50:45.440584 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:45.440548    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:45.441016 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:45.440665    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:45.441016 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:45.440687    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:45.441016 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:45.440668    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:50:45.441016 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:45.440779    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:50:45.441016 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:45.440856    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:50:47.440794 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:47.440757    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:47.441202 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:47.440859    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:47.441202 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:47.440863    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p8m" podUID="4fc8b4ba-9376-46b3-b29a-5f60380da898"
Jul 22 11:50:47.441202 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:47.440951    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ftqt" podUID="f0be44dc-51ec-49a4-97da-8e3923d9aaae"
Jul 22 11:50:47.441202 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:47.440865    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:47.441202 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:50:47.441026    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8flw" podUID="55e34c7b-6521-42cf-a952-d08ec5ce5304"
Jul 22 11:50:48.954910 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:48.954882    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-166.ec2.internal" event="NodeReady"
Jul 22 11:50:48.955344 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:48.954996    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 22 11:50:49.082326 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.082294    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-45rc7"]
Jul 22 11:50:49.084007 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.083991    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4xvzj"]
Jul 22 11:50:49.084123 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.084106    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-45rc7"
Jul 22 11:50:49.085804 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.085783    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4xvzj"
Jul 22 11:50:49.087873 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.087855    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 22 11:50:49.089838 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.089816    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 22 11:50:49.090371 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.090355    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 22 11:50:49.090957 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.090758    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 22 11:50:49.090957 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.090893    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wgjkp\""
Jul 22 11:50:49.090957 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.090900    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 22 11:50:49.091385 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.091369    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 22 11:50:49.091421 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.091391    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8jdv6\""
Jul 22 11:50:49.106907 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.106888    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-45rc7"]
Jul 22 11:50:49.110244 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.110226    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4xvzj"]
Jul 22 11:50:49.120542 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.120526    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 22 11:50:49.159449 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.159413    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4xvzj\" (UID: \"25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4\") " pod="openshift-insights/insights-runtime-extractor-4xvzj"
Jul 22 11:50:49.159449 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.159445    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/815baa25-3ce9-48f6-833a-ba208cd7676b-cert\") pod \"ingress-canary-45rc7\" (UID: \"815baa25-3ce9-48f6-833a-ba208cd7676b\") " pod="openshift-ingress-canary/ingress-canary-45rc7"
Jul 22 11:50:49.159661 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.159466    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4-crio-socket\") pod \"insights-runtime-extractor-4xvzj\" (UID: \"25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4\") " pod="openshift-insights/insights-runtime-extractor-4xvzj"
Jul 22 11:50:49.159661 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.159483    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4-data-volume\") pod \"insights-runtime-extractor-4xvzj\" (UID: \"25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4\") " pod="openshift-insights/insights-runtime-extractor-4xvzj"
Jul 22 11:50:49.159661 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.159572    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4xvzj\" (UID: \"25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4\") " pod="openshift-insights/insights-runtime-extractor-4xvzj"
Jul 22 11:50:49.159661 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.159598    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb5xs\" (UniqueName: \"kubernetes.io/projected/815baa25-3ce9-48f6-833a-ba208cd7676b-kube-api-access-tb5xs\") pod \"ingress-canary-45rc7\" (UID: \"815baa25-3ce9-48f6-833a-ba208cd7676b\") " pod="openshift-ingress-canary/ingress-canary-45rc7"
Jul 22 11:50:49.159661 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.159634    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w2wk\" (UniqueName: \"kubernetes.io/projected/25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4-kube-api-access-7w2wk\") pod \"insights-runtime-extractor-4xvzj\" (UID: \"25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4\") " pod="openshift-insights/insights-runtime-extractor-4xvzj"
Jul 22 11:50:49.176594 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.176565    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qh6kt"]
Jul 22 11:50:49.178310 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.178295    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qh6kt"
Jul 22 11:50:49.182492 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.182466    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 22 11:50:49.182787 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.182774    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2xm6s\""
Jul 22 11:50:49.184022 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.184005    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 22 11:50:49.196510 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.196491    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qh6kt"]
Jul 22 11:50:49.260659 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.260561    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87178538-8c31-4b16-9bd6-a7b6e903eae4-tmp-dir\") pod \"dns-default-qh6kt\" (UID: \"87178538-8c31-4b16-9bd6-a7b6e903eae4\") " pod="openshift-dns/dns-default-qh6kt"
Jul 22 11:50:49.260659 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.260595    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4xvzj\" (UID: \"25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4\") " pod="openshift-insights/insights-runtime-extractor-4xvzj"
Jul 22 11:50:49.260859 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.260660    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/815baa25-3ce9-48f6-833a-ba208cd7676b-cert\") pod \"ingress-canary-45rc7\" (UID: \"815baa25-3ce9-48f6-833a-ba208cd7676b\") " pod="openshift-ingress-canary/ingress-canary-45rc7"
Jul 22 11:50:49.260859 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.260691    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2548\" (UniqueName: \"kubernetes.io/projected/87178538-8c31-4b16-9bd6-a7b6e903eae4-kube-api-access-q2548\") pod \"dns-default-qh6kt\" (UID: \"87178538-8c31-4b16-9bd6-a7b6e903eae4\") " pod="openshift-dns/dns-default-qh6kt"
Jul 22 11:50:49.260859 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.260721    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4-crio-socket\") pod \"insights-runtime-extractor-4xvzj\" (UID: \"25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4\") " pod="openshift-insights/insights-runtime-extractor-4xvzj"
Jul 22 11:50:49.260859 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.260752    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4-data-volume\") pod \"insights-runtime-extractor-4xvzj\" (UID: \"25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4\") " pod="openshift-insights/insights-runtime-extractor-4xvzj"
Jul 22 11:50:49.260859 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.260824    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4xvzj\" (UID: \"25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4\") " pod="openshift-insights/insights-runtime-extractor-4xvzj"
Jul 22 11:50:49.260859 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.260831    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4-crio-socket\") pod \"insights-runtime-extractor-4xvzj\" (UID: \"25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4\") " pod="openshift-insights/insights-runtime-extractor-4xvzj"
Jul 22 11:50:49.260859 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.260846    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87178538-8c31-4b16-9bd6-a7b6e903eae4-metrics-tls\") pod \"dns-default-qh6kt\" (UID: \"87178538-8c31-4b16-9bd6-a7b6e903eae4\") " pod="openshift-dns/dns-default-qh6kt"
Jul 22 11:50:49.261150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.260892    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tb5xs\" (UniqueName: \"kubernetes.io/projected/815baa25-3ce9-48f6-833a-ba208cd7676b-kube-api-access-tb5xs\") pod \"ingress-canary-45rc7\" (UID: \"815baa25-3ce9-48f6-833a-ba208cd7676b\") " pod="openshift-ingress-canary/ingress-canary-45rc7"
Jul 22 11:50:49.261150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.260918    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w2wk\" (UniqueName: \"kubernetes.io/projected/25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4-kube-api-access-7w2wk\") pod \"insights-runtime-extractor-4xvzj\" (UID: \"25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4\") " pod="openshift-insights/insights-runtime-extractor-4xvzj"
Jul 22 11:50:49.261150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.260967    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/87178538-8c31-4b16-9bd6-a7b6e903eae4-config-volume\") pod \"dns-default-qh6kt\" (UID: \"87178538-8c31-4b16-9bd6-a7b6e903eae4\") " pod="openshift-dns/dns-default-qh6kt"
Jul 22 11:50:49.261150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.261100    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4-data-volume\") pod \"insights-runtime-extractor-4xvzj\" (UID: \"25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4\") " pod="openshift-insights/insights-runtime-extractor-4xvzj"
Jul 22 11:50:49.261405 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.261388    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4xvzj\" (UID: \"25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4\") " pod="openshift-insights/insights-runtime-extractor-4xvzj"
Jul 22 11:50:49.264439 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.264423    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4xvzj\" (UID: \"25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4\") " pod="openshift-insights/insights-runtime-extractor-4xvzj"
Jul 22 11:50:49.264577 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.264562    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/815baa25-3ce9-48f6-833a-ba208cd7676b-cert\") pod \"ingress-canary-45rc7\" (UID: \"815baa25-3ce9-48f6-833a-ba208cd7676b\") " pod="openshift-ingress-canary/ingress-canary-45rc7"
Jul 22 11:50:49.273510 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.273482    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb5xs\" (UniqueName: \"kubernetes.io/projected/815baa25-3ce9-48f6-833a-ba208cd7676b-kube-api-access-tb5xs\") pod \"ingress-canary-45rc7\" (UID: \"815baa25-3ce9-48f6-833a-ba208cd7676b\") " pod="openshift-ingress-canary/ingress-canary-45rc7"
Jul 22 11:50:49.280175 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.280151    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w2wk\" (UniqueName: \"kubernetes.io/projected/25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4-kube-api-access-7w2wk\") pod \"insights-runtime-extractor-4xvzj\" (UID: \"25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4\") " pod="openshift-insights/insights-runtime-extractor-4xvzj"
Jul 22 11:50:49.362066 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.362032    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/87178538-8c31-4b16-9bd6-a7b6e903eae4-config-volume\") pod \"dns-default-qh6kt\" (UID: \"87178538-8c31-4b16-9bd6-a7b6e903eae4\") " pod="openshift-dns/dns-default-qh6kt"
Jul 22 11:50:49.362235 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.362082    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87178538-8c31-4b16-9bd6-a7b6e903eae4-tmp-dir\") pod \"dns-default-qh6kt\" (UID: \"87178538-8c31-4b16-9bd6-a7b6e903eae4\") " pod="openshift-dns/dns-default-qh6kt"
Jul 22 11:50:49.362235 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.362112    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2548\" (UniqueName: \"kubernetes.io/projected/87178538-8c31-4b16-9bd6-a7b6e903eae4-kube-api-access-q2548\") pod \"dns-default-qh6kt\" (UID: \"87178538-8c31-4b16-9bd6-a7b6e903eae4\") " pod="openshift-dns/dns-default-qh6kt"
Jul 22 11:50:49.362235 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.362161    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87178538-8c31-4b16-9bd6-a7b6e903eae4-metrics-tls\") pod \"dns-default-qh6kt\" (UID: \"87178538-8c31-4b16-9bd6-a7b6e903eae4\") " pod="openshift-dns/dns-default-qh6kt"
Jul 22 11:50:49.362482 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.362460    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87178538-8c31-4b16-9bd6-a7b6e903eae4-tmp-dir\") pod \"dns-default-qh6kt\" (UID: \"87178538-8c31-4b16-9bd6-a7b6e903eae4\") " pod="openshift-dns/dns-default-qh6kt"
Jul 22 11:50:49.362565 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.362545    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/87178538-8c31-4b16-9bd6-a7b6e903eae4-config-volume\") pod \"dns-default-qh6kt\" (UID: \"87178538-8c31-4b16-9bd6-a7b6e903eae4\") " pod="openshift-dns/dns-default-qh6kt"
Jul 22 11:50:49.364360 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.364345    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87178538-8c31-4b16-9bd6-a7b6e903eae4-metrics-tls\") pod \"dns-default-qh6kt\" (UID: \"87178538-8c31-4b16-9bd6-a7b6e903eae4\") " pod="openshift-dns/dns-default-qh6kt"
Jul 22 11:50:49.373041 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.373018    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2548\" (UniqueName: \"kubernetes.io/projected/87178538-8c31-4b16-9bd6-a7b6e903eae4-kube-api-access-q2548\") pod \"dns-default-qh6kt\" (UID: \"87178538-8c31-4b16-9bd6-a7b6e903eae4\") " pod="openshift-dns/dns-default-qh6kt"
Jul 22 11:50:49.393957 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.393932    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-45rc7"
Jul 22 11:50:49.398429 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.398410    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4xvzj"
Jul 22 11:50:49.440828 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.440796    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:49.440988 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.440891    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:49.440988 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.440973    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:49.444503 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.444482    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 11:50:49.444503 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.444484    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 11:50:49.445453 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.445429    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 11:50:49.445596 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.445429    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 11:50:49.445596 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.445435    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b6dpz\""
Jul 22 11:50:49.446165 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.446147    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mjncz\""
Jul 22 11:50:49.487062 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.487040    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qh6kt"
Jul 22 11:50:49.547352 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.547254    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-45rc7"]
Jul 22 11:50:49.550598 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:50:49.550568    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod815baa25_3ce9_48f6_833a_ba208cd7676b.slice/crio-9e2d25a7950a7de41dc043b744d8a7a29b4e3f8ad759dac7285ac4d9fcebdb92 WatchSource:0}: Error finding container 9e2d25a7950a7de41dc043b744d8a7a29b4e3f8ad759dac7285ac4d9fcebdb92: Status 404 returned error can't find the container with id 9e2d25a7950a7de41dc043b744d8a7a29b4e3f8ad759dac7285ac4d9fcebdb92
Jul 22 11:50:49.569906 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.569875    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4xvzj"]
Jul 22 11:50:49.572431 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:50:49.572405    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25b9db7f_6b16_4ebc_8eb7_4de63dbb6ea4.slice/crio-9aaad7350d88746ffb53b36a12b945a9b1a7eadd80ac5d0cb4c8663ee032e5b8 WatchSource:0}: Error finding container 9aaad7350d88746ffb53b36a12b945a9b1a7eadd80ac5d0cb4c8663ee032e5b8: Status 404 returned error can't find the container with id 9aaad7350d88746ffb53b36a12b945a9b1a7eadd80ac5d0cb4c8663ee032e5b8
Jul 22 11:50:49.626240 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.626204    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qh6kt"]
Jul 22 11:50:49.629954 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:50:49.629928    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87178538_8c31_4b16_9bd6_a7b6e903eae4.slice/crio-bfd25a6f1def1b9c4cce22b273f03d558652b963a3f7dc7825c5dde98533ba05 WatchSource:0}: Error finding container bfd25a6f1def1b9c4cce22b273f03d558652b963a3f7dc7825c5dde98533ba05: Status 404 returned error can't find the container with id bfd25a6f1def1b9c4cce22b273f03d558652b963a3f7dc7825c5dde98533ba05
Jul 22 11:50:49.653885 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.653863    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f65bz"
Jul 22 11:50:49.715286 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.715248    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4xvzj" event={"ID":"25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4","Type":"ContainerStarted","Data":"9aaad7350d88746ffb53b36a12b945a9b1a7eadd80ac5d0cb4c8663ee032e5b8"}
Jul 22 11:50:49.716356 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.716325    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-45rc7" event={"ID":"815baa25-3ce9-48f6-833a-ba208cd7676b","Type":"ContainerStarted","Data":"9e2d25a7950a7de41dc043b744d8a7a29b4e3f8ad759dac7285ac4d9fcebdb92"}
Jul 22 11:50:49.717291 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:49.717270    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qh6kt" event={"ID":"87178538-8c31-4b16-9bd6-a7b6e903eae4","Type":"ContainerStarted","Data":"bfd25a6f1def1b9c4cce22b273f03d558652b963a3f7dc7825c5dde98533ba05"}
Jul 22 11:50:51.671585 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.670946    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6996ff777c-vrjk5"]
Jul 22 11:50:51.673242 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.673216    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6996ff777c-vrjk5"
Jul 22 11:50:51.678108 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.678080    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 22 11:50:51.678235 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.678144    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 22 11:50:51.678600 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.678423    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 22 11:50:51.678600 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.678468    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 22 11:50:51.678600 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.678483    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 22 11:50:51.678947 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.678929    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sdcc8\""
Jul 22 11:50:51.679054 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.678966    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 22 11:50:51.679054 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.679000    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 22 11:50:51.687751 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.687729    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 22 11:50:51.688951 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.688928    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6996ff777c-vrjk5"]
Jul 22 11:50:51.780787 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.780744    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8da9608f-4476-4375-b6dd-01fffa538ad7-trusted-ca-bundle\") pod \"console-6996ff777c-vrjk5\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") " pod="openshift-console/console-6996ff777c-vrjk5"
Jul 22 11:50:51.780787 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.780791    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8da9608f-4476-4375-b6dd-01fffa538ad7-console-config\") pod \"console-6996ff777c-vrjk5\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") " pod="openshift-console/console-6996ff777c-vrjk5"
Jul 22 11:50:51.781037 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.780821    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhtdb\" (UniqueName: \"kubernetes.io/projected/8da9608f-4476-4375-b6dd-01fffa538ad7-kube-api-access-bhtdb\") pod \"console-6996ff777c-vrjk5\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") " pod="openshift-console/console-6996ff777c-vrjk5"
Jul 22 11:50:51.781037 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.780917    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8da9608f-4476-4375-b6dd-01fffa538ad7-oauth-serving-cert\") pod \"console-6996ff777c-vrjk5\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") " pod="openshift-console/console-6996ff777c-vrjk5"
Jul 22 11:50:51.781037 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.780963    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8da9608f-4476-4375-b6dd-01fffa538ad7-console-oauth-config\") pod \"console-6996ff777c-vrjk5\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") " pod="openshift-console/console-6996ff777c-vrjk5"
Jul 22 11:50:51.781037 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.780990    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8da9608f-4476-4375-b6dd-01fffa538ad7-service-ca\") pod \"console-6996ff777c-vrjk5\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") " pod="openshift-console/console-6996ff777c-vrjk5"
Jul 22 11:50:51.781037 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.781022    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8da9608f-4476-4375-b6dd-01fffa538ad7-console-serving-cert\") pod \"console-6996ff777c-vrjk5\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") " pod="openshift-console/console-6996ff777c-vrjk5"
Jul 22 11:50:51.881397 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.881362    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8da9608f-4476-4375-b6dd-01fffa538ad7-trusted-ca-bundle\") pod \"console-6996ff777c-vrjk5\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") " pod="openshift-console/console-6996ff777c-vrjk5"
Jul 22 11:50:51.881397 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.881400    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8da9608f-4476-4375-b6dd-01fffa538ad7-console-config\") pod \"console-6996ff777c-vrjk5\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") " pod="openshift-console/console-6996ff777c-vrjk5"
Jul 22 11:50:51.881660 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.881426    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhtdb\" (UniqueName: \"kubernetes.io/projected/8da9608f-4476-4375-b6dd-01fffa538ad7-kube-api-access-bhtdb\") pod \"console-6996ff777c-vrjk5\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") " pod="openshift-console/console-6996ff777c-vrjk5"
Jul 22 11:50:51.881660 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.881472    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8da9608f-4476-4375-b6dd-01fffa538ad7-oauth-serving-cert\") pod \"console-6996ff777c-vrjk5\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") " pod="openshift-console/console-6996ff777c-vrjk5"
Jul 22 11:50:51.881660 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.881537    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8da9608f-4476-4375-b6dd-01fffa538ad7-console-oauth-config\") pod \"console-6996ff777c-vrjk5\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") " pod="openshift-console/console-6996ff777c-vrjk5"
Jul 22 11:50:51.881660 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.881565    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8da9608f-4476-4375-b6dd-01fffa538ad7-service-ca\") pod \"console-6996ff777c-vrjk5\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") " pod="openshift-console/console-6996ff777c-vrjk5"
Jul 22 11:50:51.881660 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.881598    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8da9608f-4476-4375-b6dd-01fffa538ad7-console-serving-cert\") pod \"console-6996ff777c-vrjk5\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") " pod="openshift-console/console-6996ff777c-vrjk5"
Jul 22 11:50:51.882387 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.882352    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8da9608f-4476-4375-b6dd-01fffa538ad7-trusted-ca-bundle\") pod \"console-6996ff777c-vrjk5\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") " pod="openshift-console/console-6996ff777c-vrjk5"
Jul 22 11:50:51.882387 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.882369    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8da9608f-4476-4375-b6dd-01fffa538ad7-oauth-serving-cert\") pod \"console-6996ff777c-vrjk5\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") " pod="openshift-console/console-6996ff777c-vrjk5"
Jul 22 11:50:51.882556 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.882513    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8da9608f-4476-4375-b6dd-01fffa538ad7-console-config\") pod \"console-6996ff777c-vrjk5\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") " pod="openshift-console/console-6996ff777c-vrjk5"
Jul 22 11:50:51.883120 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.883078    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8da9608f-4476-4375-b6dd-01fffa538ad7-service-ca\") pod \"console-6996ff777c-vrjk5\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") " pod="openshift-console/console-6996ff777c-vrjk5"
Jul 22 11:50:51.884353 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.884310    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8da9608f-4476-4375-b6dd-01fffa538ad7-console-serving-cert\") pod \"console-6996ff777c-vrjk5\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") " pod="openshift-console/console-6996ff777c-vrjk5"
Jul 22 11:50:51.885304 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.885285    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8da9608f-4476-4375-b6dd-01fffa538ad7-console-oauth-config\") pod \"console-6996ff777c-vrjk5\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") " pod="openshift-console/console-6996ff777c-vrjk5"
Jul 22 11:50:51.895542 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.895481    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhtdb\" (UniqueName: \"kubernetes.io/projected/8da9608f-4476-4375-b6dd-01fffa538ad7-kube-api-access-bhtdb\") pod \"console-6996ff777c-vrjk5\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") " pod="openshift-console/console-6996ff777c-vrjk5"
Jul 22 11:50:51.986550 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:51.986468    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6996ff777c-vrjk5"
Jul 22 11:50:53.898668 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:53.898627    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0be44dc-51ec-49a4-97da-8e3923d9aaae-metrics-certs\") pod \"network-metrics-daemon-7ftqt\" (UID: \"f0be44dc-51ec-49a4-97da-8e3923d9aaae\") " pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:53.899074 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:53.898682    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fc8b4ba-9376-46b3-b29a-5f60380da898-original-pull-secret\") pod \"global-pull-secret-syncer-k9p8m\" (UID: \"4fc8b4ba-9376-46b3-b29a-5f60380da898\") " pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:53.900986 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:53.900963    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0be44dc-51ec-49a4-97da-8e3923d9aaae-metrics-certs\") pod \"network-metrics-daemon-7ftqt\" (UID: \"f0be44dc-51ec-49a4-97da-8e3923d9aaae\") " pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:53.901095 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:53.901025    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fc8b4ba-9376-46b3-b29a-5f60380da898-original-pull-secret\") pod \"global-pull-secret-syncer-k9p8m\" (UID: \"4fc8b4ba-9376-46b3-b29a-5f60380da898\") " pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:53.962113 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:53.962074    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p8m"
Jul 22 11:50:53.972359 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:53.972329    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ftqt"
Jul 22 11:50:53.999591 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:53.999560    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntvpd\" (UniqueName: \"kubernetes.io/projected/55e34c7b-6521-42cf-a952-d08ec5ce5304-kube-api-access-ntvpd\") pod \"network-check-target-j8flw\" (UID: \"55e34c7b-6521-42cf-a952-d08ec5ce5304\") " pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:54.002415 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:54.002386    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntvpd\" (UniqueName: \"kubernetes.io/projected/55e34c7b-6521-42cf-a952-d08ec5ce5304-kube-api-access-ntvpd\") pod \"network-check-target-j8flw\" (UID: \"55e34c7b-6521-42cf-a952-d08ec5ce5304\") " pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:54.255396 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:54.255303    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:50:54.954430 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:54.954397    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6996ff777c-vrjk5"]
Jul 22 11:50:55.160913 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:50:55.160883    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8da9608f_4476_4375_b6dd_01fffa538ad7.slice/crio-8ab2414b39f185f79af8851a387b28996bca161aedf19db9956c85bd2d95f396 WatchSource:0}: Error finding container 8ab2414b39f185f79af8851a387b28996bca161aedf19db9956c85bd2d95f396: Status 404 returned error can't find the container with id 8ab2414b39f185f79af8851a387b28996bca161aedf19db9956c85bd2d95f396
Jul 22 11:50:55.326813 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:55.326732    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7ftqt"]
Jul 22 11:50:55.334075 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:50:55.334027    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0be44dc_51ec_49a4_97da_8e3923d9aaae.slice/crio-1c62e50e90ebda962947b993d68fda2f4a71d5b01dc2c5fdbf28872f7b3b27b8 WatchSource:0}: Error finding container 1c62e50e90ebda962947b993d68fda2f4a71d5b01dc2c5fdbf28872f7b3b27b8: Status 404 returned error can't find the container with id 1c62e50e90ebda962947b993d68fda2f4a71d5b01dc2c5fdbf28872f7b3b27b8
Jul 22 11:50:55.347577 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:55.347529    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j8flw"]
Jul 22 11:50:55.353343 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:50:55.353314    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55e34c7b_6521_42cf_a952_d08ec5ce5304.slice/crio-8307e4343306b8b5a73033d5d396d566bb738b9d8b8b0354d3dcfe1d83e2f430 WatchSource:0}: Error finding container 8307e4343306b8b5a73033d5d396d566bb738b9d8b8b0354d3dcfe1d83e2f430: Status 404 returned error can't find the container with id 8307e4343306b8b5a73033d5d396d566bb738b9d8b8b0354d3dcfe1d83e2f430
Jul 22 11:50:55.541130 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:55.541042    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k9p8m"]
Jul 22 11:50:55.544101 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:50:55.544077    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fc8b4ba_9376_46b3_b29a_5f60380da898.slice/crio-83ef33fdbea3705d27de12d6448a57320a3a8f734cc8f49bed2969a16a92cb8a WatchSource:0}: Error finding container 83ef33fdbea3705d27de12d6448a57320a3a8f734cc8f49bed2969a16a92cb8a: Status 404 returned error can't find the container with id 83ef33fdbea3705d27de12d6448a57320a3a8f734cc8f49bed2969a16a92cb8a
Jul 22 11:50:55.738772 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:55.738687    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6996ff777c-vrjk5" event={"ID":"8da9608f-4476-4375-b6dd-01fffa538ad7","Type":"ContainerStarted","Data":"8ab2414b39f185f79af8851a387b28996bca161aedf19db9956c85bd2d95f396"}
Jul 22 11:50:55.742067 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:55.741976    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4xvzj" event={"ID":"25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4","Type":"ContainerStarted","Data":"9562013becd78472fd124263a69f99d1f6a80a36f7b58fb05b1a651c6196eedf"}
Jul 22 11:50:55.745729 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:55.745106    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qh6kt" event={"ID":"87178538-8c31-4b16-9bd6-a7b6e903eae4","Type":"ContainerStarted","Data":"1a2aaf8220de035b62608c0965d8126f5518190088fb9358c3c62e74fffc76b0"}
Jul 22 11:50:55.745729 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:55.745152    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qh6kt" event={"ID":"87178538-8c31-4b16-9bd6-a7b6e903eae4","Type":"ContainerStarted","Data":"c0ceaf2a433324f194fed2bb784e3c8154a15d79357f2a275f218c21289429b5"}
Jul 22 11:50:55.745729 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:55.745679    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qh6kt"
Jul 22 11:50:55.747258 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:55.747191    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j8flw" event={"ID":"55e34c7b-6521-42cf-a952-d08ec5ce5304","Type":"ContainerStarted","Data":"8307e4343306b8b5a73033d5d396d566bb738b9d8b8b0354d3dcfe1d83e2f430"}
Jul 22 11:50:55.754157 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:55.754101    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-45rc7" event={"ID":"815baa25-3ce9-48f6-833a-ba208cd7676b","Type":"ContainerStarted","Data":"d9912e0c45be089e09b02a6c8754ddddf484b0df6fd6b6ddc741ef840d7e5a89"}
Jul 22 11:50:55.756870 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:55.756825    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k9p8m" event={"ID":"4fc8b4ba-9376-46b3-b29a-5f60380da898","Type":"ContainerStarted","Data":"83ef33fdbea3705d27de12d6448a57320a3a8f734cc8f49bed2969a16a92cb8a"}
Jul 22 11:50:55.760464 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:55.760416    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7ftqt" event={"ID":"f0be44dc-51ec-49a4-97da-8e3923d9aaae","Type":"ContainerStarted","Data":"1c62e50e90ebda962947b993d68fda2f4a71d5b01dc2c5fdbf28872f7b3b27b8"}
Jul 22 11:50:55.813762 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:55.813011    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qh6kt" podStartSLOduration=1.632883927 podStartE2EDuration="6.81298727s" totalImagesPullingTime="5.180103343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:50:55.786328786 +0000 UTC m=+68.152844031" watchObservedRunningTime="2026-07-22 11:50:55.81298727 +0000 UTC m=+68.179502515"
Jul 22 11:50:56.018104 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:56.016862    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-45rc7" podStartSLOduration=1.411531831 podStartE2EDuration="7.016836487s" totalImagesPullingTime="5.605304656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:50:55.813546831 +0000 UTC m=+68.180062087" watchObservedRunningTime="2026-07-22 11:50:56.016836487 +0000 UTC m=+68.383351732"
Jul 22 11:50:56.018104 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:56.017038    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-bd8b2"]
Jul 22 11:50:56.020777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:56.019374    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-bd8b2"
Jul 22 11:50:56.022445 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:56.022254    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 22 11:50:56.022445 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:56.022317    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-rmvdp\""
Jul 22 11:50:56.022639 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:56.022493    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 22 11:50:56.024479 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:56.024343    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 22 11:50:56.024479 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:56.024356    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 22 11:50:56.024642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:56.024606    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 22 11:50:56.035948 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:56.035881    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-bd8b2"]
Jul 22 11:50:56.128283 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:56.128248    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/68c9485f-a278-4f86-a153-2b944f2b4499-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-bd8b2\" (UID: \"68c9485f-a278-4f86-a153-2b944f2b4499\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-bd8b2"
Jul 22 11:50:56.128480 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:56.128305    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68c9485f-a278-4f86-a153-2b944f2b4499-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-bd8b2\" (UID: \"68c9485f-a278-4f86-a153-2b944f2b4499\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-bd8b2"
Jul 22 11:50:56.128480 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:56.128338    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68c9485f-a278-4f86-a153-2b944f2b4499-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-bd8b2\" (UID: \"68c9485f-a278-4f86-a153-2b944f2b4499\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-bd8b2"
Jul 22 11:50:56.128480 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:56.128396    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-454zw\" (UniqueName: \"kubernetes.io/projected/68c9485f-a278-4f86-a153-2b944f2b4499-kube-api-access-454zw\") pod \"prometheus-operator-5945b5cfd-bd8b2\" (UID: \"68c9485f-a278-4f86-a153-2b944f2b4499\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-bd8b2"
Jul 22 11:50:56.229456 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:56.229394    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/68c9485f-a278-4f86-a153-2b944f2b4499-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-bd8b2\" (UID: \"68c9485f-a278-4f86-a153-2b944f2b4499\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-bd8b2"
Jul 22 11:50:56.229723 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:56.229474    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68c9485f-a278-4f86-a153-2b944f2b4499-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-bd8b2\" (UID: \"68c9485f-a278-4f86-a153-2b944f2b4499\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-bd8b2"
Jul 22 11:50:56.229723 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:56.229511    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68c9485f-a278-4f86-a153-2b944f2b4499-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-bd8b2\" (UID: \"68c9485f-a278-4f86-a153-2b944f2b4499\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-bd8b2"
Jul 22 11:50:56.229723 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:56.229630    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-454zw\" (UniqueName: \"kubernetes.io/projected/68c9485f-a278-4f86-a153-2b944f2b4499-kube-api-access-454zw\") pod \"prometheus-operator-5945b5cfd-bd8b2\" (UID: \"68c9485f-a278-4f86-a153-2b944f2b4499\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-bd8b2"
Jul 22 11:50:56.231459 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:56.231411    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68c9485f-a278-4f86-a153-2b944f2b4499-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-bd8b2\" (UID: \"68c9485f-a278-4f86-a153-2b944f2b4499\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-bd8b2"
Jul 22 11:50:56.236194 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:56.236147    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/68c9485f-a278-4f86-a153-2b944f2b4499-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-bd8b2\" (UID: \"68c9485f-a278-4f86-a153-2b944f2b4499\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-bd8b2"
Jul 22 11:50:56.236840 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:56.236796    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68c9485f-a278-4f86-a153-2b944f2b4499-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-bd8b2\" (UID: \"68c9485f-a278-4f86-a153-2b944f2b4499\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-bd8b2"
Jul 22 11:50:56.240256 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:56.240189    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-454zw\" (UniqueName: \"kubernetes.io/projected/68c9485f-a278-4f86-a153-2b944f2b4499-kube-api-access-454zw\") pod \"prometheus-operator-5945b5cfd-bd8b2\" (UID: \"68c9485f-a278-4f86-a153-2b944f2b4499\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-bd8b2"
Jul 22 11:50:56.335112 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:56.335078    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-bd8b2"
Jul 22 11:50:56.819903 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:56.819776    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-bd8b2"]
Jul 22 11:50:56.823493 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:50:56.823454    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68c9485f_a278_4f86_a153_2b944f2b4499.slice/crio-a9d03f46583d1bc51294dc89bde1cbab931d87012b5556cf95c0f6bdbb68f929 WatchSource:0}: Error finding container a9d03f46583d1bc51294dc89bde1cbab931d87012b5556cf95c0f6bdbb68f929: Status 404 returned error can't find the container with id a9d03f46583d1bc51294dc89bde1cbab931d87012b5556cf95c0f6bdbb68f929
Jul 22 11:50:57.773647 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:57.773536    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7ftqt" event={"ID":"f0be44dc-51ec-49a4-97da-8e3923d9aaae","Type":"ContainerStarted","Data":"2872ecfd057970447ecdac6fd0a7dd60a036f3ad7339a25eea06f62bc0da7aad"}
Jul 22 11:50:57.773647 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:57.773605    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7ftqt" event={"ID":"f0be44dc-51ec-49a4-97da-8e3923d9aaae","Type":"ContainerStarted","Data":"fe8a790254e15008ce753a8d5f506f0f501e251bff8f8681728210a430eb74a2"}
Jul 22 11:50:57.775949 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:57.775921    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-bd8b2" event={"ID":"68c9485f-a278-4f86-a153-2b944f2b4499","Type":"ContainerStarted","Data":"a9d03f46583d1bc51294dc89bde1cbab931d87012b5556cf95c0f6bdbb68f929"}
Jul 22 11:50:57.794695 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:50:57.794224    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7ftqt" podStartSLOduration=68.388978637 podStartE2EDuration="1m9.794205645s" totalImagesPullingTime="1.405227008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:50:57.792372308 +0000 UTC m=+70.158887567" watchObservedRunningTime="2026-07-22 11:50:57.794205645 +0000 UTC m=+70.160720890"
Jul 22 11:51:03.797594 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:03.797467    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-bd8b2" event={"ID":"68c9485f-a278-4f86-a153-2b944f2b4499","Type":"ContainerStarted","Data":"bb8e4b739673c9c46fc3c1e869cbaf7f285fad69aac4d7ae79b55616844eba6c"}
Jul 22 11:51:03.797594 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:03.797535    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-bd8b2" event={"ID":"68c9485f-a278-4f86-a153-2b944f2b4499","Type":"ContainerStarted","Data":"8701f4f2d24a156c5168ee16026a9b56ed859e75f57b2cd6bf1ab9dcffd3a553"}
Jul 22 11:51:03.799787 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:03.799736    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4xvzj" event={"ID":"25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4","Type":"ContainerStarted","Data":"a0f565ee968ed8263c092469096d2c12f2355a1fcb1abe49465085da9c5df75f"}
Jul 22 11:51:03.801196 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:03.801170    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j8flw" event={"ID":"55e34c7b-6521-42cf-a952-d08ec5ce5304","Type":"ContainerStarted","Data":"dd3bf7dcf4a554460011acb87d64d3dc7e469c0c3476509ff87b7488eda288d3"}
Jul 22 11:51:03.801292 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:03.801230    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:51:03.803194 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:03.802753    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k9p8m" event={"ID":"4fc8b4ba-9376-46b3-b29a-5f60380da898","Type":"ContainerStarted","Data":"b573455ae9114560e48c862269981e36217878e7dbffb266cf11881b2f7a05f9"}
Jul 22 11:51:03.807627 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:03.807592    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6996ff777c-vrjk5" event={"ID":"8da9608f-4476-4375-b6dd-01fffa538ad7","Type":"ContainerStarted","Data":"061590b6e82ff3730a609fccfe4fa01b7a82bd4b7872e031b701d42da5acf947"}
Jul 22 11:51:03.823911 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:03.823866    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-bd8b2" podStartSLOduration=2.096577204 podStartE2EDuration="8.823851352s" totalImagesPullingTime="6.727274148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:50:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:51:03.823215963 +0000 UTC m=+76.189731227" watchObservedRunningTime="2026-07-22 11:51:03.823851352 +0000 UTC m=+76.190366623"
Jul 22 11:51:03.853689 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:03.853644    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6996ff777c-vrjk5" podStartSLOduration=4.463158497 podStartE2EDuration="12.853606122s" totalImagesPullingTime="8.390447625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:50:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:51:03.851973036 +0000 UTC m=+76.218488280" watchObservedRunningTime="2026-07-22 11:51:03.853606122 +0000 UTC m=+76.220121365"
Jul 22 11:51:03.919075 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:03.917979    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k9p8m" podStartSLOduration=67.90982894 podStartE2EDuration="1m15.917963373s" totalImagesPullingTime="8.008134433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 11:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:51:03.916857201 +0000 UTC m=+76.283372439" watchObservedRunningTime="2026-07-22 11:51:03.917963373 +0000 UTC m=+76.284478617"
Jul 22 11:51:03.919075 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:03.918645    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-j8flw" podStartSLOduration=67.71090999 podStartE2EDuration="1m15.918611298s" totalImagesPullingTime="8.207701308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:51:03.877428199 +0000 UTC m=+76.243943443" watchObservedRunningTime="2026-07-22 11:51:03.918611298 +0000 UTC m=+76.285126546"
Jul 22 11:51:05.473495 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.473459    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-qqxff"]
Jul 22 11:51:05.478447 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.478422    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qqxff"
Jul 22 11:51:05.482858 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.482832    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 22 11:51:05.482978 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.482866    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 22 11:51:05.483307 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.483287    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-nvtx5\""
Jul 22 11:51:05.527860 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.527832    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-55sg4"]
Jul 22 11:51:05.532249 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.532229    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-55sg4"
Jul 22 11:51:05.538713 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.538688    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 22 11:51:05.549612 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.549590    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 22 11:51:05.550014 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.549977    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-qwgp9\""
Jul 22 11:51:05.550014 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.550008    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 22 11:51:05.551232 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.551213    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xh4sp"]
Jul 22 11:51:05.554357 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.554339    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.574653 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.574631    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 22 11:51:05.575354 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.575335    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 22 11:51:05.576099 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.576078    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 22 11:51:05.576970 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.576952    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p2zfp\""
Jul 22 11:51:05.577798 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.577780    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-55sg4"]
Jul 22 11:51:05.585934 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.585913    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-qqxff"]
Jul 22 11:51:05.602883 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.602860    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/704bddee-6ccc-46a9-9c66-83fca35aaf79-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-qqxff\" (UID: \"704bddee-6ccc-46a9-9c66-83fca35aaf79\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qqxff"
Jul 22 11:51:05.602993 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.602902    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-55sg4\" (UID: \"dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-55sg4"
Jul 22 11:51:05.602993 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.602931    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-55sg4\" (UID: \"dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-55sg4"
Jul 22 11:51:05.603105 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.603031    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/704bddee-6ccc-46a9-9c66-83fca35aaf79-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-qqxff\" (UID: \"704bddee-6ccc-46a9-9c66-83fca35aaf79\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qqxff"
Jul 22 11:51:05.603105 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.603078    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg6vr\" (UniqueName: \"kubernetes.io/projected/704bddee-6ccc-46a9-9c66-83fca35aaf79-kube-api-access-kg6vr\") pod \"openshift-state-metrics-79f6958cdf-qqxff\" (UID: \"704bddee-6ccc-46a9-9c66-83fca35aaf79\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qqxff"
Jul 22 11:51:05.603220 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.603109    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-55sg4\" (UID: \"dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-55sg4"
Jul 22 11:51:05.603220 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.603153    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-55sg4\" (UID: \"dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-55sg4"
Jul 22 11:51:05.603220 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.603181    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-584m5\" (UniqueName: \"kubernetes.io/projected/dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd-kube-api-access-584m5\") pod \"kube-state-metrics-56c5594674-55sg4\" (UID: \"dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-55sg4"
Jul 22 11:51:05.603220 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.603212    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/704bddee-6ccc-46a9-9c66-83fca35aaf79-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-qqxff\" (UID: \"704bddee-6ccc-46a9-9c66-83fca35aaf79\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qqxff"
Jul 22 11:51:05.603519 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.603242    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-55sg4\" (UID: \"dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-55sg4"
Jul 22 11:51:05.703894 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.703859    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/704bddee-6ccc-46a9-9c66-83fca35aaf79-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-qqxff\" (UID: \"704bddee-6ccc-46a9-9c66-83fca35aaf79\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qqxff"
Jul 22 11:51:05.704061 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.703905    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-55sg4\" (UID: \"dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-55sg4"
Jul 22 11:51:05.704061 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.703935    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-55sg4\" (UID: \"dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-55sg4"
Jul 22 11:51:05.704061 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.703982    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/704bddee-6ccc-46a9-9c66-83fca35aaf79-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-qqxff\" (UID: \"704bddee-6ccc-46a9-9c66-83fca35aaf79\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qqxff"
Jul 22 11:51:05.704061 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.704011    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg6vr\" (UniqueName: \"kubernetes.io/projected/704bddee-6ccc-46a9-9c66-83fca35aaf79-kube-api-access-kg6vr\") pod \"openshift-state-metrics-79f6958cdf-qqxff\" (UID: \"704bddee-6ccc-46a9-9c66-83fca35aaf79\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qqxff"
Jul 22 11:51:05.704061 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.704037    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-55sg4\" (UID: \"dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-55sg4"
Jul 22 11:51:05.704331 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.704065    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/439719dd-e090-4f31-8d3a-7224d68b7343-node-exporter-tls\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.704331 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.704101    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/439719dd-e090-4f31-8d3a-7224d68b7343-node-exporter-textfile\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.704331 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.704127    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/439719dd-e090-4f31-8d3a-7224d68b7343-node-exporter-accelerators-collector-config\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.704331 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.704155    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/439719dd-e090-4f31-8d3a-7224d68b7343-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.704331 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.704181    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-55sg4\" (UID: \"dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-55sg4"
Jul 22 11:51:05.704331 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.704199    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-584m5\" (UniqueName: \"kubernetes.io/projected/dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd-kube-api-access-584m5\") pod \"kube-state-metrics-56c5594674-55sg4\" (UID: \"dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-55sg4"
Jul 22 11:51:05.704331 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.704219    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/704bddee-6ccc-46a9-9c66-83fca35aaf79-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-qqxff\" (UID: \"704bddee-6ccc-46a9-9c66-83fca35aaf79\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qqxff"
Jul 22 11:51:05.704331 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.704259    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/439719dd-e090-4f31-8d3a-7224d68b7343-node-exporter-wtmp\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.704331 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.704289    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-55sg4\" (UID: \"dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-55sg4"
Jul 22 11:51:05.704331 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.704303    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/439719dd-e090-4f31-8d3a-7224d68b7343-sys\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.704331 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.704321    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/439719dd-e090-4f31-8d3a-7224d68b7343-root\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.704922 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.704342    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/439719dd-e090-4f31-8d3a-7224d68b7343-metrics-client-ca\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.704922 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.704386    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwzrr\" (UniqueName: \"kubernetes.io/projected/439719dd-e090-4f31-8d3a-7224d68b7343-kube-api-access-hwzrr\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.704922 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.704657    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/704bddee-6ccc-46a9-9c66-83fca35aaf79-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-qqxff\" (UID: \"704bddee-6ccc-46a9-9c66-83fca35aaf79\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qqxff"
Jul 22 11:51:05.705076 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.705050    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-55sg4\" (UID: \"dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-55sg4"
Jul 22 11:51:05.705139 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.705110    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-55sg4\" (UID: \"dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-55sg4"
Jul 22 11:51:05.705452 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.705417    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-55sg4\" (UID: \"dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-55sg4"
Jul 22 11:51:05.707104 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.707076    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/704bddee-6ccc-46a9-9c66-83fca35aaf79-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-qqxff\" (UID: \"704bddee-6ccc-46a9-9c66-83fca35aaf79\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qqxff"
Jul 22 11:51:05.707222 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.707112    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/704bddee-6ccc-46a9-9c66-83fca35aaf79-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-qqxff\" (UID: \"704bddee-6ccc-46a9-9c66-83fca35aaf79\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qqxff"
Jul 22 11:51:05.707302 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.707278    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-55sg4\" (UID: \"dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-55sg4"
Jul 22 11:51:05.707478 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.707456    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-55sg4\" (UID: \"dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-55sg4"
Jul 22 11:51:05.716381 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.716348    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg6vr\" (UniqueName: \"kubernetes.io/projected/704bddee-6ccc-46a9-9c66-83fca35aaf79-kube-api-access-kg6vr\") pod \"openshift-state-metrics-79f6958cdf-qqxff\" (UID: \"704bddee-6ccc-46a9-9c66-83fca35aaf79\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qqxff"
Jul 22 11:51:05.717388 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.717351    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-584m5\" (UniqueName: \"kubernetes.io/projected/dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd-kube-api-access-584m5\") pod \"kube-state-metrics-56c5594674-55sg4\" (UID: \"dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-55sg4"
Jul 22 11:51:05.767487 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.767404    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qh6kt"
Jul 22 11:51:05.787923 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.787881    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qqxff"
Jul 22 11:51:05.805060 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.805028    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/439719dd-e090-4f31-8d3a-7224d68b7343-metrics-client-ca\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.805220 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.805074    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwzrr\" (UniqueName: \"kubernetes.io/projected/439719dd-e090-4f31-8d3a-7224d68b7343-kube-api-access-hwzrr\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.805220 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.805138    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/439719dd-e090-4f31-8d3a-7224d68b7343-node-exporter-tls\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.805220 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.805168    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/439719dd-e090-4f31-8d3a-7224d68b7343-node-exporter-textfile\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.805220 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.805194    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/439719dd-e090-4f31-8d3a-7224d68b7343-node-exporter-accelerators-collector-config\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.805433 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.805225    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/439719dd-e090-4f31-8d3a-7224d68b7343-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.805433 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.805262    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/439719dd-e090-4f31-8d3a-7224d68b7343-node-exporter-wtmp\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.805433 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:51:05.805273    2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 22 11:51:05.805433 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.805287    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/439719dd-e090-4f31-8d3a-7224d68b7343-sys\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.805433 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.805310    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/439719dd-e090-4f31-8d3a-7224d68b7343-root\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.805433 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:51:05.805337    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/439719dd-e090-4f31-8d3a-7224d68b7343-node-exporter-tls podName:439719dd-e090-4f31-8d3a-7224d68b7343 nodeName:}" failed. No retries permitted until 2026-07-22 11:51:06.305315137 +0000 UTC m=+78.671830366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/439719dd-e090-4f31-8d3a-7224d68b7343-node-exporter-tls") pod "node-exporter-xh4sp" (UID: "439719dd-e090-4f31-8d3a-7224d68b7343") : secret "node-exporter-tls" not found
Jul 22 11:51:05.805433 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.805382    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/439719dd-e090-4f31-8d3a-7224d68b7343-root\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.805814 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.805526    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/439719dd-e090-4f31-8d3a-7224d68b7343-sys\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.805814 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.805571    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/439719dd-e090-4f31-8d3a-7224d68b7343-node-exporter-wtmp\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.805814 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.805766    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/439719dd-e090-4f31-8d3a-7224d68b7343-metrics-client-ca\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.805958 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.805926    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/439719dd-e090-4f31-8d3a-7224d68b7343-node-exporter-accelerators-collector-config\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.806067 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.806046    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/439719dd-e090-4f31-8d3a-7224d68b7343-node-exporter-textfile\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.808042 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.808017    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/439719dd-e090-4f31-8d3a-7224d68b7343-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.835422 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.835392    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwzrr\" (UniqueName: \"kubernetes.io/projected/439719dd-e090-4f31-8d3a-7224d68b7343-kube-api-access-hwzrr\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:05.842136 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:05.842107    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-55sg4"
Jul 22 11:51:06.309683 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.309643    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/439719dd-e090-4f31-8d3a-7224d68b7343-node-exporter-tls\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:06.312593 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.312567    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/439719dd-e090-4f31-8d3a-7224d68b7343-node-exporter-tls\") pod \"node-exporter-xh4sp\" (UID: \"439719dd-e090-4f31-8d3a-7224d68b7343\") " pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:06.463834 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.463805    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xh4sp"
Jul 22 11:51:06.521659 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.521608    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 11:51:06.526704 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.526682    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.529420 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.529394    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 22 11:51:06.529690 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.529663    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 22 11:51:06.533747 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.533727    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 22 11:51:06.534216 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.534182    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 22 11:51:06.534440 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.534411    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 22 11:51:06.534521 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.534441    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 22 11:51:06.535036 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.535019    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bnwsd\""
Jul 22 11:51:06.535126 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.535019    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 22 11:51:06.535343 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.535321    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 22 11:51:06.536187 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.536167    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 22 11:51:06.556290 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.556263    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 11:51:06.612060 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.611968    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/448c4251-0b21-45fb-8a55-c5ca143da632-web-config\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.612060 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.612020    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/448c4251-0b21-45fb-8a55-c5ca143da632-config-out\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.612060 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.612050    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/448c4251-0b21-45fb-8a55-c5ca143da632-tls-assets\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.612464 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.612081    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/448c4251-0b21-45fb-8a55-c5ca143da632-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.612464 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.612122    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/448c4251-0b21-45fb-8a55-c5ca143da632-config-volume\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.612464 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.612146    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/448c4251-0b21-45fb-8a55-c5ca143da632-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.612464 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.612178    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/448c4251-0b21-45fb-8a55-c5ca143da632-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.612464 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.612203    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/448c4251-0b21-45fb-8a55-c5ca143da632-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.612464 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.612228    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/448c4251-0b21-45fb-8a55-c5ca143da632-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.612464 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.612266    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/448c4251-0b21-45fb-8a55-c5ca143da632-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.612464 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.612320    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/448c4251-0b21-45fb-8a55-c5ca143da632-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.612464 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.612345    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/448c4251-0b21-45fb-8a55-c5ca143da632-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.612464 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.612375    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swczc\" (UniqueName: \"kubernetes.io/projected/448c4251-0b21-45fb-8a55-c5ca143da632-kube-api-access-swczc\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.713552 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.713511    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/448c4251-0b21-45fb-8a55-c5ca143da632-web-config\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.713552 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.713555    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/448c4251-0b21-45fb-8a55-c5ca143da632-config-out\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.713744 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.713582    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/448c4251-0b21-45fb-8a55-c5ca143da632-tls-assets\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.713744 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.713611    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/448c4251-0b21-45fb-8a55-c5ca143da632-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.713744 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.713668    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/448c4251-0b21-45fb-8a55-c5ca143da632-config-volume\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.713744 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.713692    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/448c4251-0b21-45fb-8a55-c5ca143da632-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.713744 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.713725    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/448c4251-0b21-45fb-8a55-c5ca143da632-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.713976 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.713750    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/448c4251-0b21-45fb-8a55-c5ca143da632-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.713976 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.713772    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/448c4251-0b21-45fb-8a55-c5ca143da632-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.713976 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.713817    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/448c4251-0b21-45fb-8a55-c5ca143da632-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.713976 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.713850    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/448c4251-0b21-45fb-8a55-c5ca143da632-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.713976 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.713874    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/448c4251-0b21-45fb-8a55-c5ca143da632-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.713976 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.713907    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swczc\" (UniqueName: \"kubernetes.io/projected/448c4251-0b21-45fb-8a55-c5ca143da632-kube-api-access-swczc\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.714251 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:51:06.714101    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/448c4251-0b21-45fb-8a55-c5ca143da632-alertmanager-trusted-ca-bundle podName:448c4251-0b21-45fb-8a55-c5ca143da632 nodeName:}" failed. No retries permitted until 2026-07-22 11:51:07.214078771 +0000 UTC m=+79.580594013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/448c4251-0b21-45fb-8a55-c5ca143da632-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "448c4251-0b21-45fb-8a55-c5ca143da632") : configmap references non-existent config key: ca-bundle.crt
Jul 22 11:51:06.714319 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.714244    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/448c4251-0b21-45fb-8a55-c5ca143da632-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.716800 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.716669    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/448c4251-0b21-45fb-8a55-c5ca143da632-config-out\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.717204 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.717073    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/448c4251-0b21-45fb-8a55-c5ca143da632-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.717204 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.717093    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/448c4251-0b21-45fb-8a55-c5ca143da632-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.717383 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.717207    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/448c4251-0b21-45fb-8a55-c5ca143da632-tls-assets\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.717587 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.717473    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/448c4251-0b21-45fb-8a55-c5ca143da632-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.717587 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.717535    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/448c4251-0b21-45fb-8a55-c5ca143da632-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.717800 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.717779    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/448c4251-0b21-45fb-8a55-c5ca143da632-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.718078 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.718057    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/448c4251-0b21-45fb-8a55-c5ca143da632-config-volume\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.719005 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.718985    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/448c4251-0b21-45fb-8a55-c5ca143da632-web-config\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.719879 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.719860    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/448c4251-0b21-45fb-8a55-c5ca143da632-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:06.728324 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:06.728301    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swczc\" (UniqueName: \"kubernetes.io/projected/448c4251-0b21-45fb-8a55-c5ca143da632-kube-api-access-swczc\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:07.034305 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:51:07.034268    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod439719dd_e090_4f31_8d3a_7224d68b7343.slice/crio-3b241587f2b8cd63c0e6e7cb3cd6195bcd13adf9856e025af14108f1862f57f7 WatchSource:0}: Error finding container 3b241587f2b8cd63c0e6e7cb3cd6195bcd13adf9856e025af14108f1862f57f7: Status 404 returned error can't find the container with id 3b241587f2b8cd63c0e6e7cb3cd6195bcd13adf9856e025af14108f1862f57f7
Jul 22 11:51:07.168257 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.168226    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-qqxff"]
Jul 22 11:51:07.169415 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:51:07.169386    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod704bddee_6ccc_46a9_9c66_83fca35aaf79.slice/crio-393ab08eec0306ae34ac771a7dd5d8598bec61c45b102d79260f9dd9f12e3e6e WatchSource:0}: Error finding container 393ab08eec0306ae34ac771a7dd5d8598bec61c45b102d79260f9dd9f12e3e6e: Status 404 returned error can't find the container with id 393ab08eec0306ae34ac771a7dd5d8598bec61c45b102d79260f9dd9f12e3e6e
Jul 22 11:51:07.187352 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.187327    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-55sg4"]
Jul 22 11:51:07.188551 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:51:07.188527    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbf70bda_bf8f_45a1_a4b2_09337ddbe6cd.slice/crio-427c47ead2962d56bc131290c7b02729891149c5b67208a8cd7a3acb56e9d7b0 WatchSource:0}: Error finding container 427c47ead2962d56bc131290c7b02729891149c5b67208a8cd7a3acb56e9d7b0: Status 404 returned error can't find the container with id 427c47ead2962d56bc131290c7b02729891149c5b67208a8cd7a3acb56e9d7b0
Jul 22 11:51:07.219575 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.219547    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/448c4251-0b21-45fb-8a55-c5ca143da632-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:07.220394 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.220375    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/448c4251-0b21-45fb-8a55-c5ca143da632-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"448c4251-0b21-45fb-8a55-c5ca143da632\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:07.437050 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.437010    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:51:07.529748 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.526026    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-869bdc6bd9-w965b"]
Jul 22 11:51:07.536736 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.536708    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:07.541838 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.541804    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 22 11:51:07.552542 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.552515    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9g65bua4rns11\""
Jul 22 11:51:07.552672 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.552558    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 22 11:51:07.565384 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.565243    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-869bdc6bd9-w965b"]
Jul 22 11:51:07.565384 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.565287    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-prdnr\""
Jul 22 11:51:07.570402 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.570378    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 22 11:51:07.570805 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.570781    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 22 11:51:07.581387 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.581354    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 22 11:51:07.621088 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.621064    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 11:51:07.622167 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.622148    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26617416-0411-43f4-bcea-5e078f3698d6-secret-grpc-tls\") pod \"thanos-querier-869bdc6bd9-w965b\" (UID: \"26617416-0411-43f4-bcea-5e078f3698d6\") " pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:07.622272 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.622183    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26617416-0411-43f4-bcea-5e078f3698d6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-869bdc6bd9-w965b\" (UID: \"26617416-0411-43f4-bcea-5e078f3698d6\") " pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:07.622272 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.622214    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/26617416-0411-43f4-bcea-5e078f3698d6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-869bdc6bd9-w965b\" (UID: \"26617416-0411-43f4-bcea-5e078f3698d6\") " pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:07.622412 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.622297    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/26617416-0411-43f4-bcea-5e078f3698d6-secret-thanos-querier-tls\") pod \"thanos-querier-869bdc6bd9-w965b\" (UID: \"26617416-0411-43f4-bcea-5e078f3698d6\") " pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:07.622412 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.622325    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9rc5\" (UniqueName: \"kubernetes.io/projected/26617416-0411-43f4-bcea-5e078f3698d6-kube-api-access-r9rc5\") pod \"thanos-querier-869bdc6bd9-w965b\" (UID: \"26617416-0411-43f4-bcea-5e078f3698d6\") " pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:07.622412 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.622347    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26617416-0411-43f4-bcea-5e078f3698d6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-869bdc6bd9-w965b\" (UID: \"26617416-0411-43f4-bcea-5e078f3698d6\") " pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:07.622412 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.622368    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/26617416-0411-43f4-bcea-5e078f3698d6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-869bdc6bd9-w965b\" (UID: \"26617416-0411-43f4-bcea-5e078f3698d6\") " pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:07.622412 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.622388    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26617416-0411-43f4-bcea-5e078f3698d6-metrics-client-ca\") pod \"thanos-querier-869bdc6bd9-w965b\" (UID: \"26617416-0411-43f4-bcea-5e078f3698d6\") " pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:07.623181 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:51:07.623154    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod448c4251_0b21_45fb_8a55_c5ca143da632.slice/crio-3ecc7c5ec4c170a031936692c5b6f443cb08e1af0131c6fdc7d786cadad3a31d WatchSource:0}: Error finding container 3ecc7c5ec4c170a031936692c5b6f443cb08e1af0131c6fdc7d786cadad3a31d: Status 404 returned error can't find the container with id 3ecc7c5ec4c170a031936692c5b6f443cb08e1af0131c6fdc7d786cadad3a31d
Jul 22 11:51:07.723208 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.723172    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26617416-0411-43f4-bcea-5e078f3698d6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-869bdc6bd9-w965b\" (UID: \"26617416-0411-43f4-bcea-5e078f3698d6\") " pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:07.723393 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.723224    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/26617416-0411-43f4-bcea-5e078f3698d6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-869bdc6bd9-w965b\" (UID: \"26617416-0411-43f4-bcea-5e078f3698d6\") " pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:07.723483 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.723445    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26617416-0411-43f4-bcea-5e078f3698d6-metrics-client-ca\") pod \"thanos-querier-869bdc6bd9-w965b\" (UID: \"26617416-0411-43f4-bcea-5e078f3698d6\") " pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:07.723542 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.723515    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26617416-0411-43f4-bcea-5e078f3698d6-secret-grpc-tls\") pod \"thanos-querier-869bdc6bd9-w965b\" (UID: \"26617416-0411-43f4-bcea-5e078f3698d6\") " pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:07.723597 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.723567    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26617416-0411-43f4-bcea-5e078f3698d6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-869bdc6bd9-w965b\" (UID: \"26617416-0411-43f4-bcea-5e078f3698d6\") " pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:07.723673 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.723638    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/26617416-0411-43f4-bcea-5e078f3698d6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-869bdc6bd9-w965b\" (UID: \"26617416-0411-43f4-bcea-5e078f3698d6\") " pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:07.723720 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.723709    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/26617416-0411-43f4-bcea-5e078f3698d6-secret-thanos-querier-tls\") pod \"thanos-querier-869bdc6bd9-w965b\" (UID: \"26617416-0411-43f4-bcea-5e078f3698d6\") " pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:07.723762 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.723737    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9rc5\" (UniqueName: \"kubernetes.io/projected/26617416-0411-43f4-bcea-5e078f3698d6-kube-api-access-r9rc5\") pod \"thanos-querier-869bdc6bd9-w965b\" (UID: \"26617416-0411-43f4-bcea-5e078f3698d6\") " pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:07.724358 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.724308    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26617416-0411-43f4-bcea-5e078f3698d6-metrics-client-ca\") pod \"thanos-querier-869bdc6bd9-w965b\" (UID: \"26617416-0411-43f4-bcea-5e078f3698d6\") " pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:07.726225 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.726193    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26617416-0411-43f4-bcea-5e078f3698d6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-869bdc6bd9-w965b\" (UID: \"26617416-0411-43f4-bcea-5e078f3698d6\") " pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:07.726323 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.726205    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26617416-0411-43f4-bcea-5e078f3698d6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-869bdc6bd9-w965b\" (UID: \"26617416-0411-43f4-bcea-5e078f3698d6\") " pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:07.726575 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.726476    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/26617416-0411-43f4-bcea-5e078f3698d6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-869bdc6bd9-w965b\" (UID: \"26617416-0411-43f4-bcea-5e078f3698d6\") " pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:07.727015 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.726989    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/26617416-0411-43f4-bcea-5e078f3698d6-secret-thanos-querier-tls\") pod \"thanos-querier-869bdc6bd9-w965b\" (UID: \"26617416-0411-43f4-bcea-5e078f3698d6\") " pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:07.727279 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.727259    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/26617416-0411-43f4-bcea-5e078f3698d6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-869bdc6bd9-w965b\" (UID: \"26617416-0411-43f4-bcea-5e078f3698d6\") " pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:07.727370 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.727346    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26617416-0411-43f4-bcea-5e078f3698d6-secret-grpc-tls\") pod \"thanos-querier-869bdc6bd9-w965b\" (UID: \"26617416-0411-43f4-bcea-5e078f3698d6\") " pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:07.736545 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.736519    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9rc5\" (UniqueName: \"kubernetes.io/projected/26617416-0411-43f4-bcea-5e078f3698d6-kube-api-access-r9rc5\") pod \"thanos-querier-869bdc6bd9-w965b\" (UID: \"26617416-0411-43f4-bcea-5e078f3698d6\") " pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:07.827044 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.826949    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4xvzj" event={"ID":"25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4","Type":"ContainerStarted","Data":"41a81197d71cc4a6128bda8e8429a19cf60b69fed9f262ba814a2b923cc52a8d"}
Jul 22 11:51:07.828741 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.828707    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"448c4251-0b21-45fb-8a55-c5ca143da632","Type":"ContainerStarted","Data":"3ecc7c5ec4c170a031936692c5b6f443cb08e1af0131c6fdc7d786cadad3a31d"}
Jul 22 11:51:07.831045 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.831010    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qqxff" event={"ID":"704bddee-6ccc-46a9-9c66-83fca35aaf79","Type":"ContainerStarted","Data":"1fd9bbb46660d55f7b6fef7efe2b77470de48e57908440fcdba5dfadcca81a16"}
Jul 22 11:51:07.831135 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.831076    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qqxff" event={"ID":"704bddee-6ccc-46a9-9c66-83fca35aaf79","Type":"ContainerStarted","Data":"1d5f3110a5f252df9bb972f5fcc8928d2f184ec2d6e6159f8e3deffb5585a809"}
Jul 22 11:51:07.831135 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.831105    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qqxff" event={"ID":"704bddee-6ccc-46a9-9c66-83fca35aaf79","Type":"ContainerStarted","Data":"393ab08eec0306ae34ac771a7dd5d8598bec61c45b102d79260f9dd9f12e3e6e"}
Jul 22 11:51:07.833294 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.833238    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xh4sp" event={"ID":"439719dd-e090-4f31-8d3a-7224d68b7343","Type":"ContainerStarted","Data":"3b241587f2b8cd63c0e6e7cb3cd6195bcd13adf9856e025af14108f1862f57f7"}
Jul 22 11:51:07.834642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.834596    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-55sg4" event={"ID":"dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd","Type":"ContainerStarted","Data":"427c47ead2962d56bc131290c7b02729891149c5b67208a8cd7a3acb56e9d7b0"}
Jul 22 11:51:07.850988 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.850927    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:07.855343 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:07.855284    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4xvzj" podStartSLOduration=1.53002993 podStartE2EDuration="18.855268075s" totalImagesPullingTime="17.325238145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 11:50:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:51:07.854412996 +0000 UTC m=+80.220928251" watchObservedRunningTime="2026-07-22 11:51:07.855268075 +0000 UTC m=+80.221783320"
Jul 22 11:51:08.098901 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:08.098831    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-869bdc6bd9-w965b"]
Jul 22 11:51:08.493987 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:51:08.493955    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26617416_0411_43f4_bcea_5e078f3698d6.slice/crio-743e244e7bf55ff2ee0d3c737ccbdbe46084320820c588460f4660b59cc40d4e WatchSource:0}: Error finding container 743e244e7bf55ff2ee0d3c737ccbdbe46084320820c588460f4660b59cc40d4e: Status 404 returned error can't find the container with id 743e244e7bf55ff2ee0d3c737ccbdbe46084320820c588460f4660b59cc40d4e
Jul 22 11:51:08.840166 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:08.840079    2558 generic.go:356] "Generic (PLEG): container finished" podID="439719dd-e090-4f31-8d3a-7224d68b7343" containerID="eacf647add3802be480ec33b3053fca566677d9b5c50b048223dd084cd764fb8" exitCode=0
Jul 22 11:51:08.840582 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:08.840167    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xh4sp" event={"ID":"439719dd-e090-4f31-8d3a-7224d68b7343","Type":"ContainerDied","Data":"eacf647add3802be480ec33b3053fca566677d9b5c50b048223dd084cd764fb8"}
Jul 22 11:51:08.841538 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:08.841515    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b" event={"ID":"26617416-0411-43f4-bcea-5e078f3698d6","Type":"ContainerStarted","Data":"743e244e7bf55ff2ee0d3c737ccbdbe46084320820c588460f4660b59cc40d4e"}
Jul 22 11:51:09.847547 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:09.847506    2558 generic.go:356] "Generic (PLEG): container finished" podID="448c4251-0b21-45fb-8a55-c5ca143da632" containerID="6533d8153f54f2d4d6283675fc647001f0b0a6743a5f186b81c5568da015f23b" exitCode=0
Jul 22 11:51:09.848005 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:09.847597    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"448c4251-0b21-45fb-8a55-c5ca143da632","Type":"ContainerDied","Data":"6533d8153f54f2d4d6283675fc647001f0b0a6743a5f186b81c5568da015f23b"}
Jul 22 11:51:09.850419 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:09.850382    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qqxff" event={"ID":"704bddee-6ccc-46a9-9c66-83fca35aaf79","Type":"ContainerStarted","Data":"f020d91687a2cca99679222baff66abdfb4cd4ff65a0515cd924781a5f25d411"}
Jul 22 11:51:09.852977 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:09.852871    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xh4sp" event={"ID":"439719dd-e090-4f31-8d3a-7224d68b7343","Type":"ContainerStarted","Data":"7714bcb6e1bf97340f68c692200d477a823ce11c2b5bc5379b87b40471679478"}
Jul 22 11:51:09.852977 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:09.852927    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xh4sp" event={"ID":"439719dd-e090-4f31-8d3a-7224d68b7343","Type":"ContainerStarted","Data":"17a21ba14697ecfa5b82dcfe9c80712baf795219aa3daceec0b3c39b12aa5da5"}
Jul 22 11:51:09.855225 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:09.855204    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-55sg4" event={"ID":"dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd","Type":"ContainerStarted","Data":"b412ff95b01f1eeb474be62a0c453cb7593493e32719d48a133fe531fa9e9919"}
Jul 22 11:51:09.855312 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:09.855246    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-55sg4" event={"ID":"dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd","Type":"ContainerStarted","Data":"cafed3b2b2784011b85209fc8045f4393fd44167099f35be2faac6d3ab8acf55"}
Jul 22 11:51:09.855312 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:09.855265    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-55sg4" event={"ID":"dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd","Type":"ContainerStarted","Data":"6184a936af449b2e2c1b37d7f16f1a5ef9e6b478a9666f219cef6e557d4a4030"}
Jul 22 11:51:09.904362 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:09.904284    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qqxff" podStartSLOduration=3.216358151 podStartE2EDuration="4.904268877s" totalImagesPullingTime="1.687910726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:51:09.903068823 +0000 UTC m=+82.269584069" watchObservedRunningTime="2026-07-22 11:51:09.904268877 +0000 UTC m=+82.270784121"
Jul 22 11:51:09.926037 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:09.925975    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xh4sp" podStartSLOduration=3.90220214 podStartE2EDuration="4.925958901s" totalImagesPullingTime="944.68666ms" totalInitContainerRuntime="79.070101ms" isStatefulPod=true podCreationTimestamp="2026-07-22 11:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:51:09.925490395 +0000 UTC m=+82.292005642" watchObservedRunningTime="2026-07-22 11:51:09.925958901 +0000 UTC m=+82.292474146"
Jul 22 11:51:09.952867 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:09.952818    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-55sg4" podStartSLOduration=3.136894838 podStartE2EDuration="4.95279389s" totalImagesPullingTime="1.815899052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:51:09.951053605 +0000 UTC m=+82.317568866" watchObservedRunningTime="2026-07-22 11:51:09.95279389 +0000 UTC m=+82.319309134"
Jul 22 11:51:10.023157 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.023080    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-d65c64d4-d4g9d"]
Jul 22 11:51:10.027602 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.027582    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:51:10.031651 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.031603    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 22 11:51:10.031758 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.031682    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 22 11:51:10.031758 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.031698    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 22 11:51:10.031835 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.031698    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 22 11:51:10.031917 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.031867    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-akdnpv5dd9ttd\""
Jul 22 11:51:10.031958 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.031938    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-pp8r9\""
Jul 22 11:51:10.040781 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.040755    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d65c64d4-d4g9d"]
Jul 22 11:51:10.145127 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.145088    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d65c64d4-d4g9d\" (UID: \"5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c\") " pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:51:10.145334 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.145139    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c-secret-metrics-server-client-certs\") pod \"metrics-server-d65c64d4-d4g9d\" (UID: \"5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c\") " pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:51:10.145334 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.145185    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c-audit-log\") pod \"metrics-server-d65c64d4-d4g9d\" (UID: \"5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c\") " pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:51:10.145334 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.145232    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c-metrics-server-audit-profiles\") pod \"metrics-server-d65c64d4-d4g9d\" (UID: \"5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c\") " pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:51:10.145334 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.145260    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn4mm\" (UniqueName: \"kubernetes.io/projected/5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c-kube-api-access-hn4mm\") pod \"metrics-server-d65c64d4-d4g9d\" (UID: \"5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c\") " pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:51:10.145334 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.145317    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c-secret-metrics-server-tls\") pod \"metrics-server-d65c64d4-d4g9d\" (UID: \"5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c\") " pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:51:10.145534 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.145382    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c-client-ca-bundle\") pod \"metrics-server-d65c64d4-d4g9d\" (UID: \"5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c\") " pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:51:10.234878 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.234841    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7p6x2"]
Jul 22 11:51:10.240399 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.240356    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7p6x2"
Jul 22 11:51:10.245879 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.245848    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c-metrics-server-audit-profiles\") pod \"metrics-server-d65c64d4-d4g9d\" (UID: \"5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c\") " pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:51:10.246011 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.245890    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn4mm\" (UniqueName: \"kubernetes.io/projected/5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c-kube-api-access-hn4mm\") pod \"metrics-server-d65c64d4-d4g9d\" (UID: \"5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c\") " pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:51:10.246011 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.245924    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c-secret-metrics-server-tls\") pod \"metrics-server-d65c64d4-d4g9d\" (UID: \"5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c\") " pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:51:10.246011 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.245973    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c-client-ca-bundle\") pod \"metrics-server-d65c64d4-d4g9d\" (UID: \"5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c\") " pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:51:10.246196 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.246014    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d65c64d4-d4g9d\" (UID: \"5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c\") " pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:51:10.246196 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.246040    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c-secret-metrics-server-client-certs\") pod \"metrics-server-d65c64d4-d4g9d\" (UID: \"5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c\") " pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:51:10.246196 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.246081    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c-audit-log\") pod \"metrics-server-d65c64d4-d4g9d\" (UID: \"5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c\") " pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:51:10.247074 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.246759    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c-audit-log\") pod \"metrics-server-d65c64d4-d4g9d\" (UID: \"5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c\") " pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:51:10.247131 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.247106    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d65c64d4-d4g9d\" (UID: \"5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c\") " pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:51:10.248048 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.247289    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c-metrics-server-audit-profiles\") pod \"metrics-server-d65c64d4-d4g9d\" (UID: \"5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c\") " pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:51:10.250014 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.249584    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 22 11:51:10.250014 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.249644    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c-client-ca-bundle\") pod \"metrics-server-d65c64d4-d4g9d\" (UID: \"5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c\") " pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:51:10.250014 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.249866    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-wmf6f\""
Jul 22 11:51:10.250014 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.249901    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c-secret-metrics-server-client-certs\") pod \"metrics-server-d65c64d4-d4g9d\" (UID: \"5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c\") " pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:51:10.250253 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.250066    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c-secret-metrics-server-tls\") pod \"metrics-server-d65c64d4-d4g9d\" (UID: \"5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c\") " pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:51:10.251763 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.251739    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7p6x2"]
Jul 22 11:51:10.256318 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.256300    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6996ff777c-vrjk5"]
Jul 22 11:51:10.258833 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.258814    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn4mm\" (UniqueName: \"kubernetes.io/projected/5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c-kube-api-access-hn4mm\") pod \"metrics-server-d65c64d4-d4g9d\" (UID: \"5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c\") " pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:51:10.294065 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.293980    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c45594f99-xk7vr"]
Jul 22 11:51:10.298952 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.298926    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:10.310249 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.310220    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c45594f99-xk7vr"]
Jul 22 11:51:10.336554 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.336522    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:51:10.346912 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.346885    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcmwf\" (UniqueName: \"kubernetes.io/projected/fe2a97e1-57a6-422c-9645-518aed32d6ec-kube-api-access-bcmwf\") pod \"monitoring-plugin-7b7b7bc8bf-7p6x2\" (UID: \"fe2a97e1-57a6-422c-9645-518aed32d6ec\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7p6x2"
Jul 22 11:51:10.347042 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.346926    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe2a97e1-57a6-422c-9645-518aed32d6ec-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-7p6x2\" (UID: \"fe2a97e1-57a6-422c-9645-518aed32d6ec\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7p6x2"
Jul 22 11:51:10.448059 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.448031    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0fb91a7-84db-4251-8a7a-26aa78367786-trusted-ca-bundle\") pod \"console-5c45594f99-xk7vr\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") " pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:10.448216 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.448064    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7flg\" (UniqueName: \"kubernetes.io/projected/a0fb91a7-84db-4251-8a7a-26aa78367786-kube-api-access-l7flg\") pod \"console-5c45594f99-xk7vr\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") " pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:10.448216 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.448091    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0fb91a7-84db-4251-8a7a-26aa78367786-oauth-serving-cert\") pod \"console-5c45594f99-xk7vr\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") " pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:10.448216 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.448123    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0fb91a7-84db-4251-8a7a-26aa78367786-service-ca\") pod \"console-5c45594f99-xk7vr\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") " pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:10.448216 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.448147    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0fb91a7-84db-4251-8a7a-26aa78367786-console-config\") pod \"console-5c45594f99-xk7vr\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") " pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:10.448418 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.448232    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0fb91a7-84db-4251-8a7a-26aa78367786-console-serving-cert\") pod \"console-5c45594f99-xk7vr\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") " pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:10.448418 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.448291    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0fb91a7-84db-4251-8a7a-26aa78367786-console-oauth-config\") pod \"console-5c45594f99-xk7vr\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") " pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:10.448418 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.448329    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcmwf\" (UniqueName: \"kubernetes.io/projected/fe2a97e1-57a6-422c-9645-518aed32d6ec-kube-api-access-bcmwf\") pod \"monitoring-plugin-7b7b7bc8bf-7p6x2\" (UID: \"fe2a97e1-57a6-422c-9645-518aed32d6ec\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7p6x2"
Jul 22 11:51:10.448418 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.448383    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe2a97e1-57a6-422c-9645-518aed32d6ec-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-7p6x2\" (UID: \"fe2a97e1-57a6-422c-9645-518aed32d6ec\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7p6x2"
Jul 22 11:51:10.451010 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.450987    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe2a97e1-57a6-422c-9645-518aed32d6ec-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-7p6x2\" (UID: \"fe2a97e1-57a6-422c-9645-518aed32d6ec\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7p6x2"
Jul 22 11:51:10.458574 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.458552    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcmwf\" (UniqueName: \"kubernetes.io/projected/fe2a97e1-57a6-422c-9645-518aed32d6ec-kube-api-access-bcmwf\") pod \"monitoring-plugin-7b7b7bc8bf-7p6x2\" (UID: \"fe2a97e1-57a6-422c-9645-518aed32d6ec\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7p6x2"
Jul 22 11:51:10.549862 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.549750    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0fb91a7-84db-4251-8a7a-26aa78367786-console-oauth-config\") pod \"console-5c45594f99-xk7vr\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") " pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:10.549862 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.549851    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0fb91a7-84db-4251-8a7a-26aa78367786-trusted-ca-bundle\") pod \"console-5c45594f99-xk7vr\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") " pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:10.550086 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.549869    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7flg\" (UniqueName: \"kubernetes.io/projected/a0fb91a7-84db-4251-8a7a-26aa78367786-kube-api-access-l7flg\") pod \"console-5c45594f99-xk7vr\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") " pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:10.550086 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.550039    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0fb91a7-84db-4251-8a7a-26aa78367786-oauth-serving-cert\") pod \"console-5c45594f99-xk7vr\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") " pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:10.550086 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.550085    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0fb91a7-84db-4251-8a7a-26aa78367786-service-ca\") pod \"console-5c45594f99-xk7vr\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") " pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:10.550231 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.550117    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0fb91a7-84db-4251-8a7a-26aa78367786-console-config\") pod \"console-5c45594f99-xk7vr\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") " pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:10.550231 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.550156    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0fb91a7-84db-4251-8a7a-26aa78367786-console-serving-cert\") pod \"console-5c45594f99-xk7vr\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") " pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:10.550799 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.550773    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0fb91a7-84db-4251-8a7a-26aa78367786-oauth-serving-cert\") pod \"console-5c45594f99-xk7vr\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") " pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:10.550921 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.550815    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0fb91a7-84db-4251-8a7a-26aa78367786-service-ca\") pod \"console-5c45594f99-xk7vr\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") " pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:10.550921 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.550834    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0fb91a7-84db-4251-8a7a-26aa78367786-console-config\") pod \"console-5c45594f99-xk7vr\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") " pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:10.551033 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.550934    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0fb91a7-84db-4251-8a7a-26aa78367786-trusted-ca-bundle\") pod \"console-5c45594f99-xk7vr\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") " pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:10.552905 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.552882    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0fb91a7-84db-4251-8a7a-26aa78367786-console-serving-cert\") pod \"console-5c45594f99-xk7vr\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") " pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:10.553009 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.552936    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0fb91a7-84db-4251-8a7a-26aa78367786-console-oauth-config\") pod \"console-5c45594f99-xk7vr\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") " pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:10.560806 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.560787    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7flg\" (UniqueName: \"kubernetes.io/projected/a0fb91a7-84db-4251-8a7a-26aa78367786-kube-api-access-l7flg\") pod \"console-5c45594f99-xk7vr\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") " pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:10.571597 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.571577    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7p6x2"
Jul 22 11:51:10.610065 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.609808    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:10.718448 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.718404    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d65c64d4-d4g9d"]
Jul 22 11:51:10.722423 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:51:10.722371    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cb7b92b_f9ff_4786_ad7b_042bb4a48e4c.slice/crio-8d8e8afba8a576c08cfe4884ba51345236503e770b57d814a81006f1554afc42 WatchSource:0}: Error finding container 8d8e8afba8a576c08cfe4884ba51345236503e770b57d814a81006f1554afc42: Status 404 returned error can't find the container with id 8d8e8afba8a576c08cfe4884ba51345236503e770b57d814a81006f1554afc42
Jul 22 11:51:10.748412 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.748353    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7p6x2"]
Jul 22 11:51:10.790205 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.790170    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c45594f99-xk7vr"]
Jul 22 11:51:10.793442 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:51:10.793415    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0fb91a7_84db_4251_8a7a_26aa78367786.slice/crio-7a7e00ced183143cbcc62347c27d1a04eec79f164e850ac4cc57c906b4691180 WatchSource:0}: Error finding container 7a7e00ced183143cbcc62347c27d1a04eec79f164e850ac4cc57c906b4691180: Status 404 returned error can't find the container with id 7a7e00ced183143cbcc62347c27d1a04eec79f164e850ac4cc57c906b4691180
Jul 22 11:51:10.861878 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.861837    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b" event={"ID":"26617416-0411-43f4-bcea-5e078f3698d6","Type":"ContainerStarted","Data":"f387f193b73763301ff2032e3abaf4f1f09b8ec9d49a1cbd65937683152914e5"}
Jul 22 11:51:10.862128 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.861932    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b" event={"ID":"26617416-0411-43f4-bcea-5e078f3698d6","Type":"ContainerStarted","Data":"2da637b63ffd284edfc504a68cc8cebb275bef3f7ca0b5915c2191fbfde7161c"}
Jul 22 11:51:10.865352 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.865326    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c45594f99-xk7vr" event={"ID":"a0fb91a7-84db-4251-8a7a-26aa78367786","Type":"ContainerStarted","Data":"7a7e00ced183143cbcc62347c27d1a04eec79f164e850ac4cc57c906b4691180"}
Jul 22 11:51:10.867938 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.867916    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7p6x2" event={"ID":"fe2a97e1-57a6-422c-9645-518aed32d6ec","Type":"ContainerStarted","Data":"c11c45655964764174090c8c163b05d797ffb3af57b1e473b3a4d6810ae92051"}
Jul 22 11:51:10.870152 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:10.870128    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d" event={"ID":"5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c","Type":"ContainerStarted","Data":"8d8e8afba8a576c08cfe4884ba51345236503e770b57d814a81006f1554afc42"}
Jul 22 11:51:11.856777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.856737    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 11:51:11.865041 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.861948    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:11.868373 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.868200    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 22 11:51:11.868895 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.868788    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 22 11:51:11.868895 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.868873    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 22 11:51:11.868895 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.868890    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-77qrx\""
Jul 22 11:51:11.869115 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.868875    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 22 11:51:11.869115 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.868987    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 22 11:51:11.869455 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.869428    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 22 11:51:11.869538 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.869441    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 22 11:51:11.869538 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.869500    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 22 11:51:11.869656 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.869500    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 22 11:51:11.869656 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.869442    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 22 11:51:11.869982 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.869964    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 22 11:51:11.874538 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.874521    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 22 11:51:11.875249 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.875227    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e2109m81gmo7n\""
Jul 22 11:51:11.876778 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.876760    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 22 11:51:11.878492 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.878468    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 22 11:51:11.883804 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.883779    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b" event={"ID":"26617416-0411-43f4-bcea-5e078f3698d6","Type":"ContainerStarted","Data":"9bd60b3985efbb0e1d01559f315cc4c0309a13e6e65d8ea1e69582804882ade6"}
Jul 22 11:51:11.884924 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.884837    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 11:51:11.886580 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.886558    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c45594f99-xk7vr" event={"ID":"a0fb91a7-84db-4251-8a7a-26aa78367786","Type":"ContainerStarted","Data":"4ce9d99b3f22e7de3a7eb4f61c6686ddf20101c08c52577232b3ae378a46e8f2"}
Jul 22 11:51:11.965468 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.965402    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/162b08fa-d070-419e-a161-98209f323127-config-out\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:11.965468 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.965448    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/162b08fa-d070-419e-a161-98209f323127-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:11.965468 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.965474    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/162b08fa-d070-419e-a161-98209f323127-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:11.965761 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.965511    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqwh8\" (UniqueName: \"kubernetes.io/projected/162b08fa-d070-419e-a161-98209f323127-kube-api-access-lqwh8\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:11.965761 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.965538    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:11.965761 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.965579    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:11.965761 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.965638    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:11.965761 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.965662    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-config\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:11.965761 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.965727    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/162b08fa-d070-419e-a161-98209f323127-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:11.966056 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.965765    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/162b08fa-d070-419e-a161-98209f323127-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:11.966056 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.965791    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/162b08fa-d070-419e-a161-98209f323127-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:11.966056 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.965819    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:11.966056 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.965878    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:11.966056 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.965921    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-web-config\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:11.966056 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.965950    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:11.966056 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.965996    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/162b08fa-d070-419e-a161-98209f323127-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:11.966056 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.966038    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/162b08fa-d070-419e-a161-98209f323127-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:11.966397 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.966062    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/162b08fa-d070-419e-a161-98209f323127-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:11.966397 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.966090    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:11.966397 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.966113    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/162b08fa-d070-419e-a161-98209f323127-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:11.986970 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.986938    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6996ff777c-vrjk5"
Jul 22 11:51:11.998072 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:11.998015    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c45594f99-xk7vr" podStartSLOduration=1.9979979509999999 podStartE2EDuration="1.997997951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:51:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:51:11.996951864 +0000 UTC m=+84.363467108" watchObservedRunningTime="2026-07-22 11:51:11.997997951 +0000 UTC m=+84.364513177"
Jul 22 11:51:12.066770 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.066728    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/162b08fa-d070-419e-a161-98209f323127-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.066945 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.066782    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/162b08fa-d070-419e-a161-98209f323127-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.066945 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.066815    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.066945 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.066839    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.066945 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.066862    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-web-config\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.066945 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.066888    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.066945 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.066935    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/162b08fa-d070-419e-a161-98209f323127-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.067243 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.066985    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/162b08fa-d070-419e-a161-98209f323127-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.067243 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.067008    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/162b08fa-d070-419e-a161-98209f323127-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.067243 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.067034    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.067243 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.067057    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/162b08fa-d070-419e-a161-98209f323127-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.067243 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.067133    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/162b08fa-d070-419e-a161-98209f323127-config-out\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.067243 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.067159    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/162b08fa-d070-419e-a161-98209f323127-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.067243 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.067181    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/162b08fa-d070-419e-a161-98209f323127-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.067243 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.067220    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqwh8\" (UniqueName: \"kubernetes.io/projected/162b08fa-d070-419e-a161-98209f323127-kube-api-access-lqwh8\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.067460 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.067261    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.067460 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.067297    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.067460 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.067337    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.067460 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.067362    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-config\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.067460 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.067440    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/162b08fa-d070-419e-a161-98209f323127-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.067722 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.067693    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/162b08fa-d070-419e-a161-98209f323127-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.068505 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.068274    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/162b08fa-d070-419e-a161-98209f323127-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.068505 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.068361    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/162b08fa-d070-419e-a161-98209f323127-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.069299 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.068846    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/162b08fa-d070-419e-a161-98209f323127-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.070130 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.069778    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/162b08fa-d070-419e-a161-98209f323127-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.071686 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.071337    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/162b08fa-d070-419e-a161-98209f323127-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.071686 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.071463    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.071686 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.071463    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.072231 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.071958    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-web-config\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.072231 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.072203    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.072666 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.072641    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/162b08fa-d070-419e-a161-98209f323127-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.073689 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.073114    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/162b08fa-d070-419e-a161-98209f323127-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.073689 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.073407    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/162b08fa-d070-419e-a161-98209f323127-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.074561 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.074078    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/162b08fa-d070-419e-a161-98209f323127-config-out\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.074561 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.074522    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.076006 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.075973    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-config\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.076309 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.076266    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.077230 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.077177    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.078332 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.078310    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/162b08fa-d070-419e-a161-98209f323127-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.091397 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.091373    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqwh8\" (UniqueName: \"kubernetes.io/projected/162b08fa-d070-419e-a161-98209f323127-kube-api-access-lqwh8\") pod \"prometheus-k8s-0\" (UID: \"162b08fa-d070-419e-a161-98209f323127\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.178160 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.178124    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:12.932687 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:12.932601    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 11:51:12.933171 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:51:12.933145    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod162b08fa_d070_419e_a161_98209f323127.slice/crio-c8c3b5ae093be430e0305896a178a6cad2a84b33c43f8dd7d964ab1b6724f2dd WatchSource:0}: Error finding container c8c3b5ae093be430e0305896a178a6cad2a84b33c43f8dd7d964ab1b6724f2dd: Status 404 returned error can't find the container with id c8c3b5ae093be430e0305896a178a6cad2a84b33c43f8dd7d964ab1b6724f2dd
Jul 22 11:51:13.900375 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:13.900338    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"448c4251-0b21-45fb-8a55-c5ca143da632","Type":"ContainerStarted","Data":"cb4228508f7f77efcdac642b5dbafefe92625d4b24f5a49f2ae61cd892fcef4e"}
Jul 22 11:51:13.900532 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:13.900439    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"448c4251-0b21-45fb-8a55-c5ca143da632","Type":"ContainerStarted","Data":"9eaf6ffe15e72105f2c784f3a331a36c3b85270494c6a67ca9a9c8bf56128926"}
Jul 22 11:51:13.900532 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:13.900492    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"448c4251-0b21-45fb-8a55-c5ca143da632","Type":"ContainerStarted","Data":"7c6f01151fbd35b850389ce85594fd842b300163155814d53145982daa2423d7"}
Jul 22 11:51:13.900532 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:13.900522    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"448c4251-0b21-45fb-8a55-c5ca143da632","Type":"ContainerStarted","Data":"9eab22f434422e76b3d233437f2fdda23c7a9addd66d7d0c939f1cb94dc6b648"}
Jul 22 11:51:13.900711 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:13.900553    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"448c4251-0b21-45fb-8a55-c5ca143da632","Type":"ContainerStarted","Data":"0063dc980e31020caca29a77e8bf1ee3b8bbed13a048b418efa30470c6f642fc"}
Jul 22 11:51:13.900711 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:13.900591    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"448c4251-0b21-45fb-8a55-c5ca143da632","Type":"ContainerStarted","Data":"7b8278fe55f4ba271d1336fccbafcc9a8cab5ab2345f35082661404d1532fb86"}
Jul 22 11:51:13.903397 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:13.903370    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b" event={"ID":"26617416-0411-43f4-bcea-5e078f3698d6","Type":"ContainerStarted","Data":"f7e917606494e1d585271b4eb907a2a03982bc042fb2f948b187ce2ebf8fd265"}
Jul 22 11:51:13.903524 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:13.903429    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b" event={"ID":"26617416-0411-43f4-bcea-5e078f3698d6","Type":"ContainerStarted","Data":"0f1906ddc798376eaab72fbfa165e9ad48e4ff0da46b5377e3b51ae6f4a1c3c0"}
Jul 22 11:51:13.903524 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:13.903466    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b" event={"ID":"26617416-0411-43f4-bcea-5e078f3698d6","Type":"ContainerStarted","Data":"237ae5d142e5b178aae934dfef0afff242be28d0d201e57cc1aefc887d93630b"}
Jul 22 11:51:13.903524 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:13.903508    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:13.904871 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:13.904848    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7p6x2" event={"ID":"fe2a97e1-57a6-422c-9645-518aed32d6ec","Type":"ContainerStarted","Data":"6fb7e5b7fd17a508fdaeea79c90c1b77fe3fc33e882f79622fdbcf4b68e461ac"}
Jul 22 11:51:13.905014 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:13.904996    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7p6x2"
Jul 22 11:51:13.906470 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:13.906446    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d" event={"ID":"5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c","Type":"ContainerStarted","Data":"108bc3d3b44ee2f1989a5f2a40c317a1594590421d6928dbddc61395e03a197d"}
Jul 22 11:51:13.908113 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:13.908077    2558 generic.go:356] "Generic (PLEG): container finished" podID="162b08fa-d070-419e-a161-98209f323127" containerID="84824efdd6b3c6873befe7ca3c074f2ce565286c9dc8c4646071b6a5a62b0759" exitCode=0
Jul 22 11:51:13.908204 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:13.908118    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"162b08fa-d070-419e-a161-98209f323127","Type":"ContainerDied","Data":"84824efdd6b3c6873befe7ca3c074f2ce565286c9dc8c4646071b6a5a62b0759"}
Jul 22 11:51:13.908204 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:13.908168    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"162b08fa-d070-419e-a161-98209f323127","Type":"ContainerStarted","Data":"c8c3b5ae093be430e0305896a178a6cad2a84b33c43f8dd7d964ab1b6724f2dd"}
Jul 22 11:51:13.910387 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:13.910364    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7p6x2"
Jul 22 11:51:13.934788 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:13.934743    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.551551787 podStartE2EDuration="7.93472658s" totalImagesPullingTime="4.354384899s" totalInitContainerRuntime="28.789894ms" isStatefulPod=false podCreationTimestamp="2026-07-22 11:51:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:51:13.933327641 +0000 UTC m=+86.299842907" watchObservedRunningTime="2026-07-22 11:51:13.93472658 +0000 UTC m=+86.301241828"
Jul 22 11:51:13.959776 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:13.959719    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b" podStartSLOduration=2.724833206 podStartE2EDuration="6.95970178s" totalImagesPullingTime="4.234868574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:51:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:51:13.958921595 +0000 UTC m=+86.325436875" watchObservedRunningTime="2026-07-22 11:51:13.95970178 +0000 UTC m=+86.326217036"
Jul 22 11:51:13.978863 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:13.978816    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d" podStartSLOduration=1.92833615 podStartE2EDuration="3.978800727s" totalImagesPullingTime="2.050464577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:51:13.977923125 +0000 UTC m=+86.344438394" watchObservedRunningTime="2026-07-22 11:51:13.978800727 +0000 UTC m=+86.345315970"
Jul 22 11:51:13.998416 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:13.998367    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-7p6x2" podStartSLOduration=1.8267174449999999 podStartE2EDuration="3.998352432s" totalImagesPullingTime="2.171634987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:51:13.996926326 +0000 UTC m=+86.363441572" watchObservedRunningTime="2026-07-22 11:51:13.998352432 +0000 UTC m=+86.364867712"
Jul 22 11:51:17.931401 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:17.931362    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"162b08fa-d070-419e-a161-98209f323127","Type":"ContainerStarted","Data":"9004d63bf81e41356025a15345eb8e5486695851f0044814e54f64c72b79477b"}
Jul 22 11:51:17.931879 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:17.931481    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"162b08fa-d070-419e-a161-98209f323127","Type":"ContainerStarted","Data":"7896da049d995261942e4733550e9dc687ddf43597942433be6f4fa8b04b930b"}
Jul 22 11:51:17.931879 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:17.931524    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"162b08fa-d070-419e-a161-98209f323127","Type":"ContainerStarted","Data":"be57792bb39f3fc6a90b3a365fcf6dd41f5f76e8f51ebc8f93e52834d34c9b39"}
Jul 22 11:51:17.931879 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:17.931566    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"162b08fa-d070-419e-a161-98209f323127","Type":"ContainerStarted","Data":"46788305bc3a4e10de6562d15dfc4479c8bdf51638a422a2af05908010fce90d"}
Jul 22 11:51:17.931879 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:17.931601    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"162b08fa-d070-419e-a161-98209f323127","Type":"ContainerStarted","Data":"fc89cf6cc72e4adbd259cfc595c25b84ccb221629fe16254fdcb263fc0277b34"}
Jul 22 11:51:17.931879 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:17.931665    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"162b08fa-d070-419e-a161-98209f323127","Type":"ContainerStarted","Data":"849783c45cf4b45eb8cbcb696afd36ccbfd72b1d7f15a071440479aaffc94fff"}
Jul 22 11:51:17.967656 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:17.967579    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.896889779 podStartE2EDuration="6.967559863s" totalImagesPullingTime="3.037735604s" totalInitContainerRuntime="32.93448ms" isStatefulPod=false podCreationTimestamp="2026-07-22 11:51:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:51:17.9671698 +0000 UTC m=+90.333685105" watchObservedRunningTime="2026-07-22 11:51:17.967559863 +0000 UTC m=+90.334075108"
Jul 22 11:51:19.918207 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:19.918180    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-869bdc6bd9-w965b"
Jul 22 11:51:20.610843 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:20.610150    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:20.610843 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:20.610229    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:20.615284 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:20.615259    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:20.949509 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:20.949470    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:51:22.178365 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:22.178325    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:51:30.336978 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:30.336941    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:51:30.337406 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:30.337026    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:51:34.813214 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:34.813184    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-j8flw"
Jul 22 11:51:35.282262 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:35.282222    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6996ff777c-vrjk5" podUID="8da9608f-4476-4375-b6dd-01fffa538ad7" containerName="console" containerID="cri-o://061590b6e82ff3730a609fccfe4fa01b7a82bd4b7872e031b701d42da5acf947" gracePeriod=15
Jul 22 11:51:36.012154 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:36.012118    2558 generic.go:356] "Generic (PLEG): container finished" podID="8da9608f-4476-4375-b6dd-01fffa538ad7" containerID="061590b6e82ff3730a609fccfe4fa01b7a82bd4b7872e031b701d42da5acf947" exitCode=0
Jul 22 11:51:36.012527 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:36.012187    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6996ff777c-vrjk5" event={"ID":"8da9608f-4476-4375-b6dd-01fffa538ad7","Type":"ContainerDied","Data":"061590b6e82ff3730a609fccfe4fa01b7a82bd4b7872e031b701d42da5acf947"}
Jul 22 11:51:36.057163 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:36.057134    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6996ff777c-vrjk5"
Jul 22 11:51:36.187723 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:36.187685    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8da9608f-4476-4375-b6dd-01fffa538ad7-console-oauth-config\") pod \"8da9608f-4476-4375-b6dd-01fffa538ad7\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") "
Jul 22 11:51:36.187880 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:36.187773    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8da9608f-4476-4375-b6dd-01fffa538ad7-oauth-serving-cert\") pod \"8da9608f-4476-4375-b6dd-01fffa538ad7\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") "
Jul 22 11:51:36.187880 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:36.187805    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8da9608f-4476-4375-b6dd-01fffa538ad7-console-config\") pod \"8da9608f-4476-4375-b6dd-01fffa538ad7\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") "
Jul 22 11:51:36.187880 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:36.187823    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8da9608f-4476-4375-b6dd-01fffa538ad7-service-ca\") pod \"8da9608f-4476-4375-b6dd-01fffa538ad7\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") "
Jul 22 11:51:36.188051 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:36.187879    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8da9608f-4476-4375-b6dd-01fffa538ad7-console-serving-cert\") pod \"8da9608f-4476-4375-b6dd-01fffa538ad7\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") "
Jul 22 11:51:36.188051 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:36.187900    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8da9608f-4476-4375-b6dd-01fffa538ad7-trusted-ca-bundle\") pod \"8da9608f-4476-4375-b6dd-01fffa538ad7\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") "
Jul 22 11:51:36.188051 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:36.187919    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhtdb\" (UniqueName: \"kubernetes.io/projected/8da9608f-4476-4375-b6dd-01fffa538ad7-kube-api-access-bhtdb\") pod \"8da9608f-4476-4375-b6dd-01fffa538ad7\" (UID: \"8da9608f-4476-4375-b6dd-01fffa538ad7\") "
Jul 22 11:51:36.188223 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:36.188196    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8da9608f-4476-4375-b6dd-01fffa538ad7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8da9608f-4476-4375-b6dd-01fffa538ad7" (UID: "8da9608f-4476-4375-b6dd-01fffa538ad7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 11:51:36.188277 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:36.188206    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8da9608f-4476-4375-b6dd-01fffa538ad7-console-config" (OuterVolumeSpecName: "console-config") pod "8da9608f-4476-4375-b6dd-01fffa538ad7" (UID: "8da9608f-4476-4375-b6dd-01fffa538ad7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 11:51:36.188356 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:36.188321    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8da9608f-4476-4375-b6dd-01fffa538ad7-service-ca" (OuterVolumeSpecName: "service-ca") pod "8da9608f-4476-4375-b6dd-01fffa538ad7" (UID: "8da9608f-4476-4375-b6dd-01fffa538ad7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 11:51:36.188609 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:36.188581    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8da9608f-4476-4375-b6dd-01fffa538ad7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8da9608f-4476-4375-b6dd-01fffa538ad7" (UID: "8da9608f-4476-4375-b6dd-01fffa538ad7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 11:51:36.188743 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:36.188594    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8da9608f-4476-4375-b6dd-01fffa538ad7-oauth-serving-cert\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 11:51:36.188743 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:36.188649    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8da9608f-4476-4375-b6dd-01fffa538ad7-console-config\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 11:51:36.188743 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:36.188659    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8da9608f-4476-4375-b6dd-01fffa538ad7-service-ca\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 11:51:36.190314 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:36.190282    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8da9608f-4476-4375-b6dd-01fffa538ad7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8da9608f-4476-4375-b6dd-01fffa538ad7" (UID: "8da9608f-4476-4375-b6dd-01fffa538ad7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 11:51:36.190430 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:36.190389    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8da9608f-4476-4375-b6dd-01fffa538ad7-kube-api-access-bhtdb" (OuterVolumeSpecName: "kube-api-access-bhtdb") pod "8da9608f-4476-4375-b6dd-01fffa538ad7" (UID: "8da9608f-4476-4375-b6dd-01fffa538ad7"). InnerVolumeSpecName "kube-api-access-bhtdb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 11:51:36.190490 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:36.190456    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8da9608f-4476-4375-b6dd-01fffa538ad7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8da9608f-4476-4375-b6dd-01fffa538ad7" (UID: "8da9608f-4476-4375-b6dd-01fffa538ad7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 11:51:36.289898 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:36.289811    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8da9608f-4476-4375-b6dd-01fffa538ad7-console-serving-cert\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 11:51:36.289898 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:36.289840    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8da9608f-4476-4375-b6dd-01fffa538ad7-trusted-ca-bundle\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 11:51:36.289898 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:36.289851    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhtdb\" (UniqueName: \"kubernetes.io/projected/8da9608f-4476-4375-b6dd-01fffa538ad7-kube-api-access-bhtdb\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 11:51:36.289898 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:36.289859    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8da9608f-4476-4375-b6dd-01fffa538ad7-console-oauth-config\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 11:51:37.019538 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:37.019497    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6996ff777c-vrjk5" event={"ID":"8da9608f-4476-4375-b6dd-01fffa538ad7","Type":"ContainerDied","Data":"8ab2414b39f185f79af8851a387b28996bca161aedf19db9956c85bd2d95f396"}
Jul 22 11:51:37.019538 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:37.019534    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6996ff777c-vrjk5"
Jul 22 11:51:37.031525 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:37.031492    2558 scope.go:117] "RemoveContainer" containerID="061590b6e82ff3730a609fccfe4fa01b7a82bd4b7872e031b701d42da5acf947"
Jul 22 11:51:37.049418 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:37.049393    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6996ff777c-vrjk5"]
Jul 22 11:51:37.051772 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:37.051751    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6996ff777c-vrjk5"]
Jul 22 11:51:38.446386 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:38.446348    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8da9608f-4476-4375-b6dd-01fffa538ad7" path="/var/lib/kubelet/pods/8da9608f-4476-4375-b6dd-01fffa538ad7/volumes"
Jul 22 11:51:50.342011 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:50.341978    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:51:50.345839 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:51:50.345821    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-d65c64d4-d4g9d"
Jul 22 11:52:12.179240 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:52:12.179204    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:52:12.198299 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:52:12.198274    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:52:13.175756 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:52:13.175731    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:52:53.207269 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:52:53.207194    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c45594f99-xk7vr"]
Jul 22 11:53:18.227139 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:18.227075    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c45594f99-xk7vr" podUID="a0fb91a7-84db-4251-8a7a-26aa78367786" containerName="console" containerID="cri-o://4ce9d99b3f22e7de3a7eb4f61c6686ddf20101c08c52577232b3ae378a46e8f2" gracePeriod=15
Jul 22 11:53:18.422684 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:18.422652    2558 generic.go:356] "Generic (PLEG): container finished" podID="a0fb91a7-84db-4251-8a7a-26aa78367786" containerID="4ce9d99b3f22e7de3a7eb4f61c6686ddf20101c08c52577232b3ae378a46e8f2" exitCode=0
Jul 22 11:53:18.422827 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:18.422725    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c45594f99-xk7vr" event={"ID":"a0fb91a7-84db-4251-8a7a-26aa78367786","Type":"ContainerDied","Data":"4ce9d99b3f22e7de3a7eb4f61c6686ddf20101c08c52577232b3ae378a46e8f2"}
Jul 22 11:53:18.470058 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:18.470036    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:53:18.565186 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:18.565101    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0fb91a7-84db-4251-8a7a-26aa78367786-console-oauth-config\") pod \"a0fb91a7-84db-4251-8a7a-26aa78367786\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") "
Jul 22 11:53:18.565186 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:18.565146    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7flg\" (UniqueName: \"kubernetes.io/projected/a0fb91a7-84db-4251-8a7a-26aa78367786-kube-api-access-l7flg\") pod \"a0fb91a7-84db-4251-8a7a-26aa78367786\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") "
Jul 22 11:53:18.565393 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:18.565192    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0fb91a7-84db-4251-8a7a-26aa78367786-service-ca\") pod \"a0fb91a7-84db-4251-8a7a-26aa78367786\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") "
Jul 22 11:53:18.565393 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:18.565225    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0fb91a7-84db-4251-8a7a-26aa78367786-trusted-ca-bundle\") pod \"a0fb91a7-84db-4251-8a7a-26aa78367786\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") "
Jul 22 11:53:18.565393 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:18.565251    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0fb91a7-84db-4251-8a7a-26aa78367786-console-config\") pod \"a0fb91a7-84db-4251-8a7a-26aa78367786\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") "
Jul 22 11:53:18.565393 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:18.565308    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0fb91a7-84db-4251-8a7a-26aa78367786-oauth-serving-cert\") pod \"a0fb91a7-84db-4251-8a7a-26aa78367786\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") "
Jul 22 11:53:18.565393 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:18.565353    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0fb91a7-84db-4251-8a7a-26aa78367786-console-serving-cert\") pod \"a0fb91a7-84db-4251-8a7a-26aa78367786\" (UID: \"a0fb91a7-84db-4251-8a7a-26aa78367786\") "
Jul 22 11:53:18.565707 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:18.565674    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0fb91a7-84db-4251-8a7a-26aa78367786-service-ca" (OuterVolumeSpecName: "service-ca") pod "a0fb91a7-84db-4251-8a7a-26aa78367786" (UID: "a0fb91a7-84db-4251-8a7a-26aa78367786"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 11:53:18.565783 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:18.565690    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0fb91a7-84db-4251-8a7a-26aa78367786-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a0fb91a7-84db-4251-8a7a-26aa78367786" (UID: "a0fb91a7-84db-4251-8a7a-26aa78367786"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 11:53:18.565783 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:18.565759    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0fb91a7-84db-4251-8a7a-26aa78367786-console-config" (OuterVolumeSpecName: "console-config") pod "a0fb91a7-84db-4251-8a7a-26aa78367786" (UID: "a0fb91a7-84db-4251-8a7a-26aa78367786"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 11:53:18.565857 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:18.565774    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0fb91a7-84db-4251-8a7a-26aa78367786-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a0fb91a7-84db-4251-8a7a-26aa78367786" (UID: "a0fb91a7-84db-4251-8a7a-26aa78367786"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 11:53:18.567391 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:18.567367    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0fb91a7-84db-4251-8a7a-26aa78367786-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a0fb91a7-84db-4251-8a7a-26aa78367786" (UID: "a0fb91a7-84db-4251-8a7a-26aa78367786"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 11:53:18.567470 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:18.567394    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0fb91a7-84db-4251-8a7a-26aa78367786-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a0fb91a7-84db-4251-8a7a-26aa78367786" (UID: "a0fb91a7-84db-4251-8a7a-26aa78367786"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 11:53:18.567470 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:18.567403    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0fb91a7-84db-4251-8a7a-26aa78367786-kube-api-access-l7flg" (OuterVolumeSpecName: "kube-api-access-l7flg") pod "a0fb91a7-84db-4251-8a7a-26aa78367786" (UID: "a0fb91a7-84db-4251-8a7a-26aa78367786"). InnerVolumeSpecName "kube-api-access-l7flg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 11:53:18.666982 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:18.666946    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0fb91a7-84db-4251-8a7a-26aa78367786-console-serving-cert\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 11:53:18.666982 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:18.666976    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0fb91a7-84db-4251-8a7a-26aa78367786-console-oauth-config\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 11:53:18.666982 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:18.666987    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7flg\" (UniqueName: \"kubernetes.io/projected/a0fb91a7-84db-4251-8a7a-26aa78367786-kube-api-access-l7flg\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 11:53:18.667212 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:18.666998    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0fb91a7-84db-4251-8a7a-26aa78367786-service-ca\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 11:53:18.667212 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:18.667007    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0fb91a7-84db-4251-8a7a-26aa78367786-trusted-ca-bundle\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 11:53:18.667212 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:18.667015    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0fb91a7-84db-4251-8a7a-26aa78367786-console-config\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 11:53:18.667212 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:18.667023    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0fb91a7-84db-4251-8a7a-26aa78367786-oauth-serving-cert\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 11:53:19.427407 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:19.427371    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c45594f99-xk7vr" event={"ID":"a0fb91a7-84db-4251-8a7a-26aa78367786","Type":"ContainerDied","Data":"7a7e00ced183143cbcc62347c27d1a04eec79f164e850ac4cc57c906b4691180"}
Jul 22 11:53:19.427407 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:19.427409    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c45594f99-xk7vr"
Jul 22 11:53:19.427872 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:19.427473    2558 scope.go:117] "RemoveContainer" containerID="4ce9d99b3f22e7de3a7eb4f61c6686ddf20101c08c52577232b3ae378a46e8f2"
Jul 22 11:53:19.455080 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:19.455056    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c45594f99-xk7vr"]
Jul 22 11:53:19.459986 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:19.459964    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c45594f99-xk7vr"]
Jul 22 11:53:20.446013 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:53:20.445912    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0fb91a7-84db-4251-8a7a-26aa78367786" path="/var/lib/kubelet/pods/a0fb91a7-84db-4251-8a7a-26aa78367786/volumes"
Jul 22 11:54:00.908740 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:00.908709    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-x9j4p"]
Jul 22 11:54:00.909206 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:00.909041    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8da9608f-4476-4375-b6dd-01fffa538ad7" containerName="console"
Jul 22 11:54:00.909206 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:00.909052    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8da9608f-4476-4375-b6dd-01fffa538ad7" containerName="console"
Jul 22 11:54:00.909206 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:00.909068    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0fb91a7-84db-4251-8a7a-26aa78367786" containerName="console"
Jul 22 11:54:00.909206 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:00.909074    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0fb91a7-84db-4251-8a7a-26aa78367786" containerName="console"
Jul 22 11:54:00.909206 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:00.909129    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0fb91a7-84db-4251-8a7a-26aa78367786" containerName="console"
Jul 22 11:54:00.909206 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:00.909137    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8da9608f-4476-4375-b6dd-01fffa538ad7" containerName="console"
Jul 22 11:54:00.911454 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:00.911437    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-x9j4p"
Jul 22 11:54:00.916387 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:00.916364    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-nbvgh\""
Jul 22 11:54:00.916387 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:00.916375    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 22 11:54:00.916589 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:00.916372    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 22 11:54:00.973806 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:00.973765    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-x9j4p"]
Jul 22 11:54:01.014831 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:01.014802    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69237165-b76a-478b-9d30-f849563dc535-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-x9j4p\" (UID: \"69237165-b76a-478b-9d30-f849563dc535\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x9j4p"
Jul 22 11:54:01.014984 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:01.014867    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnkt9\" (UniqueName: \"kubernetes.io/projected/69237165-b76a-478b-9d30-f849563dc535-kube-api-access-pnkt9\") pod \"cert-manager-webhook-6486ffd997-x9j4p\" (UID: \"69237165-b76a-478b-9d30-f849563dc535\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x9j4p"
Jul 22 11:54:01.115404 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:01.115371    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69237165-b76a-478b-9d30-f849563dc535-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-x9j4p\" (UID: \"69237165-b76a-478b-9d30-f849563dc535\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x9j4p"
Jul 22 11:54:01.115572 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:01.115428    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnkt9\" (UniqueName: \"kubernetes.io/projected/69237165-b76a-478b-9d30-f849563dc535-kube-api-access-pnkt9\") pod \"cert-manager-webhook-6486ffd997-x9j4p\" (UID: \"69237165-b76a-478b-9d30-f849563dc535\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x9j4p"
Jul 22 11:54:01.135415 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:01.135384    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnkt9\" (UniqueName: \"kubernetes.io/projected/69237165-b76a-478b-9d30-f849563dc535-kube-api-access-pnkt9\") pod \"cert-manager-webhook-6486ffd997-x9j4p\" (UID: \"69237165-b76a-478b-9d30-f849563dc535\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x9j4p"
Jul 22 11:54:01.142008 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:01.141978    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69237165-b76a-478b-9d30-f849563dc535-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-x9j4p\" (UID: \"69237165-b76a-478b-9d30-f849563dc535\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x9j4p"
Jul 22 11:54:01.232712 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:01.232632    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-x9j4p"
Jul 22 11:54:01.368482 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:01.368454    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-x9j4p"]
Jul 22 11:54:01.373163 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:54:01.373129    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69237165_b76a_478b_9d30_f849563dc535.slice/crio-630e6ccd4064a14944ac4b7a104954f2772e27fcce57c94876d9764fad388c9e WatchSource:0}: Error finding container 630e6ccd4064a14944ac4b7a104954f2772e27fcce57c94876d9764fad388c9e: Status 404 returned error can't find the container with id 630e6ccd4064a14944ac4b7a104954f2772e27fcce57c94876d9764fad388c9e
Jul 22 11:54:01.585065 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:01.584981    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-x9j4p" event={"ID":"69237165-b76a-478b-9d30-f849563dc535","Type":"ContainerStarted","Data":"630e6ccd4064a14944ac4b7a104954f2772e27fcce57c94876d9764fad388c9e"}
Jul 22 11:54:04.221007 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:04.220974    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tbdn2"]
Jul 22 11:54:04.223340 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:04.223320    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-tbdn2"
Jul 22 11:54:04.228097 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:04.228075    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-5bm8p\""
Jul 22 11:54:04.240610 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:04.240583    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tbdn2"]
Jul 22 11:54:04.343739 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:04.343700    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2596ef25-0cb3-4cc3-a468-cb60fcfd92ba-bound-sa-token\") pod \"cert-manager-55b4d954d5-tbdn2\" (UID: \"2596ef25-0cb3-4cc3-a468-cb60fcfd92ba\") " pod="cert-manager/cert-manager-55b4d954d5-tbdn2"
Jul 22 11:54:04.343739 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:04.343747    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td5p9\" (UniqueName: \"kubernetes.io/projected/2596ef25-0cb3-4cc3-a468-cb60fcfd92ba-kube-api-access-td5p9\") pod \"cert-manager-55b4d954d5-tbdn2\" (UID: \"2596ef25-0cb3-4cc3-a468-cb60fcfd92ba\") " pod="cert-manager/cert-manager-55b4d954d5-tbdn2"
Jul 22 11:54:04.444217 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:04.444187    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2596ef25-0cb3-4cc3-a468-cb60fcfd92ba-bound-sa-token\") pod \"cert-manager-55b4d954d5-tbdn2\" (UID: \"2596ef25-0cb3-4cc3-a468-cb60fcfd92ba\") " pod="cert-manager/cert-manager-55b4d954d5-tbdn2"
Jul 22 11:54:04.444410 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:04.444236    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td5p9\" (UniqueName: \"kubernetes.io/projected/2596ef25-0cb3-4cc3-a468-cb60fcfd92ba-kube-api-access-td5p9\") pod \"cert-manager-55b4d954d5-tbdn2\" (UID: \"2596ef25-0cb3-4cc3-a468-cb60fcfd92ba\") " pod="cert-manager/cert-manager-55b4d954d5-tbdn2"
Jul 22 11:54:04.456635 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:04.456592    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2596ef25-0cb3-4cc3-a468-cb60fcfd92ba-bound-sa-token\") pod \"cert-manager-55b4d954d5-tbdn2\" (UID: \"2596ef25-0cb3-4cc3-a468-cb60fcfd92ba\") " pod="cert-manager/cert-manager-55b4d954d5-tbdn2"
Jul 22 11:54:04.456822 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:04.456804    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-td5p9\" (UniqueName: \"kubernetes.io/projected/2596ef25-0cb3-4cc3-a468-cb60fcfd92ba-kube-api-access-td5p9\") pod \"cert-manager-55b4d954d5-tbdn2\" (UID: \"2596ef25-0cb3-4cc3-a468-cb60fcfd92ba\") " pod="cert-manager/cert-manager-55b4d954d5-tbdn2"
Jul 22 11:54:04.534180 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:04.534079    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-tbdn2"
Jul 22 11:54:04.909885 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:04.909858    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tbdn2"]
Jul 22 11:54:04.912136 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:54:04.912110    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2596ef25_0cb3_4cc3_a468_cb60fcfd92ba.slice/crio-c33fd4fa129ab0a9c0901abcbc5f19eaf63e5b1a036ef50ec620c1563553f54f WatchSource:0}: Error finding container c33fd4fa129ab0a9c0901abcbc5f19eaf63e5b1a036ef50ec620c1563553f54f: Status 404 returned error can't find the container with id c33fd4fa129ab0a9c0901abcbc5f19eaf63e5b1a036ef50ec620c1563553f54f
Jul 22 11:54:05.603660 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:05.603609    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-tbdn2" event={"ID":"2596ef25-0cb3-4cc3-a468-cb60fcfd92ba","Type":"ContainerStarted","Data":"1f710abd9e514d07e0c421e841e2b4f3d4e6d33904030a95201b13e96f47672e"}
Jul 22 11:54:05.604074 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:05.603671    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-tbdn2" event={"ID":"2596ef25-0cb3-4cc3-a468-cb60fcfd92ba","Type":"ContainerStarted","Data":"c33fd4fa129ab0a9c0901abcbc5f19eaf63e5b1a036ef50ec620c1563553f54f"}
Jul 22 11:54:05.605144 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:05.605122    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-x9j4p" event={"ID":"69237165-b76a-478b-9d30-f849563dc535","Type":"ContainerStarted","Data":"fc455accc27b2610d029fd4264e3ad45aeb7da1a22d3053ba14039ad71f40fa1"}
Jul 22 11:54:05.605265 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:05.605247    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-x9j4p"
Jul 22 11:54:05.625878 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:05.625841    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-tbdn2" podStartSLOduration=1.625827792 podStartE2EDuration="1.625827792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:54:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:54:05.625472244 +0000 UTC m=+257.991987488" watchObservedRunningTime="2026-07-22 11:54:05.625827792 +0000 UTC m=+257.992343027"
Jul 22 11:54:05.647027 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:05.646982    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-x9j4p" podStartSLOduration=2.207116495 podStartE2EDuration="5.646966757s" totalImagesPullingTime="3.439850262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:54:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:54:05.645870935 +0000 UTC m=+258.012386180" watchObservedRunningTime="2026-07-22 11:54:05.646966757 +0000 UTC m=+258.013482000"
Jul 22 11:54:11.611668 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:11.611633    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-x9j4p"
Jul 22 11:54:25.279194 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:25.279159    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92"]
Jul 22 11:54:25.281425 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:25.281408    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92"
Jul 22 11:54:25.287174 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:25.287148    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 22 11:54:25.287285 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:25.287170    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 22 11:54:25.287285 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:25.287240    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 22 11:54:25.287885 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:25.287864    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 22 11:54:25.288004 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:25.287872    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-x6j7c\""
Jul 22 11:54:25.303424 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:25.303403    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92"]
Jul 22 11:54:25.424891 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:25.424858    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1d6bff52-9b53-40d3-a761-ce3321cbbed2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c4d6d56dd-trt92\" (UID: \"1d6bff52-9b53-40d3-a761-ce3321cbbed2\") " pod="opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92"
Jul 22 11:54:25.425076 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:25.424906    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1d6bff52-9b53-40d3-a761-ce3321cbbed2-manifests\") pod \"opendatahub-operator-controller-manager-c4d6d56dd-trt92\" (UID: \"1d6bff52-9b53-40d3-a761-ce3321cbbed2\") " pod="opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92"
Jul 22 11:54:25.425076 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:25.424947    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d6bff52-9b53-40d3-a761-ce3321cbbed2-webhook-cert\") pod \"opendatahub-operator-controller-manager-c4d6d56dd-trt92\" (UID: \"1d6bff52-9b53-40d3-a761-ce3321cbbed2\") " pod="opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92"
Jul 22 11:54:25.425076 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:25.424967    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d6bff52-9b53-40d3-a761-ce3321cbbed2-tmp\") pod \"opendatahub-operator-controller-manager-c4d6d56dd-trt92\" (UID: \"1d6bff52-9b53-40d3-a761-ce3321cbbed2\") " pod="opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92"
Jul 22 11:54:25.425076 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:25.425019    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bm4r\" (UniqueName: \"kubernetes.io/projected/1d6bff52-9b53-40d3-a761-ce3321cbbed2-kube-api-access-7bm4r\") pod \"opendatahub-operator-controller-manager-c4d6d56dd-trt92\" (UID: \"1d6bff52-9b53-40d3-a761-ce3321cbbed2\") " pod="opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92"
Jul 22 11:54:25.525606 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:25.525565    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bm4r\" (UniqueName: \"kubernetes.io/projected/1d6bff52-9b53-40d3-a761-ce3321cbbed2-kube-api-access-7bm4r\") pod \"opendatahub-operator-controller-manager-c4d6d56dd-trt92\" (UID: \"1d6bff52-9b53-40d3-a761-ce3321cbbed2\") " pod="opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92"
Jul 22 11:54:25.525841 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:25.525673    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1d6bff52-9b53-40d3-a761-ce3321cbbed2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c4d6d56dd-trt92\" (UID: \"1d6bff52-9b53-40d3-a761-ce3321cbbed2\") " pod="opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92"
Jul 22 11:54:25.525841 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:25.525735    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1d6bff52-9b53-40d3-a761-ce3321cbbed2-manifests\") pod \"opendatahub-operator-controller-manager-c4d6d56dd-trt92\" (UID: \"1d6bff52-9b53-40d3-a761-ce3321cbbed2\") " pod="opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92"
Jul 22 11:54:25.525841 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:25.525757    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d6bff52-9b53-40d3-a761-ce3321cbbed2-webhook-cert\") pod \"opendatahub-operator-controller-manager-c4d6d56dd-trt92\" (UID: \"1d6bff52-9b53-40d3-a761-ce3321cbbed2\") " pod="opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92"
Jul 22 11:54:25.525841 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:25.525789    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d6bff52-9b53-40d3-a761-ce3321cbbed2-tmp\") pod \"opendatahub-operator-controller-manager-c4d6d56dd-trt92\" (UID: \"1d6bff52-9b53-40d3-a761-ce3321cbbed2\") " pod="opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92"
Jul 22 11:54:25.526158 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:25.526134    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1d6bff52-9b53-40d3-a761-ce3321cbbed2-manifests\") pod \"opendatahub-operator-controller-manager-c4d6d56dd-trt92\" (UID: \"1d6bff52-9b53-40d3-a761-ce3321cbbed2\") " pod="opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92"
Jul 22 11:54:25.528163 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:25.528139    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d6bff52-9b53-40d3-a761-ce3321cbbed2-tmp\") pod \"opendatahub-operator-controller-manager-c4d6d56dd-trt92\" (UID: \"1d6bff52-9b53-40d3-a761-ce3321cbbed2\") " pod="opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92"
Jul 22 11:54:25.528392 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:25.528372    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1d6bff52-9b53-40d3-a761-ce3321cbbed2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c4d6d56dd-trt92\" (UID: \"1d6bff52-9b53-40d3-a761-ce3321cbbed2\") " pod="opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92"
Jul 22 11:54:25.528436 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:25.528421    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d6bff52-9b53-40d3-a761-ce3321cbbed2-webhook-cert\") pod \"opendatahub-operator-controller-manager-c4d6d56dd-trt92\" (UID: \"1d6bff52-9b53-40d3-a761-ce3321cbbed2\") " pod="opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92"
Jul 22 11:54:25.544028 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:25.543971    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bm4r\" (UniqueName: \"kubernetes.io/projected/1d6bff52-9b53-40d3-a761-ce3321cbbed2-kube-api-access-7bm4r\") pod \"opendatahub-operator-controller-manager-c4d6d56dd-trt92\" (UID: \"1d6bff52-9b53-40d3-a761-ce3321cbbed2\") " pod="opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92"
Jul 22 11:54:25.592102 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:25.592070    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92"
Jul 22 11:54:25.731355 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:25.731331    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92"]
Jul 22 11:54:25.734064 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:54:25.734043    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d6bff52_9b53_40d3_a761_ce3321cbbed2.slice/crio-37ff3546cc4f77fc98c703bb2d7f99741d5465feb01549dd2e577b89f91c31ea WatchSource:0}: Error finding container 37ff3546cc4f77fc98c703bb2d7f99741d5465feb01549dd2e577b89f91c31ea: Status 404 returned error can't find the container with id 37ff3546cc4f77fc98c703bb2d7f99741d5465feb01549dd2e577b89f91c31ea
Jul 22 11:54:26.690692 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:26.690645    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92" event={"ID":"1d6bff52-9b53-40d3-a761-ce3321cbbed2","Type":"ContainerStarted","Data":"37ff3546cc4f77fc98c703bb2d7f99741d5465feb01549dd2e577b89f91c31ea"}
Jul 22 11:54:29.706792 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:29.706754    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92" event={"ID":"1d6bff52-9b53-40d3-a761-ce3321cbbed2","Type":"ContainerStarted","Data":"1898a0c1489228da96bef1490d2b31f78eceee9b63283fb3768c9bceba121221"}
Jul 22 11:54:30.711984 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:30.711949    2558 generic.go:356] "Generic (PLEG): container finished" podID="1d6bff52-9b53-40d3-a761-ce3321cbbed2" containerID="1898a0c1489228da96bef1490d2b31f78eceee9b63283fb3768c9bceba121221" exitCode=0
Jul 22 11:54:30.711984 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:30.711989    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92" event={"ID":"1d6bff52-9b53-40d3-a761-ce3321cbbed2","Type":"ContainerDied","Data":"1898a0c1489228da96bef1490d2b31f78eceee9b63283fb3768c9bceba121221"}
Jul 22 11:54:31.718128 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:31.718088    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92" event={"ID":"1d6bff52-9b53-40d3-a761-ce3321cbbed2","Type":"ContainerStarted","Data":"f8f08fa0a55121d93fbd35e8a70f01eea9da59d6fc33eb791faadba7da2f30a8"}
Jul 22 11:54:31.718611 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:31.718221    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92"
Jul 22 11:54:31.751220 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:31.751168    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92" podStartSLOduration=2.259659397 podStartE2EDuration="6.751151099s" totalImagesPullingTime="3.456322267s" totalInitContainerRuntime="1.035169435s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:54:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:54:31.75110878 +0000 UTC m=+284.117624024" watchObservedRunningTime="2026-07-22 11:54:31.751151099 +0000 UTC m=+284.117666342"
Jul 22 11:54:42.725134 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:42.725099    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-c4d6d56dd-trt92"
Jul 22 11:54:43.810549 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:43.810514    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-755b658494-99pn5"]
Jul 22 11:54:43.813929 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:43.813910    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-755b658494-99pn5"
Jul 22 11:54:43.819679 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:43.819655    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 22 11:54:43.820086 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:43.820069    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 22 11:54:43.820909 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:43.820888    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 22 11:54:43.821010 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:43.820934    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 22 11:54:43.821010 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:43.820972    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hz6hd\""
Jul 22 11:54:43.821141 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:43.821123    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 22 11:54:43.833249 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:43.833225    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-755b658494-99pn5"]
Jul 22 11:54:43.884579 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:43.884551    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c-cert\") pod \"lws-controller-manager-755b658494-99pn5\" (UID: \"5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c\") " pod="openshift-lws-operator/lws-controller-manager-755b658494-99pn5"
Jul 22 11:54:43.884777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:43.884600    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c-metrics-cert\") pod \"lws-controller-manager-755b658494-99pn5\" (UID: \"5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c\") " pod="openshift-lws-operator/lws-controller-manager-755b658494-99pn5"
Jul 22 11:54:43.884777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:43.884705    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c-manager-config\") pod \"lws-controller-manager-755b658494-99pn5\" (UID: \"5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c\") " pod="openshift-lws-operator/lws-controller-manager-755b658494-99pn5"
Jul 22 11:54:43.884777 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:43.884739    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wppbk\" (UniqueName: \"kubernetes.io/projected/5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c-kube-api-access-wppbk\") pod \"lws-controller-manager-755b658494-99pn5\" (UID: \"5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c\") " pod="openshift-lws-operator/lws-controller-manager-755b658494-99pn5"
Jul 22 11:54:43.985502 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:43.985465    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c-metrics-cert\") pod \"lws-controller-manager-755b658494-99pn5\" (UID: \"5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c\") " pod="openshift-lws-operator/lws-controller-manager-755b658494-99pn5"
Jul 22 11:54:43.985502 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:43.985506    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c-manager-config\") pod \"lws-controller-manager-755b658494-99pn5\" (UID: \"5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c\") " pod="openshift-lws-operator/lws-controller-manager-755b658494-99pn5"
Jul 22 11:54:43.985780 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:43.985526    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wppbk\" (UniqueName: \"kubernetes.io/projected/5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c-kube-api-access-wppbk\") pod \"lws-controller-manager-755b658494-99pn5\" (UID: \"5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c\") " pod="openshift-lws-operator/lws-controller-manager-755b658494-99pn5"
Jul 22 11:54:43.985780 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:43.985583    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c-cert\") pod \"lws-controller-manager-755b658494-99pn5\" (UID: \"5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c\") " pod="openshift-lws-operator/lws-controller-manager-755b658494-99pn5"
Jul 22 11:54:43.986215 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:43.986191    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c-manager-config\") pod \"lws-controller-manager-755b658494-99pn5\" (UID: \"5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c\") " pod="openshift-lws-operator/lws-controller-manager-755b658494-99pn5"
Jul 22 11:54:43.987960 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:43.987934    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c-metrics-cert\") pod \"lws-controller-manager-755b658494-99pn5\" (UID: \"5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c\") " pod="openshift-lws-operator/lws-controller-manager-755b658494-99pn5"
Jul 22 11:54:43.988080 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:43.988063    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c-cert\") pod \"lws-controller-manager-755b658494-99pn5\" (UID: \"5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c\") " pod="openshift-lws-operator/lws-controller-manager-755b658494-99pn5"
Jul 22 11:54:44.001855 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:44.001833    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wppbk\" (UniqueName: \"kubernetes.io/projected/5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c-kube-api-access-wppbk\") pod \"lws-controller-manager-755b658494-99pn5\" (UID: \"5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c\") " pod="openshift-lws-operator/lws-controller-manager-755b658494-99pn5"
Jul 22 11:54:44.123387 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:44.123360    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-755b658494-99pn5"
Jul 22 11:54:44.297718 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:54:44.297687    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb73dc7_8d2e_49eb_89b2_1d5c17ded52c.slice/crio-6b62c581b172148d44a9eed327452ca4edc8e678161aff1ce1b9f0eda5c281d7 WatchSource:0}: Error finding container 6b62c581b172148d44a9eed327452ca4edc8e678161aff1ce1b9f0eda5c281d7: Status 404 returned error can't find the container with id 6b62c581b172148d44a9eed327452ca4edc8e678161aff1ce1b9f0eda5c281d7
Jul 22 11:54:44.298068 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:44.298045    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-755b658494-99pn5"]
Jul 22 11:54:44.771484 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:44.771452    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-755b658494-99pn5" event={"ID":"5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c","Type":"ContainerStarted","Data":"6b62c581b172148d44a9eed327452ca4edc8e678161aff1ce1b9f0eda5c281d7"}
Jul 22 11:54:47.789486 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:47.789453    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-755b658494-99pn5" event={"ID":"5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c","Type":"ContainerStarted","Data":"b9b6e414c2226bac2a0432c784e3576f7bc98ab79acc7bae6f5c5bddddef7e7a"}
Jul 22 11:54:47.789889 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:47.789573    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-755b658494-99pn5"
Jul 22 11:54:47.878155 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:47.878109    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-755b658494-99pn5" podStartSLOduration=1.871814914 podStartE2EDuration="4.8780947s" totalImagesPullingTime="3.006279786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:54:47.87648033 +0000 UTC m=+300.242995577" watchObservedRunningTime="2026-07-22 11:54:47.8780947 +0000 UTC m=+300.244609944"
Jul 22 11:54:48.121192 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:48.121168    2558 kubelet.go:1648] "Image garbage collection succeeded"
Jul 22 11:54:58.000016 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:57.999980    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-57559476c9-ttmlt"]
Jul 22 11:54:58.005315 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:58.005299    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57559476c9-ttmlt"
Jul 22 11:54:58.009326 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:58.009303    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 22 11:54:58.009912 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:58.009895    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 22 11:54:58.009971 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:58.009921    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 22 11:54:58.011085 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:58.011049    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 22 11:54:58.011302 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:58.011285    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-lhjjn\""
Jul 22 11:54:58.030164 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:58.030135    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57559476c9-ttmlt"]
Jul 22 11:54:58.112370 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:58.112338    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b47f7dc-f284-48a9-bc28-2c61b005957e-tmp\") pod \"kube-auth-proxy-57559476c9-ttmlt\" (UID: \"4b47f7dc-f284-48a9-bc28-2c61b005957e\") " pod="openshift-ingress/kube-auth-proxy-57559476c9-ttmlt"
Jul 22 11:54:58.112546 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:58.112439    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b47f7dc-f284-48a9-bc28-2c61b005957e-tls-certs\") pod \"kube-auth-proxy-57559476c9-ttmlt\" (UID: \"4b47f7dc-f284-48a9-bc28-2c61b005957e\") " pod="openshift-ingress/kube-auth-proxy-57559476c9-ttmlt"
Jul 22 11:54:58.112637 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:58.112548    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6m5d\" (UniqueName: \"kubernetes.io/projected/4b47f7dc-f284-48a9-bc28-2c61b005957e-kube-api-access-z6m5d\") pod \"kube-auth-proxy-57559476c9-ttmlt\" (UID: \"4b47f7dc-f284-48a9-bc28-2c61b005957e\") " pod="openshift-ingress/kube-auth-proxy-57559476c9-ttmlt"
Jul 22 11:54:58.213983 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:58.213951    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6m5d\" (UniqueName: \"kubernetes.io/projected/4b47f7dc-f284-48a9-bc28-2c61b005957e-kube-api-access-z6m5d\") pod \"kube-auth-proxy-57559476c9-ttmlt\" (UID: \"4b47f7dc-f284-48a9-bc28-2c61b005957e\") " pod="openshift-ingress/kube-auth-proxy-57559476c9-ttmlt"
Jul 22 11:54:58.214147 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:58.213994    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b47f7dc-f284-48a9-bc28-2c61b005957e-tmp\") pod \"kube-auth-proxy-57559476c9-ttmlt\" (UID: \"4b47f7dc-f284-48a9-bc28-2c61b005957e\") " pod="openshift-ingress/kube-auth-proxy-57559476c9-ttmlt"
Jul 22 11:54:58.214147 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:58.214030    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b47f7dc-f284-48a9-bc28-2c61b005957e-tls-certs\") pod \"kube-auth-proxy-57559476c9-ttmlt\" (UID: \"4b47f7dc-f284-48a9-bc28-2c61b005957e\") " pod="openshift-ingress/kube-auth-proxy-57559476c9-ttmlt"
Jul 22 11:54:58.216121 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:58.216096    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b47f7dc-f284-48a9-bc28-2c61b005957e-tmp\") pod \"kube-auth-proxy-57559476c9-ttmlt\" (UID: \"4b47f7dc-f284-48a9-bc28-2c61b005957e\") " pod="openshift-ingress/kube-auth-proxy-57559476c9-ttmlt"
Jul 22 11:54:58.216334 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:58.216314    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b47f7dc-f284-48a9-bc28-2c61b005957e-tls-certs\") pod \"kube-auth-proxy-57559476c9-ttmlt\" (UID: \"4b47f7dc-f284-48a9-bc28-2c61b005957e\") " pod="openshift-ingress/kube-auth-proxy-57559476c9-ttmlt"
Jul 22 11:54:58.229252 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:58.229223    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6m5d\" (UniqueName: \"kubernetes.io/projected/4b47f7dc-f284-48a9-bc28-2c61b005957e-kube-api-access-z6m5d\") pod \"kube-auth-proxy-57559476c9-ttmlt\" (UID: \"4b47f7dc-f284-48a9-bc28-2c61b005957e\") " pod="openshift-ingress/kube-auth-proxy-57559476c9-ttmlt"
Jul 22 11:54:58.315143 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:58.315059    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57559476c9-ttmlt"
Jul 22 11:54:58.471574 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:58.471542    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57559476c9-ttmlt"]
Jul 22 11:54:58.474738 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:54:58.474713    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b47f7dc_f284_48a9_bc28_2c61b005957e.slice/crio-564ad903d92192032927bf0115e9b9560c63d552b36f1e0e784c4eaf0f5c9bcb WatchSource:0}: Error finding container 564ad903d92192032927bf0115e9b9560c63d552b36f1e0e784c4eaf0f5c9bcb: Status 404 returned error can't find the container with id 564ad903d92192032927bf0115e9b9560c63d552b36f1e0e784c4eaf0f5c9bcb
Jul 22 11:54:58.476882 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:58.476864    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 11:54:58.795822 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:58.795796    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-755b658494-99pn5"
Jul 22 11:54:58.838016 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:54:58.837976    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57559476c9-ttmlt" event={"ID":"4b47f7dc-f284-48a9-bc28-2c61b005957e","Type":"ContainerStarted","Data":"564ad903d92192032927bf0115e9b9560c63d552b36f1e0e784c4eaf0f5c9bcb"}
Jul 22 11:55:01.852642 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:55:01.852597    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57559476c9-ttmlt" event={"ID":"4b47f7dc-f284-48a9-bc28-2c61b005957e","Type":"ContainerStarted","Data":"118a33400bbc869d8b657f84838eb826cb4ff6447bf4f07de3e311a867ce2040"}
Jul 22 11:55:01.921356 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:55:01.921305    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-57559476c9-ttmlt" podStartSLOduration=2.492361339 podStartE2EDuration="4.921288785s" totalImagesPullingTime="2.428927446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:54:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:55:01.920561592 +0000 UTC m=+314.287076835" watchObservedRunningTime="2026-07-22 11:55:01.921288785 +0000 UTC m=+314.287804028"
Jul 22 11:56:23.167500 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:23.167463    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wc966"]
Jul 22 11:56:23.177933 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:23.177902    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wc966"
Jul 22 11:56:23.181305 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:23.181275    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-p4qz5\""
Jul 22 11:56:23.181552 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:23.181532    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 11:56:23.181804 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:23.181788    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 11:56:23.182267 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:23.181975    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 22 11:56:23.182667 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:23.182641    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wc966"]
Jul 22 11:56:23.261102 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:23.261063    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9zkl\" (UniqueName: \"kubernetes.io/projected/f84478a2-ef1a-4b88-8fd7-ae6eb5517f47-kube-api-access-t9zkl\") pod \"dns-operator-controller-manager-864dd78c4c-wc966\" (UID: \"f84478a2-ef1a-4b88-8fd7-ae6eb5517f47\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wc966"
Jul 22 11:56:23.361954 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:23.361911    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9zkl\" (UniqueName: \"kubernetes.io/projected/f84478a2-ef1a-4b88-8fd7-ae6eb5517f47-kube-api-access-t9zkl\") pod \"dns-operator-controller-manager-864dd78c4c-wc966\" (UID: \"f84478a2-ef1a-4b88-8fd7-ae6eb5517f47\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wc966"
Jul 22 11:56:23.375694 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:23.375658    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9zkl\" (UniqueName: \"kubernetes.io/projected/f84478a2-ef1a-4b88-8fd7-ae6eb5517f47-kube-api-access-t9zkl\") pod \"dns-operator-controller-manager-864dd78c4c-wc966\" (UID: \"f84478a2-ef1a-4b88-8fd7-ae6eb5517f47\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wc966"
Jul 22 11:56:23.490580 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:23.490496    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wc966"
Jul 22 11:56:23.620813 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:23.620706    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wc966"]
Jul 22 11:56:23.622940 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:56:23.622912    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf84478a2_ef1a_4b88_8fd7_ae6eb5517f47.slice/crio-a44870979e5e8fb6ecc09596011cacd289a66fd645c2e15d7a41a01080320f5e WatchSource:0}: Error finding container a44870979e5e8fb6ecc09596011cacd289a66fd645c2e15d7a41a01080320f5e: Status 404 returned error can't find the container with id a44870979e5e8fb6ecc09596011cacd289a66fd645c2e15d7a41a01080320f5e
Jul 22 11:56:24.217670 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:24.217633    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wc966" event={"ID":"f84478a2-ef1a-4b88-8fd7-ae6eb5517f47","Type":"ContainerStarted","Data":"a44870979e5e8fb6ecc09596011cacd289a66fd645c2e15d7a41a01080320f5e"}
Jul 22 11:56:26.227174 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:26.227135    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wc966" event={"ID":"f84478a2-ef1a-4b88-8fd7-ae6eb5517f47","Type":"ContainerStarted","Data":"2f1f909335b35a2cdc8098ee71dad991dec61e58a40a09095d662425cbc16594"}
Jul 22 11:56:26.227660 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:26.227260    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wc966"
Jul 22 11:56:26.249820 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:26.249770    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wc966" podStartSLOduration=0.768920443 podStartE2EDuration="3.249756233s" totalImagesPullingTime="2.48083579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:56:26.247833133 +0000 UTC m=+398.614348378" watchObservedRunningTime="2026-07-22 11:56:26.249756233 +0000 UTC m=+398.616271477"
Jul 22 11:56:37.234546 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:37.234517    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wc966"
Jul 22 11:56:47.586051 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:47.586017    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-svsdg"]
Jul 22 11:56:47.589612 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:47.589593    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-svsdg"
Jul 22 11:56:47.592788 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:56:47.592758    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-console-plugin-66b5774985-svsdg\" is forbidden: User \"system:node:ip-10-0-132-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-166.ec2.internal' and this object" podUID="26354044-1df9-4308-ba21-de9185d935a0" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-svsdg"
Jul 22 11:56:47.593344 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:56:47.593319    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-z7z59\" is forbidden: User \"system:node:ip-10-0-132-166.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-166.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z7z59\"" type="*v1.Secret"
Jul 22 11:56:47.594234 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:56:47.594216    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kuadrant-console-nginx-conf\" is forbidden: User \"system:node:ip-10-0-132-166.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-166.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" type="*v1.ConfigMap"
Jul 22 11:56:47.602467 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:47.602443    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-svsdg"]
Jul 22 11:56:47.602713 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:56:47.602689    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"plugin-serving-cert\" is forbidden: User \"system:node:ip-10-0-132-166.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-166.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" type="*v1.Secret"
Jul 22 11:56:47.685336 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:47.685303    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/26354044-1df9-4308-ba21-de9185d935a0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-svsdg\" (UID: \"26354044-1df9-4308-ba21-de9185d935a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-svsdg"
Jul 22 11:56:47.685490 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:47.685361    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/26354044-1df9-4308-ba21-de9185d935a0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-svsdg\" (UID: \"26354044-1df9-4308-ba21-de9185d935a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-svsdg"
Jul 22 11:56:47.685490 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:47.685400    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6fw9\" (UniqueName: \"kubernetes.io/projected/26354044-1df9-4308-ba21-de9185d935a0-kube-api-access-z6fw9\") pod \"kuadrant-console-plugin-66b5774985-svsdg\" (UID: \"26354044-1df9-4308-ba21-de9185d935a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-svsdg"
Jul 22 11:56:47.786340 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:47.786312    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/26354044-1df9-4308-ba21-de9185d935a0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-svsdg\" (UID: \"26354044-1df9-4308-ba21-de9185d935a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-svsdg"
Jul 22 11:56:47.786504 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:47.786361    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/26354044-1df9-4308-ba21-de9185d935a0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-svsdg\" (UID: \"26354044-1df9-4308-ba21-de9185d935a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-svsdg"
Jul 22 11:56:47.786504 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:47.786381    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6fw9\" (UniqueName: \"kubernetes.io/projected/26354044-1df9-4308-ba21-de9185d935a0-kube-api-access-z6fw9\") pod \"kuadrant-console-plugin-66b5774985-svsdg\" (UID: \"26354044-1df9-4308-ba21-de9185d935a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-svsdg"
Jul 22 11:56:47.797460 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:47.797432    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6fw9\" (UniqueName: \"kubernetes.io/projected/26354044-1df9-4308-ba21-de9185d935a0-kube-api-access-z6fw9\") pod \"kuadrant-console-plugin-66b5774985-svsdg\" (UID: \"26354044-1df9-4308-ba21-de9185d935a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-svsdg"
Jul 22 11:56:48.506965 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:48.506934    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 22 11:56:48.517146 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:48.517123    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/26354044-1df9-4308-ba21-de9185d935a0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-svsdg\" (UID: \"26354044-1df9-4308-ba21-de9185d935a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-svsdg"
Jul 22 11:56:48.787069 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:56:48.786976    2558 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: failed to sync secret cache: timed out waiting for the condition
Jul 22 11:56:48.787069 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:56:48.787062    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26354044-1df9-4308-ba21-de9185d935a0-plugin-serving-cert podName:26354044-1df9-4308-ba21-de9185d935a0 nodeName:}" failed. No retries permitted until 2026-07-22 11:56:49.287044504 +0000 UTC m=+421.653559725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/26354044-1df9-4308-ba21-de9185d935a0-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-svsdg" (UID: "26354044-1df9-4308-ba21-de9185d935a0") : failed to sync secret cache: timed out waiting for the condition
Jul 22 11:56:48.831406 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:48.831379    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z7z59\""
Jul 22 11:56:49.182896 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:49.182869    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 22 11:56:49.299018 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:49.298985    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/26354044-1df9-4308-ba21-de9185d935a0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-svsdg\" (UID: \"26354044-1df9-4308-ba21-de9185d935a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-svsdg"
Jul 22 11:56:49.301340 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:49.301310    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/26354044-1df9-4308-ba21-de9185d935a0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-svsdg\" (UID: \"26354044-1df9-4308-ba21-de9185d935a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-svsdg"
Jul 22 11:56:49.399295 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:49.399252    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-svsdg"
Jul 22 11:56:49.533538 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:49.533506    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-svsdg"]
Jul 22 11:56:49.537061 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:56:49.537028    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26354044_1df9_4308_ba21_de9185d935a0.slice/crio-058171d2465be926194599331c6e8a5aa7700239767c7db2a76076b86e19dcd2 WatchSource:0}: Error finding container 058171d2465be926194599331c6e8a5aa7700239767c7db2a76076b86e19dcd2: Status 404 returned error can't find the container with id 058171d2465be926194599331c6e8a5aa7700239767c7db2a76076b86e19dcd2
Jul 22 11:56:50.346076 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:50.346035    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-svsdg" event={"ID":"26354044-1df9-4308-ba21-de9185d935a0","Type":"ContainerStarted","Data":"058171d2465be926194599331c6e8a5aa7700239767c7db2a76076b86e19dcd2"}
Jul 22 11:56:57.479023 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:57.478986    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncd55"]
Jul 22 11:56:57.487352 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:57.487328    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncd55"
Jul 22 11:56:57.490250 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:57.490226    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pg7tg\""
Jul 22 11:56:57.495779 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:57.495751    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncd55"]
Jul 22 11:56:57.576092 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:57.576052    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11972580-d050-41b9-afb1-8cecc92439af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ncd55\" (UID: \"11972580-d050-41b9-afb1-8cecc92439af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncd55"
Jul 22 11:56:57.576285 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:57.576218    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7gqm\" (UniqueName: \"kubernetes.io/projected/11972580-d050-41b9-afb1-8cecc92439af-kube-api-access-g7gqm\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ncd55\" (UID: \"11972580-d050-41b9-afb1-8cecc92439af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncd55"
Jul 22 11:56:57.676710 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:57.676671    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7gqm\" (UniqueName: \"kubernetes.io/projected/11972580-d050-41b9-afb1-8cecc92439af-kube-api-access-g7gqm\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ncd55\" (UID: \"11972580-d050-41b9-afb1-8cecc92439af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncd55"
Jul 22 11:56:57.676881 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:57.676727    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11972580-d050-41b9-afb1-8cecc92439af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ncd55\" (UID: \"11972580-d050-41b9-afb1-8cecc92439af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncd55"
Jul 22 11:56:57.677174 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:57.677148    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11972580-d050-41b9-afb1-8cecc92439af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ncd55\" (UID: \"11972580-d050-41b9-afb1-8cecc92439af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncd55"
Jul 22 11:56:57.688284 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:57.688259    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7gqm\" (UniqueName: \"kubernetes.io/projected/11972580-d050-41b9-afb1-8cecc92439af-kube-api-access-g7gqm\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ncd55\" (UID: \"11972580-d050-41b9-afb1-8cecc92439af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncd55"
Jul 22 11:56:57.801220 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:56:57.801136    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncd55"
Jul 22 11:57:03.246879 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:03.246839    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncd55"]
Jul 22 11:57:03.253019 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:03.252983    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncd55"]
Jul 22 11:57:03.369488 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:03.369453    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4cwq6"]
Jul 22 11:57:03.458195 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:03.458109    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4cwq6"]
Jul 22 11:57:03.458391 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:03.458331    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4cwq6"
Jul 22 11:57:03.528068 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:03.527981    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcxr9\" (UniqueName: \"kubernetes.io/projected/d96343a0-d788-4c8e-a187-0a7706b2ff99-kube-api-access-zcxr9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4cwq6\" (UID: \"d96343a0-d788-4c8e-a187-0a7706b2ff99\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4cwq6"
Jul 22 11:57:03.528068 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:03.528038    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d96343a0-d788-4c8e-a187-0a7706b2ff99-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4cwq6\" (UID: \"d96343a0-d788-4c8e-a187-0a7706b2ff99\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4cwq6"
Jul 22 11:57:03.628939 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:03.628896    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcxr9\" (UniqueName: \"kubernetes.io/projected/d96343a0-d788-4c8e-a187-0a7706b2ff99-kube-api-access-zcxr9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4cwq6\" (UID: \"d96343a0-d788-4c8e-a187-0a7706b2ff99\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4cwq6"
Jul 22 11:57:03.629106 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:03.629003    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d96343a0-d788-4c8e-a187-0a7706b2ff99-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4cwq6\" (UID: \"d96343a0-d788-4c8e-a187-0a7706b2ff99\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4cwq6"
Jul 22 11:57:03.629402 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:03.629381    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d96343a0-d788-4c8e-a187-0a7706b2ff99-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4cwq6\" (UID: \"d96343a0-d788-4c8e-a187-0a7706b2ff99\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4cwq6"
Jul 22 11:57:03.650961 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:03.650793    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcxr9\" (UniqueName: \"kubernetes.io/projected/d96343a0-d788-4c8e-a187-0a7706b2ff99-kube-api-access-zcxr9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4cwq6\" (UID: \"d96343a0-d788-4c8e-a187-0a7706b2ff99\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4cwq6"
Jul 22 11:57:03.770857 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:03.770822    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4cwq6"
Jul 22 11:57:10.692562 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:10.692536    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4cwq6"]
Jul 22 11:57:10.693275 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:57:10.693254    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd96343a0_d788_4c8e_a187_0a7706b2ff99.slice/crio-9e99d1f7ef1c8f7722842026ea6204e42980528884c0d29b9facf7a666c70888 WatchSource:0}: Error finding container 9e99d1f7ef1c8f7722842026ea6204e42980528884c0d29b9facf7a666c70888: Status 404 returned error can't find the container with id 9e99d1f7ef1c8f7722842026ea6204e42980528884c0d29b9facf7a666c70888
Jul 22 11:57:11.465362 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:11.465325    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-svsdg" event={"ID":"26354044-1df9-4308-ba21-de9185d935a0","Type":"ContainerStarted","Data":"26538b6d9435a37ec2f1b2c0c577ced13b273a103a4e939e5b2cc345b6915cc7"}
Jul 22 11:57:11.466740 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:11.466710    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4cwq6" event={"ID":"d96343a0-d788-4c8e-a187-0a7706b2ff99","Type":"ContainerStarted","Data":"9e99d1f7ef1c8f7722842026ea6204e42980528884c0d29b9facf7a666c70888"}
Jul 22 11:57:11.485204 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:11.485158    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-svsdg" podStartSLOduration=3.422580183 podStartE2EDuration="24.48514357s" totalImagesPullingTime="21.062563387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:57:11.483575817 +0000 UTC m=+443.850091053" watchObservedRunningTime="2026-07-22 11:57:11.48514357 +0000 UTC m=+443.851658813"
Jul 22 11:57:13.101239 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:57:13.101189    2558 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-ncd55_kuadrant-system_11972580-d050-41b9-afb1-8cecc92439af_0(588360720f30eb88460ccce27408f385edf29fc0f5edbea883bd7e1c2c8f1092): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-ncd55 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 22 11:57:13.101606 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:57:13.101267    2558 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-ncd55_kuadrant-system_11972580-d050-41b9-afb1-8cecc92439af_0(588360720f30eb88460ccce27408f385edf29fc0f5edbea883bd7e1c2c8f1092): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-ncd55 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncd55"
Jul 22 11:57:13.475335 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:13.475302    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncd55"
Jul 22 11:57:13.478086 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:57:13.478006    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ncd55\" is forbidden: User \"system:node:ip-10-0-132-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-166.ec2.internal' and this object" podUID="11972580-d050-41b9-afb1-8cecc92439af" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncd55"
Jul 22 11:57:13.483236 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:13.483214    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncd55"
Jul 22 11:57:13.486115 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:57:13.486087    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ncd55\" is forbidden: User \"system:node:ip-10-0-132-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-166.ec2.internal' and this object" podUID="11972580-d050-41b9-afb1-8cecc92439af" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncd55"
Jul 22 11:57:13.521837 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:13.521814    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7gqm\" (UniqueName: \"kubernetes.io/projected/11972580-d050-41b9-afb1-8cecc92439af-kube-api-access-g7gqm\") pod \"11972580-d050-41b9-afb1-8cecc92439af\" (UID: \"11972580-d050-41b9-afb1-8cecc92439af\") "
Jul 22 11:57:13.521964 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:13.521903    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11972580-d050-41b9-afb1-8cecc92439af-extensions-socket-volume\") pod \"11972580-d050-41b9-afb1-8cecc92439af\" (UID: \"11972580-d050-41b9-afb1-8cecc92439af\") "
Jul 22 11:57:13.522180 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:13.522151    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11972580-d050-41b9-afb1-8cecc92439af-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "11972580-d050-41b9-afb1-8cecc92439af" (UID: "11972580-d050-41b9-afb1-8cecc92439af"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 11:57:13.522580 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:13.522320    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11972580-d050-41b9-afb1-8cecc92439af-extensions-socket-volume\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 11:57:13.523931 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:13.523908    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11972580-d050-41b9-afb1-8cecc92439af-kube-api-access-g7gqm" (OuterVolumeSpecName: "kube-api-access-g7gqm") pod "11972580-d050-41b9-afb1-8cecc92439af" (UID: "11972580-d050-41b9-afb1-8cecc92439af"). InnerVolumeSpecName "kube-api-access-g7gqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 11:57:13.623333 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:13.623294    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7gqm\" (UniqueName: \"kubernetes.io/projected/11972580-d050-41b9-afb1-8cecc92439af-kube-api-access-g7gqm\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 11:57:14.448377 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:14.448340    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11972580-d050-41b9-afb1-8cecc92439af" path="/var/lib/kubelet/pods/11972580-d050-41b9-afb1-8cecc92439af/volumes"
Jul 22 11:57:14.480122 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:14.480092    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncd55"
Jul 22 11:57:14.482830 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:57:14.482797    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ncd55\" is forbidden: User \"system:node:ip-10-0-132-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-166.ec2.internal' and this object" podUID="11972580-d050-41b9-afb1-8cecc92439af" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncd55"
Jul 22 11:57:14.485048 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:57:14.485022    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ncd55\" is forbidden: User \"system:node:ip-10-0-132-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-166.ec2.internal' and this object" podUID="11972580-d050-41b9-afb1-8cecc92439af" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncd55"
Jul 22 11:57:15.487792 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:15.487750    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4cwq6" event={"ID":"d96343a0-d788-4c8e-a187-0a7706b2ff99","Type":"ContainerStarted","Data":"0a623a7b115273e7a47c2c9a1633ab05775649a94e8abfb8ac26c69bf11bb690"}
Jul 22 11:57:15.488170 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:15.487827    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4cwq6"
Jul 22 11:57:15.489952 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:57:15.489927    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ncd55\" is forbidden: User \"system:node:ip-10-0-132-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-166.ec2.internal' and this object" podUID="11972580-d050-41b9-afb1-8cecc92439af" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncd55"
Jul 22 11:57:15.512810 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:15.512738    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4cwq6" podStartSLOduration=8.498707373 podStartE2EDuration="12.512719621s" totalImagesPullingTime="4.014012248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:57:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:57:15.50976229 +0000 UTC m=+447.876277535" watchObservedRunningTime="2026-07-22 11:57:15.512719621 +0000 UTC m=+447.879234864"
Jul 22 11:57:15.552227 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:15.552189    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4cwq6"]
Jul 22 11:57:17.496225 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:17.496179    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4cwq6" podUID="d96343a0-d788-4c8e-a187-0a7706b2ff99" containerName="manager" containerID="cri-o://0a623a7b115273e7a47c2c9a1633ab05775649a94e8abfb8ac26c69bf11bb690" gracePeriod=10
Jul 22 11:57:17.745466 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:17.745444    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4cwq6"
Jul 22 11:57:17.861839 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:17.861752    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d96343a0-d788-4c8e-a187-0a7706b2ff99-extensions-socket-volume\") pod \"d96343a0-d788-4c8e-a187-0a7706b2ff99\" (UID: \"d96343a0-d788-4c8e-a187-0a7706b2ff99\") "
Jul 22 11:57:17.861839 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:17.861788    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcxr9\" (UniqueName: \"kubernetes.io/projected/d96343a0-d788-4c8e-a187-0a7706b2ff99-kube-api-access-zcxr9\") pod \"d96343a0-d788-4c8e-a187-0a7706b2ff99\" (UID: \"d96343a0-d788-4c8e-a187-0a7706b2ff99\") "
Jul 22 11:57:17.862272 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:17.862248    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d96343a0-d788-4c8e-a187-0a7706b2ff99-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d96343a0-d788-4c8e-a187-0a7706b2ff99" (UID: "d96343a0-d788-4c8e-a187-0a7706b2ff99"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 11:57:17.864003 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:17.863982    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d96343a0-d788-4c8e-a187-0a7706b2ff99-kube-api-access-zcxr9" (OuterVolumeSpecName: "kube-api-access-zcxr9") pod "d96343a0-d788-4c8e-a187-0a7706b2ff99" (UID: "d96343a0-d788-4c8e-a187-0a7706b2ff99"). InnerVolumeSpecName "kube-api-access-zcxr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 11:57:17.962769 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:17.962726    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d96343a0-d788-4c8e-a187-0a7706b2ff99-extensions-socket-volume\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 11:57:17.962769 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:17.962763    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcxr9\" (UniqueName: \"kubernetes.io/projected/d96343a0-d788-4c8e-a187-0a7706b2ff99-kube-api-access-zcxr9\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 11:57:18.502741 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:18.502705    2558 generic.go:356] "Generic (PLEG): container finished" podID="d96343a0-d788-4c8e-a187-0a7706b2ff99" containerID="0a623a7b115273e7a47c2c9a1633ab05775649a94e8abfb8ac26c69bf11bb690" exitCode=0
Jul 22 11:57:18.503168 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:18.502751    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4cwq6"
Jul 22 11:57:18.503168 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:18.502784    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4cwq6" event={"ID":"d96343a0-d788-4c8e-a187-0a7706b2ff99","Type":"ContainerDied","Data":"0a623a7b115273e7a47c2c9a1633ab05775649a94e8abfb8ac26c69bf11bb690"}
Jul 22 11:57:18.503168 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:18.502839    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4cwq6" event={"ID":"d96343a0-d788-4c8e-a187-0a7706b2ff99","Type":"ContainerDied","Data":"9e99d1f7ef1c8f7722842026ea6204e42980528884c0d29b9facf7a666c70888"}
Jul 22 11:57:18.503168 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:18.502863    2558 scope.go:117] "RemoveContainer" containerID="0a623a7b115273e7a47c2c9a1633ab05775649a94e8abfb8ac26c69bf11bb690"
Jul 22 11:57:18.511352 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:18.511334    2558 scope.go:117] "RemoveContainer" containerID="0a623a7b115273e7a47c2c9a1633ab05775649a94e8abfb8ac26c69bf11bb690"
Jul 22 11:57:18.511638 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:57:18.511607    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a623a7b115273e7a47c2c9a1633ab05775649a94e8abfb8ac26c69bf11bb690\": container with ID starting with 0a623a7b115273e7a47c2c9a1633ab05775649a94e8abfb8ac26c69bf11bb690 not found: ID does not exist" containerID="0a623a7b115273e7a47c2c9a1633ab05775649a94e8abfb8ac26c69bf11bb690"
Jul 22 11:57:18.511689 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:18.511649    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a623a7b115273e7a47c2c9a1633ab05775649a94e8abfb8ac26c69bf11bb690"} err="failed to get container status \"0a623a7b115273e7a47c2c9a1633ab05775649a94e8abfb8ac26c69bf11bb690\": rpc error: code = NotFound desc = could not find container \"0a623a7b115273e7a47c2c9a1633ab05775649a94e8abfb8ac26c69bf11bb690\": container with ID starting with 0a623a7b115273e7a47c2c9a1633ab05775649a94e8abfb8ac26c69bf11bb690 not found: ID does not exist"
Jul 22 11:57:18.529829 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:18.529804    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4cwq6"]
Jul 22 11:57:18.537628 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:18.537594    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4cwq6"]
Jul 22 11:57:20.446317 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:20.446281    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d96343a0-d788-4c8e-a187-0a7706b2ff99" path="/var/lib/kubelet/pods/d96343a0-d788-4c8e-a187-0a7706b2ff99/volumes"
Jul 22 11:57:44.315589 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:44.315556    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g2nvq"]
Jul 22 11:57:44.316063 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:44.315959    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d96343a0-d788-4c8e-a187-0a7706b2ff99" containerName="manager"
Jul 22 11:57:44.316063 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:44.315971    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d96343a0-d788-4c8e-a187-0a7706b2ff99" containerName="manager"
Jul 22 11:57:44.316063 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:44.316044    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d96343a0-d788-4c8e-a187-0a7706b2ff99" containerName="manager"
Jul 22 11:57:44.389361 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:44.389327    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g2nvq"]
Jul 22 11:57:44.389568 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:44.389380    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g2nvq"
Jul 22 11:57:44.392073 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:44.392045    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 22 11:57:44.398976 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:44.398954    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm8kp\" (UniqueName: \"kubernetes.io/projected/0432a67a-ee5c-4a54-b967-f34826e9da35-kube-api-access-dm8kp\") pod \"limitador-limitador-64c94fd64f-g2nvq\" (UID: \"0432a67a-ee5c-4a54-b967-f34826e9da35\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g2nvq"
Jul 22 11:57:44.399080 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:44.398985    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0432a67a-ee5c-4a54-b967-f34826e9da35-config-file\") pod \"limitador-limitador-64c94fd64f-g2nvq\" (UID: \"0432a67a-ee5c-4a54-b967-f34826e9da35\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g2nvq"
Jul 22 11:57:44.402422 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:44.402398    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g2nvq"]
Jul 22 11:57:44.500183 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:44.500145    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm8kp\" (UniqueName: \"kubernetes.io/projected/0432a67a-ee5c-4a54-b967-f34826e9da35-kube-api-access-dm8kp\") pod \"limitador-limitador-64c94fd64f-g2nvq\" (UID: \"0432a67a-ee5c-4a54-b967-f34826e9da35\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g2nvq"
Jul 22 11:57:44.500183 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:44.500184    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0432a67a-ee5c-4a54-b967-f34826e9da35-config-file\") pod \"limitador-limitador-64c94fd64f-g2nvq\" (UID: \"0432a67a-ee5c-4a54-b967-f34826e9da35\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g2nvq"
Jul 22 11:57:44.500869 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:44.500851    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0432a67a-ee5c-4a54-b967-f34826e9da35-config-file\") pod \"limitador-limitador-64c94fd64f-g2nvq\" (UID: \"0432a67a-ee5c-4a54-b967-f34826e9da35\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g2nvq"
Jul 22 11:57:44.512323 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:44.512293    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm8kp\" (UniqueName: \"kubernetes.io/projected/0432a67a-ee5c-4a54-b967-f34826e9da35-kube-api-access-dm8kp\") pod \"limitador-limitador-64c94fd64f-g2nvq\" (UID: \"0432a67a-ee5c-4a54-b967-f34826e9da35\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g2nvq"
Jul 22 11:57:44.701436 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:44.701396    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g2nvq"
Jul 22 11:57:44.836244 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:44.836217    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g2nvq"]
Jul 22 11:57:44.838419 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:57:44.838393    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0432a67a_ee5c_4a54_b967_f34826e9da35.slice/crio-6c426ca2047c485b5e9065322546f63e4f2e912d9a356798b2f8f5a9ddc219ca WatchSource:0}: Error finding container 6c426ca2047c485b5e9065322546f63e4f2e912d9a356798b2f8f5a9ddc219ca: Status 404 returned error can't find the container with id 6c426ca2047c485b5e9065322546f63e4f2e912d9a356798b2f8f5a9ddc219ca
Jul 22 11:57:45.628172 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:45.628131    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g2nvq" event={"ID":"0432a67a-ee5c-4a54-b967-f34826e9da35","Type":"ContainerStarted","Data":"6c426ca2047c485b5e9065322546f63e4f2e912d9a356798b2f8f5a9ddc219ca"}
Jul 22 11:57:47.640821 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:47.640775    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g2nvq" event={"ID":"0432a67a-ee5c-4a54-b967-f34826e9da35","Type":"ContainerStarted","Data":"1ba26f3f810f59eb48222dcb089fdb81a79ebd7f7e4caf48f8e39193a4e2b50c"}
Jul 22 11:57:47.641156 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:47.640994    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-g2nvq"
Jul 22 11:57:47.662655 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:47.662594    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-g2nvq" podStartSLOduration=0.927578524 podStartE2EDuration="3.662576124s" totalImagesPullingTime="2.7349976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:57:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:57:47.661112915 +0000 UTC m=+480.027628158" watchObservedRunningTime="2026-07-22 11:57:47.662576124 +0000 UTC m=+480.029091368"
Jul 22 11:57:50.905276 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:50.905240    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78fb454dff-qgtj9"]
Jul 22 11:57:50.909723 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:50.909706    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:57:50.913403 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:50.913368    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 22 11:57:50.914592 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:50.914571    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 22 11:57:50.915729 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:50.915690    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 22 11:57:50.915729 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:50.915701    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 22 11:57:50.915907 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:50.915808    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 22 11:57:50.915977 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:50.915956    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 22 11:57:50.916036 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:50.915964    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sdcc8\""
Jul 22 11:57:50.916129 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:50.916112    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 22 11:57:50.919498 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:50.919469    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 22 11:57:50.921638 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:50.921598    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78fb454dff-qgtj9"]
Jul 22 11:57:50.960577 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:50.960546    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tkkd\" (UniqueName: \"kubernetes.io/projected/c2f01a8a-0cdd-4d85-86a5-40f42e679098-kube-api-access-6tkkd\") pod \"console-78fb454dff-qgtj9\" (UID: \"c2f01a8a-0cdd-4d85-86a5-40f42e679098\") " pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:57:50.960750 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:50.960585    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2f01a8a-0cdd-4d85-86a5-40f42e679098-oauth-serving-cert\") pod \"console-78fb454dff-qgtj9\" (UID: \"c2f01a8a-0cdd-4d85-86a5-40f42e679098\") " pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:57:50.960750 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:50.960610    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2f01a8a-0cdd-4d85-86a5-40f42e679098-console-serving-cert\") pod \"console-78fb454dff-qgtj9\" (UID: \"c2f01a8a-0cdd-4d85-86a5-40f42e679098\") " pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:57:50.960750 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:50.960684    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2f01a8a-0cdd-4d85-86a5-40f42e679098-console-oauth-config\") pod \"console-78fb454dff-qgtj9\" (UID: \"c2f01a8a-0cdd-4d85-86a5-40f42e679098\") " pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:57:50.960750 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:50.960713    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2f01a8a-0cdd-4d85-86a5-40f42e679098-trusted-ca-bundle\") pod \"console-78fb454dff-qgtj9\" (UID: \"c2f01a8a-0cdd-4d85-86a5-40f42e679098\") " pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:57:50.960750 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:50.960740    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2f01a8a-0cdd-4d85-86a5-40f42e679098-service-ca\") pod \"console-78fb454dff-qgtj9\" (UID: \"c2f01a8a-0cdd-4d85-86a5-40f42e679098\") " pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:57:50.960945 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:50.960785    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2f01a8a-0cdd-4d85-86a5-40f42e679098-console-config\") pod \"console-78fb454dff-qgtj9\" (UID: \"c2f01a8a-0cdd-4d85-86a5-40f42e679098\") " pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:57:51.061341 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:51.061305    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2f01a8a-0cdd-4d85-86a5-40f42e679098-console-config\") pod \"console-78fb454dff-qgtj9\" (UID: \"c2f01a8a-0cdd-4d85-86a5-40f42e679098\") " pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:57:51.061520 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:51.061352    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tkkd\" (UniqueName: \"kubernetes.io/projected/c2f01a8a-0cdd-4d85-86a5-40f42e679098-kube-api-access-6tkkd\") pod \"console-78fb454dff-qgtj9\" (UID: \"c2f01a8a-0cdd-4d85-86a5-40f42e679098\") " pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:57:51.061520 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:51.061391    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2f01a8a-0cdd-4d85-86a5-40f42e679098-oauth-serving-cert\") pod \"console-78fb454dff-qgtj9\" (UID: \"c2f01a8a-0cdd-4d85-86a5-40f42e679098\") " pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:57:51.061520 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:51.061428    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2f01a8a-0cdd-4d85-86a5-40f42e679098-console-serving-cert\") pod \"console-78fb454dff-qgtj9\" (UID: \"c2f01a8a-0cdd-4d85-86a5-40f42e679098\") " pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:57:51.061520 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:51.061468    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2f01a8a-0cdd-4d85-86a5-40f42e679098-console-oauth-config\") pod \"console-78fb454dff-qgtj9\" (UID: \"c2f01a8a-0cdd-4d85-86a5-40f42e679098\") " pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:57:51.061520 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:51.061509    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2f01a8a-0cdd-4d85-86a5-40f42e679098-trusted-ca-bundle\") pod \"console-78fb454dff-qgtj9\" (UID: \"c2f01a8a-0cdd-4d85-86a5-40f42e679098\") " pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:57:51.061843 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:51.061534    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2f01a8a-0cdd-4d85-86a5-40f42e679098-service-ca\") pod \"console-78fb454dff-qgtj9\" (UID: \"c2f01a8a-0cdd-4d85-86a5-40f42e679098\") " pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:57:51.069010 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:51.062686    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2f01a8a-0cdd-4d85-86a5-40f42e679098-service-ca\") pod \"console-78fb454dff-qgtj9\" (UID: \"c2f01a8a-0cdd-4d85-86a5-40f42e679098\") " pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:57:51.069010 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:51.062686    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2f01a8a-0cdd-4d85-86a5-40f42e679098-console-config\") pod \"console-78fb454dff-qgtj9\" (UID: \"c2f01a8a-0cdd-4d85-86a5-40f42e679098\") " pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:57:51.069010 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:51.062779    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2f01a8a-0cdd-4d85-86a5-40f42e679098-oauth-serving-cert\") pod \"console-78fb454dff-qgtj9\" (UID: \"c2f01a8a-0cdd-4d85-86a5-40f42e679098\") " pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:57:51.069010 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:51.062875    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2f01a8a-0cdd-4d85-86a5-40f42e679098-trusted-ca-bundle\") pod \"console-78fb454dff-qgtj9\" (UID: \"c2f01a8a-0cdd-4d85-86a5-40f42e679098\") " pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:57:51.069010 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:51.064743    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2f01a8a-0cdd-4d85-86a5-40f42e679098-console-oauth-config\") pod \"console-78fb454dff-qgtj9\" (UID: \"c2f01a8a-0cdd-4d85-86a5-40f42e679098\") " pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:57:51.069010 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:51.064891    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2f01a8a-0cdd-4d85-86a5-40f42e679098-console-serving-cert\") pod \"console-78fb454dff-qgtj9\" (UID: \"c2f01a8a-0cdd-4d85-86a5-40f42e679098\") " pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:57:51.071649 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:51.071611    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tkkd\" (UniqueName: \"kubernetes.io/projected/c2f01a8a-0cdd-4d85-86a5-40f42e679098-kube-api-access-6tkkd\") pod \"console-78fb454dff-qgtj9\" (UID: \"c2f01a8a-0cdd-4d85-86a5-40f42e679098\") " pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:57:51.219763 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:51.219696    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:57:51.358494 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:51.358444    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78fb454dff-qgtj9"]
Jul 22 11:57:51.360584 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:57:51.360557    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2f01a8a_0cdd_4d85_86a5_40f42e679098.slice/crio-d74371b2e79e9036391fc97844314b3de8f27b8036882bec1862d4eb3f82d209 WatchSource:0}: Error finding container d74371b2e79e9036391fc97844314b3de8f27b8036882bec1862d4eb3f82d209: Status 404 returned error can't find the container with id d74371b2e79e9036391fc97844314b3de8f27b8036882bec1862d4eb3f82d209
Jul 22 11:57:51.663293 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:51.663254    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78fb454dff-qgtj9" event={"ID":"c2f01a8a-0cdd-4d85-86a5-40f42e679098","Type":"ContainerStarted","Data":"8db57e2405b8fbe2d959b8e7670b0c2b95ccb1bb31eab3032051076c24f80c8e"}
Jul 22 11:57:51.663471 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:51.663308    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78fb454dff-qgtj9" event={"ID":"c2f01a8a-0cdd-4d85-86a5-40f42e679098","Type":"ContainerStarted","Data":"d74371b2e79e9036391fc97844314b3de8f27b8036882bec1862d4eb3f82d209"}
Jul 22 11:57:51.691849 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:51.691799    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78fb454dff-qgtj9" podStartSLOduration=1.691781567 podStartE2EDuration="1.691781567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:57:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:57:51.690254348 +0000 UTC m=+484.056769592" watchObservedRunningTime="2026-07-22 11:57:51.691781567 +0000 UTC m=+484.058296810"
Jul 22 11:57:58.647988 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:58.647959    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-g2nvq"
Jul 22 11:57:58.968066 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:58.967971    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g2nvq"]
Jul 22 11:57:58.968346 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:58.968197    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-g2nvq" podUID="0432a67a-ee5c-4a54-b967-f34826e9da35" containerName="limitador" containerID="cri-o://1ba26f3f810f59eb48222dcb089fdb81a79ebd7f7e4caf48f8e39193a4e2b50c" gracePeriod=30
Jul 22 11:57:59.515562 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:59.515540    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g2nvq"
Jul 22 11:57:59.635368 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:59.635344    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0432a67a-ee5c-4a54-b967-f34826e9da35-config-file\") pod \"0432a67a-ee5c-4a54-b967-f34826e9da35\" (UID: \"0432a67a-ee5c-4a54-b967-f34826e9da35\") "
Jul 22 11:57:59.635530 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:59.635388    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dm8kp\" (UniqueName: \"kubernetes.io/projected/0432a67a-ee5c-4a54-b967-f34826e9da35-kube-api-access-dm8kp\") pod \"0432a67a-ee5c-4a54-b967-f34826e9da35\" (UID: \"0432a67a-ee5c-4a54-b967-f34826e9da35\") "
Jul 22 11:57:59.635720 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:59.635693    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0432a67a-ee5c-4a54-b967-f34826e9da35-config-file" (OuterVolumeSpecName: "config-file") pod "0432a67a-ee5c-4a54-b967-f34826e9da35" (UID: "0432a67a-ee5c-4a54-b967-f34826e9da35"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 11:57:59.637398 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:59.637380    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0432a67a-ee5c-4a54-b967-f34826e9da35-kube-api-access-dm8kp" (OuterVolumeSpecName: "kube-api-access-dm8kp") pod "0432a67a-ee5c-4a54-b967-f34826e9da35" (UID: "0432a67a-ee5c-4a54-b967-f34826e9da35"). InnerVolumeSpecName "kube-api-access-dm8kp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 11:57:59.700775 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:59.700746    2558 generic.go:356] "Generic (PLEG): container finished" podID="0432a67a-ee5c-4a54-b967-f34826e9da35" containerID="1ba26f3f810f59eb48222dcb089fdb81a79ebd7f7e4caf48f8e39193a4e2b50c" exitCode=0
Jul 22 11:57:59.701130 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:59.700800    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g2nvq"
Jul 22 11:57:59.701130 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:59.700822    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g2nvq" event={"ID":"0432a67a-ee5c-4a54-b967-f34826e9da35","Type":"ContainerDied","Data":"1ba26f3f810f59eb48222dcb089fdb81a79ebd7f7e4caf48f8e39193a4e2b50c"}
Jul 22 11:57:59.701130 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:59.700874    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g2nvq" event={"ID":"0432a67a-ee5c-4a54-b967-f34826e9da35","Type":"ContainerDied","Data":"6c426ca2047c485b5e9065322546f63e4f2e912d9a356798b2f8f5a9ddc219ca"}
Jul 22 11:57:59.701130 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:59.700895    2558 scope.go:117] "RemoveContainer" containerID="1ba26f3f810f59eb48222dcb089fdb81a79ebd7f7e4caf48f8e39193a4e2b50c"
Jul 22 11:57:59.709542 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:59.709528    2558 scope.go:117] "RemoveContainer" containerID="1ba26f3f810f59eb48222dcb089fdb81a79ebd7f7e4caf48f8e39193a4e2b50c"
Jul 22 11:57:59.709803 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:57:59.709784    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ba26f3f810f59eb48222dcb089fdb81a79ebd7f7e4caf48f8e39193a4e2b50c\": container with ID starting with 1ba26f3f810f59eb48222dcb089fdb81a79ebd7f7e4caf48f8e39193a4e2b50c not found: ID does not exist" containerID="1ba26f3f810f59eb48222dcb089fdb81a79ebd7f7e4caf48f8e39193a4e2b50c"
Jul 22 11:57:59.709870 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:59.709811    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ba26f3f810f59eb48222dcb089fdb81a79ebd7f7e4caf48f8e39193a4e2b50c"} err="failed to get container status \"1ba26f3f810f59eb48222dcb089fdb81a79ebd7f7e4caf48f8e39193a4e2b50c\": rpc error: code = NotFound desc = could not find container \"1ba26f3f810f59eb48222dcb089fdb81a79ebd7f7e4caf48f8e39193a4e2b50c\": container with ID starting with 1ba26f3f810f59eb48222dcb089fdb81a79ebd7f7e4caf48f8e39193a4e2b50c not found: ID does not exist"
Jul 22 11:57:59.725550 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:59.725526    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g2nvq"]
Jul 22 11:57:59.730480 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:59.730458    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g2nvq"]
Jul 22 11:57:59.736292 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:59.736274    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dm8kp\" (UniqueName: \"kubernetes.io/projected/0432a67a-ee5c-4a54-b967-f34826e9da35-kube-api-access-dm8kp\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 11:57:59.736337 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:57:59.736296    2558 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0432a67a-ee5c-4a54-b967-f34826e9da35-config-file\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 11:58:00.446317 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:00.446284    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0432a67a-ee5c-4a54-b967-f34826e9da35" path="/var/lib/kubelet/pods/0432a67a-ee5c-4a54-b967-f34826e9da35/volumes"
Jul 22 11:58:01.220442 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:01.220407    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:58:01.220880 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:01.220487    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:58:01.227278 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:01.227252    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:58:01.719334 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:01.719305    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78fb454dff-qgtj9"
Jul 22 11:58:05.628148 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:05.628117    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-h8f5z"]
Jul 22 11:58:05.628509 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:05.628460    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0432a67a-ee5c-4a54-b967-f34826e9da35" containerName="limitador"
Jul 22 11:58:05.628509 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:05.628470    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0432a67a-ee5c-4a54-b967-f34826e9da35" containerName="limitador"
Jul 22 11:58:05.628583 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:05.628536    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0432a67a-ee5c-4a54-b967-f34826e9da35" containerName="limitador"
Jul 22 11:58:05.632914 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:05.632889    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h8f5z"
Jul 22 11:58:05.636982 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:05.636964    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 11:58:05.637080 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:05.636964    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-4t6v2\""
Jul 22 11:58:05.637867 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:05.637851    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 22 11:58:05.637957 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:05.637855    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 11:58:05.644520 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:05.644500    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-h8f5z"]
Jul 22 11:58:05.687756 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:05.687733    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xzkb\" (UniqueName: \"kubernetes.io/projected/8f1f2b7f-f5d6-442c-a3a2-ef604de77771-kube-api-access-4xzkb\") pod \"postgres-69fb4594cf-h8f5z\" (UID: \"8f1f2b7f-f5d6-442c-a3a2-ef604de77771\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h8f5z"
Jul 22 11:58:05.687912 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:05.687889    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8f1f2b7f-f5d6-442c-a3a2-ef604de77771-data\") pod \"postgres-69fb4594cf-h8f5z\" (UID: \"8f1f2b7f-f5d6-442c-a3a2-ef604de77771\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h8f5z"
Jul 22 11:58:05.788831 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:05.788789    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8f1f2b7f-f5d6-442c-a3a2-ef604de77771-data\") pod \"postgres-69fb4594cf-h8f5z\" (UID: \"8f1f2b7f-f5d6-442c-a3a2-ef604de77771\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h8f5z"
Jul 22 11:58:05.789012 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:05.788848    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xzkb\" (UniqueName: \"kubernetes.io/projected/8f1f2b7f-f5d6-442c-a3a2-ef604de77771-kube-api-access-4xzkb\") pod \"postgres-69fb4594cf-h8f5z\" (UID: \"8f1f2b7f-f5d6-442c-a3a2-ef604de77771\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h8f5z"
Jul 22 11:58:05.789173 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:05.789156    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8f1f2b7f-f5d6-442c-a3a2-ef604de77771-data\") pod \"postgres-69fb4594cf-h8f5z\" (UID: \"8f1f2b7f-f5d6-442c-a3a2-ef604de77771\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h8f5z"
Jul 22 11:58:05.799096 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:05.799073    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xzkb\" (UniqueName: \"kubernetes.io/projected/8f1f2b7f-f5d6-442c-a3a2-ef604de77771-kube-api-access-4xzkb\") pod \"postgres-69fb4594cf-h8f5z\" (UID: \"8f1f2b7f-f5d6-442c-a3a2-ef604de77771\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h8f5z"
Jul 22 11:58:05.943708 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:05.943605    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h8f5z"
Jul 22 11:58:06.079600 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:06.079569    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-h8f5z"]
Jul 22 11:58:06.079981 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:58:06.079951    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f1f2b7f_f5d6_442c_a3a2_ef604de77771.slice/crio-6c73c5dee9a226a6e938cbad9469433fd49f4269c9ef19ebe7e2058a767f4ced WatchSource:0}: Error finding container 6c73c5dee9a226a6e938cbad9469433fd49f4269c9ef19ebe7e2058a767f4ced: Status 404 returned error can't find the container with id 6c73c5dee9a226a6e938cbad9469433fd49f4269c9ef19ebe7e2058a767f4ced
Jul 22 11:58:06.737110 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:06.737066    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h8f5z" event={"ID":"8f1f2b7f-f5d6-442c-a3a2-ef604de77771","Type":"ContainerStarted","Data":"6c73c5dee9a226a6e938cbad9469433fd49f4269c9ef19ebe7e2058a767f4ced"}
Jul 22 11:58:11.764606 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:11.764571    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h8f5z" event={"ID":"8f1f2b7f-f5d6-442c-a3a2-ef604de77771","Type":"ContainerStarted","Data":"38dcf25b18aa179474a5141e9dd2b777615bf2609ba8b85b7dd5a21aa3241c61"}
Jul 22 11:58:11.765008 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:11.764784    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h8f5z"
Jul 22 11:58:11.785341 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:11.785286    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h8f5z" podStartSLOduration=1.7682529 podStartE2EDuration="6.785270526s" totalImagesPullingTime="5.017017626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:58:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:58:11.783216617 +0000 UTC m=+504.149731864" watchObservedRunningTime="2026-07-22 11:58:11.785270526 +0000 UTC m=+504.151785770"
Jul 22 11:58:17.798257 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:17.798230    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h8f5z"
Jul 22 11:58:25.952399 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:25.952362    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-766c85d54-zr8t5"]
Jul 22 11:58:25.970406 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:25.970383    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-766c85d54-zr8t5"
Jul 22 11:58:25.973681 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:25.973639    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 11:58:25.974089 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:25.974063    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 11:58:25.974655 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:25.974633    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xpzz9\""
Jul 22 11:58:25.975285 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:25.975260    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-766c85d54-zr8t5"]
Jul 22 11:58:25.985530 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:25.985508    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e646067-4d98-47a5-b711-df32518dff2f-webhook-cert\") pod \"maas-controller-766c85d54-zr8t5\" (UID: \"0e646067-4d98-47a5-b711-df32518dff2f\") " pod="opendatahub/maas-controller-766c85d54-zr8t5"
Jul 22 11:58:25.985612 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:25.985544    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8ch5\" (UniqueName: \"kubernetes.io/projected/0e646067-4d98-47a5-b711-df32518dff2f-kube-api-access-d8ch5\") pod \"maas-controller-766c85d54-zr8t5\" (UID: \"0e646067-4d98-47a5-b711-df32518dff2f\") " pod="opendatahub/maas-controller-766c85d54-zr8t5"
Jul 22 11:58:26.086612 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:26.086565    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e646067-4d98-47a5-b711-df32518dff2f-webhook-cert\") pod \"maas-controller-766c85d54-zr8t5\" (UID: \"0e646067-4d98-47a5-b711-df32518dff2f\") " pod="opendatahub/maas-controller-766c85d54-zr8t5"
Jul 22 11:58:26.086814 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:26.086652    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8ch5\" (UniqueName: \"kubernetes.io/projected/0e646067-4d98-47a5-b711-df32518dff2f-kube-api-access-d8ch5\") pod \"maas-controller-766c85d54-zr8t5\" (UID: \"0e646067-4d98-47a5-b711-df32518dff2f\") " pod="opendatahub/maas-controller-766c85d54-zr8t5"
Jul 22 11:58:26.088948 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:26.088920    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e646067-4d98-47a5-b711-df32518dff2f-webhook-cert\") pod \"maas-controller-766c85d54-zr8t5\" (UID: \"0e646067-4d98-47a5-b711-df32518dff2f\") " pod="opendatahub/maas-controller-766c85d54-zr8t5"
Jul 22 11:58:26.097822 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:26.097804    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8ch5\" (UniqueName: \"kubernetes.io/projected/0e646067-4d98-47a5-b711-df32518dff2f-kube-api-access-d8ch5\") pod \"maas-controller-766c85d54-zr8t5\" (UID: \"0e646067-4d98-47a5-b711-df32518dff2f\") " pod="opendatahub/maas-controller-766c85d54-zr8t5"
Jul 22 11:58:26.183366 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:26.183334    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bbfbc5ddf-dlvt8"]
Jul 22 11:58:26.185843 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:26.185827    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bbfbc5ddf-dlvt8"
Jul 22 11:58:26.199552 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:26.199526    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bbfbc5ddf-dlvt8"]
Jul 22 11:58:26.283210 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:26.283131    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-766c85d54-zr8t5"
Jul 22 11:58:26.288568 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:26.288544    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/858d01a4-b725-4b4d-a66a-d33585753a90-webhook-cert\") pod \"maas-controller-bbfbc5ddf-dlvt8\" (UID: \"858d01a4-b725-4b4d-a66a-d33585753a90\") " pod="opendatahub/maas-controller-bbfbc5ddf-dlvt8"
Jul 22 11:58:26.288730 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:26.288586    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhv74\" (UniqueName: \"kubernetes.io/projected/858d01a4-b725-4b4d-a66a-d33585753a90-kube-api-access-dhv74\") pod \"maas-controller-bbfbc5ddf-dlvt8\" (UID: \"858d01a4-b725-4b4d-a66a-d33585753a90\") " pod="opendatahub/maas-controller-bbfbc5ddf-dlvt8"
Jul 22 11:58:26.389978 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:26.389948    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhv74\" (UniqueName: \"kubernetes.io/projected/858d01a4-b725-4b4d-a66a-d33585753a90-kube-api-access-dhv74\") pod \"maas-controller-bbfbc5ddf-dlvt8\" (UID: \"858d01a4-b725-4b4d-a66a-d33585753a90\") " pod="opendatahub/maas-controller-bbfbc5ddf-dlvt8"
Jul 22 11:58:26.390150 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:26.390036    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/858d01a4-b725-4b4d-a66a-d33585753a90-webhook-cert\") pod \"maas-controller-bbfbc5ddf-dlvt8\" (UID: \"858d01a4-b725-4b4d-a66a-d33585753a90\") " pod="opendatahub/maas-controller-bbfbc5ddf-dlvt8"
Jul 22 11:58:26.392391 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:26.392368    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/858d01a4-b725-4b4d-a66a-d33585753a90-webhook-cert\") pod \"maas-controller-bbfbc5ddf-dlvt8\" (UID: \"858d01a4-b725-4b4d-a66a-d33585753a90\") " pod="opendatahub/maas-controller-bbfbc5ddf-dlvt8"
Jul 22 11:58:26.403405 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:26.403384    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhv74\" (UniqueName: \"kubernetes.io/projected/858d01a4-b725-4b4d-a66a-d33585753a90-kube-api-access-dhv74\") pod \"maas-controller-bbfbc5ddf-dlvt8\" (UID: \"858d01a4-b725-4b4d-a66a-d33585753a90\") " pod="opendatahub/maas-controller-bbfbc5ddf-dlvt8"
Jul 22 11:58:26.421501 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:26.421476    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-766c85d54-zr8t5"]
Jul 22 11:58:26.422712 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:58:26.422685    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e646067_4d98_47a5_b711_df32518dff2f.slice/crio-13a1040fdacb2618074a6760fcf2bf6a127c699cd6b0e38e609d99e161087871 WatchSource:0}: Error finding container 13a1040fdacb2618074a6760fcf2bf6a127c699cd6b0e38e609d99e161087871: Status 404 returned error can't find the container with id 13a1040fdacb2618074a6760fcf2bf6a127c699cd6b0e38e609d99e161087871
Jul 22 11:58:26.495794 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:26.495754    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bbfbc5ddf-dlvt8"
Jul 22 11:58:26.634346 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:26.634312    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bbfbc5ddf-dlvt8"]
Jul 22 11:58:26.639469 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:58:26.639435    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod858d01a4_b725_4b4d_a66a_d33585753a90.slice/crio-3fe0ef0afde30a1c587e9a87d9eb3e2e2279729e9311d11f33ad71f0c8374af2 WatchSource:0}: Error finding container 3fe0ef0afde30a1c587e9a87d9eb3e2e2279729e9311d11f33ad71f0c8374af2: Status 404 returned error can't find the container with id 3fe0ef0afde30a1c587e9a87d9eb3e2e2279729e9311d11f33ad71f0c8374af2
Jul 22 11:58:26.832697 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:26.832584    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bbfbc5ddf-dlvt8" event={"ID":"858d01a4-b725-4b4d-a66a-d33585753a90","Type":"ContainerStarted","Data":"3fe0ef0afde30a1c587e9a87d9eb3e2e2279729e9311d11f33ad71f0c8374af2"}
Jul 22 11:58:26.833770 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:26.833742    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-766c85d54-zr8t5" event={"ID":"0e646067-4d98-47a5-b711-df32518dff2f","Type":"ContainerStarted","Data":"13a1040fdacb2618074a6760fcf2bf6a127c699cd6b0e38e609d99e161087871"}
Jul 22 11:58:29.853671 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:29.853606    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-766c85d54-zr8t5" event={"ID":"0e646067-4d98-47a5-b711-df32518dff2f","Type":"ContainerStarted","Data":"b50961a254d7348bfe16f00b37f3375a933efb6ed05b6e81d981257cca0c239b"}
Jul 22 11:58:29.854171 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:29.853731    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-766c85d54-zr8t5"
Jul 22 11:58:29.855003 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:29.854977    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bbfbc5ddf-dlvt8" event={"ID":"858d01a4-b725-4b4d-a66a-d33585753a90","Type":"ContainerStarted","Data":"72bd7cdc2f64f3f2486a3528b1229334dd3500e8ff7caa2b61e17605bc88a532"}
Jul 22 11:58:29.855143 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:29.855039    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bbfbc5ddf-dlvt8"
Jul 22 11:58:29.881586 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:29.881536    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-766c85d54-zr8t5" podStartSLOduration=2.195097493 podStartE2EDuration="4.881521549s" totalImagesPullingTime="2.686424056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:58:29.880503088 +0000 UTC m=+522.247018332" watchObservedRunningTime="2026-07-22 11:58:29.881521549 +0000 UTC m=+522.248036790"
Jul 22 11:58:29.924487 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:29.924440    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bbfbc5ddf-dlvt8" podStartSLOduration=1.448273746 podStartE2EDuration="3.924422233s" totalImagesPullingTime="2.476148487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:58:29.923564733 +0000 UTC m=+522.290079977" watchObservedRunningTime="2026-07-22 11:58:29.924422233 +0000 UTC m=+522.290937476"
Jul 22 11:58:40.862932 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:40.862845    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-766c85d54-zr8t5"
Jul 22 11:58:40.862932 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:40.862921    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bbfbc5ddf-dlvt8"
Jul 22 11:58:40.968929 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:40.968893    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-766c85d54-zr8t5"]
Jul 22 11:58:40.969121 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:40.969095    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-766c85d54-zr8t5" podUID="0e646067-4d98-47a5-b711-df32518dff2f" containerName="manager" containerID="cri-o://b50961a254d7348bfe16f00b37f3375a933efb6ed05b6e81d981257cca0c239b" gracePeriod=30
Jul 22 11:58:41.209097 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:41.209075    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-766c85d54-zr8t5"
Jul 22 11:58:41.330933 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:41.330892    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8ch5\" (UniqueName: \"kubernetes.io/projected/0e646067-4d98-47a5-b711-df32518dff2f-kube-api-access-d8ch5\") pod \"0e646067-4d98-47a5-b711-df32518dff2f\" (UID: \"0e646067-4d98-47a5-b711-df32518dff2f\") "
Jul 22 11:58:41.331099 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:41.330996    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e646067-4d98-47a5-b711-df32518dff2f-webhook-cert\") pod \"0e646067-4d98-47a5-b711-df32518dff2f\" (UID: \"0e646067-4d98-47a5-b711-df32518dff2f\") "
Jul 22 11:58:41.333070 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:41.333044    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e646067-4d98-47a5-b711-df32518dff2f-kube-api-access-d8ch5" (OuterVolumeSpecName: "kube-api-access-d8ch5") pod "0e646067-4d98-47a5-b711-df32518dff2f" (UID: "0e646067-4d98-47a5-b711-df32518dff2f"). InnerVolumeSpecName "kube-api-access-d8ch5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 11:58:41.333369 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:41.333053    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e646067-4d98-47a5-b711-df32518dff2f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0e646067-4d98-47a5-b711-df32518dff2f" (UID: "0e646067-4d98-47a5-b711-df32518dff2f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 11:58:41.432655 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:41.432564    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8ch5\" (UniqueName: \"kubernetes.io/projected/0e646067-4d98-47a5-b711-df32518dff2f-kube-api-access-d8ch5\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 11:58:41.432655 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:41.432592    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e646067-4d98-47a5-b711-df32518dff2f-webhook-cert\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 11:58:41.916136 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:41.916101    2558 generic.go:356] "Generic (PLEG): container finished" podID="0e646067-4d98-47a5-b711-df32518dff2f" containerID="b50961a254d7348bfe16f00b37f3375a933efb6ed05b6e81d981257cca0c239b" exitCode=0
Jul 22 11:58:41.916565 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:41.916147    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-766c85d54-zr8t5"
Jul 22 11:58:41.916565 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:41.916188    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-766c85d54-zr8t5" event={"ID":"0e646067-4d98-47a5-b711-df32518dff2f","Type":"ContainerDied","Data":"b50961a254d7348bfe16f00b37f3375a933efb6ed05b6e81d981257cca0c239b"}
Jul 22 11:58:41.916565 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:41.916240    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-766c85d54-zr8t5" event={"ID":"0e646067-4d98-47a5-b711-df32518dff2f","Type":"ContainerDied","Data":"13a1040fdacb2618074a6760fcf2bf6a127c699cd6b0e38e609d99e161087871"}
Jul 22 11:58:41.916565 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:41.916264    2558 scope.go:117] "RemoveContainer" containerID="b50961a254d7348bfe16f00b37f3375a933efb6ed05b6e81d981257cca0c239b"
Jul 22 11:58:41.924993 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:41.924977    2558 scope.go:117] "RemoveContainer" containerID="b50961a254d7348bfe16f00b37f3375a933efb6ed05b6e81d981257cca0c239b"
Jul 22 11:58:41.925226 ip-10-0-132-166 kubenswrapper[2558]: E0722 11:58:41.925206    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b50961a254d7348bfe16f00b37f3375a933efb6ed05b6e81d981257cca0c239b\": container with ID starting with b50961a254d7348bfe16f00b37f3375a933efb6ed05b6e81d981257cca0c239b not found: ID does not exist" containerID="b50961a254d7348bfe16f00b37f3375a933efb6ed05b6e81d981257cca0c239b"
Jul 22 11:58:41.925272 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:41.925234    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b50961a254d7348bfe16f00b37f3375a933efb6ed05b6e81d981257cca0c239b"} err="failed to get container status \"b50961a254d7348bfe16f00b37f3375a933efb6ed05b6e81d981257cca0c239b\": rpc error: code = NotFound desc = could not find container \"b50961a254d7348bfe16f00b37f3375a933efb6ed05b6e81d981257cca0c239b\": container with ID starting with b50961a254d7348bfe16f00b37f3375a933efb6ed05b6e81d981257cca0c239b not found: ID does not exist"
Jul 22 11:58:41.948912 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:41.948885    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-766c85d54-zr8t5"]
Jul 22 11:58:41.951436 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:41.951412    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-766c85d54-zr8t5"]
Jul 22 11:58:42.446673 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:58:42.446635    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e646067-4d98-47a5-b711-df32518dff2f" path="/var/lib/kubelet/pods/0e646067-4d98-47a5-b711-df32518dff2f/volumes"
Jul 22 11:59:02.223603 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:02.223568    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5ff8b9d49d-4k76b"]
Jul 22 11:59:02.224107 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:02.223930    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e646067-4d98-47a5-b711-df32518dff2f" containerName="manager"
Jul 22 11:59:02.224107 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:02.223941    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e646067-4d98-47a5-b711-df32518dff2f" containerName="manager"
Jul 22 11:59:02.224107 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:02.224010    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e646067-4d98-47a5-b711-df32518dff2f" containerName="manager"
Jul 22 11:59:02.228462 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:02.228441    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5ff8b9d49d-4k76b"
Jul 22 11:59:02.231121 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:02.231099    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wmkkt\""
Jul 22 11:59:02.231595 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:02.231578    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 22 11:59:02.247809 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:02.247790    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5ff8b9d49d-4k76b"]
Jul 22 11:59:02.319415 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:02.319379    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/727fba9e-71f0-45f1-a676-592c54e16659-maas-api-tls\") pod \"maas-api-5ff8b9d49d-4k76b\" (UID: \"727fba9e-71f0-45f1-a676-592c54e16659\") " pod="odh-ai-gateway-infra/maas-api-5ff8b9d49d-4k76b"
Jul 22 11:59:02.319600 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:02.319428    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tjw6\" (UniqueName: \"kubernetes.io/projected/727fba9e-71f0-45f1-a676-592c54e16659-kube-api-access-5tjw6\") pod \"maas-api-5ff8b9d49d-4k76b\" (UID: \"727fba9e-71f0-45f1-a676-592c54e16659\") " pod="odh-ai-gateway-infra/maas-api-5ff8b9d49d-4k76b"
Jul 22 11:59:02.319707 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:02.319601    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/727fba9e-71f0-45f1-a676-592c54e16659-openshift-service-ca\") pod \"maas-api-5ff8b9d49d-4k76b\" (UID: \"727fba9e-71f0-45f1-a676-592c54e16659\") " pod="odh-ai-gateway-infra/maas-api-5ff8b9d49d-4k76b"
Jul 22 11:59:02.420041 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:02.420000    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/727fba9e-71f0-45f1-a676-592c54e16659-openshift-service-ca\") pod \"maas-api-5ff8b9d49d-4k76b\" (UID: \"727fba9e-71f0-45f1-a676-592c54e16659\") " pod="odh-ai-gateway-infra/maas-api-5ff8b9d49d-4k76b"
Jul 22 11:59:02.420231 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:02.420049    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/727fba9e-71f0-45f1-a676-592c54e16659-maas-api-tls\") pod \"maas-api-5ff8b9d49d-4k76b\" (UID: \"727fba9e-71f0-45f1-a676-592c54e16659\") " pod="odh-ai-gateway-infra/maas-api-5ff8b9d49d-4k76b"
Jul 22 11:59:02.420231 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:02.420084    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tjw6\" (UniqueName: \"kubernetes.io/projected/727fba9e-71f0-45f1-a676-592c54e16659-kube-api-access-5tjw6\") pod \"maas-api-5ff8b9d49d-4k76b\" (UID: \"727fba9e-71f0-45f1-a676-592c54e16659\") " pod="odh-ai-gateway-infra/maas-api-5ff8b9d49d-4k76b"
Jul 22 11:59:02.420674 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:02.420641    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/727fba9e-71f0-45f1-a676-592c54e16659-openshift-service-ca\") pod \"maas-api-5ff8b9d49d-4k76b\" (UID: \"727fba9e-71f0-45f1-a676-592c54e16659\") " pod="odh-ai-gateway-infra/maas-api-5ff8b9d49d-4k76b"
Jul 22 11:59:02.422483 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:02.422457    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/727fba9e-71f0-45f1-a676-592c54e16659-maas-api-tls\") pod \"maas-api-5ff8b9d49d-4k76b\" (UID: \"727fba9e-71f0-45f1-a676-592c54e16659\") " pod="odh-ai-gateway-infra/maas-api-5ff8b9d49d-4k76b"
Jul 22 11:59:02.439950 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:02.439923    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tjw6\" (UniqueName: \"kubernetes.io/projected/727fba9e-71f0-45f1-a676-592c54e16659-kube-api-access-5tjw6\") pod \"maas-api-5ff8b9d49d-4k76b\" (UID: \"727fba9e-71f0-45f1-a676-592c54e16659\") " pod="odh-ai-gateway-infra/maas-api-5ff8b9d49d-4k76b"
Jul 22 11:59:02.538793 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:02.538717    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5ff8b9d49d-4k76b"
Jul 22 11:59:02.688509 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:02.688486    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5ff8b9d49d-4k76b"]
Jul 22 11:59:02.691060 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:59:02.691033    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod727fba9e_71f0_45f1_a676_592c54e16659.slice/crio-8827b7776e19c50b9fcbc76de686ba708e646e7d041f58bc77663e1034199790 WatchSource:0}: Error finding container 8827b7776e19c50b9fcbc76de686ba708e646e7d041f58bc77663e1034199790: Status 404 returned error can't find the container with id 8827b7776e19c50b9fcbc76de686ba708e646e7d041f58bc77663e1034199790
Jul 22 11:59:02.987579 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:02.987541    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-bdmqc"]
Jul 22 11:59:02.993859 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:02.993836    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-bdmqc"
Jul 22 11:59:02.997178 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:02.997151    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 22 11:59:02.997295 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:02.997246    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-g7hjt\""
Jul 22 11:59:03.010503 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:03.007831    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-bdmqc"]
Jul 22 11:59:03.016827 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:03.016792    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5ff8b9d49d-4k76b" event={"ID":"727fba9e-71f0-45f1-a676-592c54e16659","Type":"ContainerStarted","Data":"8827b7776e19c50b9fcbc76de686ba708e646e7d041f58bc77663e1034199790"}
Jul 22 11:59:03.024856 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:03.024830    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nngss\" (UniqueName: \"kubernetes.io/projected/a838aab7-dd17-4454-ad0f-c1b7f1b85371-kube-api-access-nngss\") pod \"payload-pre-processing-7677b774bb-bdmqc\" (UID: \"a838aab7-dd17-4454-ad0f-c1b7f1b85371\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-bdmqc"
Jul 22 11:59:03.024978 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:03.024888    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a838aab7-dd17-4454-ad0f-c1b7f1b85371-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-bdmqc\" (UID: \"a838aab7-dd17-4454-ad0f-c1b7f1b85371\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-bdmqc"
Jul 22 11:59:03.059673 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:03.059638    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-prd5q"]
Jul 22 11:59:03.063829 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:03.063812    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-prd5q"
Jul 22 11:59:03.082250 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:03.082224    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-prd5q"]
Jul 22 11:59:03.125545 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:03.125514    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nngss\" (UniqueName: \"kubernetes.io/projected/a838aab7-dd17-4454-ad0f-c1b7f1b85371-kube-api-access-nngss\") pod \"payload-pre-processing-7677b774bb-bdmqc\" (UID: \"a838aab7-dd17-4454-ad0f-c1b7f1b85371\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-bdmqc"
Jul 22 11:59:03.125709 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:03.125559    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c60c3a5f-a087-4d42-8b18-10f38213268c-plugins-config-volume\") pod \"payload-processing-5bf47cd988-prd5q\" (UID: \"c60c3a5f-a087-4d42-8b18-10f38213268c\") " pod="openshift-ingress/payload-processing-5bf47cd988-prd5q"
Jul 22 11:59:03.125709 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:03.125587    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a838aab7-dd17-4454-ad0f-c1b7f1b85371-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-bdmqc\" (UID: \"a838aab7-dd17-4454-ad0f-c1b7f1b85371\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-bdmqc"
Jul 22 11:59:03.125709 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:03.125610    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrdz6\" (UniqueName: \"kubernetes.io/projected/c60c3a5f-a087-4d42-8b18-10f38213268c-kube-api-access-vrdz6\") pod \"payload-processing-5bf47cd988-prd5q\" (UID: \"c60c3a5f-a087-4d42-8b18-10f38213268c\") " pod="openshift-ingress/payload-processing-5bf47cd988-prd5q"
Jul 22 11:59:03.126247 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:03.126227    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a838aab7-dd17-4454-ad0f-c1b7f1b85371-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-bdmqc\" (UID: \"a838aab7-dd17-4454-ad0f-c1b7f1b85371\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-bdmqc"
Jul 22 11:59:03.135819 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:03.135798    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nngss\" (UniqueName: \"kubernetes.io/projected/a838aab7-dd17-4454-ad0f-c1b7f1b85371-kube-api-access-nngss\") pod \"payload-pre-processing-7677b774bb-bdmqc\" (UID: \"a838aab7-dd17-4454-ad0f-c1b7f1b85371\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-bdmqc"
Jul 22 11:59:03.226239 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:03.226206    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c60c3a5f-a087-4d42-8b18-10f38213268c-plugins-config-volume\") pod \"payload-processing-5bf47cd988-prd5q\" (UID: \"c60c3a5f-a087-4d42-8b18-10f38213268c\") " pod="openshift-ingress/payload-processing-5bf47cd988-prd5q"
Jul 22 11:59:03.226653 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:03.226246    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrdz6\" (UniqueName: \"kubernetes.io/projected/c60c3a5f-a087-4d42-8b18-10f38213268c-kube-api-access-vrdz6\") pod \"payload-processing-5bf47cd988-prd5q\" (UID: \"c60c3a5f-a087-4d42-8b18-10f38213268c\") " pod="openshift-ingress/payload-processing-5bf47cd988-prd5q"
Jul 22 11:59:03.226976 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:03.226955    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c60c3a5f-a087-4d42-8b18-10f38213268c-plugins-config-volume\") pod \"payload-processing-5bf47cd988-prd5q\" (UID: \"c60c3a5f-a087-4d42-8b18-10f38213268c\") " pod="openshift-ingress/payload-processing-5bf47cd988-prd5q"
Jul 22 11:59:03.239904 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:03.239845    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrdz6\" (UniqueName: \"kubernetes.io/projected/c60c3a5f-a087-4d42-8b18-10f38213268c-kube-api-access-vrdz6\") pod \"payload-processing-5bf47cd988-prd5q\" (UID: \"c60c3a5f-a087-4d42-8b18-10f38213268c\") " pod="openshift-ingress/payload-processing-5bf47cd988-prd5q"
Jul 22 11:59:03.305343 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:03.305309    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-bdmqc"
Jul 22 11:59:03.374049 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:03.374012    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-prd5q"
Jul 22 11:59:03.481003 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:03.480974    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-bdmqc"]
Jul 22 11:59:03.486000 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:59:03.485964    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda838aab7_dd17_4454_ad0f_c1b7f1b85371.slice/crio-cfeb4dada8560cd29cd8cec76f0f84da142cea11050b44266c5824bd32703f21 WatchSource:0}: Error finding container cfeb4dada8560cd29cd8cec76f0f84da142cea11050b44266c5824bd32703f21: Status 404 returned error can't find the container with id cfeb4dada8560cd29cd8cec76f0f84da142cea11050b44266c5824bd32703f21
Jul 22 11:59:03.549828 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:03.549797    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-prd5q"]
Jul 22 11:59:03.551572 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:59:03.551545    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc60c3a5f_a087_4d42_8b18_10f38213268c.slice/crio-2a839faa6e974bdd6dc7b6a9d1e958ab04eb851a0b67a0d0f42c7c81a35f27f4 WatchSource:0}: Error finding container 2a839faa6e974bdd6dc7b6a9d1e958ab04eb851a0b67a0d0f42c7c81a35f27f4: Status 404 returned error can't find the container with id 2a839faa6e974bdd6dc7b6a9d1e958ab04eb851a0b67a0d0f42c7c81a35f27f4
Jul 22 11:59:04.025337 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:04.025303    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-prd5q" event={"ID":"c60c3a5f-a087-4d42-8b18-10f38213268c","Type":"ContainerStarted","Data":"2a839faa6e974bdd6dc7b6a9d1e958ab04eb851a0b67a0d0f42c7c81a35f27f4"}
Jul 22 11:59:04.026804 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:04.026773    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-bdmqc" event={"ID":"a838aab7-dd17-4454-ad0f-c1b7f1b85371","Type":"ContainerStarted","Data":"cfeb4dada8560cd29cd8cec76f0f84da142cea11050b44266c5824bd32703f21"}
Jul 22 11:59:05.035421 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:05.035344    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5ff8b9d49d-4k76b" event={"ID":"727fba9e-71f0-45f1-a676-592c54e16659","Type":"ContainerStarted","Data":"84853a7dc24b942bbeddb39931399843c64b318389a317a913b8081f72652630"}
Jul 22 11:59:05.035913 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:05.035648    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5ff8b9d49d-4k76b"
Jul 22 11:59:05.059825 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:05.059766    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5ff8b9d49d-4k76b" podStartSLOduration=1.585468171 podStartE2EDuration="3.059749546s" totalImagesPullingTime="1.474281375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:59:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:59:05.05898453 +0000 UTC m=+557.425499774" watchObservedRunningTime="2026-07-22 11:59:05.059749546 +0000 UTC m=+557.426264789"
Jul 22 11:59:06.041077 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:06.041039    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-prd5q" event={"ID":"c60c3a5f-a087-4d42-8b18-10f38213268c","Type":"ContainerStarted","Data":"d54c221c153b753ed9858d827e90570603f63680d16578a612a84a997f8f2638"}
Jul 22 11:59:06.041542 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:06.041208    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-prd5q"
Jul 22 11:59:06.042482 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:06.042459    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-bdmqc" event={"ID":"a838aab7-dd17-4454-ad0f-c1b7f1b85371","Type":"ContainerStarted","Data":"db059e1d0a7617e5279c411b06160c51b3fc354bc99dc729ed64e498c425e088"}
Jul 22 11:59:06.042598 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:06.042568    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-bdmqc"
Jul 22 11:59:06.061671 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:06.061603    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-prd5q" podStartSLOduration=1.0721772 podStartE2EDuration="3.061588489s" totalImagesPullingTime="1.989411289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:59:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:59:06.059727185 +0000 UTC m=+558.426242430" watchObservedRunningTime="2026-07-22 11:59:06.061588489 +0000 UTC m=+558.428103733"
Jul 22 11:59:06.078987 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:06.078935    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-bdmqc" podStartSLOduration=2.029921399 podStartE2EDuration="4.07891416s" totalImagesPullingTime="2.048992761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:59:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:59:06.076420648 +0000 UTC m=+558.442935893" watchObservedRunningTime="2026-07-22 11:59:06.07891416 +0000 UTC m=+558.445429408"
Jul 22 11:59:11.048389 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:11.048359    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5ff8b9d49d-4k76b"
Jul 22 11:59:17.049570 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:17.049540    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-prd5q"
Jul 22 11:59:17.050153 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:17.049607    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-bdmqc"
Jul 22 11:59:24.206919 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.206862    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"]
Jul 22 11:59:24.211090 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.211066    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"
Jul 22 11:59:24.214202 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.214177    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rx8m7\""
Jul 22 11:59:24.214339 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.214220    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 22 11:59:24.215278 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.215258    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 22 11:59:24.215525 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.215508    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 22 11:59:24.222284 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.222260    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"]
Jul 22 11:59:24.310646 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.310576    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c6257b6-2d47-4f1d-bb83-34a27a3d527a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hhjcf\" (UID: \"7c6257b6-2d47-4f1d-bb83-34a27a3d527a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"
Jul 22 11:59:24.310833 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.310710    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwlbq\" (UniqueName: \"kubernetes.io/projected/7c6257b6-2d47-4f1d-bb83-34a27a3d527a-kube-api-access-mwlbq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hhjcf\" (UID: \"7c6257b6-2d47-4f1d-bb83-34a27a3d527a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"
Jul 22 11:59:24.310833 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.310789    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c6257b6-2d47-4f1d-bb83-34a27a3d527a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hhjcf\" (UID: \"7c6257b6-2d47-4f1d-bb83-34a27a3d527a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"
Jul 22 11:59:24.310833 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.310816    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c6257b6-2d47-4f1d-bb83-34a27a3d527a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hhjcf\" (UID: \"7c6257b6-2d47-4f1d-bb83-34a27a3d527a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"
Jul 22 11:59:24.311013 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.310904    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c6257b6-2d47-4f1d-bb83-34a27a3d527a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hhjcf\" (UID: \"7c6257b6-2d47-4f1d-bb83-34a27a3d527a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"
Jul 22 11:59:24.311013 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.310930    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c6257b6-2d47-4f1d-bb83-34a27a3d527a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hhjcf\" (UID: \"7c6257b6-2d47-4f1d-bb83-34a27a3d527a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"
Jul 22 11:59:24.411776 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.411744    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c6257b6-2d47-4f1d-bb83-34a27a3d527a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hhjcf\" (UID: \"7c6257b6-2d47-4f1d-bb83-34a27a3d527a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"
Jul 22 11:59:24.411958 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.411783    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwlbq\" (UniqueName: \"kubernetes.io/projected/7c6257b6-2d47-4f1d-bb83-34a27a3d527a-kube-api-access-mwlbq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hhjcf\" (UID: \"7c6257b6-2d47-4f1d-bb83-34a27a3d527a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"
Jul 22 11:59:24.411958 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.411820    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c6257b6-2d47-4f1d-bb83-34a27a3d527a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hhjcf\" (UID: \"7c6257b6-2d47-4f1d-bb83-34a27a3d527a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"
Jul 22 11:59:24.411958 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.411835    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c6257b6-2d47-4f1d-bb83-34a27a3d527a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hhjcf\" (UID: \"7c6257b6-2d47-4f1d-bb83-34a27a3d527a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"
Jul 22 11:59:24.411958 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.411885    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c6257b6-2d47-4f1d-bb83-34a27a3d527a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hhjcf\" (UID: \"7c6257b6-2d47-4f1d-bb83-34a27a3d527a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"
Jul 22 11:59:24.411958 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.411904    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c6257b6-2d47-4f1d-bb83-34a27a3d527a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hhjcf\" (UID: \"7c6257b6-2d47-4f1d-bb83-34a27a3d527a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"
Jul 22 11:59:24.412239 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.412128    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c6257b6-2d47-4f1d-bb83-34a27a3d527a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hhjcf\" (UID: \"7c6257b6-2d47-4f1d-bb83-34a27a3d527a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"
Jul 22 11:59:24.412239 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.412195    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c6257b6-2d47-4f1d-bb83-34a27a3d527a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hhjcf\" (UID: \"7c6257b6-2d47-4f1d-bb83-34a27a3d527a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"
Jul 22 11:59:24.412239 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.412229    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c6257b6-2d47-4f1d-bb83-34a27a3d527a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hhjcf\" (UID: \"7c6257b6-2d47-4f1d-bb83-34a27a3d527a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"
Jul 22 11:59:24.414124 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.414092    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c6257b6-2d47-4f1d-bb83-34a27a3d527a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hhjcf\" (UID: \"7c6257b6-2d47-4f1d-bb83-34a27a3d527a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"
Jul 22 11:59:24.414243 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.414226    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c6257b6-2d47-4f1d-bb83-34a27a3d527a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hhjcf\" (UID: \"7c6257b6-2d47-4f1d-bb83-34a27a3d527a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"
Jul 22 11:59:24.421576 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.421555    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwlbq\" (UniqueName: \"kubernetes.io/projected/7c6257b6-2d47-4f1d-bb83-34a27a3d527a-kube-api-access-mwlbq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hhjcf\" (UID: \"7c6257b6-2d47-4f1d-bb83-34a27a3d527a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"
Jul 22 11:59:24.524915 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.524833    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"
Jul 22 11:59:24.672168 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:24.672131    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"]
Jul 22 11:59:24.674691 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:59:24.674662    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c6257b6_2d47_4f1d_bb83_34a27a3d527a.slice/crio-0ff6f2f8733d3749941e5e80183c2c11a2e4c992f93fbd347c3d88090dc3b6a1 WatchSource:0}: Error finding container 0ff6f2f8733d3749941e5e80183c2c11a2e4c992f93fbd347c3d88090dc3b6a1: Status 404 returned error can't find the container with id 0ff6f2f8733d3749941e5e80183c2c11a2e4c992f93fbd347c3d88090dc3b6a1
Jul 22 11:59:25.139455 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:25.139418    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf" event={"ID":"7c6257b6-2d47-4f1d-bb83-34a27a3d527a","Type":"ContainerStarted","Data":"0ff6f2f8733d3749941e5e80183c2c11a2e4c992f93fbd347c3d88090dc3b6a1"}
Jul 22 11:59:28.156348 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:28.156309    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf" event={"ID":"7c6257b6-2d47-4f1d-bb83-34a27a3d527a","Type":"ContainerStarted","Data":"b049e4e919c4c8fde6f126d91c33e8cdb875fad5ba452f0b9a21f2819b4a6935"}
Jul 22 11:59:28.184721 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:28.184600    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf" podStartSLOduration=0.94052705 podStartE2EDuration="4.184584679s" totalImagesPullingTime="3.244057629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:59:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:59:28.182352021 +0000 UTC m=+580.548867294" watchObservedRunningTime="2026-07-22 11:59:28.184584679 +0000 UTC m=+580.551099957"
Jul 22 11:59:34.525802 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:34.525749    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"
Jul 22 11:59:34.525802 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:34.525823    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"
Jul 22 11:59:34.538366 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:34.538338    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"
Jul 22 11:59:35.202486 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:35.202461    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hhjcf"
Jul 22 11:59:42.114806 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:42.114771    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"]
Jul 22 11:59:42.118503 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:42.118487    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"
Jul 22 11:59:42.122137 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:42.122118    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 22 11:59:42.136267 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:42.136245    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"]
Jul 22 11:59:42.277197 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:42.277164    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03cabd1e-21ba-4842-b384-3051fab66e1c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229\" (UID: \"03cabd1e-21ba-4842-b384-3051fab66e1c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"
Jul 22 11:59:42.277390 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:42.277204    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03cabd1e-21ba-4842-b384-3051fab66e1c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229\" (UID: \"03cabd1e-21ba-4842-b384-3051fab66e1c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"
Jul 22 11:59:42.277390 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:42.277243    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82rrx\" (UniqueName: \"kubernetes.io/projected/03cabd1e-21ba-4842-b384-3051fab66e1c-kube-api-access-82rrx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229\" (UID: \"03cabd1e-21ba-4842-b384-3051fab66e1c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"
Jul 22 11:59:42.277390 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:42.277309    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03cabd1e-21ba-4842-b384-3051fab66e1c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229\" (UID: \"03cabd1e-21ba-4842-b384-3051fab66e1c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"
Jul 22 11:59:42.277390 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:42.277349    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03cabd1e-21ba-4842-b384-3051fab66e1c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229\" (UID: \"03cabd1e-21ba-4842-b384-3051fab66e1c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"
Jul 22 11:59:42.277390 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:42.277387    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03cabd1e-21ba-4842-b384-3051fab66e1c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229\" (UID: \"03cabd1e-21ba-4842-b384-3051fab66e1c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"
Jul 22 11:59:42.378348 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:42.378261    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03cabd1e-21ba-4842-b384-3051fab66e1c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229\" (UID: \"03cabd1e-21ba-4842-b384-3051fab66e1c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"
Jul 22 11:59:42.378348 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:42.378323    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82rrx\" (UniqueName: \"kubernetes.io/projected/03cabd1e-21ba-4842-b384-3051fab66e1c-kube-api-access-82rrx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229\" (UID: \"03cabd1e-21ba-4842-b384-3051fab66e1c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"
Jul 22 11:59:42.378572 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:42.378371    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03cabd1e-21ba-4842-b384-3051fab66e1c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229\" (UID: \"03cabd1e-21ba-4842-b384-3051fab66e1c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"
Jul 22 11:59:42.378572 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:42.378419    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03cabd1e-21ba-4842-b384-3051fab66e1c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229\" (UID: \"03cabd1e-21ba-4842-b384-3051fab66e1c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"
Jul 22 11:59:42.378572 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:42.378450    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03cabd1e-21ba-4842-b384-3051fab66e1c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229\" (UID: \"03cabd1e-21ba-4842-b384-3051fab66e1c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"
Jul 22 11:59:42.378572 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:42.378527    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03cabd1e-21ba-4842-b384-3051fab66e1c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229\" (UID: \"03cabd1e-21ba-4842-b384-3051fab66e1c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"
Jul 22 11:59:42.378960 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:42.378925    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03cabd1e-21ba-4842-b384-3051fab66e1c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229\" (UID: \"03cabd1e-21ba-4842-b384-3051fab66e1c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"
Jul 22 11:59:42.379068 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:42.378990    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03cabd1e-21ba-4842-b384-3051fab66e1c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229\" (UID: \"03cabd1e-21ba-4842-b384-3051fab66e1c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"
Jul 22 11:59:42.379068 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:42.379027    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03cabd1e-21ba-4842-b384-3051fab66e1c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229\" (UID: \"03cabd1e-21ba-4842-b384-3051fab66e1c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"
Jul 22 11:59:42.380633 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:42.380598    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03cabd1e-21ba-4842-b384-3051fab66e1c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229\" (UID: \"03cabd1e-21ba-4842-b384-3051fab66e1c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"
Jul 22 11:59:42.380941 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:42.380923    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03cabd1e-21ba-4842-b384-3051fab66e1c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229\" (UID: \"03cabd1e-21ba-4842-b384-3051fab66e1c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"
Jul 22 11:59:42.390307 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:42.390284    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82rrx\" (UniqueName: \"kubernetes.io/projected/03cabd1e-21ba-4842-b384-3051fab66e1c-kube-api-access-82rrx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229\" (UID: \"03cabd1e-21ba-4842-b384-3051fab66e1c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"
Jul 22 11:59:42.428550 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:42.428524    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"
Jul 22 11:59:42.578678 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:42.578648    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"]
Jul 22 11:59:42.587560 ip-10-0-132-166 kubenswrapper[2558]: W0722 11:59:42.587536    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03cabd1e_21ba_4842_b384_3051fab66e1c.slice/crio-afe929aeb47ba4667ac76bbe9f77ca1ecca104c4a34bebd81c823e68b774e430 WatchSource:0}: Error finding container afe929aeb47ba4667ac76bbe9f77ca1ecca104c4a34bebd81c823e68b774e430: Status 404 returned error can't find the container with id afe929aeb47ba4667ac76bbe9f77ca1ecca104c4a34bebd81c823e68b774e430
Jul 22 11:59:43.227152 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:43.227114    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229" event={"ID":"03cabd1e-21ba-4842-b384-3051fab66e1c","Type":"ContainerStarted","Data":"afe929aeb47ba4667ac76bbe9f77ca1ecca104c4a34bebd81c823e68b774e430"}
Jul 22 11:59:44.233512 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:44.233479    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229" event={"ID":"03cabd1e-21ba-4842-b384-3051fab66e1c","Type":"ContainerStarted","Data":"d55d25116757320e67a7be2282a24e0d124449773aca40a31064e7bfa91b0553"}
Jul 22 11:59:44.259417 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:44.259369    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229" podStartSLOduration=1.204167619 podStartE2EDuration="2.259355667s" totalImagesPullingTime="1.055188048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:59:44.257448576 +0000 UTC m=+596.623963819" watchObservedRunningTime="2026-07-22 11:59:44.259355667 +0000 UTC m=+596.625870910"
Jul 22 11:59:52.429400 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:52.429365    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"
Jul 22 11:59:52.429986 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:52.429428    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"
Jul 22 11:59:52.447014 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:52.446992    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"
Jul 22 11:59:53.286054 ip-10-0-132-166 kubenswrapper[2558]: I0722 11:59:53.286024    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229"
Jul 22 12:01:39.790135 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:01:39.790050    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bbfbc5ddf-dlvt8"]
Jul 22 12:01:39.790727 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:01:39.790360    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-bbfbc5ddf-dlvt8" podUID="858d01a4-b725-4b4d-a66a-d33585753a90" containerName="manager" containerID="cri-o://72bd7cdc2f64f3f2486a3528b1229334dd3500e8ff7caa2b61e17605bc88a532" gracePeriod=30
Jul 22 12:01:40.041921 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:01:40.041864    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bbfbc5ddf-dlvt8"
Jul 22 12:01:40.192700 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:01:40.192663    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhv74\" (UniqueName: \"kubernetes.io/projected/858d01a4-b725-4b4d-a66a-d33585753a90-kube-api-access-dhv74\") pod \"858d01a4-b725-4b4d-a66a-d33585753a90\" (UID: \"858d01a4-b725-4b4d-a66a-d33585753a90\") "
Jul 22 12:01:40.192906 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:01:40.192769    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/858d01a4-b725-4b4d-a66a-d33585753a90-webhook-cert\") pod \"858d01a4-b725-4b4d-a66a-d33585753a90\" (UID: \"858d01a4-b725-4b4d-a66a-d33585753a90\") "
Jul 22 12:01:40.194854 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:01:40.194825    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/858d01a4-b725-4b4d-a66a-d33585753a90-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "858d01a4-b725-4b4d-a66a-d33585753a90" (UID: "858d01a4-b725-4b4d-a66a-d33585753a90"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:01:40.194976 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:01:40.194961    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/858d01a4-b725-4b4d-a66a-d33585753a90-kube-api-access-dhv74" (OuterVolumeSpecName: "kube-api-access-dhv74") pod "858d01a4-b725-4b4d-a66a-d33585753a90" (UID: "858d01a4-b725-4b4d-a66a-d33585753a90"). InnerVolumeSpecName "kube-api-access-dhv74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:01:40.293657 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:01:40.293544    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhv74\" (UniqueName: \"kubernetes.io/projected/858d01a4-b725-4b4d-a66a-d33585753a90-kube-api-access-dhv74\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:01:40.293657 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:01:40.293576    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/858d01a4-b725-4b4d-a66a-d33585753a90-webhook-cert\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:01:40.786849 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:01:40.786819    2558 generic.go:356] "Generic (PLEG): container finished" podID="858d01a4-b725-4b4d-a66a-d33585753a90" containerID="72bd7cdc2f64f3f2486a3528b1229334dd3500e8ff7caa2b61e17605bc88a532" exitCode=0
Jul 22 12:01:40.787031 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:01:40.786879    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bbfbc5ddf-dlvt8"
Jul 22 12:01:40.787031 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:01:40.786906    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bbfbc5ddf-dlvt8" event={"ID":"858d01a4-b725-4b4d-a66a-d33585753a90","Type":"ContainerDied","Data":"72bd7cdc2f64f3f2486a3528b1229334dd3500e8ff7caa2b61e17605bc88a532"}
Jul 22 12:01:40.787031 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:01:40.786961    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bbfbc5ddf-dlvt8" event={"ID":"858d01a4-b725-4b4d-a66a-d33585753a90","Type":"ContainerDied","Data":"3fe0ef0afde30a1c587e9a87d9eb3e2e2279729e9311d11f33ad71f0c8374af2"}
Jul 22 12:01:40.787031 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:01:40.786986    2558 scope.go:117] "RemoveContainer" containerID="72bd7cdc2f64f3f2486a3528b1229334dd3500e8ff7caa2b61e17605bc88a532"
Jul 22 12:01:40.795743 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:01:40.795537    2558 scope.go:117] "RemoveContainer" containerID="72bd7cdc2f64f3f2486a3528b1229334dd3500e8ff7caa2b61e17605bc88a532"
Jul 22 12:01:40.795958 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:01:40.795811    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72bd7cdc2f64f3f2486a3528b1229334dd3500e8ff7caa2b61e17605bc88a532\": container with ID starting with 72bd7cdc2f64f3f2486a3528b1229334dd3500e8ff7caa2b61e17605bc88a532 not found: ID does not exist" containerID="72bd7cdc2f64f3f2486a3528b1229334dd3500e8ff7caa2b61e17605bc88a532"
Jul 22 12:01:40.795958 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:01:40.795833    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72bd7cdc2f64f3f2486a3528b1229334dd3500e8ff7caa2b61e17605bc88a532"} err="failed to get container status \"72bd7cdc2f64f3f2486a3528b1229334dd3500e8ff7caa2b61e17605bc88a532\": rpc error: code = NotFound desc = could not find container \"72bd7cdc2f64f3f2486a3528b1229334dd3500e8ff7caa2b61e17605bc88a532\": container with ID starting with 72bd7cdc2f64f3f2486a3528b1229334dd3500e8ff7caa2b61e17605bc88a532 not found: ID does not exist"
Jul 22 12:01:40.818972 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:01:40.818940    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bbfbc5ddf-dlvt8"]
Jul 22 12:01:40.824283 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:01:40.824260    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bbfbc5ddf-dlvt8"]
Jul 22 12:01:42.447325 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:01:42.447294    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="858d01a4-b725-4b4d-a66a-d33585753a90" path="/var/lib/kubelet/pods/858d01a4-b725-4b4d-a66a-d33585753a90/volumes"
Jul 22 12:02:41.703895 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:02:41.703863    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bbfbc5ddf-5rtch"]
Jul 22 12:02:41.704340 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:02:41.704264    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="858d01a4-b725-4b4d-a66a-d33585753a90" containerName="manager"
Jul 22 12:02:41.704340 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:02:41.704275    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="858d01a4-b725-4b4d-a66a-d33585753a90" containerName="manager"
Jul 22 12:02:41.704340 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:02:41.704336    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="858d01a4-b725-4b4d-a66a-d33585753a90" containerName="manager"
Jul 22 12:02:41.707473 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:02:41.707457    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bbfbc5ddf-5rtch"
Jul 22 12:02:41.710754 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:02:41.710728    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 12:02:41.711999 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:02:41.711982    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 12:02:41.712102 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:02:41.712028    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xpzz9\""
Jul 22 12:02:41.720570 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:02:41.720544    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bbfbc5ddf-5rtch"]
Jul 22 12:02:41.755376 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:02:41.755341    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtr44\" (UniqueName: \"kubernetes.io/projected/3de77b73-7356-48d9-b4cd-5d557263b473-kube-api-access-xtr44\") pod \"maas-controller-bbfbc5ddf-5rtch\" (UID: \"3de77b73-7356-48d9-b4cd-5d557263b473\") " pod="opendatahub/maas-controller-bbfbc5ddf-5rtch"
Jul 22 12:02:41.755543 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:02:41.755411    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3de77b73-7356-48d9-b4cd-5d557263b473-webhook-cert\") pod \"maas-controller-bbfbc5ddf-5rtch\" (UID: \"3de77b73-7356-48d9-b4cd-5d557263b473\") " pod="opendatahub/maas-controller-bbfbc5ddf-5rtch"
Jul 22 12:02:41.856507 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:02:41.856471    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtr44\" (UniqueName: \"kubernetes.io/projected/3de77b73-7356-48d9-b4cd-5d557263b473-kube-api-access-xtr44\") pod \"maas-controller-bbfbc5ddf-5rtch\" (UID: \"3de77b73-7356-48d9-b4cd-5d557263b473\") " pod="opendatahub/maas-controller-bbfbc5ddf-5rtch"
Jul 22 12:02:41.856741 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:02:41.856528    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3de77b73-7356-48d9-b4cd-5d557263b473-webhook-cert\") pod \"maas-controller-bbfbc5ddf-5rtch\" (UID: \"3de77b73-7356-48d9-b4cd-5d557263b473\") " pod="opendatahub/maas-controller-bbfbc5ddf-5rtch"
Jul 22 12:02:41.859075 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:02:41.859049    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3de77b73-7356-48d9-b4cd-5d557263b473-webhook-cert\") pod \"maas-controller-bbfbc5ddf-5rtch\" (UID: \"3de77b73-7356-48d9-b4cd-5d557263b473\") " pod="opendatahub/maas-controller-bbfbc5ddf-5rtch"
Jul 22 12:02:41.872281 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:02:41.872257    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtr44\" (UniqueName: \"kubernetes.io/projected/3de77b73-7356-48d9-b4cd-5d557263b473-kube-api-access-xtr44\") pod \"maas-controller-bbfbc5ddf-5rtch\" (UID: \"3de77b73-7356-48d9-b4cd-5d557263b473\") " pod="opendatahub/maas-controller-bbfbc5ddf-5rtch"
Jul 22 12:02:42.019220 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:02:42.019124    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bbfbc5ddf-5rtch"
Jul 22 12:02:42.155868 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:02:42.155834    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bbfbc5ddf-5rtch"]
Jul 22 12:02:42.157541 ip-10-0-132-166 kubenswrapper[2558]: W0722 12:02:42.157516    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3de77b73_7356_48d9_b4cd_5d557263b473.slice/crio-8dabc348ce3c25444db7c5a1c418eb1b2a3902dd72f667c99799d7f7087050b0 WatchSource:0}: Error finding container 8dabc348ce3c25444db7c5a1c418eb1b2a3902dd72f667c99799d7f7087050b0: Status 404 returned error can't find the container with id 8dabc348ce3c25444db7c5a1c418eb1b2a3902dd72f667c99799d7f7087050b0
Jul 22 12:02:42.159263 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:02:42.159243    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 12:02:43.082748 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:02:43.082707    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bbfbc5ddf-5rtch" event={"ID":"3de77b73-7356-48d9-b4cd-5d557263b473","Type":"ContainerStarted","Data":"8dabc348ce3c25444db7c5a1c418eb1b2a3902dd72f667c99799d7f7087050b0"}
Jul 22 12:02:44.088582 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:02:44.088539    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bbfbc5ddf-5rtch" event={"ID":"3de77b73-7356-48d9-b4cd-5d557263b473","Type":"ContainerStarted","Data":"c7084b2914448d5989873e8247ddf02284b70f0101c8475267f67f82afda3aca"}
Jul 22 12:02:44.088979 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:02:44.088662    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bbfbc5ddf-5rtch"
Jul 22 12:02:44.109116 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:02:44.109059    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bbfbc5ddf-5rtch" podStartSLOduration=1.867883112 podStartE2EDuration="3.109043163s" totalImagesPullingTime="1.241160051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:02:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:02:44.108095403 +0000 UTC m=+776.474610677" watchObservedRunningTime="2026-07-22 12:02:44.109043163 +0000 UTC m=+776.475558407"
Jul 22 12:02:55.095429 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:02:55.095400    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bbfbc5ddf-5rtch"
Jul 22 12:02:59.888072 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:02:59.888037    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bbfbc5ddf-5rtch"]
Jul 22 12:02:59.888648 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:02:59.888249    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-bbfbc5ddf-5rtch" podUID="3de77b73-7356-48d9-b4cd-5d557263b473" containerName="manager" containerID="cri-o://c7084b2914448d5989873e8247ddf02284b70f0101c8475267f67f82afda3aca" gracePeriod=30
Jul 22 12:03:00.136186 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:00.136160    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bbfbc5ddf-5rtch"
Jul 22 12:03:00.170817 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:00.170729    2558 generic.go:356] "Generic (PLEG): container finished" podID="3de77b73-7356-48d9-b4cd-5d557263b473" containerID="c7084b2914448d5989873e8247ddf02284b70f0101c8475267f67f82afda3aca" exitCode=0
Jul 22 12:03:00.170817 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:00.170770    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bbfbc5ddf-5rtch"
Jul 22 12:03:00.171037 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:00.170808    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bbfbc5ddf-5rtch" event={"ID":"3de77b73-7356-48d9-b4cd-5d557263b473","Type":"ContainerDied","Data":"c7084b2914448d5989873e8247ddf02284b70f0101c8475267f67f82afda3aca"}
Jul 22 12:03:00.171037 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:00.170867    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bbfbc5ddf-5rtch" event={"ID":"3de77b73-7356-48d9-b4cd-5d557263b473","Type":"ContainerDied","Data":"8dabc348ce3c25444db7c5a1c418eb1b2a3902dd72f667c99799d7f7087050b0"}
Jul 22 12:03:00.171037 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:00.170897    2558 scope.go:117] "RemoveContainer" containerID="c7084b2914448d5989873e8247ddf02284b70f0101c8475267f67f82afda3aca"
Jul 22 12:03:00.180514 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:00.180493    2558 scope.go:117] "RemoveContainer" containerID="c7084b2914448d5989873e8247ddf02284b70f0101c8475267f67f82afda3aca"
Jul 22 12:03:00.180826 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:03:00.180799    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7084b2914448d5989873e8247ddf02284b70f0101c8475267f67f82afda3aca\": container with ID starting with c7084b2914448d5989873e8247ddf02284b70f0101c8475267f67f82afda3aca not found: ID does not exist" containerID="c7084b2914448d5989873e8247ddf02284b70f0101c8475267f67f82afda3aca"
Jul 22 12:03:00.180943 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:00.180840    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7084b2914448d5989873e8247ddf02284b70f0101c8475267f67f82afda3aca"} err="failed to get container status \"c7084b2914448d5989873e8247ddf02284b70f0101c8475267f67f82afda3aca\": rpc error: code = NotFound desc = could not find container \"c7084b2914448d5989873e8247ddf02284b70f0101c8475267f67f82afda3aca\": container with ID starting with c7084b2914448d5989873e8247ddf02284b70f0101c8475267f67f82afda3aca not found: ID does not exist"
Jul 22 12:03:00.233880 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:00.233839    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3de77b73-7356-48d9-b4cd-5d557263b473-webhook-cert\") pod \"3de77b73-7356-48d9-b4cd-5d557263b473\" (UID: \"3de77b73-7356-48d9-b4cd-5d557263b473\") "
Jul 22 12:03:00.234054 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:00.233906    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtr44\" (UniqueName: \"kubernetes.io/projected/3de77b73-7356-48d9-b4cd-5d557263b473-kube-api-access-xtr44\") pod \"3de77b73-7356-48d9-b4cd-5d557263b473\" (UID: \"3de77b73-7356-48d9-b4cd-5d557263b473\") "
Jul 22 12:03:00.236025 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:00.235987    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3de77b73-7356-48d9-b4cd-5d557263b473-kube-api-access-xtr44" (OuterVolumeSpecName: "kube-api-access-xtr44") pod "3de77b73-7356-48d9-b4cd-5d557263b473" (UID: "3de77b73-7356-48d9-b4cd-5d557263b473"). InnerVolumeSpecName "kube-api-access-xtr44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:03:00.236025 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:00.235994    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3de77b73-7356-48d9-b4cd-5d557263b473-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3de77b73-7356-48d9-b4cd-5d557263b473" (UID: "3de77b73-7356-48d9-b4cd-5d557263b473"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:03:00.335035 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:00.335002    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3de77b73-7356-48d9-b4cd-5d557263b473-webhook-cert\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:03:00.335035 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:00.335032    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtr44\" (UniqueName: \"kubernetes.io/projected/3de77b73-7356-48d9-b4cd-5d557263b473-kube-api-access-xtr44\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:03:00.490029 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:00.489993    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bbfbc5ddf-5rtch"]
Jul 22 12:03:00.498201 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:00.498172    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bbfbc5ddf-5rtch"]
Jul 22 12:03:01.698060 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:01.698025    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bbfbc5ddf-ctrjd"]
Jul 22 12:03:01.698488 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:01.698430    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3de77b73-7356-48d9-b4cd-5d557263b473" containerName="manager"
Jul 22 12:03:01.698488 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:01.698444    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3de77b73-7356-48d9-b4cd-5d557263b473" containerName="manager"
Jul 22 12:03:01.698601 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:01.698514    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3de77b73-7356-48d9-b4cd-5d557263b473" containerName="manager"
Jul 22 12:03:01.703132 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:01.703116    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bbfbc5ddf-ctrjd"
Jul 22 12:03:01.706175 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:01.706154    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 12:03:01.706312 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:01.706205    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xpzz9\""
Jul 22 12:03:01.707223 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:01.707207    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 12:03:01.731696 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:01.731665    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bbfbc5ddf-ctrjd"]
Jul 22 12:03:01.847548 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:01.847511    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0d17b02-39a5-4763-863d-fb2078a40d1d-webhook-cert\") pod \"maas-controller-bbfbc5ddf-ctrjd\" (UID: \"a0d17b02-39a5-4763-863d-fb2078a40d1d\") " pod="opendatahub/maas-controller-bbfbc5ddf-ctrjd"
Jul 22 12:03:01.847735 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:01.847595    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xfcq\" (UniqueName: \"kubernetes.io/projected/a0d17b02-39a5-4763-863d-fb2078a40d1d-kube-api-access-9xfcq\") pod \"maas-controller-bbfbc5ddf-ctrjd\" (UID: \"a0d17b02-39a5-4763-863d-fb2078a40d1d\") " pod="opendatahub/maas-controller-bbfbc5ddf-ctrjd"
Jul 22 12:03:01.948696 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:01.948578    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xfcq\" (UniqueName: \"kubernetes.io/projected/a0d17b02-39a5-4763-863d-fb2078a40d1d-kube-api-access-9xfcq\") pod \"maas-controller-bbfbc5ddf-ctrjd\" (UID: \"a0d17b02-39a5-4763-863d-fb2078a40d1d\") " pod="opendatahub/maas-controller-bbfbc5ddf-ctrjd"
Jul 22 12:03:01.948696 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:01.948696    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0d17b02-39a5-4763-863d-fb2078a40d1d-webhook-cert\") pod \"maas-controller-bbfbc5ddf-ctrjd\" (UID: \"a0d17b02-39a5-4763-863d-fb2078a40d1d\") " pod="opendatahub/maas-controller-bbfbc5ddf-ctrjd"
Jul 22 12:03:01.951081 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:01.951056    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0d17b02-39a5-4763-863d-fb2078a40d1d-webhook-cert\") pod \"maas-controller-bbfbc5ddf-ctrjd\" (UID: \"a0d17b02-39a5-4763-863d-fb2078a40d1d\") " pod="opendatahub/maas-controller-bbfbc5ddf-ctrjd"
Jul 22 12:03:01.965117 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:01.965095    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xfcq\" (UniqueName: \"kubernetes.io/projected/a0d17b02-39a5-4763-863d-fb2078a40d1d-kube-api-access-9xfcq\") pod \"maas-controller-bbfbc5ddf-ctrjd\" (UID: \"a0d17b02-39a5-4763-863d-fb2078a40d1d\") " pod="opendatahub/maas-controller-bbfbc5ddf-ctrjd"
Jul 22 12:03:02.013284 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:02.013254    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bbfbc5ddf-ctrjd"
Jul 22 12:03:02.153118 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:02.153090    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bbfbc5ddf-ctrjd"]
Jul 22 12:03:02.154035 ip-10-0-132-166 kubenswrapper[2558]: W0722 12:03:02.154007    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0d17b02_39a5_4763_863d_fb2078a40d1d.slice/crio-a3e67296638c6da0c792c6e471b63a14930cbb32f6b933f908073952ab67595d WatchSource:0}: Error finding container a3e67296638c6da0c792c6e471b63a14930cbb32f6b933f908073952ab67595d: Status 404 returned error can't find the container with id a3e67296638c6da0c792c6e471b63a14930cbb32f6b933f908073952ab67595d
Jul 22 12:03:02.183591 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:02.183563    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bbfbc5ddf-ctrjd" event={"ID":"a0d17b02-39a5-4763-863d-fb2078a40d1d","Type":"ContainerStarted","Data":"a3e67296638c6da0c792c6e471b63a14930cbb32f6b933f908073952ab67595d"}
Jul 22 12:03:02.448041 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:02.448006    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3de77b73-7356-48d9-b4cd-5d557263b473" path="/var/lib/kubelet/pods/3de77b73-7356-48d9-b4cd-5d557263b473/volumes"
Jul 22 12:03:04.194531 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:04.194494    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bbfbc5ddf-ctrjd" event={"ID":"a0d17b02-39a5-4763-863d-fb2078a40d1d","Type":"ContainerStarted","Data":"ee419ace355e744e71655492e141d7babcae809ef45fe28d37966e57f5574e79"}
Jul 22 12:03:04.194928 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:04.194644    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bbfbc5ddf-ctrjd"
Jul 22 12:03:04.227212 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:04.227152    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bbfbc5ddf-ctrjd" podStartSLOduration=1.910044132 podStartE2EDuration="3.227136593s" totalImagesPullingTime="1.317092461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:03:04.22605062 +0000 UTC m=+796.592565864" watchObservedRunningTime="2026-07-22 12:03:04.227136593 +0000 UTC m=+796.593651839"
Jul 22 12:03:15.202754 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:03:15.202725    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bbfbc5ddf-ctrjd"
Jul 22 12:11:42.404358 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:42.404323    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"]
Jul 22 12:11:42.407860 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:42.407840    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"
Jul 22 12:11:42.410374 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:42.410350    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-19e11e4d-kserve-self-signed-certs\""
Jul 22 12:11:42.426193 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:42.426166    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"]
Jul 22 12:11:42.545307 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:42.545271    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec2f8d34-1f3c-4964-8b7f-371099f56a25-tmp-dir\") pod \"e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql\" (UID: \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\") " pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"
Jul 22 12:11:42.545467 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:42.545317    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec2f8d34-1f3c-4964-8b7f-371099f56a25-tls-certs\") pod \"e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql\" (UID: \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\") " pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"
Jul 22 12:11:42.545467 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:42.545341    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec2f8d34-1f3c-4964-8b7f-371099f56a25-dshm\") pod \"e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql\" (UID: \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\") " pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"
Jul 22 12:11:42.545467 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:42.545397    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mndr\" (UniqueName: \"kubernetes.io/projected/ec2f8d34-1f3c-4964-8b7f-371099f56a25-kube-api-access-8mndr\") pod \"e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql\" (UID: \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\") " pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"
Jul 22 12:11:42.545467 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:42.545446    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec2f8d34-1f3c-4964-8b7f-371099f56a25-home\") pod \"e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql\" (UID: \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\") " pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"
Jul 22 12:11:42.545643 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:42.545482    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec2f8d34-1f3c-4964-8b7f-371099f56a25-model-cache\") pod \"e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql\" (UID: \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\") " pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"
Jul 22 12:11:42.646425 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:42.646395    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec2f8d34-1f3c-4964-8b7f-371099f56a25-tls-certs\") pod \"e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql\" (UID: \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\") " pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"
Jul 22 12:11:42.646598 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:42.646434    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec2f8d34-1f3c-4964-8b7f-371099f56a25-dshm\") pod \"e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql\" (UID: \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\") " pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"
Jul 22 12:11:42.646598 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:42.646486    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mndr\" (UniqueName: \"kubernetes.io/projected/ec2f8d34-1f3c-4964-8b7f-371099f56a25-kube-api-access-8mndr\") pod \"e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql\" (UID: \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\") " pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"
Jul 22 12:11:42.646598 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:42.646514    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec2f8d34-1f3c-4964-8b7f-371099f56a25-home\") pod \"e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql\" (UID: \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\") " pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"
Jul 22 12:11:42.646598 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:42.646543    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec2f8d34-1f3c-4964-8b7f-371099f56a25-model-cache\") pod \"e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql\" (UID: \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\") " pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"
Jul 22 12:11:42.646865 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:42.646602    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec2f8d34-1f3c-4964-8b7f-371099f56a25-tmp-dir\") pod \"e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql\" (UID: \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\") " pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"
Jul 22 12:11:42.647027 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:42.646998    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec2f8d34-1f3c-4964-8b7f-371099f56a25-tmp-dir\") pod \"e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql\" (UID: \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\") " pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"
Jul 22 12:11:42.647134 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:42.647027    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec2f8d34-1f3c-4964-8b7f-371099f56a25-model-cache\") pod \"e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql\" (UID: \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\") " pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"
Jul 22 12:11:42.647134 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:42.647079    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec2f8d34-1f3c-4964-8b7f-371099f56a25-home\") pod \"e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql\" (UID: \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\") " pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"
Jul 22 12:11:42.648766 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:42.648749    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec2f8d34-1f3c-4964-8b7f-371099f56a25-dshm\") pod \"e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql\" (UID: \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\") " pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"
Jul 22 12:11:42.648871 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:42.648854    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec2f8d34-1f3c-4964-8b7f-371099f56a25-tls-certs\") pod \"e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql\" (UID: \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\") " pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"
Jul 22 12:11:42.654922 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:42.654869    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mndr\" (UniqueName: \"kubernetes.io/projected/ec2f8d34-1f3c-4964-8b7f-371099f56a25-kube-api-access-8mndr\") pod \"e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql\" (UID: \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\") " pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"
Jul 22 12:11:42.717127 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:42.717096    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"
Jul 22 12:11:42.855751 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:42.855720    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"]
Jul 22 12:11:42.857174 ip-10-0-132-166 kubenswrapper[2558]: W0722 12:11:42.857148    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec2f8d34_1f3c_4964_8b7f_371099f56a25.slice/crio-b25b87085d4c050a8d28b64aded1cefd9fed8cdc4091c99455762ea78ab6fbaa WatchSource:0}: Error finding container b25b87085d4c050a8d28b64aded1cefd9fed8cdc4091c99455762ea78ab6fbaa: Status 404 returned error can't find the container with id b25b87085d4c050a8d28b64aded1cefd9fed8cdc4091c99455762ea78ab6fbaa
Jul 22 12:11:43.690766 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:43.690718    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql" event={"ID":"ec2f8d34-1f3c-4964-8b7f-371099f56a25","Type":"ContainerStarted","Data":"a5d9143a8e7ac3b129595da27286cb5223b4af592fc1fcfb84b94db084aa0251"}
Jul 22 12:11:43.691216 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:43.690772    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql" event={"ID":"ec2f8d34-1f3c-4964-8b7f-371099f56a25","Type":"ContainerStarted","Data":"b25b87085d4c050a8d28b64aded1cefd9fed8cdc4091c99455762ea78ab6fbaa"}
Jul 22 12:11:43.709531 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:43.709464    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql" podStartSLOduration=1.7094502390000001 podStartE2EDuration="1.709450239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:11:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:11:43.708408618 +0000 UTC m=+1316.074923863" watchObservedRunningTime="2026-07-22 12:11:43.709450239 +0000 UTC m=+1316.075965483"
Jul 22 12:11:52.717430 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:52.717322    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"
Jul 22 12:11:52.717430 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:52.717393    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"
Jul 22 12:11:52.730418 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:52.730389    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"
Jul 22 12:11:52.745611 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:11:52.745586    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"
Jul 22 12:12:00.408227 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:00.408191    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"]
Jul 22 12:12:00.411910 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:00.411894    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"
Jul 22 12:12:00.414453 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:00.414427    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-19e11e4d-kserve-self-signed-certs\""
Jul 22 12:12:00.420089 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:00.420064    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"]
Jul 22 12:12:00.517134 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:00.517099    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43cfe73a-80e6-441d-9c6e-4763775322a2-home\") pod \"e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v\" (UID: \"43cfe73a-80e6-441d-9c6e-4763775322a2\") " pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"
Jul 22 12:12:00.517299 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:00.517141    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfgbj\" (UniqueName: \"kubernetes.io/projected/43cfe73a-80e6-441d-9c6e-4763775322a2-kube-api-access-rfgbj\") pod \"e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v\" (UID: \"43cfe73a-80e6-441d-9c6e-4763775322a2\") " pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"
Jul 22 12:12:00.517299 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:00.517161    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43cfe73a-80e6-441d-9c6e-4763775322a2-tls-certs\") pod \"e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v\" (UID: \"43cfe73a-80e6-441d-9c6e-4763775322a2\") " pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"
Jul 22 12:12:00.517299 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:00.517230    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43cfe73a-80e6-441d-9c6e-4763775322a2-dshm\") pod \"e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v\" (UID: \"43cfe73a-80e6-441d-9c6e-4763775322a2\") " pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"
Jul 22 12:12:00.517511 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:00.517483    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43cfe73a-80e6-441d-9c6e-4763775322a2-model-cache\") pod \"e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v\" (UID: \"43cfe73a-80e6-441d-9c6e-4763775322a2\") " pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"
Jul 22 12:12:00.517577 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:00.517564    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43cfe73a-80e6-441d-9c6e-4763775322a2-tmp-dir\") pod \"e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v\" (UID: \"43cfe73a-80e6-441d-9c6e-4763775322a2\") " pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"
Jul 22 12:12:00.618871 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:00.618835    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43cfe73a-80e6-441d-9c6e-4763775322a2-model-cache\") pod \"e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v\" (UID: \"43cfe73a-80e6-441d-9c6e-4763775322a2\") " pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"
Jul 22 12:12:00.618871 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:00.618872    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43cfe73a-80e6-441d-9c6e-4763775322a2-tmp-dir\") pod \"e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v\" (UID: \"43cfe73a-80e6-441d-9c6e-4763775322a2\") " pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"
Jul 22 12:12:00.619105 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:00.618910    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43cfe73a-80e6-441d-9c6e-4763775322a2-home\") pod \"e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v\" (UID: \"43cfe73a-80e6-441d-9c6e-4763775322a2\") " pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"
Jul 22 12:12:00.619105 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:00.618946    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfgbj\" (UniqueName: \"kubernetes.io/projected/43cfe73a-80e6-441d-9c6e-4763775322a2-kube-api-access-rfgbj\") pod \"e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v\" (UID: \"43cfe73a-80e6-441d-9c6e-4763775322a2\") " pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"
Jul 22 12:12:00.619105 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:00.618976    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43cfe73a-80e6-441d-9c6e-4763775322a2-tls-certs\") pod \"e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v\" (UID: \"43cfe73a-80e6-441d-9c6e-4763775322a2\") " pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"
Jul 22 12:12:00.619105 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:00.619004    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43cfe73a-80e6-441d-9c6e-4763775322a2-dshm\") pod \"e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v\" (UID: \"43cfe73a-80e6-441d-9c6e-4763775322a2\") " pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"
Jul 22 12:12:00.619295 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:00.619241    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43cfe73a-80e6-441d-9c6e-4763775322a2-model-cache\") pod \"e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v\" (UID: \"43cfe73a-80e6-441d-9c6e-4763775322a2\") " pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"
Jul 22 12:12:00.619343 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:00.619299    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43cfe73a-80e6-441d-9c6e-4763775322a2-tmp-dir\") pod \"e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v\" (UID: \"43cfe73a-80e6-441d-9c6e-4763775322a2\") " pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"
Jul 22 12:12:00.619378 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:00.619352    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43cfe73a-80e6-441d-9c6e-4763775322a2-home\") pod \"e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v\" (UID: \"43cfe73a-80e6-441d-9c6e-4763775322a2\") " pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"
Jul 22 12:12:00.621236 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:00.621216    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43cfe73a-80e6-441d-9c6e-4763775322a2-dshm\") pod \"e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v\" (UID: \"43cfe73a-80e6-441d-9c6e-4763775322a2\") " pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"
Jul 22 12:12:00.621501 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:00.621482    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43cfe73a-80e6-441d-9c6e-4763775322a2-tls-certs\") pod \"e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v\" (UID: \"43cfe73a-80e6-441d-9c6e-4763775322a2\") " pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"
Jul 22 12:12:00.627658 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:00.627637    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfgbj\" (UniqueName: \"kubernetes.io/projected/43cfe73a-80e6-441d-9c6e-4763775322a2-kube-api-access-rfgbj\") pod \"e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v\" (UID: \"43cfe73a-80e6-441d-9c6e-4763775322a2\") " pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"
Jul 22 12:12:00.723107 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:00.723027    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"
Jul 22 12:12:00.859466 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:00.859437    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"]
Jul 22 12:12:00.861199 ip-10-0-132-166 kubenswrapper[2558]: W0722 12:12:00.861170    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43cfe73a_80e6_441d_9c6e_4763775322a2.slice/crio-7daaeb60546d0bf3ba20723cb3d46831ab4e66f83ab4ccacf859382bd5103bfd WatchSource:0}: Error finding container 7daaeb60546d0bf3ba20723cb3d46831ab4e66f83ab4ccacf859382bd5103bfd: Status 404 returned error can't find the container with id 7daaeb60546d0bf3ba20723cb3d46831ab4e66f83ab4ccacf859382bd5103bfd
Jul 22 12:12:01.778044 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:01.778004    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v" event={"ID":"43cfe73a-80e6-441d-9c6e-4763775322a2","Type":"ContainerStarted","Data":"af8648e0e6a945ca4f433dc1a17432a1b3faef46343ab521a66932d45d669748"}
Jul 22 12:12:01.778044 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:01.778047    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v" event={"ID":"43cfe73a-80e6-441d-9c6e-4763775322a2","Type":"ContainerStarted","Data":"7daaeb60546d0bf3ba20723cb3d46831ab4e66f83ab4ccacf859382bd5103bfd"}
Jul 22 12:12:01.798313 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:01.798238    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v" podStartSLOduration=1.798220282 podStartE2EDuration="1.798220282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:12:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:12:01.797826742 +0000 UTC m=+1334.164342005" watchObservedRunningTime="2026-07-22 12:12:01.798220282 +0000 UTC m=+1334.164735526"
Jul 22 12:12:10.723725 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:10.723687    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"
Jul 22 12:12:10.724213 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:10.724006    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"
Jul 22 12:12:10.736402 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:10.736380    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"
Jul 22 12:12:10.834133 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:10.834103    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"
Jul 22 12:12:33.312469 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:33.312425    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"]
Jul 22 12:12:34.334519 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:34.334479    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"]
Jul 22 12:12:48.333112 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:48.333063    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql" podUID="ec2f8d34-1f3c-4964-8b7f-371099f56a25" containerName="main" containerID="cri-o://a5d9143a8e7ac3b129595da27286cb5223b4af592fc1fcfb84b94db084aa0251" gracePeriod=45
Jul 22 12:12:48.593919 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:48.593866    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"
Jul 22 12:12:48.683748 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:48.683717    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec2f8d34-1f3c-4964-8b7f-371099f56a25-tls-certs\") pod \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\" (UID: \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\") "
Jul 22 12:12:48.683918 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:48.683757    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec2f8d34-1f3c-4964-8b7f-371099f56a25-home\") pod \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\" (UID: \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\") "
Jul 22 12:12:48.683918 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:48.683796    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mndr\" (UniqueName: \"kubernetes.io/projected/ec2f8d34-1f3c-4964-8b7f-371099f56a25-kube-api-access-8mndr\") pod \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\" (UID: \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\") "
Jul 22 12:12:48.683918 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:48.683818    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec2f8d34-1f3c-4964-8b7f-371099f56a25-tmp-dir\") pod \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\" (UID: \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\") "
Jul 22 12:12:48.684065 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:48.683983    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec2f8d34-1f3c-4964-8b7f-371099f56a25-model-cache\") pod \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\" (UID: \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\") "
Jul 22 12:12:48.684065 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:48.684033    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec2f8d34-1f3c-4964-8b7f-371099f56a25-dshm\") pod \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\" (UID: \"ec2f8d34-1f3c-4964-8b7f-371099f56a25\") "
Jul 22 12:12:48.684160 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:48.684087    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec2f8d34-1f3c-4964-8b7f-371099f56a25-home" (OuterVolumeSpecName: "home") pod "ec2f8d34-1f3c-4964-8b7f-371099f56a25" (UID: "ec2f8d34-1f3c-4964-8b7f-371099f56a25"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:12:48.684160 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:48.684095    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec2f8d34-1f3c-4964-8b7f-371099f56a25-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ec2f8d34-1f3c-4964-8b7f-371099f56a25" (UID: "ec2f8d34-1f3c-4964-8b7f-371099f56a25"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:12:48.684244 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:48.684202    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec2f8d34-1f3c-4964-8b7f-371099f56a25-model-cache" (OuterVolumeSpecName: "model-cache") pod "ec2f8d34-1f3c-4964-8b7f-371099f56a25" (UID: "ec2f8d34-1f3c-4964-8b7f-371099f56a25"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:12:48.684421 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:48.684401    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec2f8d34-1f3c-4964-8b7f-371099f56a25-tmp-dir\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:12:48.684421 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:48.684421    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec2f8d34-1f3c-4964-8b7f-371099f56a25-model-cache\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:12:48.684547 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:48.684429    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec2f8d34-1f3c-4964-8b7f-371099f56a25-home\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:12:48.686052 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:48.686026    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec2f8d34-1f3c-4964-8b7f-371099f56a25-kube-api-access-8mndr" (OuterVolumeSpecName: "kube-api-access-8mndr") pod "ec2f8d34-1f3c-4964-8b7f-371099f56a25" (UID: "ec2f8d34-1f3c-4964-8b7f-371099f56a25"). InnerVolumeSpecName "kube-api-access-8mndr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:12:48.686199 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:48.686074    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec2f8d34-1f3c-4964-8b7f-371099f56a25-dshm" (OuterVolumeSpecName: "dshm") pod "ec2f8d34-1f3c-4964-8b7f-371099f56a25" (UID: "ec2f8d34-1f3c-4964-8b7f-371099f56a25"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:12:48.686199 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:48.686112    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec2f8d34-1f3c-4964-8b7f-371099f56a25-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ec2f8d34-1f3c-4964-8b7f-371099f56a25" (UID: "ec2f8d34-1f3c-4964-8b7f-371099f56a25"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:12:48.785790 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:48.785753    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec2f8d34-1f3c-4964-8b7f-371099f56a25-dshm\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:12:48.785790 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:48.785782    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec2f8d34-1f3c-4964-8b7f-371099f56a25-tls-certs\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:12:48.785790 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:48.785796    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mndr\" (UniqueName: \"kubernetes.io/projected/ec2f8d34-1f3c-4964-8b7f-371099f56a25-kube-api-access-8mndr\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:12:49.035968 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.035926    2558 generic.go:356] "Generic (PLEG): container finished" podID="ec2f8d34-1f3c-4964-8b7f-371099f56a25" containerID="a5d9143a8e7ac3b129595da27286cb5223b4af592fc1fcfb84b94db084aa0251" exitCode=0
Jul 22 12:12:49.036138 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.035975    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"
Jul 22 12:12:49.036138 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.036015    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql" event={"ID":"ec2f8d34-1f3c-4964-8b7f-371099f56a25","Type":"ContainerDied","Data":"a5d9143a8e7ac3b129595da27286cb5223b4af592fc1fcfb84b94db084aa0251"}
Jul 22 12:12:49.036138 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.036060    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql" event={"ID":"ec2f8d34-1f3c-4964-8b7f-371099f56a25","Type":"ContainerDied","Data":"b25b87085d4c050a8d28b64aded1cefd9fed8cdc4091c99455762ea78ab6fbaa"}
Jul 22 12:12:49.036138 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.036082    2558 scope.go:117] "RemoveContainer" containerID="a5d9143a8e7ac3b129595da27286cb5223b4af592fc1fcfb84b94db084aa0251"
Jul 22 12:12:49.045178 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.045161    2558 scope.go:117] "RemoveContainer" containerID="a5d9143a8e7ac3b129595da27286cb5223b4af592fc1fcfb84b94db084aa0251"
Jul 22 12:12:49.045385 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:12:49.045368    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5d9143a8e7ac3b129595da27286cb5223b4af592fc1fcfb84b94db084aa0251\": container with ID starting with a5d9143a8e7ac3b129595da27286cb5223b4af592fc1fcfb84b94db084aa0251 not found: ID does not exist" containerID="a5d9143a8e7ac3b129595da27286cb5223b4af592fc1fcfb84b94db084aa0251"
Jul 22 12:12:49.045439 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.045393    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5d9143a8e7ac3b129595da27286cb5223b4af592fc1fcfb84b94db084aa0251"} err="failed to get container status \"a5d9143a8e7ac3b129595da27286cb5223b4af592fc1fcfb84b94db084aa0251\": rpc error: code = NotFound desc = could not find container \"a5d9143a8e7ac3b129595da27286cb5223b4af592fc1fcfb84b94db084aa0251\": container with ID starting with a5d9143a8e7ac3b129595da27286cb5223b4af592fc1fcfb84b94db084aa0251 not found: ID does not exist"
Jul 22 12:12:49.058892 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.058869    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"]
Jul 22 12:12:49.063582 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.063561    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-19e11e4d-kserve-6464b6f455-xfzql"]
Jul 22 12:12:49.355306 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.355220    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v" podUID="43cfe73a-80e6-441d-9c6e-4763775322a2" containerName="main" containerID="cri-o://af8648e0e6a945ca4f433dc1a17432a1b3faef46343ab521a66932d45d669748" gracePeriod=45
Jul 22 12:12:49.609054 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.609002    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"
Jul 22 12:12:49.694388 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.694354    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43cfe73a-80e6-441d-9c6e-4763775322a2-tls-certs\") pod \"43cfe73a-80e6-441d-9c6e-4763775322a2\" (UID: \"43cfe73a-80e6-441d-9c6e-4763775322a2\") "
Jul 22 12:12:49.694569 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.694421    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43cfe73a-80e6-441d-9c6e-4763775322a2-dshm\") pod \"43cfe73a-80e6-441d-9c6e-4763775322a2\" (UID: \"43cfe73a-80e6-441d-9c6e-4763775322a2\") "
Jul 22 12:12:49.694569 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.694482    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43cfe73a-80e6-441d-9c6e-4763775322a2-model-cache\") pod \"43cfe73a-80e6-441d-9c6e-4763775322a2\" (UID: \"43cfe73a-80e6-441d-9c6e-4763775322a2\") "
Jul 22 12:12:49.694569 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.694530    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfgbj\" (UniqueName: \"kubernetes.io/projected/43cfe73a-80e6-441d-9c6e-4763775322a2-kube-api-access-rfgbj\") pod \"43cfe73a-80e6-441d-9c6e-4763775322a2\" (UID: \"43cfe73a-80e6-441d-9c6e-4763775322a2\") "
Jul 22 12:12:49.694808 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.694604    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43cfe73a-80e6-441d-9c6e-4763775322a2-home\") pod \"43cfe73a-80e6-441d-9c6e-4763775322a2\" (UID: \"43cfe73a-80e6-441d-9c6e-4763775322a2\") "
Jul 22 12:12:49.694808 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.694659    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43cfe73a-80e6-441d-9c6e-4763775322a2-tmp-dir\") pod \"43cfe73a-80e6-441d-9c6e-4763775322a2\" (UID: \"43cfe73a-80e6-441d-9c6e-4763775322a2\") "
Jul 22 12:12:49.694808 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.694760    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43cfe73a-80e6-441d-9c6e-4763775322a2-model-cache" (OuterVolumeSpecName: "model-cache") pod "43cfe73a-80e6-441d-9c6e-4763775322a2" (UID: "43cfe73a-80e6-441d-9c6e-4763775322a2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:12:49.694955 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.694888    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43cfe73a-80e6-441d-9c6e-4763775322a2-home" (OuterVolumeSpecName: "home") pod "43cfe73a-80e6-441d-9c6e-4763775322a2" (UID: "43cfe73a-80e6-441d-9c6e-4763775322a2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:12:49.695026 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.694979    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43cfe73a-80e6-441d-9c6e-4763775322a2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "43cfe73a-80e6-441d-9c6e-4763775322a2" (UID: "43cfe73a-80e6-441d-9c6e-4763775322a2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:12:49.695079 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.695067    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43cfe73a-80e6-441d-9c6e-4763775322a2-model-cache\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:12:49.695129 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.695082    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43cfe73a-80e6-441d-9c6e-4763775322a2-home\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:12:49.695129 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.695091    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43cfe73a-80e6-441d-9c6e-4763775322a2-tmp-dir\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:12:49.696526 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.696504    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43cfe73a-80e6-441d-9c6e-4763775322a2-dshm" (OuterVolumeSpecName: "dshm") pod "43cfe73a-80e6-441d-9c6e-4763775322a2" (UID: "43cfe73a-80e6-441d-9c6e-4763775322a2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:12:49.696634 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.696534    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43cfe73a-80e6-441d-9c6e-4763775322a2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "43cfe73a-80e6-441d-9c6e-4763775322a2" (UID: "43cfe73a-80e6-441d-9c6e-4763775322a2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:12:49.696688 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.696631    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43cfe73a-80e6-441d-9c6e-4763775322a2-kube-api-access-rfgbj" (OuterVolumeSpecName: "kube-api-access-rfgbj") pod "43cfe73a-80e6-441d-9c6e-4763775322a2" (UID: "43cfe73a-80e6-441d-9c6e-4763775322a2"). InnerVolumeSpecName "kube-api-access-rfgbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:12:49.796116 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.796079    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43cfe73a-80e6-441d-9c6e-4763775322a2-tls-certs\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:12:49.796116 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.796110    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43cfe73a-80e6-441d-9c6e-4763775322a2-dshm\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:12:49.796116 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:49.796119    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfgbj\" (UniqueName: \"kubernetes.io/projected/43cfe73a-80e6-441d-9c6e-4763775322a2-kube-api-access-rfgbj\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:12:50.041862 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:50.041826    2558 generic.go:356] "Generic (PLEG): container finished" podID="43cfe73a-80e6-441d-9c6e-4763775322a2" containerID="af8648e0e6a945ca4f433dc1a17432a1b3faef46343ab521a66932d45d669748" exitCode=0
Jul 22 12:12:50.042048 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:50.041868    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"
Jul 22 12:12:50.042048 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:50.041905    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v" event={"ID":"43cfe73a-80e6-441d-9c6e-4763775322a2","Type":"ContainerDied","Data":"af8648e0e6a945ca4f433dc1a17432a1b3faef46343ab521a66932d45d669748"}
Jul 22 12:12:50.042048 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:50.041950    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v" event={"ID":"43cfe73a-80e6-441d-9c6e-4763775322a2","Type":"ContainerDied","Data":"7daaeb60546d0bf3ba20723cb3d46831ab4e66f83ab4ccacf859382bd5103bfd"}
Jul 22 12:12:50.042048 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:50.042028    2558 scope.go:117] "RemoveContainer" containerID="af8648e0e6a945ca4f433dc1a17432a1b3faef46343ab521a66932d45d669748"
Jul 22 12:12:50.050761 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:50.050742    2558 scope.go:117] "RemoveContainer" containerID="af8648e0e6a945ca4f433dc1a17432a1b3faef46343ab521a66932d45d669748"
Jul 22 12:12:50.051013 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:12:50.050993    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af8648e0e6a945ca4f433dc1a17432a1b3faef46343ab521a66932d45d669748\": container with ID starting with af8648e0e6a945ca4f433dc1a17432a1b3faef46343ab521a66932d45d669748 not found: ID does not exist" containerID="af8648e0e6a945ca4f433dc1a17432a1b3faef46343ab521a66932d45d669748"
Jul 22 12:12:50.051075 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:50.051026    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af8648e0e6a945ca4f433dc1a17432a1b3faef46343ab521a66932d45d669748"} err="failed to get container status \"af8648e0e6a945ca4f433dc1a17432a1b3faef46343ab521a66932d45d669748\": rpc error: code = NotFound desc = could not find container \"af8648e0e6a945ca4f433dc1a17432a1b3faef46343ab521a66932d45d669748\": container with ID starting with af8648e0e6a945ca4f433dc1a17432a1b3faef46343ab521a66932d45d669748 not found: ID does not exist"
Jul 22 12:12:50.067391 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:50.067366    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"]
Jul 22 12:12:50.069113 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:50.069092    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-19e11e4d-kserve-85d9975fcf-m667v"]
Jul 22 12:12:50.446842 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:50.446808    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43cfe73a-80e6-441d-9c6e-4763775322a2" path="/var/lib/kubelet/pods/43cfe73a-80e6-441d-9c6e-4763775322a2/volumes"
Jul 22 12:12:50.447246 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:12:50.447206    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec2f8d34-1f3c-4964-8b7f-371099f56a25" path="/var/lib/kubelet/pods/ec2f8d34-1f3c-4964-8b7f-371099f56a25/volumes"
Jul 22 12:15:00.138456 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:15:00.138414    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745375-476ts"]
Jul 22 12:15:00.138955 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:15:00.138877    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec2f8d34-1f3c-4964-8b7f-371099f56a25" containerName="main"
Jul 22 12:15:00.138955 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:15:00.138889    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec2f8d34-1f3c-4964-8b7f-371099f56a25" containerName="main"
Jul 22 12:15:00.138955 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:15:00.138901    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43cfe73a-80e6-441d-9c6e-4763775322a2" containerName="main"
Jul 22 12:15:00.138955 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:15:00.138909    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="43cfe73a-80e6-441d-9c6e-4763775322a2" containerName="main"
Jul 22 12:15:00.139088 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:15:00.138987    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec2f8d34-1f3c-4964-8b7f-371099f56a25" containerName="main"
Jul 22 12:15:00.139088 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:15:00.138996    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="43cfe73a-80e6-441d-9c6e-4763775322a2" containerName="main"
Jul 22 12:15:00.141711 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:15:00.141690    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745375-476ts"
Jul 22 12:15:00.144204 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:15:00.144181    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7kmhv\""
Jul 22 12:15:00.151205 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:15:00.151190    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745375-476ts"
Jul 22 12:15:00.160259 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:15:00.160237    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745375-476ts"]
Jul 22 12:15:00.297327 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:15:00.297286    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745375-476ts"]
Jul 22 12:15:00.300658 ip-10-0-132-166 kubenswrapper[2558]: W0722 12:15:00.300631    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18e8ad12_688a_4a73_b34b_ce9bef2e6219.slice/crio-5b3f98d17b884287b84e5aad135b50d687a2e9c9b43d26c6eb5ae4b2ad0065c8 WatchSource:0}: Error finding container 5b3f98d17b884287b84e5aad135b50d687a2e9c9b43d26c6eb5ae4b2ad0065c8: Status 404 returned error can't find the container with id 5b3f98d17b884287b84e5aad135b50d687a2e9c9b43d26c6eb5ae4b2ad0065c8
Jul 22 12:15:00.302431 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:15:00.302414    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 12:15:00.672535 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:15:00.672502    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745375-476ts" event={"ID":"18e8ad12-688a-4a73-b34b-ce9bef2e6219","Type":"ContainerStarted","Data":"5b3f98d17b884287b84e5aad135b50d687a2e9c9b43d26c6eb5ae4b2ad0065c8"}
Jul 22 12:15:02.690283 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:15:02.690242    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745375-476ts" event={"ID":"18e8ad12-688a-4a73-b34b-ce9bef2e6219","Type":"ContainerStarted","Data":"08ecf6ed1fa94fb2b30b7a7b019c83879f2784d8be25902f678ee50169c3e945"}
Jul 22 12:15:02.709966 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:15:02.709909    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745375-476ts" podStartSLOduration=0.657825598 podStartE2EDuration="2.709894313s" totalImagesPullingTime="2.052068715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:15:02.70821754 +0000 UTC m=+1515.074732776" watchObservedRunningTime="2026-07-22 12:15:02.709894313 +0000 UTC m=+1515.076409557"
Jul 22 12:15:03.696231 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:15:03.696198    2558 generic.go:356] "Generic (PLEG): container finished" podID="18e8ad12-688a-4a73-b34b-ce9bef2e6219" containerID="08ecf6ed1fa94fb2b30b7a7b019c83879f2784d8be25902f678ee50169c3e945" exitCode=0
Jul 22 12:15:03.696604 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:15:03.696290    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745375-476ts" event={"ID":"18e8ad12-688a-4a73-b34b-ce9bef2e6219","Type":"ContainerDied","Data":"08ecf6ed1fa94fb2b30b7a7b019c83879f2784d8be25902f678ee50169c3e945"}
Jul 22 12:15:04.834561 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:15:04.834534    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745375-476ts"
Jul 22 12:15:05.707296 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:15:05.707264    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745375-476ts"
Jul 22 12:15:05.707296 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:15:05.707290    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745375-476ts" event={"ID":"18e8ad12-688a-4a73-b34b-ce9bef2e6219","Type":"ContainerDied","Data":"5b3f98d17b884287b84e5aad135b50d687a2e9c9b43d26c6eb5ae4b2ad0065c8"}
Jul 22 12:15:05.707517 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:15:05.707338    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b3f98d17b884287b84e5aad135b50d687a2e9c9b43d26c6eb5ae4b2ad0065c8"
Jul 22 12:16:13.452701 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:13.452658    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x"]
Jul 22 12:16:13.453325 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:13.453308    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18e8ad12-688a-4a73-b34b-ce9bef2e6219" containerName="cleanup"
Jul 22 12:16:13.453369 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:13.453328    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="18e8ad12-688a-4a73-b34b-ce9bef2e6219" containerName="cleanup"
Jul 22 12:16:13.453435 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:13.453423    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="18e8ad12-688a-4a73-b34b-ce9bef2e6219" containerName="cleanup"
Jul 22 12:16:13.456895 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:13.456877    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x"
Jul 22 12:16:13.459777 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:13.459755    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-83dec4d6-serving-cert\""
Jul 22 12:16:13.466973 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:13.466948    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x"]
Jul 22 12:16:13.529693 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:13.529653    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d2926f9-d7e2-4946-8f76-dd65b4b752c9-openshift-service-ca\") pod \"maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x\" (UID: \"6d2926f9-d7e2-4946-8f76-dd65b4b752c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x"
Jul 22 12:16:13.529888 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:13.529707    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d2926f9-d7e2-4946-8f76-dd65b4b752c9-maas-api-tls\") pod \"maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x\" (UID: \"6d2926f9-d7e2-4946-8f76-dd65b4b752c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x"
Jul 22 12:16:13.529888 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:13.529765    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8jk2\" (UniqueName: \"kubernetes.io/projected/6d2926f9-d7e2-4946-8f76-dd65b4b752c9-kube-api-access-d8jk2\") pod \"maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x\" (UID: \"6d2926f9-d7e2-4946-8f76-dd65b4b752c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x"
Jul 22 12:16:13.631358 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:13.631321    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d2926f9-d7e2-4946-8f76-dd65b4b752c9-openshift-service-ca\") pod \"maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x\" (UID: \"6d2926f9-d7e2-4946-8f76-dd65b4b752c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x"
Jul 22 12:16:13.631525 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:13.631374    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d2926f9-d7e2-4946-8f76-dd65b4b752c9-maas-api-tls\") pod \"maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x\" (UID: \"6d2926f9-d7e2-4946-8f76-dd65b4b752c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x"
Jul 22 12:16:13.631525 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:13.631407    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8jk2\" (UniqueName: \"kubernetes.io/projected/6d2926f9-d7e2-4946-8f76-dd65b4b752c9-kube-api-access-d8jk2\") pod \"maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x\" (UID: \"6d2926f9-d7e2-4946-8f76-dd65b4b752c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x"
Jul 22 12:16:13.632123 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:13.632104    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d2926f9-d7e2-4946-8f76-dd65b4b752c9-openshift-service-ca\") pod \"maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x\" (UID: \"6d2926f9-d7e2-4946-8f76-dd65b4b752c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x"
Jul 22 12:16:13.633878 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:13.633858    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d2926f9-d7e2-4946-8f76-dd65b4b752c9-maas-api-tls\") pod \"maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x\" (UID: \"6d2926f9-d7e2-4946-8f76-dd65b4b752c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x"
Jul 22 12:16:13.640157 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:13.640132    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8jk2\" (UniqueName: \"kubernetes.io/projected/6d2926f9-d7e2-4946-8f76-dd65b4b752c9-kube-api-access-d8jk2\") pod \"maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x\" (UID: \"6d2926f9-d7e2-4946-8f76-dd65b4b752c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x"
Jul 22 12:16:13.768927 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:13.768839    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x"
Jul 22 12:16:13.906530 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:13.906507    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x"]
Jul 22 12:16:13.908481 ip-10-0-132-166 kubenswrapper[2558]: W0722 12:16:13.908451    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d2926f9_d7e2_4946_8f76_dd65b4b752c9.slice/crio-c9445b616d145147751ed521cda603c62bf19dd3ad3ae34f74ff683015cd1bbf WatchSource:0}: Error finding container c9445b616d145147751ed521cda603c62bf19dd3ad3ae34f74ff683015cd1bbf: Status 404 returned error can't find the container with id c9445b616d145147751ed521cda603c62bf19dd3ad3ae34f74ff683015cd1bbf
Jul 22 12:16:14.056555 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:14.056457    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x" event={"ID":"6d2926f9-d7e2-4946-8f76-dd65b4b752c9","Type":"ContainerStarted","Data":"c9445b616d145147751ed521cda603c62bf19dd3ad3ae34f74ff683015cd1bbf"}
Jul 22 12:16:15.062863 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:15.062830    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x" event={"ID":"6d2926f9-d7e2-4946-8f76-dd65b4b752c9","Type":"ContainerStarted","Data":"b5e3203bddd2dcb349f1828a5b9e2f9391561be473e145862c5bb2f7b98c16fc"}
Jul 22 12:16:15.063309 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:15.062972    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x"
Jul 22 12:16:21.073570 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:21.073540    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x"
Jul 22 12:16:21.095266 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:21.095219    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x" podStartSLOduration=7.455316731 podStartE2EDuration="8.095205446s" totalImagesPullingTime="639.888715ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:16:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:16:15.090490058 +0000 UTC m=+1587.457005301" watchObservedRunningTime="2026-07-22 12:16:21.095205446 +0000 UTC m=+1593.461720689"
Jul 22 12:16:38.907720 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:38.907678    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83dec4d6-9gfzr"]
Jul 22 12:16:38.911359 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:38.911338    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83dec4d6-9gfzr"
Jul 22 12:16:38.913940 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:38.913918    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7kmhv\""
Jul 22 12:16:38.919288 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:38.919261    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83dec4d6-9gfzr"]
Jul 22 12:16:38.976497 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:38.976460    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1b77afa-3ea5-4f02-8976-353556571c69-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-83dec4d6-9gfzr\" (UID: \"e1b77afa-3ea5-4f02-8976-353556571c69\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83dec4d6-9gfzr"
Jul 22 12:16:39.077102 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:39.077068    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1b77afa-3ea5-4f02-8976-353556571c69-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-83dec4d6-9gfzr\" (UID: \"e1b77afa-3ea5-4f02-8976-353556571c69\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83dec4d6-9gfzr"
Jul 22 12:16:39.077713 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:39.077693    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1b77afa-3ea5-4f02-8976-353556571c69-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-83dec4d6-9gfzr\" (UID: \"e1b77afa-3ea5-4f02-8976-353556571c69\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83dec4d6-9gfzr"
Jul 22 12:16:39.225840 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:39.225755    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83dec4d6-9gfzr"
Jul 22 12:16:39.364750 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:39.364726    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83dec4d6-9gfzr"]
Jul 22 12:16:39.367530 ip-10-0-132-166 kubenswrapper[2558]: W0722 12:16:39.367506    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1b77afa_3ea5_4f02_8976_353556571c69.slice/crio-a9fd5130fe88cea8b0967b6ea264b68542fcae5dfae01a1ff6250be4b878c831 WatchSource:0}: Error finding container a9fd5130fe88cea8b0967b6ea264b68542fcae5dfae01a1ff6250be4b878c831: Status 404 returned error can't find the container with id a9fd5130fe88cea8b0967b6ea264b68542fcae5dfae01a1ff6250be4b878c831
Jul 22 12:16:40.192444 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:40.192410    2558 generic.go:356] "Generic (PLEG): container finished" podID="e1b77afa-3ea5-4f02-8976-353556571c69" containerID="5818684362b61ec595db801100054dd0606b1ea8d554a8d57296a8c569435ccf" exitCode=0
Jul 22 12:16:40.192860 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:40.192501    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83dec4d6-9gfzr" event={"ID":"e1b77afa-3ea5-4f02-8976-353556571c69","Type":"ContainerDied","Data":"5818684362b61ec595db801100054dd0606b1ea8d554a8d57296a8c569435ccf"}
Jul 22 12:16:40.192860 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:40.192607    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83dec4d6-9gfzr" event={"ID":"e1b77afa-3ea5-4f02-8976-353556571c69","Type":"ContainerStarted","Data":"a9fd5130fe88cea8b0967b6ea264b68542fcae5dfae01a1ff6250be4b878c831"}
Jul 22 12:16:41.333377 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:41.333350    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83dec4d6-9gfzr"
Jul 22 12:16:41.401399 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:41.401369    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1b77afa-3ea5-4f02-8976-353556571c69-maas-api-service-ca\") pod \"e1b77afa-3ea5-4f02-8976-353556571c69\" (UID: \"e1b77afa-3ea5-4f02-8976-353556571c69\") "
Jul 22 12:16:41.401810 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:41.401789    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1b77afa-3ea5-4f02-8976-353556571c69-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e1b77afa-3ea5-4f02-8976-353556571c69" (UID: "e1b77afa-3ea5-4f02-8976-353556571c69"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:16:41.502483 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:41.502397    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1b77afa-3ea5-4f02-8976-353556571c69-maas-api-service-ca\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:16:42.203557 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:42.203529    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83dec4d6-9gfzr"
Jul 22 12:16:42.203726 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:42.203558    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83dec4d6-9gfzr" event={"ID":"e1b77afa-3ea5-4f02-8976-353556571c69","Type":"ContainerDied","Data":"a9fd5130fe88cea8b0967b6ea264b68542fcae5dfae01a1ff6250be4b878c831"}
Jul 22 12:16:42.203726 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:42.203606    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9fd5130fe88cea8b0967b6ea264b68542fcae5dfae01a1ff6250be4b878c831"
Jul 22 12:16:49.541669 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:49.541636    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x"]
Jul 22 12:16:49.544024 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:49.541837    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x" podUID="6d2926f9-d7e2-4946-8f76-dd65b4b752c9" containerName="maas-api" containerID="cri-o://b5e3203bddd2dcb349f1828a5b9e2f9391561be473e145862c5bb2f7b98c16fc" gracePeriod=30
Jul 22 12:16:49.789577 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:49.789552    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x"
Jul 22 12:16:49.879808 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:49.879775    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d2926f9-d7e2-4946-8f76-dd65b4b752c9-maas-api-tls\") pod \"6d2926f9-d7e2-4946-8f76-dd65b4b752c9\" (UID: \"6d2926f9-d7e2-4946-8f76-dd65b4b752c9\") "
Jul 22 12:16:49.879995 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:49.879874    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d2926f9-d7e2-4946-8f76-dd65b4b752c9-openshift-service-ca\") pod \"6d2926f9-d7e2-4946-8f76-dd65b4b752c9\" (UID: \"6d2926f9-d7e2-4946-8f76-dd65b4b752c9\") "
Jul 22 12:16:49.879995 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:49.879945    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8jk2\" (UniqueName: \"kubernetes.io/projected/6d2926f9-d7e2-4946-8f76-dd65b4b752c9-kube-api-access-d8jk2\") pod \"6d2926f9-d7e2-4946-8f76-dd65b4b752c9\" (UID: \"6d2926f9-d7e2-4946-8f76-dd65b4b752c9\") "
Jul 22 12:16:49.880225 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:49.880202    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d2926f9-d7e2-4946-8f76-dd65b4b752c9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6d2926f9-d7e2-4946-8f76-dd65b4b752c9" (UID: "6d2926f9-d7e2-4946-8f76-dd65b4b752c9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:16:49.882107 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:49.882075    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d2926f9-d7e2-4946-8f76-dd65b4b752c9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6d2926f9-d7e2-4946-8f76-dd65b4b752c9" (UID: "6d2926f9-d7e2-4946-8f76-dd65b4b752c9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:16:49.882236 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:49.882135    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d2926f9-d7e2-4946-8f76-dd65b4b752c9-kube-api-access-d8jk2" (OuterVolumeSpecName: "kube-api-access-d8jk2") pod "6d2926f9-d7e2-4946-8f76-dd65b4b752c9" (UID: "6d2926f9-d7e2-4946-8f76-dd65b4b752c9"). InnerVolumeSpecName "kube-api-access-d8jk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:16:49.987898 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:49.987855    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d2926f9-d7e2-4946-8f76-dd65b4b752c9-openshift-service-ca\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:16:49.988109 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:49.988039    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8jk2\" (UniqueName: \"kubernetes.io/projected/6d2926f9-d7e2-4946-8f76-dd65b4b752c9-kube-api-access-d8jk2\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:16:49.988109 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:49.988057    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d2926f9-d7e2-4946-8f76-dd65b4b752c9-maas-api-tls\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:16:50.244032 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:50.243926    2558 generic.go:356] "Generic (PLEG): container finished" podID="6d2926f9-d7e2-4946-8f76-dd65b4b752c9" containerID="b5e3203bddd2dcb349f1828a5b9e2f9391561be473e145862c5bb2f7b98c16fc" exitCode=0
Jul 22 12:16:50.244032 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:50.243982    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x"
Jul 22 12:16:50.244032 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:50.244007    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x" event={"ID":"6d2926f9-d7e2-4946-8f76-dd65b4b752c9","Type":"ContainerDied","Data":"b5e3203bddd2dcb349f1828a5b9e2f9391561be473e145862c5bb2f7b98c16fc"}
Jul 22 12:16:50.244307 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:50.244084    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x" event={"ID":"6d2926f9-d7e2-4946-8f76-dd65b4b752c9","Type":"ContainerDied","Data":"c9445b616d145147751ed521cda603c62bf19dd3ad3ae34f74ff683015cd1bbf"}
Jul 22 12:16:50.244307 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:50.244114    2558 scope.go:117] "RemoveContainer" containerID="b5e3203bddd2dcb349f1828a5b9e2f9391561be473e145862c5bb2f7b98c16fc"
Jul 22 12:16:50.253689 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:50.253664    2558 scope.go:117] "RemoveContainer" containerID="b5e3203bddd2dcb349f1828a5b9e2f9391561be473e145862c5bb2f7b98c16fc"
Jul 22 12:16:50.253942 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:16:50.253919    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5e3203bddd2dcb349f1828a5b9e2f9391561be473e145862c5bb2f7b98c16fc\": container with ID starting with b5e3203bddd2dcb349f1828a5b9e2f9391561be473e145862c5bb2f7b98c16fc not found: ID does not exist" containerID="b5e3203bddd2dcb349f1828a5b9e2f9391561be473e145862c5bb2f7b98c16fc"
Jul 22 12:16:50.254016 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:50.253951    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5e3203bddd2dcb349f1828a5b9e2f9391561be473e145862c5bb2f7b98c16fc"} err="failed to get container status \"b5e3203bddd2dcb349f1828a5b9e2f9391561be473e145862c5bb2f7b98c16fc\": rpc error: code = NotFound desc = could not find container \"b5e3203bddd2dcb349f1828a5b9e2f9391561be473e145862c5bb2f7b98c16fc\": container with ID starting with b5e3203bddd2dcb349f1828a5b9e2f9391561be473e145862c5bb2f7b98c16fc not found: ID does not exist"
Jul 22 12:16:50.268053 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:50.268027    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x"]
Jul 22 12:16:50.272835 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:50.272809    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-83dec4d6-68b84bdd8b-kgk4x"]
Jul 22 12:16:50.447270 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:50.447235    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d2926f9-d7e2-4946-8f76-dd65b4b752c9" path="/var/lib/kubelet/pods/6d2926f9-d7e2-4946-8f76-dd65b4b752c9/volumes"
Jul 22 12:16:54.011510 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:54.011470    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83dec4d6-9gfzr"]
Jul 22 12:16:54.020874 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:54.020845    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83dec4d6-9gfzr"]
Jul 22 12:16:54.447522 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:54.447490    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1b77afa-3ea5-4f02-8976-353556571c69" path="/var/lib/kubelet/pods/e1b77afa-3ea5-4f02-8976-353556571c69/volumes"
Jul 22 12:16:57.827270 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:57.827230    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx"]
Jul 22 12:16:57.827866 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:57.827845    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1b77afa-3ea5-4f02-8976-353556571c69" containerName="revoke-keys"
Jul 22 12:16:57.827866 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:57.827868    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1b77afa-3ea5-4f02-8976-353556571c69" containerName="revoke-keys"
Jul 22 12:16:57.828003 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:57.827881    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d2926f9-d7e2-4946-8f76-dd65b4b752c9" containerName="maas-api"
Jul 22 12:16:57.828003 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:57.827888    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d2926f9-d7e2-4946-8f76-dd65b4b752c9" containerName="maas-api"
Jul 22 12:16:57.828003 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:57.827989    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1b77afa-3ea5-4f02-8976-353556571c69" containerName="revoke-keys"
Jul 22 12:16:57.828003 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:57.828001    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d2926f9-d7e2-4946-8f76-dd65b4b752c9" containerName="maas-api"
Jul 22 12:16:57.832562 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:57.832541    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx"
Jul 22 12:16:57.835024 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:57.835002    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-82f25c67-serving-cert\""
Jul 22 12:16:57.840028 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:57.839921    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx"]
Jul 22 12:16:57.964657 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:57.964604    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42902acb-00bb-443e-b184-a237cbc00574-openshift-service-ca\") pod \"maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx\" (UID: \"42902acb-00bb-443e-b184-a237cbc00574\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx"
Jul 22 12:16:57.964824 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:57.964738    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42902acb-00bb-443e-b184-a237cbc00574-maas-api-tls\") pod \"maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx\" (UID: \"42902acb-00bb-443e-b184-a237cbc00574\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx"
Jul 22 12:16:57.964824 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:57.964778    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxz6f\" (UniqueName: \"kubernetes.io/projected/42902acb-00bb-443e-b184-a237cbc00574-kube-api-access-sxz6f\") pod \"maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx\" (UID: \"42902acb-00bb-443e-b184-a237cbc00574\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx"
Jul 22 12:16:58.066103 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:58.066069    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42902acb-00bb-443e-b184-a237cbc00574-openshift-service-ca\") pod \"maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx\" (UID: \"42902acb-00bb-443e-b184-a237cbc00574\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx"
Jul 22 12:16:58.066263 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:58.066142    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42902acb-00bb-443e-b184-a237cbc00574-maas-api-tls\") pod \"maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx\" (UID: \"42902acb-00bb-443e-b184-a237cbc00574\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx"
Jul 22 12:16:58.066263 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:58.066164    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxz6f\" (UniqueName: \"kubernetes.io/projected/42902acb-00bb-443e-b184-a237cbc00574-kube-api-access-sxz6f\") pod \"maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx\" (UID: \"42902acb-00bb-443e-b184-a237cbc00574\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx"
Jul 22 12:16:58.066712 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:58.066676    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42902acb-00bb-443e-b184-a237cbc00574-openshift-service-ca\") pod \"maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx\" (UID: \"42902acb-00bb-443e-b184-a237cbc00574\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx"
Jul 22 12:16:58.068593 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:58.068570    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42902acb-00bb-443e-b184-a237cbc00574-maas-api-tls\") pod \"maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx\" (UID: \"42902acb-00bb-443e-b184-a237cbc00574\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx"
Jul 22 12:16:58.076427 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:58.076401    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxz6f\" (UniqueName: \"kubernetes.io/projected/42902acb-00bb-443e-b184-a237cbc00574-kube-api-access-sxz6f\") pod \"maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx\" (UID: \"42902acb-00bb-443e-b184-a237cbc00574\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx"
Jul 22 12:16:58.144512 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:58.144475    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx"
Jul 22 12:16:58.281173 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:58.281131    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx"]
Jul 22 12:16:58.283206 ip-10-0-132-166 kubenswrapper[2558]: W0722 12:16:58.283168    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42902acb_00bb_443e_b184_a237cbc00574.slice/crio-f4a24e11a7d8e17ee298da6156817b3d97db269fef0a41fec84e0e3e38decb6d WatchSource:0}: Error finding container f4a24e11a7d8e17ee298da6156817b3d97db269fef0a41fec84e0e3e38decb6d: Status 404 returned error can't find the container with id f4a24e11a7d8e17ee298da6156817b3d97db269fef0a41fec84e0e3e38decb6d
Jul 22 12:16:59.291626 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:59.291580    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx" event={"ID":"42902acb-00bb-443e-b184-a237cbc00574","Type":"ContainerStarted","Data":"118284acde9bccb902084a2467c4ef227337ec7b1709874fe31b015ba381fc0f"}
Jul 22 12:16:59.292016 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:59.291664    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx"
Jul 22 12:16:59.292016 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:59.291684    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx" event={"ID":"42902acb-00bb-443e-b184-a237cbc00574","Type":"ContainerStarted","Data":"f4a24e11a7d8e17ee298da6156817b3d97db269fef0a41fec84e0e3e38decb6d"}
Jul 22 12:16:59.329631 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:16:59.329570    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx" podStartSLOduration=1.923629161 podStartE2EDuration="2.329554686s" totalImagesPullingTime="405.925525ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:16:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:16:59.328339955 +0000 UTC m=+1631.694855200" watchObservedRunningTime="2026-07-22 12:16:59.329554686 +0000 UTC m=+1631.696069929"
Jul 22 12:17:05.305685 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:05.305649    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx"
Jul 22 12:17:22.770333 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:22.770292    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-82f25c67-dvkgn"]
Jul 22 12:17:22.780271 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:22.780236    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-82f25c67-dvkgn"
Jul 22 12:17:22.783284 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:22.783251    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7kmhv\""
Jul 22 12:17:22.787770 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:22.787704    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-82f25c67-dvkgn"]
Jul 22 12:17:22.894025 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:22.893993    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7d4b29a-6c58-4d30-b1da-7fc8f9327f26-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-82f25c67-dvkgn\" (UID: \"f7d4b29a-6c58-4d30-b1da-7fc8f9327f26\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-82f25c67-dvkgn"
Jul 22 12:17:22.995355 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:22.995311    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7d4b29a-6c58-4d30-b1da-7fc8f9327f26-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-82f25c67-dvkgn\" (UID: \"f7d4b29a-6c58-4d30-b1da-7fc8f9327f26\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-82f25c67-dvkgn"
Jul 22 12:17:22.996005 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:22.995985    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7d4b29a-6c58-4d30-b1da-7fc8f9327f26-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-82f25c67-dvkgn\" (UID: \"f7d4b29a-6c58-4d30-b1da-7fc8f9327f26\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-82f25c67-dvkgn"
Jul 22 12:17:23.094440 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:23.094347    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-82f25c67-dvkgn"
Jul 22 12:17:23.241430 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:23.241394    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-82f25c67-dvkgn"]
Jul 22 12:17:23.244669 ip-10-0-132-166 kubenswrapper[2558]: W0722 12:17:23.244635    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7d4b29a_6c58_4d30_b1da_7fc8f9327f26.slice/crio-d13ba636f05c519d72c81fa257696d5b6cf8d182a594e097296ab424d99fba67 WatchSource:0}: Error finding container d13ba636f05c519d72c81fa257696d5b6cf8d182a594e097296ab424d99fba67: Status 404 returned error can't find the container with id d13ba636f05c519d72c81fa257696d5b6cf8d182a594e097296ab424d99fba67
Jul 22 12:17:23.415764 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:23.415726    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-82f25c67-dvkgn" event={"ID":"f7d4b29a-6c58-4d30-b1da-7fc8f9327f26","Type":"ContainerStarted","Data":"d13ba636f05c519d72c81fa257696d5b6cf8d182a594e097296ab424d99fba67"}
Jul 22 12:17:24.421909 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:24.421875    2558 generic.go:356] "Generic (PLEG): container finished" podID="f7d4b29a-6c58-4d30-b1da-7fc8f9327f26" containerID="9435c41144bfcce533411aaef249baf028888c57eb1a9548b7a09df0cfd64c3b" exitCode=0
Jul 22 12:17:24.422292 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:24.421963    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-82f25c67-dvkgn" event={"ID":"f7d4b29a-6c58-4d30-b1da-7fc8f9327f26","Type":"ContainerDied","Data":"9435c41144bfcce533411aaef249baf028888c57eb1a9548b7a09df0cfd64c3b"}
Jul 22 12:17:25.554103 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:25.554079    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-82f25c67-dvkgn"
Jul 22 12:17:25.620643 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:25.620590    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7d4b29a-6c58-4d30-b1da-7fc8f9327f26-maas-api-service-ca\") pod \"f7d4b29a-6c58-4d30-b1da-7fc8f9327f26\" (UID: \"f7d4b29a-6c58-4d30-b1da-7fc8f9327f26\") "
Jul 22 12:17:25.620952 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:25.620931    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7d4b29a-6c58-4d30-b1da-7fc8f9327f26-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f7d4b29a-6c58-4d30-b1da-7fc8f9327f26" (UID: "f7d4b29a-6c58-4d30-b1da-7fc8f9327f26"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:17:25.721607 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:25.721521    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7d4b29a-6c58-4d30-b1da-7fc8f9327f26-maas-api-service-ca\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:17:26.434264 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:26.434234    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-82f25c67-dvkgn"
Jul 22 12:17:26.434438 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:26.434267    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-82f25c67-dvkgn" event={"ID":"f7d4b29a-6c58-4d30-b1da-7fc8f9327f26","Type":"ContainerDied","Data":"d13ba636f05c519d72c81fa257696d5b6cf8d182a594e097296ab424d99fba67"}
Jul 22 12:17:26.434438 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:26.434320    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d13ba636f05c519d72c81fa257696d5b6cf8d182a594e097296ab424d99fba67"
Jul 22 12:17:33.215353 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:33.215321    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx"]
Jul 22 12:17:33.215855 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:33.215546    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx" podUID="42902acb-00bb-443e-b184-a237cbc00574" containerName="maas-api" containerID="cri-o://118284acde9bccb902084a2467c4ef227337ec7b1709874fe31b015ba381fc0f" gracePeriod=30
Jul 22 12:17:33.464655 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:33.464611    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx"
Jul 22 12:17:33.470125 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:33.470067    2558 generic.go:356] "Generic (PLEG): container finished" podID="42902acb-00bb-443e-b184-a237cbc00574" containerID="118284acde9bccb902084a2467c4ef227337ec7b1709874fe31b015ba381fc0f" exitCode=0
Jul 22 12:17:33.470125 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:33.470099    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx"
Jul 22 12:17:33.470283 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:33.470121    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx" event={"ID":"42902acb-00bb-443e-b184-a237cbc00574","Type":"ContainerDied","Data":"118284acde9bccb902084a2467c4ef227337ec7b1709874fe31b015ba381fc0f"}
Jul 22 12:17:33.470283 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:33.470182    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx" event={"ID":"42902acb-00bb-443e-b184-a237cbc00574","Type":"ContainerDied","Data":"f4a24e11a7d8e17ee298da6156817b3d97db269fef0a41fec84e0e3e38decb6d"}
Jul 22 12:17:33.470283 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:33.470204    2558 scope.go:117] "RemoveContainer" containerID="118284acde9bccb902084a2467c4ef227337ec7b1709874fe31b015ba381fc0f"
Jul 22 12:17:33.481000 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:33.480977    2558 scope.go:117] "RemoveContainer" containerID="118284acde9bccb902084a2467c4ef227337ec7b1709874fe31b015ba381fc0f"
Jul 22 12:17:33.481273 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:17:33.481252    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"118284acde9bccb902084a2467c4ef227337ec7b1709874fe31b015ba381fc0f\": container with ID starting with 118284acde9bccb902084a2467c4ef227337ec7b1709874fe31b015ba381fc0f not found: ID does not exist" containerID="118284acde9bccb902084a2467c4ef227337ec7b1709874fe31b015ba381fc0f"
Jul 22 12:17:33.481344 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:33.481287    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"118284acde9bccb902084a2467c4ef227337ec7b1709874fe31b015ba381fc0f"} err="failed to get container status \"118284acde9bccb902084a2467c4ef227337ec7b1709874fe31b015ba381fc0f\": rpc error: code = NotFound desc = could not find container \"118284acde9bccb902084a2467c4ef227337ec7b1709874fe31b015ba381fc0f\": container with ID starting with 118284acde9bccb902084a2467c4ef227337ec7b1709874fe31b015ba381fc0f not found: ID does not exist"
Jul 22 12:17:33.599875 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:33.599841    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxz6f\" (UniqueName: \"kubernetes.io/projected/42902acb-00bb-443e-b184-a237cbc00574-kube-api-access-sxz6f\") pod \"42902acb-00bb-443e-b184-a237cbc00574\" (UID: \"42902acb-00bb-443e-b184-a237cbc00574\") "
Jul 22 12:17:33.599875 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:33.599880    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42902acb-00bb-443e-b184-a237cbc00574-openshift-service-ca\") pod \"42902acb-00bb-443e-b184-a237cbc00574\" (UID: \"42902acb-00bb-443e-b184-a237cbc00574\") "
Jul 22 12:17:33.600068 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:33.600018    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42902acb-00bb-443e-b184-a237cbc00574-maas-api-tls\") pod \"42902acb-00bb-443e-b184-a237cbc00574\" (UID: \"42902acb-00bb-443e-b184-a237cbc00574\") "
Jul 22 12:17:33.600275 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:33.600238    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42902acb-00bb-443e-b184-a237cbc00574-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "42902acb-00bb-443e-b184-a237cbc00574" (UID: "42902acb-00bb-443e-b184-a237cbc00574"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:17:33.600396 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:33.600379    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42902acb-00bb-443e-b184-a237cbc00574-openshift-service-ca\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:17:33.602067 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:33.602043    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42902acb-00bb-443e-b184-a237cbc00574-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "42902acb-00bb-443e-b184-a237cbc00574" (UID: "42902acb-00bb-443e-b184-a237cbc00574"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:17:33.602067 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:33.602058    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42902acb-00bb-443e-b184-a237cbc00574-kube-api-access-sxz6f" (OuterVolumeSpecName: "kube-api-access-sxz6f") pod "42902acb-00bb-443e-b184-a237cbc00574" (UID: "42902acb-00bb-443e-b184-a237cbc00574"). InnerVolumeSpecName "kube-api-access-sxz6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:17:33.701560 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:33.701520    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42902acb-00bb-443e-b184-a237cbc00574-maas-api-tls\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:17:33.701560 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:33.701551    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxz6f\" (UniqueName: \"kubernetes.io/projected/42902acb-00bb-443e-b184-a237cbc00574-kube-api-access-sxz6f\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:17:33.800557 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:33.800525    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx"]
Jul 22 12:17:33.805423 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:33.805398    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-82f25c67-77bbd66849-br2gx"]
Jul 22 12:17:34.447101 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:34.447063    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42902acb-00bb-443e-b184-a237cbc00574" path="/var/lib/kubelet/pods/42902acb-00bb-443e-b184-a237cbc00574/volumes"
Jul 22 12:17:37.938985 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:37.938911    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-82f25c67-dvkgn"]
Jul 22 12:17:37.941302 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:37.941277    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-82f25c67-dvkgn"]
Jul 22 12:17:38.447220 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:38.447181    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7d4b29a-6c58-4d30-b1da-7fc8f9327f26" path="/var/lib/kubelet/pods/f7d4b29a-6c58-4d30-b1da-7fc8f9327f26/volumes"
Jul 22 12:17:40.945867 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:40.945831    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c"]
Jul 22 12:17:40.946347 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:40.946328    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42902acb-00bb-443e-b184-a237cbc00574" containerName="maas-api"
Jul 22 12:17:40.946394 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:40.946349    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="42902acb-00bb-443e-b184-a237cbc00574" containerName="maas-api"
Jul 22 12:17:40.946394 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:40.946358    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7d4b29a-6c58-4d30-b1da-7fc8f9327f26" containerName="revoke-keys"
Jul 22 12:17:40.946394 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:40.946364    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7d4b29a-6c58-4d30-b1da-7fc8f9327f26" containerName="revoke-keys"
Jul 22 12:17:40.946482 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:40.946429    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="42902acb-00bb-443e-b184-a237cbc00574" containerName="maas-api"
Jul 22 12:17:40.946482 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:40.946437    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7d4b29a-6c58-4d30-b1da-7fc8f9327f26" containerName="revoke-keys"
Jul 22 12:17:40.950611 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:40.950591    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c"
Jul 22 12:17:40.953093 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:40.953074    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-800b6cf7-serving-cert\""
Jul 22 12:17:40.960555 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:40.960532    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c"]
Jul 22 12:17:41.071488 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:41.071457    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2190d55-a534-45f1-984d-9145606dfe04-maas-api-tls\") pod \"maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c\" (UID: \"f2190d55-a534-45f1-984d-9145606dfe04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c"
Jul 22 12:17:41.071656 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:41.071512    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2190d55-a534-45f1-984d-9145606dfe04-openshift-service-ca\") pod \"maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c\" (UID: \"f2190d55-a534-45f1-984d-9145606dfe04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c"
Jul 22 12:17:41.071656 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:41.071566    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77f9w\" (UniqueName: \"kubernetes.io/projected/f2190d55-a534-45f1-984d-9145606dfe04-kube-api-access-77f9w\") pod \"maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c\" (UID: \"f2190d55-a534-45f1-984d-9145606dfe04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c"
Jul 22 12:17:41.172961 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:41.172927    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2190d55-a534-45f1-984d-9145606dfe04-openshift-service-ca\") pod \"maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c\" (UID: \"f2190d55-a534-45f1-984d-9145606dfe04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c"
Jul 22 12:17:41.172961 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:41.172971    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77f9w\" (UniqueName: \"kubernetes.io/projected/f2190d55-a534-45f1-984d-9145606dfe04-kube-api-access-77f9w\") pod \"maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c\" (UID: \"f2190d55-a534-45f1-984d-9145606dfe04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c"
Jul 22 12:17:41.173224 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:41.173029    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2190d55-a534-45f1-984d-9145606dfe04-maas-api-tls\") pod \"maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c\" (UID: \"f2190d55-a534-45f1-984d-9145606dfe04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c"
Jul 22 12:17:41.173534 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:41.173508    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2190d55-a534-45f1-984d-9145606dfe04-openshift-service-ca\") pod \"maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c\" (UID: \"f2190d55-a534-45f1-984d-9145606dfe04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c"
Jul 22 12:17:41.175396 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:41.175375    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2190d55-a534-45f1-984d-9145606dfe04-maas-api-tls\") pod \"maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c\" (UID: \"f2190d55-a534-45f1-984d-9145606dfe04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c"
Jul 22 12:17:41.181259 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:41.181237    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77f9w\" (UniqueName: \"kubernetes.io/projected/f2190d55-a534-45f1-984d-9145606dfe04-kube-api-access-77f9w\") pod \"maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c\" (UID: \"f2190d55-a534-45f1-984d-9145606dfe04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c"
Jul 22 12:17:41.261903 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:41.261815    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c"
Jul 22 12:17:41.414821 ip-10-0-132-166 kubenswrapper[2558]: W0722 12:17:41.414792    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2190d55_a534_45f1_984d_9145606dfe04.slice/crio-89084081ea662e52dc35c49fb08739762884e97d907b09fe0363bba47089ca74 WatchSource:0}: Error finding container 89084081ea662e52dc35c49fb08739762884e97d907b09fe0363bba47089ca74: Status 404 returned error can't find the container with id 89084081ea662e52dc35c49fb08739762884e97d907b09fe0363bba47089ca74
Jul 22 12:17:41.424259 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:41.424224    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c"]
Jul 22 12:17:41.512242 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:41.512156    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c" event={"ID":"f2190d55-a534-45f1-984d-9145606dfe04","Type":"ContainerStarted","Data":"89084081ea662e52dc35c49fb08739762884e97d907b09fe0363bba47089ca74"}
Jul 22 12:17:42.518768 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:42.518731    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c" event={"ID":"f2190d55-a534-45f1-984d-9145606dfe04","Type":"ContainerStarted","Data":"e0ec80fefee7db90b116bdfb834527af80b7ddf90c3dc0c3399b54b534bc48f4"}
Jul 22 12:17:42.519216 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:42.518855    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c"
Jul 22 12:17:42.538316 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:42.538265    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c" podStartSLOduration=1.9726019190000001 podStartE2EDuration="2.538251151s" totalImagesPullingTime="565.649232ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:17:42.536738439 +0000 UTC m=+1674.903253688" watchObservedRunningTime="2026-07-22 12:17:42.538251151 +0000 UTC m=+1674.904766398"
Jul 22 12:17:48.529512 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:17:48.529481    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c"
Jul 22 12:18:17.210845 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:17.210811    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c"]
Jul 22 12:18:17.211459 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:17.211032    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c" podUID="f2190d55-a534-45f1-984d-9145606dfe04" containerName="maas-api" containerID="cri-o://e0ec80fefee7db90b116bdfb834527af80b7ddf90c3dc0c3399b54b534bc48f4" gracePeriod=30
Jul 22 12:18:17.464128 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:17.464059    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c"
Jul 22 12:18:17.612165 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:17.612114    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2190d55-a534-45f1-984d-9145606dfe04-maas-api-tls\") pod \"f2190d55-a534-45f1-984d-9145606dfe04\" (UID: \"f2190d55-a534-45f1-984d-9145606dfe04\") "
Jul 22 12:18:17.612165 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:17.612177    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2190d55-a534-45f1-984d-9145606dfe04-openshift-service-ca\") pod \"f2190d55-a534-45f1-984d-9145606dfe04\" (UID: \"f2190d55-a534-45f1-984d-9145606dfe04\") "
Jul 22 12:18:17.612396 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:17.612214    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77f9w\" (UniqueName: \"kubernetes.io/projected/f2190d55-a534-45f1-984d-9145606dfe04-kube-api-access-77f9w\") pod \"f2190d55-a534-45f1-984d-9145606dfe04\" (UID: \"f2190d55-a534-45f1-984d-9145606dfe04\") "
Jul 22 12:18:17.612603 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:17.612577    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2190d55-a534-45f1-984d-9145606dfe04-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f2190d55-a534-45f1-984d-9145606dfe04" (UID: "f2190d55-a534-45f1-984d-9145606dfe04"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:18:17.614370 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:17.614342    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2190d55-a534-45f1-984d-9145606dfe04-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f2190d55-a534-45f1-984d-9145606dfe04" (UID: "f2190d55-a534-45f1-984d-9145606dfe04"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:18:17.614468 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:17.614452    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2190d55-a534-45f1-984d-9145606dfe04-kube-api-access-77f9w" (OuterVolumeSpecName: "kube-api-access-77f9w") pod "f2190d55-a534-45f1-984d-9145606dfe04" (UID: "f2190d55-a534-45f1-984d-9145606dfe04"). InnerVolumeSpecName "kube-api-access-77f9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:18:17.702264 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:17.702232    2558 generic.go:356] "Generic (PLEG): container finished" podID="f2190d55-a534-45f1-984d-9145606dfe04" containerID="e0ec80fefee7db90b116bdfb834527af80b7ddf90c3dc0c3399b54b534bc48f4" exitCode=0
Jul 22 12:18:17.702439 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:17.702272    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c"
Jul 22 12:18:17.702439 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:17.702308    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c" event={"ID":"f2190d55-a534-45f1-984d-9145606dfe04","Type":"ContainerDied","Data":"e0ec80fefee7db90b116bdfb834527af80b7ddf90c3dc0c3399b54b534bc48f4"}
Jul 22 12:18:17.702439 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:17.702360    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c" event={"ID":"f2190d55-a534-45f1-984d-9145606dfe04","Type":"ContainerDied","Data":"89084081ea662e52dc35c49fb08739762884e97d907b09fe0363bba47089ca74"}
Jul 22 12:18:17.702439 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:17.702385    2558 scope.go:117] "RemoveContainer" containerID="e0ec80fefee7db90b116bdfb834527af80b7ddf90c3dc0c3399b54b534bc48f4"
Jul 22 12:18:17.711595 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:17.711576    2558 scope.go:117] "RemoveContainer" containerID="e0ec80fefee7db90b116bdfb834527af80b7ddf90c3dc0c3399b54b534bc48f4"
Jul 22 12:18:17.711886 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:18:17.711867    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0ec80fefee7db90b116bdfb834527af80b7ddf90c3dc0c3399b54b534bc48f4\": container with ID starting with e0ec80fefee7db90b116bdfb834527af80b7ddf90c3dc0c3399b54b534bc48f4 not found: ID does not exist" containerID="e0ec80fefee7db90b116bdfb834527af80b7ddf90c3dc0c3399b54b534bc48f4"
Jul 22 12:18:17.711984 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:17.711894    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0ec80fefee7db90b116bdfb834527af80b7ddf90c3dc0c3399b54b534bc48f4"} err="failed to get container status \"e0ec80fefee7db90b116bdfb834527af80b7ddf90c3dc0c3399b54b534bc48f4\": rpc error: code = NotFound desc = could not find container \"e0ec80fefee7db90b116bdfb834527af80b7ddf90c3dc0c3399b54b534bc48f4\": container with ID starting with e0ec80fefee7db90b116bdfb834527af80b7ddf90c3dc0c3399b54b534bc48f4 not found: ID does not exist"
Jul 22 12:18:17.713331 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:17.713313    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2190d55-a534-45f1-984d-9145606dfe04-maas-api-tls\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:18:17.713388 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:17.713334    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2190d55-a534-45f1-984d-9145606dfe04-openshift-service-ca\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:18:17.713388 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:17.713343    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77f9w\" (UniqueName: \"kubernetes.io/projected/f2190d55-a534-45f1-984d-9145606dfe04-kube-api-access-77f9w\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:18:17.725765 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:17.725702    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c"]
Jul 22 12:18:17.729881 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:17.729859    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-800b6cf7-6b64fd78c9-kjd9c"]
Jul 22 12:18:18.447914 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:18.447870    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2190d55-a534-45f1-984d-9145606dfe04" path="/var/lib/kubelet/pods/f2190d55-a534-45f1-984d-9145606dfe04/volumes"
Jul 22 12:18:26.190527 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:26.190488    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2"]
Jul 22 12:18:26.191135 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:26.191116    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2190d55-a534-45f1-984d-9145606dfe04" containerName="maas-api"
Jul 22 12:18:26.191236 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:26.191139    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2190d55-a534-45f1-984d-9145606dfe04" containerName="maas-api"
Jul 22 12:18:26.191297 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:26.191262    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2190d55-a534-45f1-984d-9145606dfe04" containerName="maas-api"
Jul 22 12:18:26.194278 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:26.194257    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2"
Jul 22 12:18:26.196661 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:26.196643    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-94d621ea-serving-cert\""
Jul 22 12:18:26.205155 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:26.205133    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2"]
Jul 22 12:18:26.295703 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:26.295670    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfd1a51f-8256-4fd0-8a7c-9510fc0dc252-maas-api-tls\") pod \"maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2\" (UID: \"dfd1a51f-8256-4fd0-8a7c-9510fc0dc252\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2"
Jul 22 12:18:26.295878 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:26.295724    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnf5s\" (UniqueName: \"kubernetes.io/projected/dfd1a51f-8256-4fd0-8a7c-9510fc0dc252-kube-api-access-bnf5s\") pod \"maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2\" (UID: \"dfd1a51f-8256-4fd0-8a7c-9510fc0dc252\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2"
Jul 22 12:18:26.295878 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:26.295772    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfd1a51f-8256-4fd0-8a7c-9510fc0dc252-openshift-service-ca\") pod \"maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2\" (UID: \"dfd1a51f-8256-4fd0-8a7c-9510fc0dc252\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2"
Jul 22 12:18:26.396658 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:26.396600    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfd1a51f-8256-4fd0-8a7c-9510fc0dc252-maas-api-tls\") pod \"maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2\" (UID: \"dfd1a51f-8256-4fd0-8a7c-9510fc0dc252\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2"
Jul 22 12:18:26.396845 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:26.396682    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnf5s\" (UniqueName: \"kubernetes.io/projected/dfd1a51f-8256-4fd0-8a7c-9510fc0dc252-kube-api-access-bnf5s\") pod \"maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2\" (UID: \"dfd1a51f-8256-4fd0-8a7c-9510fc0dc252\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2"
Jul 22 12:18:26.396845 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:26.396707    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfd1a51f-8256-4fd0-8a7c-9510fc0dc252-openshift-service-ca\") pod \"maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2\" (UID: \"dfd1a51f-8256-4fd0-8a7c-9510fc0dc252\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2"
Jul 22 12:18:26.397395 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:26.397373    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfd1a51f-8256-4fd0-8a7c-9510fc0dc252-openshift-service-ca\") pod \"maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2\" (UID: \"dfd1a51f-8256-4fd0-8a7c-9510fc0dc252\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2"
Jul 22 12:18:26.399247 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:26.399219    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfd1a51f-8256-4fd0-8a7c-9510fc0dc252-maas-api-tls\") pod \"maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2\" (UID: \"dfd1a51f-8256-4fd0-8a7c-9510fc0dc252\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2"
Jul 22 12:18:26.405094 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:26.405070    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnf5s\" (UniqueName: \"kubernetes.io/projected/dfd1a51f-8256-4fd0-8a7c-9510fc0dc252-kube-api-access-bnf5s\") pod \"maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2\" (UID: \"dfd1a51f-8256-4fd0-8a7c-9510fc0dc252\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2"
Jul 22 12:18:26.504831 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:26.504740    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2"
Jul 22 12:18:26.646711 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:26.646679    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2"]
Jul 22 12:18:26.648958 ip-10-0-132-166 kubenswrapper[2558]: W0722 12:18:26.648928    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfd1a51f_8256_4fd0_8a7c_9510fc0dc252.slice/crio-7c9ea309f1d29ab3a52971afc814acd64242b164f0e3cd245d46f7582778e64d WatchSource:0}: Error finding container 7c9ea309f1d29ab3a52971afc814acd64242b164f0e3cd245d46f7582778e64d: Status 404 returned error can't find the container with id 7c9ea309f1d29ab3a52971afc814acd64242b164f0e3cd245d46f7582778e64d
Jul 22 12:18:26.749886 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:26.749846    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2" event={"ID":"dfd1a51f-8256-4fd0-8a7c-9510fc0dc252","Type":"ContainerStarted","Data":"7c9ea309f1d29ab3a52971afc814acd64242b164f0e3cd245d46f7582778e64d"}
Jul 22 12:18:27.756396 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:27.756300    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2" event={"ID":"dfd1a51f-8256-4fd0-8a7c-9510fc0dc252","Type":"ContainerStarted","Data":"01c9847b94d84a392ced97cc0e862e0e8320d193de0a927f4d908ba352f7960e"}
Jul 22 12:18:27.756396 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:27.756376    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2"
Jul 22 12:18:27.776558 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:27.776507    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2" podStartSLOduration=0.964898204 podStartE2EDuration="1.776491161s" totalImagesPullingTime="811.592957ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:18:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:18:27.775472009 +0000 UTC m=+1720.141987253" watchObservedRunningTime="2026-07-22 12:18:27.776491161 +0000 UTC m=+1720.143006404"
Jul 22 12:18:33.767961 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:18:33.767933    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2"
Jul 22 12:19:01.519339 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:19:01.519303    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2"]
Jul 22 12:19:01.519906 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:19:01.519725    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2" podUID="dfd1a51f-8256-4fd0-8a7c-9510fc0dc252" containerName="maas-api" containerID="cri-o://01c9847b94d84a392ced97cc0e862e0e8320d193de0a927f4d908ba352f7960e" gracePeriod=30
Jul 22 12:19:01.772280 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:19:01.772219    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2"
Jul 22 12:19:01.837222 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:19:01.837190    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfd1a51f-8256-4fd0-8a7c-9510fc0dc252-maas-api-tls\") pod \"dfd1a51f-8256-4fd0-8a7c-9510fc0dc252\" (UID: \"dfd1a51f-8256-4fd0-8a7c-9510fc0dc252\") "
Jul 22 12:19:01.837393 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:19:01.837248    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfd1a51f-8256-4fd0-8a7c-9510fc0dc252-openshift-service-ca\") pod \"dfd1a51f-8256-4fd0-8a7c-9510fc0dc252\" (UID: \"dfd1a51f-8256-4fd0-8a7c-9510fc0dc252\") "
Jul 22 12:19:01.837393 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:19:01.837311    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnf5s\" (UniqueName: \"kubernetes.io/projected/dfd1a51f-8256-4fd0-8a7c-9510fc0dc252-kube-api-access-bnf5s\") pod \"dfd1a51f-8256-4fd0-8a7c-9510fc0dc252\" (UID: \"dfd1a51f-8256-4fd0-8a7c-9510fc0dc252\") "
Jul 22 12:19:01.837670 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:19:01.837643    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfd1a51f-8256-4fd0-8a7c-9510fc0dc252-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dfd1a51f-8256-4fd0-8a7c-9510fc0dc252" (UID: "dfd1a51f-8256-4fd0-8a7c-9510fc0dc252"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:19:01.839284 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:19:01.839253    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfd1a51f-8256-4fd0-8a7c-9510fc0dc252-kube-api-access-bnf5s" (OuterVolumeSpecName: "kube-api-access-bnf5s") pod "dfd1a51f-8256-4fd0-8a7c-9510fc0dc252" (UID: "dfd1a51f-8256-4fd0-8a7c-9510fc0dc252"). InnerVolumeSpecName "kube-api-access-bnf5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:19:01.839284 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:19:01.839265    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfd1a51f-8256-4fd0-8a7c-9510fc0dc252-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dfd1a51f-8256-4fd0-8a7c-9510fc0dc252" (UID: "dfd1a51f-8256-4fd0-8a7c-9510fc0dc252"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:19:01.925090 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:19:01.925058    2558 generic.go:356] "Generic (PLEG): container finished" podID="dfd1a51f-8256-4fd0-8a7c-9510fc0dc252" containerID="01c9847b94d84a392ced97cc0e862e0e8320d193de0a927f4d908ba352f7960e" exitCode=0
Jul 22 12:19:01.925293 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:19:01.925109    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2"
Jul 22 12:19:01.925293 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:19:01.925123    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2" event={"ID":"dfd1a51f-8256-4fd0-8a7c-9510fc0dc252","Type":"ContainerDied","Data":"01c9847b94d84a392ced97cc0e862e0e8320d193de0a927f4d908ba352f7960e"}
Jul 22 12:19:01.925293 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:19:01.925164    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2" event={"ID":"dfd1a51f-8256-4fd0-8a7c-9510fc0dc252","Type":"ContainerDied","Data":"7c9ea309f1d29ab3a52971afc814acd64242b164f0e3cd245d46f7582778e64d"}
Jul 22 12:19:01.925293 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:19:01.925185    2558 scope.go:117] "RemoveContainer" containerID="01c9847b94d84a392ced97cc0e862e0e8320d193de0a927f4d908ba352f7960e"
Jul 22 12:19:01.934404 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:19:01.934386    2558 scope.go:117] "RemoveContainer" containerID="01c9847b94d84a392ced97cc0e862e0e8320d193de0a927f4d908ba352f7960e"
Jul 22 12:19:01.934683 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:19:01.934660    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01c9847b94d84a392ced97cc0e862e0e8320d193de0a927f4d908ba352f7960e\": container with ID starting with 01c9847b94d84a392ced97cc0e862e0e8320d193de0a927f4d908ba352f7960e not found: ID does not exist" containerID="01c9847b94d84a392ced97cc0e862e0e8320d193de0a927f4d908ba352f7960e"
Jul 22 12:19:01.934758 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:19:01.934691    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01c9847b94d84a392ced97cc0e862e0e8320d193de0a927f4d908ba352f7960e"} err="failed to get container status \"01c9847b94d84a392ced97cc0e862e0e8320d193de0a927f4d908ba352f7960e\": rpc error: code = NotFound desc = could not find container \"01c9847b94d84a392ced97cc0e862e0e8320d193de0a927f4d908ba352f7960e\": container with ID starting with 01c9847b94d84a392ced97cc0e862e0e8320d193de0a927f4d908ba352f7960e not found: ID does not exist"
Jul 22 12:19:01.938100 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:19:01.938083    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfd1a51f-8256-4fd0-8a7c-9510fc0dc252-openshift-service-ca\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:19:01.938153 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:19:01.938103    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnf5s\" (UniqueName: \"kubernetes.io/projected/dfd1a51f-8256-4fd0-8a7c-9510fc0dc252-kube-api-access-bnf5s\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:19:01.938153 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:19:01.938113    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfd1a51f-8256-4fd0-8a7c-9510fc0dc252-maas-api-tls\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:19:01.947567 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:19:01.947543    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2"]
Jul 22 12:19:01.951968 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:19:01.951946    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-94d621ea-6975bc9b6b-752x2"]
Jul 22 12:19:02.446688 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:19:02.446658    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfd1a51f-8256-4fd0-8a7c-9510fc0dc252" path="/var/lib/kubelet/pods/dfd1a51f-8256-4fd0-8a7c-9510fc0dc252/volumes"
Jul 22 12:20:56.664424 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:20:56.664382    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf"]
Jul 22 12:20:56.665063 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:20:56.664960    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfd1a51f-8256-4fd0-8a7c-9510fc0dc252" containerName="maas-api"
Jul 22 12:20:56.665063 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:20:56.664976    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfd1a51f-8256-4fd0-8a7c-9510fc0dc252" containerName="maas-api"
Jul 22 12:20:56.665063 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:20:56.665037    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfd1a51f-8256-4fd0-8a7c-9510fc0dc252" containerName="maas-api"
Jul 22 12:20:56.668031 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:20:56.668005    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf"
Jul 22 12:20:56.670674 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:20:56.670653    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-a9b9afab-serving-cert\""
Jul 22 12:20:56.679824 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:20:56.679801    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf"]
Jul 22 12:20:56.820897 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:20:56.820863    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b745d71-63e6-443c-95c9-f160676f849e-openshift-service-ca\") pod \"maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf\" (UID: \"2b745d71-63e6-443c-95c9-f160676f849e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf"
Jul 22 12:20:56.821103 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:20:56.820988    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrmmn\" (UniqueName: \"kubernetes.io/projected/2b745d71-63e6-443c-95c9-f160676f849e-kube-api-access-nrmmn\") pod \"maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf\" (UID: \"2b745d71-63e6-443c-95c9-f160676f849e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf"
Jul 22 12:20:56.821103 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:20:56.821049    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b745d71-63e6-443c-95c9-f160676f849e-maas-api-tls\") pod \"maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf\" (UID: \"2b745d71-63e6-443c-95c9-f160676f849e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf"
Jul 22 12:20:56.922570 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:20:56.922477    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrmmn\" (UniqueName: \"kubernetes.io/projected/2b745d71-63e6-443c-95c9-f160676f849e-kube-api-access-nrmmn\") pod \"maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf\" (UID: \"2b745d71-63e6-443c-95c9-f160676f849e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf"
Jul 22 12:20:56.922570 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:20:56.922518    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b745d71-63e6-443c-95c9-f160676f849e-maas-api-tls\") pod \"maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf\" (UID: \"2b745d71-63e6-443c-95c9-f160676f849e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf"
Jul 22 12:20:56.922570 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:20:56.922553    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b745d71-63e6-443c-95c9-f160676f849e-openshift-service-ca\") pod \"maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf\" (UID: \"2b745d71-63e6-443c-95c9-f160676f849e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf"
Jul 22 12:20:56.922910 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:20:56.922677    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-serving-cert: secret "maas-api-e2e-mt-a9b9afab-serving-cert" not found
Jul 22 12:20:56.922910 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:20:56.922760    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b745d71-63e6-443c-95c9-f160676f849e-maas-api-tls podName:2b745d71-63e6-443c-95c9-f160676f849e nodeName:}" failed. No retries permitted until 2026-07-22 12:20:57.422738382 +0000 UTC m=+1869.789253607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2b745d71-63e6-443c-95c9-f160676f849e-maas-api-tls") pod "maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf" (UID: "2b745d71-63e6-443c-95c9-f160676f849e") : secret "maas-api-e2e-mt-a9b9afab-serving-cert" not found
Jul 22 12:20:56.923175 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:20:56.923157    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b745d71-63e6-443c-95c9-f160676f849e-openshift-service-ca\") pod \"maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf\" (UID: \"2b745d71-63e6-443c-95c9-f160676f849e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf"
Jul 22 12:20:56.933044 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:20:56.933011    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrmmn\" (UniqueName: \"kubernetes.io/projected/2b745d71-63e6-443c-95c9-f160676f849e-kube-api-access-nrmmn\") pod \"maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf\" (UID: \"2b745d71-63e6-443c-95c9-f160676f849e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf"
Jul 22 12:20:57.426729 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:20:57.426686    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b745d71-63e6-443c-95c9-f160676f849e-maas-api-tls\") pod \"maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf\" (UID: \"2b745d71-63e6-443c-95c9-f160676f849e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf"
Jul 22 12:20:57.429067 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:20:57.429043    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b745d71-63e6-443c-95c9-f160676f849e-maas-api-tls\") pod \"maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf\" (UID: \"2b745d71-63e6-443c-95c9-f160676f849e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf"
Jul 22 12:20:57.580016 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:20:57.579984    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf"
Jul 22 12:20:57.719612 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:20:57.719583    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf"]
Jul 22 12:20:57.721559 ip-10-0-132-166 kubenswrapper[2558]: W0722 12:20:57.721532    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b745d71_63e6_443c_95c9_f160676f849e.slice/crio-7f44e833b049695f3a8964c5dfbb70595eaf911f309fb285d1daaf2fa2883a4b WatchSource:0}: Error finding container 7f44e833b049695f3a8964c5dfbb70595eaf911f309fb285d1daaf2fa2883a4b: Status 404 returned error can't find the container with id 7f44e833b049695f3a8964c5dfbb70595eaf911f309fb285d1daaf2fa2883a4b
Jul 22 12:20:57.723079 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:20:57.723057    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 12:20:58.505605 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:20:58.505516    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf" event={"ID":"2b745d71-63e6-443c-95c9-f160676f849e","Type":"ContainerStarted","Data":"a70b6f77c1e87b8c2e760b094930b80531fa30afc1511cb2e0391d0ef1a19b49"}
Jul 22 12:20:58.505605 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:20:58.505571    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf" event={"ID":"2b745d71-63e6-443c-95c9-f160676f849e","Type":"ContainerStarted","Data":"7f44e833b049695f3a8964c5dfbb70595eaf911f309fb285d1daaf2fa2883a4b"}
Jul 22 12:20:58.505854 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:20:58.505609    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf"
Jul 22 12:20:58.525493 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:20:58.525438    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf" podStartSLOduration=2.054810038 podStartE2EDuration="2.52541949s" totalImagesPullingTime="470.609452ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:20:58.522759781 +0000 UTC m=+1870.889275027" watchObservedRunningTime="2026-07-22 12:20:58.52541949 +0000 UTC m=+1870.891934733"
Jul 22 12:21:04.516159 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:04.516127    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf"
Jul 22 12:21:19.192319 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:19.192280    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf"]
Jul 22 12:21:19.192795 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:19.192531    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf" podUID="2b745d71-63e6-443c-95c9-f160676f849e" containerName="maas-api" containerID="cri-o://a70b6f77c1e87b8c2e760b094930b80531fa30afc1511cb2e0391d0ef1a19b49" gracePeriod=30
Jul 22 12:21:19.443417 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:19.443355    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf"
Jul 22 12:21:19.533985 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:19.533954    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b745d71-63e6-443c-95c9-f160676f849e-maas-api-tls\") pod \"2b745d71-63e6-443c-95c9-f160676f849e\" (UID: \"2b745d71-63e6-443c-95c9-f160676f849e\") "
Jul 22 12:21:19.534170 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:19.534032    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b745d71-63e6-443c-95c9-f160676f849e-openshift-service-ca\") pod \"2b745d71-63e6-443c-95c9-f160676f849e\" (UID: \"2b745d71-63e6-443c-95c9-f160676f849e\") "
Jul 22 12:21:19.534170 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:19.534089    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrmmn\" (UniqueName: \"kubernetes.io/projected/2b745d71-63e6-443c-95c9-f160676f849e-kube-api-access-nrmmn\") pod \"2b745d71-63e6-443c-95c9-f160676f849e\" (UID: \"2b745d71-63e6-443c-95c9-f160676f849e\") "
Jul 22 12:21:19.534469 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:19.534418    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b745d71-63e6-443c-95c9-f160676f849e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2b745d71-63e6-443c-95c9-f160676f849e" (UID: "2b745d71-63e6-443c-95c9-f160676f849e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:21:19.536157 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:19.536134    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b745d71-63e6-443c-95c9-f160676f849e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2b745d71-63e6-443c-95c9-f160676f849e" (UID: "2b745d71-63e6-443c-95c9-f160676f849e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:21:19.536271 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:19.536243    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b745d71-63e6-443c-95c9-f160676f849e-kube-api-access-nrmmn" (OuterVolumeSpecName: "kube-api-access-nrmmn") pod "2b745d71-63e6-443c-95c9-f160676f849e" (UID: "2b745d71-63e6-443c-95c9-f160676f849e"). InnerVolumeSpecName "kube-api-access-nrmmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:21:19.609513 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:19.609478    2558 generic.go:356] "Generic (PLEG): container finished" podID="2b745d71-63e6-443c-95c9-f160676f849e" containerID="a70b6f77c1e87b8c2e760b094930b80531fa30afc1511cb2e0391d0ef1a19b49" exitCode=0
Jul 22 12:21:19.609735 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:19.609522    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf"
Jul 22 12:21:19.609735 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:19.609570    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf" event={"ID":"2b745d71-63e6-443c-95c9-f160676f849e","Type":"ContainerDied","Data":"a70b6f77c1e87b8c2e760b094930b80531fa30afc1511cb2e0391d0ef1a19b49"}
Jul 22 12:21:19.609735 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:19.609628    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf" event={"ID":"2b745d71-63e6-443c-95c9-f160676f849e","Type":"ContainerDied","Data":"7f44e833b049695f3a8964c5dfbb70595eaf911f309fb285d1daaf2fa2883a4b"}
Jul 22 12:21:19.609735 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:19.609656    2558 scope.go:117] "RemoveContainer" containerID="a70b6f77c1e87b8c2e760b094930b80531fa30afc1511cb2e0391d0ef1a19b49"
Jul 22 12:21:19.618897 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:19.618876    2558 scope.go:117] "RemoveContainer" containerID="a70b6f77c1e87b8c2e760b094930b80531fa30afc1511cb2e0391d0ef1a19b49"
Jul 22 12:21:19.619191 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:21:19.619170    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a70b6f77c1e87b8c2e760b094930b80531fa30afc1511cb2e0391d0ef1a19b49\": container with ID starting with a70b6f77c1e87b8c2e760b094930b80531fa30afc1511cb2e0391d0ef1a19b49 not found: ID does not exist" containerID="a70b6f77c1e87b8c2e760b094930b80531fa30afc1511cb2e0391d0ef1a19b49"
Jul 22 12:21:19.619270 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:19.619204    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a70b6f77c1e87b8c2e760b094930b80531fa30afc1511cb2e0391d0ef1a19b49"} err="failed to get container status \"a70b6f77c1e87b8c2e760b094930b80531fa30afc1511cb2e0391d0ef1a19b49\": rpc error: code = NotFound desc = could not find container \"a70b6f77c1e87b8c2e760b094930b80531fa30afc1511cb2e0391d0ef1a19b49\": container with ID starting with a70b6f77c1e87b8c2e760b094930b80531fa30afc1511cb2e0391d0ef1a19b49 not found: ID does not exist"
Jul 22 12:21:19.631952 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:19.631923    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf"]
Jul 22 12:21:19.635967 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:19.635941    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b745d71-63e6-443c-95c9-f160676f849e-openshift-service-ca\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:21:19.636082 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:19.635970    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrmmn\" (UniqueName: \"kubernetes.io/projected/2b745d71-63e6-443c-95c9-f160676f849e-kube-api-access-nrmmn\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:21:19.636082 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:19.635987    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b745d71-63e6-443c-95c9-f160676f849e-maas-api-tls\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:21:19.636178 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:19.636158    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a9b9afab-7569f69655-f9gcf"]
Jul 22 12:21:20.447130 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:20.447097    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b745d71-63e6-443c-95c9-f160676f849e" path="/var/lib/kubelet/pods/2b745d71-63e6-443c-95c9-f160676f849e/volumes"
Jul 22 12:21:54.051725 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:54.051688    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57"]
Jul 22 12:21:54.054029 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:54.052299    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b745d71-63e6-443c-95c9-f160676f849e" containerName="maas-api"
Jul 22 12:21:54.054029 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:54.052317    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b745d71-63e6-443c-95c9-f160676f849e" containerName="maas-api"
Jul 22 12:21:54.054029 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:54.052458    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b745d71-63e6-443c-95c9-f160676f849e" containerName="maas-api"
Jul 22 12:21:54.055958 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:54.055936    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57"
Jul 22 12:21:54.058433 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:54.058409    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-8cd00702-serving-cert\""
Jul 22 12:21:54.065007 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:54.064980    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57"]
Jul 22 12:21:54.166939 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:54.166897    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwtrg\" (UniqueName: \"kubernetes.io/projected/d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6-kube-api-access-kwtrg\") pod \"maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57\" (UID: \"d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57"
Jul 22 12:21:54.166939 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:54.166941    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6-maas-api-tls\") pod \"maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57\" (UID: \"d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57"
Jul 22 12:21:54.167164 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:54.166973    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6-openshift-service-ca\") pod \"maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57\" (UID: \"d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57"
Jul 22 12:21:54.268114 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:54.268079    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6-openshift-service-ca\") pod \"maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57\" (UID: \"d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57"
Jul 22 12:21:54.268299 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:54.268177    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwtrg\" (UniqueName: \"kubernetes.io/projected/d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6-kube-api-access-kwtrg\") pod \"maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57\" (UID: \"d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57"
Jul 22 12:21:54.268299 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:54.268204    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6-maas-api-tls\") pod \"maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57\" (UID: \"d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57"
Jul 22 12:21:54.268748 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:54.268717    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6-openshift-service-ca\") pod \"maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57\" (UID: \"d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57"
Jul 22 12:21:54.270648 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:54.270610    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6-maas-api-tls\") pod \"maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57\" (UID: \"d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57"
Jul 22 12:21:54.290742 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:54.290712    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwtrg\" (UniqueName: \"kubernetes.io/projected/d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6-kube-api-access-kwtrg\") pod \"maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57\" (UID: \"d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57"
Jul 22 12:21:54.367655 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:54.367602    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57"
Jul 22 12:21:54.502919 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:54.502894    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57"]
Jul 22 12:21:54.504711 ip-10-0-132-166 kubenswrapper[2558]: W0722 12:21:54.504688    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4efd2f8_5f3b_4c6e_bf6a_8cd9a340eba6.slice/crio-2bbabbd0dcbf0ab084a3edfbf739b0702915d0d634e9b186345d0b1cbbcd26d0 WatchSource:0}: Error finding container 2bbabbd0dcbf0ab084a3edfbf739b0702915d0d634e9b186345d0b1cbbcd26d0: Status 404 returned error can't find the container with id 2bbabbd0dcbf0ab084a3edfbf739b0702915d0d634e9b186345d0b1cbbcd26d0
Jul 22 12:21:54.795870 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:54.795784    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57" event={"ID":"d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6","Type":"ContainerStarted","Data":"2bbabbd0dcbf0ab084a3edfbf739b0702915d0d634e9b186345d0b1cbbcd26d0"}
Jul 22 12:21:55.802904 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:55.802868    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57" event={"ID":"d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6","Type":"ContainerStarted","Data":"635d2c600de8ca5d0159c8184415ac2d1ec55773a9e9d762591bb1f56c6daff3"}
Jul 22 12:21:55.803286 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:55.802930    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57"
Jul 22 12:21:55.821887 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:21:55.821826    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57" podStartSLOduration=1.369747949 podStartE2EDuration="1.821812334s" totalImagesPullingTime="452.064385ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:21:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:21:55.819925301 +0000 UTC m=+1928.186440546" watchObservedRunningTime="2026-07-22 12:21:55.821812334 +0000 UTC m=+1928.188327577"
Jul 22 12:22:01.814242 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:01.814207    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57"
Jul 22 12:22:16.293098 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.293056    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"]
Jul 22 12:22:16.297062 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.297038    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"
Jul 22 12:22:16.299684 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.299656    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-8cd00702\"/\"openshift-service-ca.crt\""
Jul 22 12:22:16.299684 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.299667    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-8cd00702\"/\"kube-root-ca.crt\""
Jul 22 12:22:16.300551 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.300532    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-8cd00702\"/\"default-dockercfg-4kprq\""
Jul 22 12:22:16.300598 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.300582    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-8cd00702\"/\"e2e-lifecycle-model-8cd00702-kserve-self-signed-certs\""
Jul 22 12:22:16.306196 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.306113    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"]
Jul 22 12:22:16.393565 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.393528    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/569eacf0-e898-421a-9393-6cc47ba983c0-tmp-dir\") pod \"e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww\" (UID: \"569eacf0-e898-421a-9393-6cc47ba983c0\") " pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"
Jul 22 12:22:16.393790 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.393577    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/569eacf0-e898-421a-9393-6cc47ba983c0-model-cache\") pod \"e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww\" (UID: \"569eacf0-e898-421a-9393-6cc47ba983c0\") " pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"
Jul 22 12:22:16.393790 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.393689    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zjw2\" (UniqueName: \"kubernetes.io/projected/569eacf0-e898-421a-9393-6cc47ba983c0-kube-api-access-6zjw2\") pod \"e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww\" (UID: \"569eacf0-e898-421a-9393-6cc47ba983c0\") " pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"
Jul 22 12:22:16.393790 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.393768    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/569eacf0-e898-421a-9393-6cc47ba983c0-tls-certs\") pod \"e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww\" (UID: \"569eacf0-e898-421a-9393-6cc47ba983c0\") " pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"
Jul 22 12:22:16.393910 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.393815    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/569eacf0-e898-421a-9393-6cc47ba983c0-home\") pod \"e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww\" (UID: \"569eacf0-e898-421a-9393-6cc47ba983c0\") " pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"
Jul 22 12:22:16.393910 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.393887    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/569eacf0-e898-421a-9393-6cc47ba983c0-dshm\") pod \"e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww\" (UID: \"569eacf0-e898-421a-9393-6cc47ba983c0\") " pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"
Jul 22 12:22:16.495488 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.495456    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/569eacf0-e898-421a-9393-6cc47ba983c0-model-cache\") pod \"e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww\" (UID: \"569eacf0-e898-421a-9393-6cc47ba983c0\") " pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"
Jul 22 12:22:16.495732 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.495507    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zjw2\" (UniqueName: \"kubernetes.io/projected/569eacf0-e898-421a-9393-6cc47ba983c0-kube-api-access-6zjw2\") pod \"e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww\" (UID: \"569eacf0-e898-421a-9393-6cc47ba983c0\") " pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"
Jul 22 12:22:16.495732 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.495549    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/569eacf0-e898-421a-9393-6cc47ba983c0-tls-certs\") pod \"e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww\" (UID: \"569eacf0-e898-421a-9393-6cc47ba983c0\") " pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"
Jul 22 12:22:16.495732 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.495582    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/569eacf0-e898-421a-9393-6cc47ba983c0-home\") pod \"e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww\" (UID: \"569eacf0-e898-421a-9393-6cc47ba983c0\") " pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"
Jul 22 12:22:16.495732 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.495642    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/569eacf0-e898-421a-9393-6cc47ba983c0-dshm\") pod \"e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww\" (UID: \"569eacf0-e898-421a-9393-6cc47ba983c0\") " pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"
Jul 22 12:22:16.495732 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.495677    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/569eacf0-e898-421a-9393-6cc47ba983c0-tmp-dir\") pod \"e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww\" (UID: \"569eacf0-e898-421a-9393-6cc47ba983c0\") " pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"
Jul 22 12:22:16.496039 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.495955    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/569eacf0-e898-421a-9393-6cc47ba983c0-model-cache\") pod \"e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww\" (UID: \"569eacf0-e898-421a-9393-6cc47ba983c0\") " pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"
Jul 22 12:22:16.496039 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.496003    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/569eacf0-e898-421a-9393-6cc47ba983c0-home\") pod \"e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww\" (UID: \"569eacf0-e898-421a-9393-6cc47ba983c0\") " pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"
Jul 22 12:22:16.496039 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.496021    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/569eacf0-e898-421a-9393-6cc47ba983c0-tmp-dir\") pod \"e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww\" (UID: \"569eacf0-e898-421a-9393-6cc47ba983c0\") " pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"
Jul 22 12:22:16.497967 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.497938    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/569eacf0-e898-421a-9393-6cc47ba983c0-dshm\") pod \"e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww\" (UID: \"569eacf0-e898-421a-9393-6cc47ba983c0\") " pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"
Jul 22 12:22:16.498212 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.498195    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/569eacf0-e898-421a-9393-6cc47ba983c0-tls-certs\") pod \"e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww\" (UID: \"569eacf0-e898-421a-9393-6cc47ba983c0\") " pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"
Jul 22 12:22:16.504252 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.504228    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zjw2\" (UniqueName: \"kubernetes.io/projected/569eacf0-e898-421a-9393-6cc47ba983c0-kube-api-access-6zjw2\") pod \"e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww\" (UID: \"569eacf0-e898-421a-9393-6cc47ba983c0\") " pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"
Jul 22 12:22:16.609308 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.609220    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"
Jul 22 12:22:16.745339 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.745311    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"]
Jul 22 12:22:16.747218 ip-10-0-132-166 kubenswrapper[2558]: W0722 12:22:16.747184    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod569eacf0_e898_421a_9393_6cc47ba983c0.slice/crio-44c3e2d8f15ceb83a7181629ca8dcb0c8c5a9525a48a1b73001dd9ddb14fef34 WatchSource:0}: Error finding container 44c3e2d8f15ceb83a7181629ca8dcb0c8c5a9525a48a1b73001dd9ddb14fef34: Status 404 returned error can't find the container with id 44c3e2d8f15ceb83a7181629ca8dcb0c8c5a9525a48a1b73001dd9ddb14fef34
Jul 22 12:22:16.911097 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.911062    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww" event={"ID":"569eacf0-e898-421a-9393-6cc47ba983c0","Type":"ContainerStarted","Data":"283101fc16ee248d366eeb671136c084094b154151a917cd54814b966a7c232f"}
Jul 22 12:22:16.911271 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.911105    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww" event={"ID":"569eacf0-e898-421a-9393-6cc47ba983c0","Type":"ContainerStarted","Data":"44c3e2d8f15ceb83a7181629ca8dcb0c8c5a9525a48a1b73001dd9ddb14fef34"}
Jul 22 12:22:16.931273 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:16.931225    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww" podStartSLOduration=0.931209194 podStartE2EDuration="931.209194ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:22:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:22:16.929462433 +0000 UTC m=+1949.295977679" watchObservedRunningTime="2026-07-22 12:22:16.931209194 +0000 UTC m=+1949.297724438"
Jul 22 12:22:26.609437 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:26.609397    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"
Jul 22 12:22:26.610002 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:26.609452    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"
Jul 22 12:22:26.621515 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:26.621492    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"
Jul 22 12:22:26.973340 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:26.973314    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"
Jul 22 12:22:48.378967 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:48.378896    2558 scope.go:117] "RemoveContainer" containerID="5818684362b61ec595db801100054dd0606b1ea8d554a8d57296a8c569435ccf"
Jul 22 12:22:52.204999 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:52.204964    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57"]
Jul 22 12:22:52.205456 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:52.205170    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57" podUID="d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6" containerName="maas-api" containerID="cri-o://635d2c600de8ca5d0159c8184415ac2d1ec55773a9e9d762591bb1f56c6daff3" gracePeriod=30
Jul 22 12:22:52.460160 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:52.460101    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57"
Jul 22 12:22:52.543059 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:52.543024    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwtrg\" (UniqueName: \"kubernetes.io/projected/d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6-kube-api-access-kwtrg\") pod \"d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6\" (UID: \"d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6\") "
Jul 22 12:22:52.543237 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:52.543091    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6-openshift-service-ca\") pod \"d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6\" (UID: \"d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6\") "
Jul 22 12:22:52.543237 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:52.543194    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6-maas-api-tls\") pod \"d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6\" (UID: \"d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6\") "
Jul 22 12:22:52.543527 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:52.543500    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6" (UID: "d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:22:52.545141 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:52.545120    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6" (UID: "d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:22:52.545221 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:52.545180    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6-kube-api-access-kwtrg" (OuterVolumeSpecName: "kube-api-access-kwtrg") pod "d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6" (UID: "d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6"). InnerVolumeSpecName "kube-api-access-kwtrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:22:52.644476 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:52.644447    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6-maas-api-tls\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:22:52.644476 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:52.644474    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwtrg\" (UniqueName: \"kubernetes.io/projected/d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6-kube-api-access-kwtrg\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:22:52.644683 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:52.644484    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6-openshift-service-ca\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:22:53.098723 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:53.098685    2558 generic.go:356] "Generic (PLEG): container finished" podID="d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6" containerID="635d2c600de8ca5d0159c8184415ac2d1ec55773a9e9d762591bb1f56c6daff3" exitCode=0
Jul 22 12:22:53.098892 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:53.098736    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57"
Jul 22 12:22:53.098892 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:53.098776    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57" event={"ID":"d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6","Type":"ContainerDied","Data":"635d2c600de8ca5d0159c8184415ac2d1ec55773a9e9d762591bb1f56c6daff3"}
Jul 22 12:22:53.098892 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:53.098833    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57" event={"ID":"d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6","Type":"ContainerDied","Data":"2bbabbd0dcbf0ab084a3edfbf739b0702915d0d634e9b186345d0b1cbbcd26d0"}
Jul 22 12:22:53.098892 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:53.098855    2558 scope.go:117] "RemoveContainer" containerID="635d2c600de8ca5d0159c8184415ac2d1ec55773a9e9d762591bb1f56c6daff3"
Jul 22 12:22:53.109487 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:53.109457    2558 scope.go:117] "RemoveContainer" containerID="635d2c600de8ca5d0159c8184415ac2d1ec55773a9e9d762591bb1f56c6daff3"
Jul 22 12:22:53.109920 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:22:53.109900    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"635d2c600de8ca5d0159c8184415ac2d1ec55773a9e9d762591bb1f56c6daff3\": container with ID starting with 635d2c600de8ca5d0159c8184415ac2d1ec55773a9e9d762591bb1f56c6daff3 not found: ID does not exist" containerID="635d2c600de8ca5d0159c8184415ac2d1ec55773a9e9d762591bb1f56c6daff3"
Jul 22 12:22:53.110006 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:53.109932    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"635d2c600de8ca5d0159c8184415ac2d1ec55773a9e9d762591bb1f56c6daff3"} err="failed to get container status \"635d2c600de8ca5d0159c8184415ac2d1ec55773a9e9d762591bb1f56c6daff3\": rpc error: code = NotFound desc = could not find container \"635d2c600de8ca5d0159c8184415ac2d1ec55773a9e9d762591bb1f56c6daff3\": container with ID starting with 635d2c600de8ca5d0159c8184415ac2d1ec55773a9e9d762591bb1f56c6daff3 not found: ID does not exist"
Jul 22 12:22:53.124636 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:53.124598    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57"]
Jul 22 12:22:53.127445 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:53.127425    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8cd00702-6ff855d6f4-twc57"]
Jul 22 12:22:54.447397 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:22:54.447362    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6" path="/var/lib/kubelet/pods/d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6/volumes"
Jul 22 12:23:04.090359 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:04.090321    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"]
Jul 22 12:23:19.110774 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:19.110710    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww" podUID="569eacf0-e898-421a-9393-6cc47ba983c0" containerName="main" containerID="cri-o://283101fc16ee248d366eeb671136c084094b154151a917cd54814b966a7c232f" gracePeriod=45
Jul 22 12:23:19.229720 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:19.229690    2558 generic.go:356] "Generic (PLEG): container finished" podID="569eacf0-e898-421a-9393-6cc47ba983c0" containerID="283101fc16ee248d366eeb671136c084094b154151a917cd54814b966a7c232f" exitCode=0
Jul 22 12:23:19.229854 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:19.229731    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww" event={"ID":"569eacf0-e898-421a-9393-6cc47ba983c0","Type":"ContainerDied","Data":"283101fc16ee248d366eeb671136c084094b154151a917cd54814b966a7c232f"}
Jul 22 12:23:19.367663 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:19.367640    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"
Jul 22 12:23:19.493508 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:19.493476    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/569eacf0-e898-421a-9393-6cc47ba983c0-model-cache\") pod \"569eacf0-e898-421a-9393-6cc47ba983c0\" (UID: \"569eacf0-e898-421a-9393-6cc47ba983c0\") "
Jul 22 12:23:19.493738 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:19.493516    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zjw2\" (UniqueName: \"kubernetes.io/projected/569eacf0-e898-421a-9393-6cc47ba983c0-kube-api-access-6zjw2\") pod \"569eacf0-e898-421a-9393-6cc47ba983c0\" (UID: \"569eacf0-e898-421a-9393-6cc47ba983c0\") "
Jul 22 12:23:19.493738 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:19.493543    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/569eacf0-e898-421a-9393-6cc47ba983c0-dshm\") pod \"569eacf0-e898-421a-9393-6cc47ba983c0\" (UID: \"569eacf0-e898-421a-9393-6cc47ba983c0\") "
Jul 22 12:23:19.493738 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:19.493639    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/569eacf0-e898-421a-9393-6cc47ba983c0-tls-certs\") pod \"569eacf0-e898-421a-9393-6cc47ba983c0\" (UID: \"569eacf0-e898-421a-9393-6cc47ba983c0\") "
Jul 22 12:23:19.493738 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:19.493692    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/569eacf0-e898-421a-9393-6cc47ba983c0-tmp-dir\") pod \"569eacf0-e898-421a-9393-6cc47ba983c0\" (UID: \"569eacf0-e898-421a-9393-6cc47ba983c0\") "
Jul 22 12:23:19.493738 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:19.493720    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/569eacf0-e898-421a-9393-6cc47ba983c0-home\") pod \"569eacf0-e898-421a-9393-6cc47ba983c0\" (UID: \"569eacf0-e898-421a-9393-6cc47ba983c0\") "
Jul 22 12:23:19.494000 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:19.493813    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/569eacf0-e898-421a-9393-6cc47ba983c0-model-cache" (OuterVolumeSpecName: "model-cache") pod "569eacf0-e898-421a-9393-6cc47ba983c0" (UID: "569eacf0-e898-421a-9393-6cc47ba983c0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:23:19.494054 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:19.494004    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/569eacf0-e898-421a-9393-6cc47ba983c0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "569eacf0-e898-421a-9393-6cc47ba983c0" (UID: "569eacf0-e898-421a-9393-6cc47ba983c0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:23:19.494108 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:19.494045    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/569eacf0-e898-421a-9393-6cc47ba983c0-home" (OuterVolumeSpecName: "home") pod "569eacf0-e898-421a-9393-6cc47ba983c0" (UID: "569eacf0-e898-421a-9393-6cc47ba983c0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:23:19.494108 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:19.494090    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/569eacf0-e898-421a-9393-6cc47ba983c0-model-cache\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:23:19.495906 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:19.495882    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/569eacf0-e898-421a-9393-6cc47ba983c0-dshm" (OuterVolumeSpecName: "dshm") pod "569eacf0-e898-421a-9393-6cc47ba983c0" (UID: "569eacf0-e898-421a-9393-6cc47ba983c0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:23:19.495906 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:19.495887    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/569eacf0-e898-421a-9393-6cc47ba983c0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "569eacf0-e898-421a-9393-6cc47ba983c0" (UID: "569eacf0-e898-421a-9393-6cc47ba983c0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:23:19.496034 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:19.495889    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/569eacf0-e898-421a-9393-6cc47ba983c0-kube-api-access-6zjw2" (OuterVolumeSpecName: "kube-api-access-6zjw2") pod "569eacf0-e898-421a-9393-6cc47ba983c0" (UID: "569eacf0-e898-421a-9393-6cc47ba983c0"). InnerVolumeSpecName "kube-api-access-6zjw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:23:19.594876 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:19.594833    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/569eacf0-e898-421a-9393-6cc47ba983c0-tls-certs\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:23:19.594876 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:19.594868    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/569eacf0-e898-421a-9393-6cc47ba983c0-tmp-dir\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:23:19.594876 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:19.594876    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/569eacf0-e898-421a-9393-6cc47ba983c0-home\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:23:19.594876 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:19.594885    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zjw2\" (UniqueName: \"kubernetes.io/projected/569eacf0-e898-421a-9393-6cc47ba983c0-kube-api-access-6zjw2\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:23:19.595152 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:19.594895    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/569eacf0-e898-421a-9393-6cc47ba983c0-dshm\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:23:20.236204 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:20.236173    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"
Jul 22 12:23:20.236684 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:20.236211    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww" event={"ID":"569eacf0-e898-421a-9393-6cc47ba983c0","Type":"ContainerDied","Data":"44c3e2d8f15ceb83a7181629ca8dcb0c8c5a9525a48a1b73001dd9ddb14fef34"}
Jul 22 12:23:20.236684 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:20.236262    2558 scope.go:117] "RemoveContainer" containerID="283101fc16ee248d366eeb671136c084094b154151a917cd54814b966a7c232f"
Jul 22 12:23:20.260989 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:20.260962    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"]
Jul 22 12:23:20.265887 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:20.265862    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-8cd00702/e2e-lifecycle-model-8cd00702-kserve-54c887d95f-xjhww"]
Jul 22 12:23:20.447870 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:20.447841    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="569eacf0-e898-421a-9393-6cc47ba983c0" path="/var/lib/kubelet/pods/569eacf0-e898-421a-9393-6cc47ba983c0/volumes"
Jul 22 12:23:48.403721 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:23:48.401063    2558 scope.go:117] "RemoveContainer" containerID="9435c41144bfcce533411aaef249baf028888c57eb1a9548b7a09df0cfd64c3b"
Jul 22 12:24:49.138284 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:49.138244    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz"]
Jul 22 12:24:49.138926 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:49.138905    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6" containerName="maas-api"
Jul 22 12:24:49.138979 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:49.138931    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6" containerName="maas-api"
Jul 22 12:24:49.138979 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:49.138947    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="569eacf0-e898-421a-9393-6cc47ba983c0" containerName="main"
Jul 22 12:24:49.138979 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:49.138957    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="569eacf0-e898-421a-9393-6cc47ba983c0" containerName="main"
Jul 22 12:24:49.139087 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:49.139075    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="569eacf0-e898-421a-9393-6cc47ba983c0" containerName="main"
Jul 22 12:24:49.139123 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:49.139094    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4efd2f8-5f3b-4c6e-bf6a-8cd9a340eba6" containerName="maas-api"
Jul 22 12:24:49.142546 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:49.142521    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz"
Jul 22 12:24:49.144992 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:49.144961    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-53f570-serving-cert\""
Jul 22 12:24:49.153167 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:49.153142    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz"]
Jul 22 12:24:49.249785 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:49.249749    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2c2ea81-068d-4dc8-9ab4-49947c36c2c1-maas-api-tls\") pod \"maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz\" (UID: \"f2c2ea81-068d-4dc8-9ab4-49947c36c2c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz"
Jul 22 12:24:49.249958 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:49.249806    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5wdr\" (UniqueName: \"kubernetes.io/projected/f2c2ea81-068d-4dc8-9ab4-49947c36c2c1-kube-api-access-v5wdr\") pod \"maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz\" (UID: \"f2c2ea81-068d-4dc8-9ab4-49947c36c2c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz"
Jul 22 12:24:49.249958 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:49.249929    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2c2ea81-068d-4dc8-9ab4-49947c36c2c1-openshift-service-ca\") pod \"maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz\" (UID: \"f2c2ea81-068d-4dc8-9ab4-49947c36c2c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz"
Jul 22 12:24:49.350757 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:49.350722    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2c2ea81-068d-4dc8-9ab4-49947c36c2c1-maas-api-tls\") pod \"maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz\" (UID: \"f2c2ea81-068d-4dc8-9ab4-49947c36c2c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz"
Jul 22 12:24:49.350943 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:49.350774    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5wdr\" (UniqueName: \"kubernetes.io/projected/f2c2ea81-068d-4dc8-9ab4-49947c36c2c1-kube-api-access-v5wdr\") pod \"maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz\" (UID: \"f2c2ea81-068d-4dc8-9ab4-49947c36c2c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz"
Jul 22 12:24:49.350943 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:49.350828    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2c2ea81-068d-4dc8-9ab4-49947c36c2c1-openshift-service-ca\") pod \"maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz\" (UID: \"f2c2ea81-068d-4dc8-9ab4-49947c36c2c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz"
Jul 22 12:24:49.350943 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:24:49.350879    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-serving-cert: secret "maas-api-e2e-inf-a-53f570-serving-cert" not found
Jul 22 12:24:49.351054 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:24:49.350960    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2c2ea81-068d-4dc8-9ab4-49947c36c2c1-maas-api-tls podName:f2c2ea81-068d-4dc8-9ab4-49947c36c2c1 nodeName:}" failed. No retries permitted until 2026-07-22 12:24:49.850942277 +0000 UTC m=+2102.217457500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f2c2ea81-068d-4dc8-9ab4-49947c36c2c1-maas-api-tls") pod "maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz" (UID: "f2c2ea81-068d-4dc8-9ab4-49947c36c2c1") : secret "maas-api-e2e-inf-a-53f570-serving-cert" not found
Jul 22 12:24:49.351416 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:49.351399    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2c2ea81-068d-4dc8-9ab4-49947c36c2c1-openshift-service-ca\") pod \"maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz\" (UID: \"f2c2ea81-068d-4dc8-9ab4-49947c36c2c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz"
Jul 22 12:24:49.360869 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:49.360843    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5wdr\" (UniqueName: \"kubernetes.io/projected/f2c2ea81-068d-4dc8-9ab4-49947c36c2c1-kube-api-access-v5wdr\") pod \"maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz\" (UID: \"f2c2ea81-068d-4dc8-9ab4-49947c36c2c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz"
Jul 22 12:24:49.855781 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:49.855741    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2c2ea81-068d-4dc8-9ab4-49947c36c2c1-maas-api-tls\") pod \"maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz\" (UID: \"f2c2ea81-068d-4dc8-9ab4-49947c36c2c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz"
Jul 22 12:24:49.858319 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:49.858284    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2c2ea81-068d-4dc8-9ab4-49947c36c2c1-maas-api-tls\") pod \"maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz\" (UID: \"f2c2ea81-068d-4dc8-9ab4-49947c36c2c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz"
Jul 22 12:24:50.054435 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:50.054394    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz"
Jul 22 12:24:50.197812 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:50.197783    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz"]
Jul 22 12:24:50.199597 ip-10-0-132-166 kubenswrapper[2558]: W0722 12:24:50.199575    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2c2ea81_068d_4dc8_9ab4_49947c36c2c1.slice/crio-68895295b2978ca1960de80e7497d7f7cd85f6b66e4e06a745d8b6108e164a96 WatchSource:0}: Error finding container 68895295b2978ca1960de80e7497d7f7cd85f6b66e4e06a745d8b6108e164a96: Status 404 returned error can't find the container with id 68895295b2978ca1960de80e7497d7f7cd85f6b66e4e06a745d8b6108e164a96
Jul 22 12:24:50.668607 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:50.668572    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz" event={"ID":"f2c2ea81-068d-4dc8-9ab4-49947c36c2c1","Type":"ContainerStarted","Data":"7bed7aba1e147ad16e3fbc41e4b3ca969fa6af825c51bc577d6b8a6daf752bbd"}
Jul 22 12:24:50.668732 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:50.668659    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz"
Jul 22 12:24:50.668732 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:50.668687    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz" event={"ID":"f2c2ea81-068d-4dc8-9ab4-49947c36c2c1","Type":"ContainerStarted","Data":"68895295b2978ca1960de80e7497d7f7cd85f6b66e4e06a745d8b6108e164a96"}
Jul 22 12:24:50.687387 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:50.687335    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz" podStartSLOduration=1.290618292 podStartE2EDuration="1.687317561s" totalImagesPullingTime="396.699269ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:24:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:24:50.68625307 +0000 UTC m=+2103.052768313" watchObservedRunningTime="2026-07-22 12:24:50.687317561 +0000 UTC m=+2103.053832804"
Jul 22 12:24:56.678944 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:56.678915    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz"
Jul 22 12:24:57.142242 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:57.142207    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q"]
Jul 22 12:24:57.146197 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:57.146179    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q"
Jul 22 12:24:57.148714 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:57.148694    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-ffe082-serving-cert\""
Jul 22 12:24:57.157298 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:57.157270    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q"]
Jul 22 12:24:57.224110 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:57.224077    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzz5z\" (UniqueName: \"kubernetes.io/projected/c05d79d5-c182-4336-859b-a77947bb3008-kube-api-access-fzz5z\") pod \"maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q\" (UID: \"c05d79d5-c182-4336-859b-a77947bb3008\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q"
Jul 22 12:24:57.224301 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:57.224166    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c05d79d5-c182-4336-859b-a77947bb3008-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q\" (UID: \"c05d79d5-c182-4336-859b-a77947bb3008\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q"
Jul 22 12:24:57.224301 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:57.224211    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c05d79d5-c182-4336-859b-a77947bb3008-maas-api-tls\") pod \"maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q\" (UID: \"c05d79d5-c182-4336-859b-a77947bb3008\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q"
Jul 22 12:24:57.324891 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:57.324856    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzz5z\" (UniqueName: \"kubernetes.io/projected/c05d79d5-c182-4336-859b-a77947bb3008-kube-api-access-fzz5z\") pod \"maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q\" (UID: \"c05d79d5-c182-4336-859b-a77947bb3008\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q"
Jul 22 12:24:57.325074 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:57.324946    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c05d79d5-c182-4336-859b-a77947bb3008-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q\" (UID: \"c05d79d5-c182-4336-859b-a77947bb3008\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q"
Jul 22 12:24:57.325074 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:57.324997    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c05d79d5-c182-4336-859b-a77947bb3008-maas-api-tls\") pod \"maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q\" (UID: \"c05d79d5-c182-4336-859b-a77947bb3008\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q"
Jul 22 12:24:57.325161 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:24:57.325113    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-serving-cert: secret "maas-api-e2e-inf-b-ffe082-serving-cert" not found
Jul 22 12:24:57.325200 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:24:57.325193    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c05d79d5-c182-4336-859b-a77947bb3008-maas-api-tls podName:c05d79d5-c182-4336-859b-a77947bb3008 nodeName:}" failed. No retries permitted until 2026-07-22 12:24:57.825171712 +0000 UTC m=+2110.191686937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c05d79d5-c182-4336-859b-a77947bb3008-maas-api-tls") pod "maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q" (UID: "c05d79d5-c182-4336-859b-a77947bb3008") : secret "maas-api-e2e-inf-b-ffe082-serving-cert" not found
Jul 22 12:24:57.325729 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:57.325712    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c05d79d5-c182-4336-859b-a77947bb3008-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q\" (UID: \"c05d79d5-c182-4336-859b-a77947bb3008\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q"
Jul 22 12:24:57.333812 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:57.333792    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzz5z\" (UniqueName: \"kubernetes.io/projected/c05d79d5-c182-4336-859b-a77947bb3008-kube-api-access-fzz5z\") pod \"maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q\" (UID: \"c05d79d5-c182-4336-859b-a77947bb3008\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q"
Jul 22 12:24:57.829818 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:57.829785    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c05d79d5-c182-4336-859b-a77947bb3008-maas-api-tls\") pod \"maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q\" (UID: \"c05d79d5-c182-4336-859b-a77947bb3008\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q"
Jul 22 12:24:57.832104 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:57.832074    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c05d79d5-c182-4336-859b-a77947bb3008-maas-api-tls\") pod \"maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q\" (UID: \"c05d79d5-c182-4336-859b-a77947bb3008\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q"
Jul 22 12:24:58.057740 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:58.057704    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q"
Jul 22 12:24:58.193356 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:58.193329    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q"]
Jul 22 12:24:58.195845 ip-10-0-132-166 kubenswrapper[2558]: W0722 12:24:58.195816    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc05d79d5_c182_4336_859b_a77947bb3008.slice/crio-b60fb9ccb0c6b5ca1bc8b1970280d54bf1514f194b912fb223a42292b9cf7389 WatchSource:0}: Error finding container b60fb9ccb0c6b5ca1bc8b1970280d54bf1514f194b912fb223a42292b9cf7389: Status 404 returned error can't find the container with id b60fb9ccb0c6b5ca1bc8b1970280d54bf1514f194b912fb223a42292b9cf7389
Jul 22 12:24:58.711034 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:58.710997    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q" event={"ID":"c05d79d5-c182-4336-859b-a77947bb3008","Type":"ContainerStarted","Data":"4dd7bcc984d1cd73a36bb214bb49c90c898d7d58e493eef6b4dcf7f96c99e529"}
Jul 22 12:24:58.711208 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:58.711052    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q" event={"ID":"c05d79d5-c182-4336-859b-a77947bb3008","Type":"ContainerStarted","Data":"b60fb9ccb0c6b5ca1bc8b1970280d54bf1514f194b912fb223a42292b9cf7389"}
Jul 22 12:24:58.711208 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:58.711074    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q"
Jul 22 12:24:58.731143 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:24:58.731097    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q" podStartSLOduration=1.320648725 podStartE2EDuration="1.731082324s" totalImagesPullingTime="410.433599ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:24:58.731041798 +0000 UTC m=+2111.097557070" watchObservedRunningTime="2026-07-22 12:24:58.731082324 +0000 UTC m=+2111.097597562"
Jul 22 12:25:04.721499 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:04.721463    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q"
Jul 22 12:25:07.103937 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.103905    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"]
Jul 22 12:25:07.107610 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.107593    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"
Jul 22 12:25:07.110210 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.110185    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-53f570\"/\"openshift-service-ca.crt\""
Jul 22 12:25:07.110324 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.110255    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-53f570\"/\"kube-root-ca.crt\""
Jul 22 12:25:07.111305 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.111289    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-53f570\"/\"default-dockercfg-pb4mp\""
Jul 22 12:25:07.111439 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.111321    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-53f570\"/\"test-model-53f570-kserve-self-signed-certs\""
Jul 22 12:25:07.120980 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.120952    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"]
Jul 22 12:25:07.227340 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.227305    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38016109-c09f-4150-9c53-d08c9fe96d3b-home\") pod \"test-model-53f570-kserve-6ff97b5669-fgv5j\" (UID: \"38016109-c09f-4150-9c53-d08c9fe96d3b\") " pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"
Jul 22 12:25:07.227340 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.227348    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38016109-c09f-4150-9c53-d08c9fe96d3b-tls-certs\") pod \"test-model-53f570-kserve-6ff97b5669-fgv5j\" (UID: \"38016109-c09f-4150-9c53-d08c9fe96d3b\") " pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"
Jul 22 12:25:07.227560 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.227447    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhlpp\" (UniqueName: \"kubernetes.io/projected/38016109-c09f-4150-9c53-d08c9fe96d3b-kube-api-access-jhlpp\") pod \"test-model-53f570-kserve-6ff97b5669-fgv5j\" (UID: \"38016109-c09f-4150-9c53-d08c9fe96d3b\") " pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"
Jul 22 12:25:07.227560 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.227482    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38016109-c09f-4150-9c53-d08c9fe96d3b-model-cache\") pod \"test-model-53f570-kserve-6ff97b5669-fgv5j\" (UID: \"38016109-c09f-4150-9c53-d08c9fe96d3b\") " pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"
Jul 22 12:25:07.227560 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.227531    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38016109-c09f-4150-9c53-d08c9fe96d3b-dshm\") pod \"test-model-53f570-kserve-6ff97b5669-fgv5j\" (UID: \"38016109-c09f-4150-9c53-d08c9fe96d3b\") " pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"
Jul 22 12:25:07.227560 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.227553    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38016109-c09f-4150-9c53-d08c9fe96d3b-tmp-dir\") pod \"test-model-53f570-kserve-6ff97b5669-fgv5j\" (UID: \"38016109-c09f-4150-9c53-d08c9fe96d3b\") " pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"
Jul 22 12:25:07.328419 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.328381    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38016109-c09f-4150-9c53-d08c9fe96d3b-tls-certs\") pod \"test-model-53f570-kserve-6ff97b5669-fgv5j\" (UID: \"38016109-c09f-4150-9c53-d08c9fe96d3b\") " pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"
Jul 22 12:25:07.328608 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.328456    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhlpp\" (UniqueName: \"kubernetes.io/projected/38016109-c09f-4150-9c53-d08c9fe96d3b-kube-api-access-jhlpp\") pod \"test-model-53f570-kserve-6ff97b5669-fgv5j\" (UID: \"38016109-c09f-4150-9c53-d08c9fe96d3b\") " pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"
Jul 22 12:25:07.328608 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.328484    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38016109-c09f-4150-9c53-d08c9fe96d3b-model-cache\") pod \"test-model-53f570-kserve-6ff97b5669-fgv5j\" (UID: \"38016109-c09f-4150-9c53-d08c9fe96d3b\") " pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"
Jul 22 12:25:07.328608 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.328515    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38016109-c09f-4150-9c53-d08c9fe96d3b-dshm\") pod \"test-model-53f570-kserve-6ff97b5669-fgv5j\" (UID: \"38016109-c09f-4150-9c53-d08c9fe96d3b\") " pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"
Jul 22 12:25:07.328608 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.328534    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38016109-c09f-4150-9c53-d08c9fe96d3b-tmp-dir\") pod \"test-model-53f570-kserve-6ff97b5669-fgv5j\" (UID: \"38016109-c09f-4150-9c53-d08c9fe96d3b\") " pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"
Jul 22 12:25:07.328608 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.328579    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38016109-c09f-4150-9c53-d08c9fe96d3b-home\") pod \"test-model-53f570-kserve-6ff97b5669-fgv5j\" (UID: \"38016109-c09f-4150-9c53-d08c9fe96d3b\") " pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"
Jul 22 12:25:07.329034 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.329008    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38016109-c09f-4150-9c53-d08c9fe96d3b-model-cache\") pod \"test-model-53f570-kserve-6ff97b5669-fgv5j\" (UID: \"38016109-c09f-4150-9c53-d08c9fe96d3b\") " pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"
Jul 22 12:25:07.329115 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.329034    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38016109-c09f-4150-9c53-d08c9fe96d3b-home\") pod \"test-model-53f570-kserve-6ff97b5669-fgv5j\" (UID: \"38016109-c09f-4150-9c53-d08c9fe96d3b\") " pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"
Jul 22 12:25:07.329115 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.329092    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38016109-c09f-4150-9c53-d08c9fe96d3b-tmp-dir\") pod \"test-model-53f570-kserve-6ff97b5669-fgv5j\" (UID: \"38016109-c09f-4150-9c53-d08c9fe96d3b\") " pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"
Jul 22 12:25:07.330735 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.330714    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38016109-c09f-4150-9c53-d08c9fe96d3b-dshm\") pod \"test-model-53f570-kserve-6ff97b5669-fgv5j\" (UID: \"38016109-c09f-4150-9c53-d08c9fe96d3b\") " pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"
Jul 22 12:25:07.331091 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.331062    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38016109-c09f-4150-9c53-d08c9fe96d3b-tls-certs\") pod \"test-model-53f570-kserve-6ff97b5669-fgv5j\" (UID: \"38016109-c09f-4150-9c53-d08c9fe96d3b\") " pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"
Jul 22 12:25:07.338361 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.338334    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhlpp\" (UniqueName: \"kubernetes.io/projected/38016109-c09f-4150-9c53-d08c9fe96d3b-kube-api-access-jhlpp\") pod \"test-model-53f570-kserve-6ff97b5669-fgv5j\" (UID: \"38016109-c09f-4150-9c53-d08c9fe96d3b\") " pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"
Jul 22 12:25:07.416704 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.416667    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"
Jul 22 12:25:07.559579 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.559553    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"]
Jul 22 12:25:07.561235 ip-10-0-132-166 kubenswrapper[2558]: W0722 12:25:07.561207    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38016109_c09f_4150_9c53_d08c9fe96d3b.slice/crio-76e72ca41b8065b303e941aa06db8db517a2a29c4fe8014bd4fdef538bf8dbe3 WatchSource:0}: Error finding container 76e72ca41b8065b303e941aa06db8db517a2a29c4fe8014bd4fdef538bf8dbe3: Status 404 returned error can't find the container with id 76e72ca41b8065b303e941aa06db8db517a2a29c4fe8014bd4fdef538bf8dbe3
Jul 22 12:25:07.762815 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.762707    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j" event={"ID":"38016109-c09f-4150-9c53-d08c9fe96d3b","Type":"ContainerStarted","Data":"5d8f6af12867221b2a87be353703f46b87c9d14666063d96058cce30fcd6d130"}
Jul 22 12:25:07.762815 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.762766    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j" event={"ID":"38016109-c09f-4150-9c53-d08c9fe96d3b","Type":"ContainerStarted","Data":"76e72ca41b8065b303e941aa06db8db517a2a29c4fe8014bd4fdef538bf8dbe3"}
Jul 22 12:25:07.782675 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:07.782589    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j" podStartSLOduration=0.782568714 podStartE2EDuration="782.568714ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:25:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:25:07.781726058 +0000 UTC m=+2120.148241330" watchObservedRunningTime="2026-07-22 12:25:07.782568714 +0000 UTC m=+2120.149083960"
Jul 22 12:25:17.417226 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:17.417182    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"
Jul 22 12:25:17.417226 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:17.417228    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"
Jul 22 12:25:17.430033 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:17.430004    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"
Jul 22 12:25:17.826124 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:25:17.826040    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"
Jul 22 12:26:16.342658 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:16.342601    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"]
Jul 22 12:26:27.799433 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:27.799394    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz"]
Jul 22 12:26:27.799916 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:27.799670    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz" podUID="f2c2ea81-068d-4dc8-9ab4-49947c36c2c1" containerName="maas-api" containerID="cri-o://7bed7aba1e147ad16e3fbc41e4b3ca969fa6af825c51bc577d6b8a6daf752bbd" gracePeriod=30
Jul 22 12:26:28.051693 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:28.051640    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz"
Jul 22 12:26:28.115517 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:28.115479    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2c2ea81-068d-4dc8-9ab4-49947c36c2c1-openshift-service-ca\") pod \"f2c2ea81-068d-4dc8-9ab4-49947c36c2c1\" (UID: \"f2c2ea81-068d-4dc8-9ab4-49947c36c2c1\") "
Jul 22 12:26:28.115718 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:28.115561    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2c2ea81-068d-4dc8-9ab4-49947c36c2c1-maas-api-tls\") pod \"f2c2ea81-068d-4dc8-9ab4-49947c36c2c1\" (UID: \"f2c2ea81-068d-4dc8-9ab4-49947c36c2c1\") "
Jul 22 12:26:28.115718 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:28.115644    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5wdr\" (UniqueName: \"kubernetes.io/projected/f2c2ea81-068d-4dc8-9ab4-49947c36c2c1-kube-api-access-v5wdr\") pod \"f2c2ea81-068d-4dc8-9ab4-49947c36c2c1\" (UID: \"f2c2ea81-068d-4dc8-9ab4-49947c36c2c1\") "
Jul 22 12:26:28.115949 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:28.115923    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2c2ea81-068d-4dc8-9ab4-49947c36c2c1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f2c2ea81-068d-4dc8-9ab4-49947c36c2c1" (UID: "f2c2ea81-068d-4dc8-9ab4-49947c36c2c1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:26:28.117713 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:28.117692    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2c2ea81-068d-4dc8-9ab4-49947c36c2c1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f2c2ea81-068d-4dc8-9ab4-49947c36c2c1" (UID: "f2c2ea81-068d-4dc8-9ab4-49947c36c2c1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:26:28.117778 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:28.117696    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2c2ea81-068d-4dc8-9ab4-49947c36c2c1-kube-api-access-v5wdr" (OuterVolumeSpecName: "kube-api-access-v5wdr") pod "f2c2ea81-068d-4dc8-9ab4-49947c36c2c1" (UID: "f2c2ea81-068d-4dc8-9ab4-49947c36c2c1"). InnerVolumeSpecName "kube-api-access-v5wdr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:26:28.184180 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:28.184145    2558 generic.go:356] "Generic (PLEG): container finished" podID="f2c2ea81-068d-4dc8-9ab4-49947c36c2c1" containerID="7bed7aba1e147ad16e3fbc41e4b3ca969fa6af825c51bc577d6b8a6daf752bbd" exitCode=0
Jul 22 12:26:28.184337 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:28.184184    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz"
Jul 22 12:26:28.184337 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:28.184212    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz" event={"ID":"f2c2ea81-068d-4dc8-9ab4-49947c36c2c1","Type":"ContainerDied","Data":"7bed7aba1e147ad16e3fbc41e4b3ca969fa6af825c51bc577d6b8a6daf752bbd"}
Jul 22 12:26:28.184337 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:28.184257    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz" event={"ID":"f2c2ea81-068d-4dc8-9ab4-49947c36c2c1","Type":"ContainerDied","Data":"68895295b2978ca1960de80e7497d7f7cd85f6b66e4e06a745d8b6108e164a96"}
Jul 22 12:26:28.184337 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:28.184283    2558 scope.go:117] "RemoveContainer" containerID="7bed7aba1e147ad16e3fbc41e4b3ca969fa6af825c51bc577d6b8a6daf752bbd"
Jul 22 12:26:28.192986 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:28.192968    2558 scope.go:117] "RemoveContainer" containerID="7bed7aba1e147ad16e3fbc41e4b3ca969fa6af825c51bc577d6b8a6daf752bbd"
Jul 22 12:26:28.193230 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:26:28.193210    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bed7aba1e147ad16e3fbc41e4b3ca969fa6af825c51bc577d6b8a6daf752bbd\": container with ID starting with 7bed7aba1e147ad16e3fbc41e4b3ca969fa6af825c51bc577d6b8a6daf752bbd not found: ID does not exist" containerID="7bed7aba1e147ad16e3fbc41e4b3ca969fa6af825c51bc577d6b8a6daf752bbd"
Jul 22 12:26:28.193282 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:28.193238    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bed7aba1e147ad16e3fbc41e4b3ca969fa6af825c51bc577d6b8a6daf752bbd"} err="failed to get container status \"7bed7aba1e147ad16e3fbc41e4b3ca969fa6af825c51bc577d6b8a6daf752bbd\": rpc error: code = NotFound desc = could not find container \"7bed7aba1e147ad16e3fbc41e4b3ca969fa6af825c51bc577d6b8a6daf752bbd\": container with ID starting with 7bed7aba1e147ad16e3fbc41e4b3ca969fa6af825c51bc577d6b8a6daf752bbd not found: ID does not exist"
Jul 22 12:26:28.206923 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:28.206894    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz"]
Jul 22 12:26:28.211478 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:28.211455    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-53f570-cd9d84f9d-fk4sz"]
Jul 22 12:26:28.216776 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:28.216759    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2c2ea81-068d-4dc8-9ab4-49947c36c2c1-maas-api-tls\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:26:28.216849 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:28.216779    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5wdr\" (UniqueName: \"kubernetes.io/projected/f2c2ea81-068d-4dc8-9ab4-49947c36c2c1-kube-api-access-v5wdr\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:26:28.216849 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:28.216788    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2c2ea81-068d-4dc8-9ab4-49947c36c2c1-openshift-service-ca\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:26:28.452124 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:28.451433    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2c2ea81-068d-4dc8-9ab4-49947c36c2c1" path="/var/lib/kubelet/pods/f2c2ea81-068d-4dc8-9ab4-49947c36c2c1/volumes"
Jul 22 12:26:31.363749 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:31.363700    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j" podUID="38016109-c09f-4150-9c53-d08c9fe96d3b" containerName="main" containerID="cri-o://5d8f6af12867221b2a87be353703f46b87c9d14666063d96058cce30fcd6d130" gracePeriod=45
Jul 22 12:26:31.618556 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:31.618531    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"
Jul 22 12:26:31.749337 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:31.749301    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38016109-c09f-4150-9c53-d08c9fe96d3b-tmp-dir\") pod \"38016109-c09f-4150-9c53-d08c9fe96d3b\" (UID: \"38016109-c09f-4150-9c53-d08c9fe96d3b\") "
Jul 22 12:26:31.749493 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:31.749368    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38016109-c09f-4150-9c53-d08c9fe96d3b-home\") pod \"38016109-c09f-4150-9c53-d08c9fe96d3b\" (UID: \"38016109-c09f-4150-9c53-d08c9fe96d3b\") "
Jul 22 12:26:31.749493 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:31.749422    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38016109-c09f-4150-9c53-d08c9fe96d3b-dshm\") pod \"38016109-c09f-4150-9c53-d08c9fe96d3b\" (UID: \"38016109-c09f-4150-9c53-d08c9fe96d3b\") "
Jul 22 12:26:31.749493 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:31.749443    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38016109-c09f-4150-9c53-d08c9fe96d3b-tls-certs\") pod \"38016109-c09f-4150-9c53-d08c9fe96d3b\" (UID: \"38016109-c09f-4150-9c53-d08c9fe96d3b\") "
Jul 22 12:26:31.749493 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:31.749474    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhlpp\" (UniqueName: \"kubernetes.io/projected/38016109-c09f-4150-9c53-d08c9fe96d3b-kube-api-access-jhlpp\") pod \"38016109-c09f-4150-9c53-d08c9fe96d3b\" (UID: \"38016109-c09f-4150-9c53-d08c9fe96d3b\") "
Jul 22 12:26:31.749493 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:31.749495    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38016109-c09f-4150-9c53-d08c9fe96d3b-model-cache\") pod \"38016109-c09f-4150-9c53-d08c9fe96d3b\" (UID: \"38016109-c09f-4150-9c53-d08c9fe96d3b\") "
Jul 22 12:26:31.749819 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:31.749646    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38016109-c09f-4150-9c53-d08c9fe96d3b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "38016109-c09f-4150-9c53-d08c9fe96d3b" (UID: "38016109-c09f-4150-9c53-d08c9fe96d3b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:26:31.749819 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:31.749712    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38016109-c09f-4150-9c53-d08c9fe96d3b-home" (OuterVolumeSpecName: "home") pod "38016109-c09f-4150-9c53-d08c9fe96d3b" (UID: "38016109-c09f-4150-9c53-d08c9fe96d3b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:26:31.749907 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:31.749848    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38016109-c09f-4150-9c53-d08c9fe96d3b-model-cache" (OuterVolumeSpecName: "model-cache") pod "38016109-c09f-4150-9c53-d08c9fe96d3b" (UID: "38016109-c09f-4150-9c53-d08c9fe96d3b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:26:31.749907 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:31.749862    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38016109-c09f-4150-9c53-d08c9fe96d3b-tmp-dir\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:26:31.749907 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:31.749880    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38016109-c09f-4150-9c53-d08c9fe96d3b-home\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:26:31.751784 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:31.751757    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38016109-c09f-4150-9c53-d08c9fe96d3b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "38016109-c09f-4150-9c53-d08c9fe96d3b" (UID: "38016109-c09f-4150-9c53-d08c9fe96d3b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:26:31.751895 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:31.751782    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38016109-c09f-4150-9c53-d08c9fe96d3b-dshm" (OuterVolumeSpecName: "dshm") pod "38016109-c09f-4150-9c53-d08c9fe96d3b" (UID: "38016109-c09f-4150-9c53-d08c9fe96d3b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:26:31.751895 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:31.751868    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38016109-c09f-4150-9c53-d08c9fe96d3b-kube-api-access-jhlpp" (OuterVolumeSpecName: "kube-api-access-jhlpp") pod "38016109-c09f-4150-9c53-d08c9fe96d3b" (UID: "38016109-c09f-4150-9c53-d08c9fe96d3b"). InnerVolumeSpecName "kube-api-access-jhlpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:26:31.850560 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:31.850516    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38016109-c09f-4150-9c53-d08c9fe96d3b-dshm\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:26:31.850560 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:31.850553    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38016109-c09f-4150-9c53-d08c9fe96d3b-tls-certs\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:26:31.850560 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:31.850565    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhlpp\" (UniqueName: \"kubernetes.io/projected/38016109-c09f-4150-9c53-d08c9fe96d3b-kube-api-access-jhlpp\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:26:31.850821 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:31.850576    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38016109-c09f-4150-9c53-d08c9fe96d3b-model-cache\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:26:32.205937 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:32.205906    2558 generic.go:356] "Generic (PLEG): container finished" podID="38016109-c09f-4150-9c53-d08c9fe96d3b" containerID="5d8f6af12867221b2a87be353703f46b87c9d14666063d96058cce30fcd6d130" exitCode=0
Jul 22 12:26:32.206110 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:32.205945    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"
Jul 22 12:26:32.206110 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:32.205974    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j" event={"ID":"38016109-c09f-4150-9c53-d08c9fe96d3b","Type":"ContainerDied","Data":"5d8f6af12867221b2a87be353703f46b87c9d14666063d96058cce30fcd6d130"}
Jul 22 12:26:32.206110 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:32.206008    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j" event={"ID":"38016109-c09f-4150-9c53-d08c9fe96d3b","Type":"ContainerDied","Data":"76e72ca41b8065b303e941aa06db8db517a2a29c4fe8014bd4fdef538bf8dbe3"}
Jul 22 12:26:32.206110 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:32.206025    2558 scope.go:117] "RemoveContainer" containerID="5d8f6af12867221b2a87be353703f46b87c9d14666063d96058cce30fcd6d130"
Jul 22 12:26:32.216033 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:32.216015    2558 scope.go:117] "RemoveContainer" containerID="5d8f6af12867221b2a87be353703f46b87c9d14666063d96058cce30fcd6d130"
Jul 22 12:26:32.216291 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:26:32.216272    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d8f6af12867221b2a87be353703f46b87c9d14666063d96058cce30fcd6d130\": container with ID starting with 5d8f6af12867221b2a87be353703f46b87c9d14666063d96058cce30fcd6d130 not found: ID does not exist" containerID="5d8f6af12867221b2a87be353703f46b87c9d14666063d96058cce30fcd6d130"
Jul 22 12:26:32.216369 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:32.216300    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d8f6af12867221b2a87be353703f46b87c9d14666063d96058cce30fcd6d130"} err="failed to get container status \"5d8f6af12867221b2a87be353703f46b87c9d14666063d96058cce30fcd6d130\": rpc error: code = NotFound desc = could not find container \"5d8f6af12867221b2a87be353703f46b87c9d14666063d96058cce30fcd6d130\": container with ID starting with 5d8f6af12867221b2a87be353703f46b87c9d14666063d96058cce30fcd6d130 not found: ID does not exist"
Jul 22 12:26:32.229105 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:32.229070    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"]
Jul 22 12:26:32.233851 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:32.233825    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-53f570/test-model-53f570-kserve-6ff97b5669-fgv5j"]
Jul 22 12:26:32.446659 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:32.446609    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38016109-c09f-4150-9c53-d08c9fe96d3b" path="/var/lib/kubelet/pods/38016109-c09f-4150-9c53-d08c9fe96d3b/volumes"
Jul 22 12:26:50.504661 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:50.504611    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q"]
Jul 22 12:26:50.505137 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:50.504859    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q" podUID="c05d79d5-c182-4336-859b-a77947bb3008" containerName="maas-api" containerID="cri-o://4dd7bcc984d1cd73a36bb214bb49c90c898d7d58e493eef6b4dcf7f96c99e529" gracePeriod=30
Jul 22 12:26:50.956411 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:50.956386    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q"
Jul 22 12:26:51.032126 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:51.032042    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c05d79d5-c182-4336-859b-a77947bb3008-maas-api-tls\") pod \"c05d79d5-c182-4336-859b-a77947bb3008\" (UID: \"c05d79d5-c182-4336-859b-a77947bb3008\") "
Jul 22 12:26:51.032126 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:51.032117    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzz5z\" (UniqueName: \"kubernetes.io/projected/c05d79d5-c182-4336-859b-a77947bb3008-kube-api-access-fzz5z\") pod \"c05d79d5-c182-4336-859b-a77947bb3008\" (UID: \"c05d79d5-c182-4336-859b-a77947bb3008\") "
Jul 22 12:26:51.032319 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:51.032223    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c05d79d5-c182-4336-859b-a77947bb3008-openshift-service-ca\") pod \"c05d79d5-c182-4336-859b-a77947bb3008\" (UID: \"c05d79d5-c182-4336-859b-a77947bb3008\") "
Jul 22 12:26:51.032557 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:51.032530    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c05d79d5-c182-4336-859b-a77947bb3008-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c05d79d5-c182-4336-859b-a77947bb3008" (UID: "c05d79d5-c182-4336-859b-a77947bb3008"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:26:51.034205 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:51.034182    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c05d79d5-c182-4336-859b-a77947bb3008-kube-api-access-fzz5z" (OuterVolumeSpecName: "kube-api-access-fzz5z") pod "c05d79d5-c182-4336-859b-a77947bb3008" (UID: "c05d79d5-c182-4336-859b-a77947bb3008"). InnerVolumeSpecName "kube-api-access-fzz5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:26:51.034205 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:51.034192    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c05d79d5-c182-4336-859b-a77947bb3008-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c05d79d5-c182-4336-859b-a77947bb3008" (UID: "c05d79d5-c182-4336-859b-a77947bb3008"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:26:51.133381 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:51.133350    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c05d79d5-c182-4336-859b-a77947bb3008-openshift-service-ca\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:26:51.133381 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:51.133377    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c05d79d5-c182-4336-859b-a77947bb3008-maas-api-tls\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:26:51.133381 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:51.133386    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzz5z\" (UniqueName: \"kubernetes.io/projected/c05d79d5-c182-4336-859b-a77947bb3008-kube-api-access-fzz5z\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:26:51.304980 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:51.304893    2558 generic.go:356] "Generic (PLEG): container finished" podID="c05d79d5-c182-4336-859b-a77947bb3008" containerID="4dd7bcc984d1cd73a36bb214bb49c90c898d7d58e493eef6b4dcf7f96c99e529" exitCode=0
Jul 22 12:26:51.304980 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:51.304944    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q"
Jul 22 12:26:51.305173 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:51.304942    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q" event={"ID":"c05d79d5-c182-4336-859b-a77947bb3008","Type":"ContainerDied","Data":"4dd7bcc984d1cd73a36bb214bb49c90c898d7d58e493eef6b4dcf7f96c99e529"}
Jul 22 12:26:51.305173 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:51.305091    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q" event={"ID":"c05d79d5-c182-4336-859b-a77947bb3008","Type":"ContainerDied","Data":"b60fb9ccb0c6b5ca1bc8b1970280d54bf1514f194b912fb223a42292b9cf7389"}
Jul 22 12:26:51.305173 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:51.305122    2558 scope.go:117] "RemoveContainer" containerID="4dd7bcc984d1cd73a36bb214bb49c90c898d7d58e493eef6b4dcf7f96c99e529"
Jul 22 12:26:51.314187 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:51.314168    2558 scope.go:117] "RemoveContainer" containerID="4dd7bcc984d1cd73a36bb214bb49c90c898d7d58e493eef6b4dcf7f96c99e529"
Jul 22 12:26:51.314442 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:26:51.314420    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dd7bcc984d1cd73a36bb214bb49c90c898d7d58e493eef6b4dcf7f96c99e529\": container with ID starting with 4dd7bcc984d1cd73a36bb214bb49c90c898d7d58e493eef6b4dcf7f96c99e529 not found: ID does not exist" containerID="4dd7bcc984d1cd73a36bb214bb49c90c898d7d58e493eef6b4dcf7f96c99e529"
Jul 22 12:26:51.314503 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:51.314450    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dd7bcc984d1cd73a36bb214bb49c90c898d7d58e493eef6b4dcf7f96c99e529"} err="failed to get container status \"4dd7bcc984d1cd73a36bb214bb49c90c898d7d58e493eef6b4dcf7f96c99e529\": rpc error: code = NotFound desc = could not find container \"4dd7bcc984d1cd73a36bb214bb49c90c898d7d58e493eef6b4dcf7f96c99e529\": container with ID starting with 4dd7bcc984d1cd73a36bb214bb49c90c898d7d58e493eef6b4dcf7f96c99e529 not found: ID does not exist"
Jul 22 12:26:51.327050 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:51.327027    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q"]
Jul 22 12:26:51.331158 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:51.331136    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ffe082-5ff88b94cb-m4d7q"]
Jul 22 12:26:52.446778 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:26:52.446740    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c05d79d5-c182-4336-859b-a77947bb3008" path="/var/lib/kubelet/pods/c05d79d5-c182-4336-859b-a77947bb3008/volumes"
Jul 22 12:27:06.858074 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:06.858038    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6"]
Jul 22 12:27:06.858527 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:06.858510    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38016109-c09f-4150-9c53-d08c9fe96d3b" containerName="main"
Jul 22 12:27:06.858573 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:06.858530    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="38016109-c09f-4150-9c53-d08c9fe96d3b" containerName="main"
Jul 22 12:27:06.858573 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:06.858548    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2c2ea81-068d-4dc8-9ab4-49947c36c2c1" containerName="maas-api"
Jul 22 12:27:06.858573 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:06.858554    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2c2ea81-068d-4dc8-9ab4-49947c36c2c1" containerName="maas-api"
Jul 22 12:27:06.858573 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:06.858567    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c05d79d5-c182-4336-859b-a77947bb3008" containerName="maas-api"
Jul 22 12:27:06.858573 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:06.858573    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c05d79d5-c182-4336-859b-a77947bb3008" containerName="maas-api"
Jul 22 12:27:06.858762 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:06.858653    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="38016109-c09f-4150-9c53-d08c9fe96d3b" containerName="main"
Jul 22 12:27:06.858762 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:06.858662    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2c2ea81-068d-4dc8-9ab4-49947c36c2c1" containerName="maas-api"
Jul 22 12:27:06.858762 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:06.858669    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c05d79d5-c182-4336-859b-a77947bb3008" containerName="maas-api"
Jul 22 12:27:06.861847 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:06.861832    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6"
Jul 22 12:27:06.864383 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:06.864351    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-e96939-serving-cert\""
Jul 22 12:27:06.872933 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:06.872908    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6"]
Jul 22 12:27:06.979307 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:06.979269    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6627cfed-7768-4a23-929c-162883bd8b35-openshift-service-ca\") pod \"maas-api-e2e-api-a-e96939-599dcb4778-4qsw6\" (UID: \"6627cfed-7768-4a23-929c-162883bd8b35\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6"
Jul 22 12:27:06.979477 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:06.979323    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6627cfed-7768-4a23-929c-162883bd8b35-maas-api-tls\") pod \"maas-api-e2e-api-a-e96939-599dcb4778-4qsw6\" (UID: \"6627cfed-7768-4a23-929c-162883bd8b35\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6"
Jul 22 12:27:06.979477 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:06.979392    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnvwt\" (UniqueName: \"kubernetes.io/projected/6627cfed-7768-4a23-929c-162883bd8b35-kube-api-access-wnvwt\") pod \"maas-api-e2e-api-a-e96939-599dcb4778-4qsw6\" (UID: \"6627cfed-7768-4a23-929c-162883bd8b35\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6"
Jul 22 12:27:07.080341 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:07.080303    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6627cfed-7768-4a23-929c-162883bd8b35-openshift-service-ca\") pod \"maas-api-e2e-api-a-e96939-599dcb4778-4qsw6\" (UID: \"6627cfed-7768-4a23-929c-162883bd8b35\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6"
Jul 22 12:27:07.080552 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:07.080363    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6627cfed-7768-4a23-929c-162883bd8b35-maas-api-tls\") pod \"maas-api-e2e-api-a-e96939-599dcb4778-4qsw6\" (UID: \"6627cfed-7768-4a23-929c-162883bd8b35\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6"
Jul 22 12:27:07.080552 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:07.080437    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnvwt\" (UniqueName: \"kubernetes.io/projected/6627cfed-7768-4a23-929c-162883bd8b35-kube-api-access-wnvwt\") pod \"maas-api-e2e-api-a-e96939-599dcb4778-4qsw6\" (UID: \"6627cfed-7768-4a23-929c-162883bd8b35\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6"
Jul 22 12:27:07.081204 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:07.081172    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6627cfed-7768-4a23-929c-162883bd8b35-openshift-service-ca\") pod \"maas-api-e2e-api-a-e96939-599dcb4778-4qsw6\" (UID: \"6627cfed-7768-4a23-929c-162883bd8b35\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6"
Jul 22 12:27:07.083465 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:07.083441    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6627cfed-7768-4a23-929c-162883bd8b35-maas-api-tls\") pod \"maas-api-e2e-api-a-e96939-599dcb4778-4qsw6\" (UID: \"6627cfed-7768-4a23-929c-162883bd8b35\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6"
Jul 22 12:27:07.090851 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:07.090829    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnvwt\" (UniqueName: \"kubernetes.io/projected/6627cfed-7768-4a23-929c-162883bd8b35-kube-api-access-wnvwt\") pod \"maas-api-e2e-api-a-e96939-599dcb4778-4qsw6\" (UID: \"6627cfed-7768-4a23-929c-162883bd8b35\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6"
Jul 22 12:27:07.173006 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:07.172971    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6"
Jul 22 12:27:07.316568 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:07.316533    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6"]
Jul 22 12:27:07.318770 ip-10-0-132-166 kubenswrapper[2558]: W0722 12:27:07.318745    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6627cfed_7768_4a23_929c_162883bd8b35.slice/crio-f62248e4c249547d1958739c31193827444ccb0d0ad43c0afccbc3412c56e250 WatchSource:0}: Error finding container f62248e4c249547d1958739c31193827444ccb0d0ad43c0afccbc3412c56e250: Status 404 returned error can't find the container with id f62248e4c249547d1958739c31193827444ccb0d0ad43c0afccbc3412c56e250
Jul 22 12:27:07.320506 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:07.320488    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 12:27:07.392539 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:07.392502    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6" event={"ID":"6627cfed-7768-4a23-929c-162883bd8b35","Type":"ContainerStarted","Data":"f62248e4c249547d1958739c31193827444ccb0d0ad43c0afccbc3412c56e250"}
Jul 22 12:27:08.400680 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:08.400643    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6" event={"ID":"6627cfed-7768-4a23-929c-162883bd8b35","Type":"ContainerStarted","Data":"b5ac7482be91c0f7e7271c602f4d402f65b02cf6123b6123db3fe24dd8766b7b"}
Jul 22 12:27:08.401091 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:08.400739    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6"
Jul 22 12:27:08.418716 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:08.418663    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6" podStartSLOduration=2.006790189 podStartE2EDuration="2.418647441s" totalImagesPullingTime="411.857252ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:27:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:27:08.417237947 +0000 UTC m=+2240.783753209" watchObservedRunningTime="2026-07-22 12:27:08.418647441 +0000 UTC m=+2240.785162679"
Jul 22 12:27:14.413423 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:14.413389    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6"
Jul 22 12:27:14.812836 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:14.812753    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r"]
Jul 22 12:27:14.816547 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:14.816527    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r"
Jul 22 12:27:14.819269 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:14.819242    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-9edc58-serving-cert\""
Jul 22 12:27:14.828941 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:14.828915    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r"]
Jul 22 12:27:14.960421 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:14.960383    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1caf3e3-3bbb-4e2d-afd7-c75f54392873-maas-api-tls\") pod \"maas-api-e2e-api-b-9edc58-79f699564d-4gd8r\" (UID: \"a1caf3e3-3bbb-4e2d-afd7-c75f54392873\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r"
Jul 22 12:27:14.960592 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:14.960436    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1caf3e3-3bbb-4e2d-afd7-c75f54392873-openshift-service-ca\") pod \"maas-api-e2e-api-b-9edc58-79f699564d-4gd8r\" (UID: \"a1caf3e3-3bbb-4e2d-afd7-c75f54392873\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r"
Jul 22 12:27:14.960592 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:14.960501    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpmlj\" (UniqueName: \"kubernetes.io/projected/a1caf3e3-3bbb-4e2d-afd7-c75f54392873-kube-api-access-rpmlj\") pod \"maas-api-e2e-api-b-9edc58-79f699564d-4gd8r\" (UID: \"a1caf3e3-3bbb-4e2d-afd7-c75f54392873\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r"
Jul 22 12:27:15.061269 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:15.061237    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1caf3e3-3bbb-4e2d-afd7-c75f54392873-openshift-service-ca\") pod \"maas-api-e2e-api-b-9edc58-79f699564d-4gd8r\" (UID: \"a1caf3e3-3bbb-4e2d-afd7-c75f54392873\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r"
Jul 22 12:27:15.061418 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:15.061302    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpmlj\" (UniqueName: \"kubernetes.io/projected/a1caf3e3-3bbb-4e2d-afd7-c75f54392873-kube-api-access-rpmlj\") pod \"maas-api-e2e-api-b-9edc58-79f699564d-4gd8r\" (UID: \"a1caf3e3-3bbb-4e2d-afd7-c75f54392873\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r"
Jul 22 12:27:15.061418 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:15.061406    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1caf3e3-3bbb-4e2d-afd7-c75f54392873-maas-api-tls\") pod \"maas-api-e2e-api-b-9edc58-79f699564d-4gd8r\" (UID: \"a1caf3e3-3bbb-4e2d-afd7-c75f54392873\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r"
Jul 22 12:27:15.061550 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:27:15.061531    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-serving-cert: secret "maas-api-e2e-api-b-9edc58-serving-cert" not found
Jul 22 12:27:15.061673 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:27:15.061660    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1caf3e3-3bbb-4e2d-afd7-c75f54392873-maas-api-tls podName:a1caf3e3-3bbb-4e2d-afd7-c75f54392873 nodeName:}" failed. No retries permitted until 2026-07-22 12:27:15.561610988 +0000 UTC m=+2247.928126210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a1caf3e3-3bbb-4e2d-afd7-c75f54392873-maas-api-tls") pod "maas-api-e2e-api-b-9edc58-79f699564d-4gd8r" (UID: "a1caf3e3-3bbb-4e2d-afd7-c75f54392873") : secret "maas-api-e2e-api-b-9edc58-serving-cert" not found
Jul 22 12:27:15.062052 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:15.062033    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1caf3e3-3bbb-4e2d-afd7-c75f54392873-openshift-service-ca\") pod \"maas-api-e2e-api-b-9edc58-79f699564d-4gd8r\" (UID: \"a1caf3e3-3bbb-4e2d-afd7-c75f54392873\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r"
Jul 22 12:27:15.073251 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:15.073186    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpmlj\" (UniqueName: \"kubernetes.io/projected/a1caf3e3-3bbb-4e2d-afd7-c75f54392873-kube-api-access-rpmlj\") pod \"maas-api-e2e-api-b-9edc58-79f699564d-4gd8r\" (UID: \"a1caf3e3-3bbb-4e2d-afd7-c75f54392873\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r"
Jul 22 12:27:15.566088 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:15.566052    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1caf3e3-3bbb-4e2d-afd7-c75f54392873-maas-api-tls\") pod \"maas-api-e2e-api-b-9edc58-79f699564d-4gd8r\" (UID: \"a1caf3e3-3bbb-4e2d-afd7-c75f54392873\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r"
Jul 22 12:27:15.568589 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:15.568563    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1caf3e3-3bbb-4e2d-afd7-c75f54392873-maas-api-tls\") pod \"maas-api-e2e-api-b-9edc58-79f699564d-4gd8r\" (UID: \"a1caf3e3-3bbb-4e2d-afd7-c75f54392873\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r"
Jul 22 12:27:15.728588 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:15.728552    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r"
Jul 22 12:27:15.870322 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:15.870293    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r"]
Jul 22 12:27:15.873165 ip-10-0-132-166 kubenswrapper[2558]: W0722 12:27:15.873119    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1caf3e3_3bbb_4e2d_afd7_c75f54392873.slice/crio-fd98fecc32497728c2bc93faff4987d3afbabcbbfa40e8b1373c5b47ce221afa WatchSource:0}: Error finding container fd98fecc32497728c2bc93faff4987d3afbabcbbfa40e8b1373c5b47ce221afa: Status 404 returned error can't find the container with id fd98fecc32497728c2bc93faff4987d3afbabcbbfa40e8b1373c5b47ce221afa
Jul 22 12:27:16.447373 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:16.447338    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r"
Jul 22 12:27:16.447535 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:16.447386    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r" event={"ID":"a1caf3e3-3bbb-4e2d-afd7-c75f54392873","Type":"ContainerStarted","Data":"22070975c989465f40cc7e0679f34a27f8cbe64666d059a1c7861132e0b9f486"}
Jul 22 12:27:16.447535 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:16.447407    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r" event={"ID":"a1caf3e3-3bbb-4e2d-afd7-c75f54392873","Type":"ContainerStarted","Data":"fd98fecc32497728c2bc93faff4987d3afbabcbbfa40e8b1373c5b47ce221afa"}
Jul 22 12:27:16.464994 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:16.464944    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r" podStartSLOduration=2.075847342 podStartE2EDuration="2.464929922s" totalImagesPullingTime="389.08258ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:27:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:27:16.46279269 +0000 UTC m=+2248.829307934" watchObservedRunningTime="2026-07-22 12:27:16.464929922 +0000 UTC m=+2248.831445165"
Jul 22 12:27:22.457251 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:22.457219    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r"
Jul 22 12:27:43.156271 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:43.156234    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6"]
Jul 22 12:27:43.156691 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:43.156513    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6" podUID="6627cfed-7768-4a23-929c-162883bd8b35" containerName="maas-api" containerID="cri-o://b5ac7482be91c0f7e7271c602f4d402f65b02cf6123b6123db3fe24dd8766b7b" gracePeriod=30
Jul 22 12:27:43.409061 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:43.409003    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6"
Jul 22 12:27:43.530720 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:43.530683    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6627cfed-7768-4a23-929c-162883bd8b35-openshift-service-ca\") pod \"6627cfed-7768-4a23-929c-162883bd8b35\" (UID: \"6627cfed-7768-4a23-929c-162883bd8b35\") "
Jul 22 12:27:43.530910 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:43.530751    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnvwt\" (UniqueName: \"kubernetes.io/projected/6627cfed-7768-4a23-929c-162883bd8b35-kube-api-access-wnvwt\") pod \"6627cfed-7768-4a23-929c-162883bd8b35\" (UID: \"6627cfed-7768-4a23-929c-162883bd8b35\") "
Jul 22 12:27:43.530910 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:43.530888    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6627cfed-7768-4a23-929c-162883bd8b35-maas-api-tls\") pod \"6627cfed-7768-4a23-929c-162883bd8b35\" (UID: \"6627cfed-7768-4a23-929c-162883bd8b35\") "
Jul 22 12:27:43.531261 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:43.531232    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6627cfed-7768-4a23-929c-162883bd8b35-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6627cfed-7768-4a23-929c-162883bd8b35" (UID: "6627cfed-7768-4a23-929c-162883bd8b35"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:27:43.532756 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:43.532732    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6627cfed-7768-4a23-929c-162883bd8b35-kube-api-access-wnvwt" (OuterVolumeSpecName: "kube-api-access-wnvwt") pod "6627cfed-7768-4a23-929c-162883bd8b35" (UID: "6627cfed-7768-4a23-929c-162883bd8b35"). InnerVolumeSpecName "kube-api-access-wnvwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:27:43.532939 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:43.532924    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6627cfed-7768-4a23-929c-162883bd8b35-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6627cfed-7768-4a23-929c-162883bd8b35" (UID: "6627cfed-7768-4a23-929c-162883bd8b35"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:27:43.581226 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:43.581197    2558 generic.go:356] "Generic (PLEG): container finished" podID="6627cfed-7768-4a23-929c-162883bd8b35" containerID="b5ac7482be91c0f7e7271c602f4d402f65b02cf6123b6123db3fe24dd8766b7b" exitCode=0
Jul 22 12:27:43.581360 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:43.581239    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6"
Jul 22 12:27:43.581360 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:43.581281    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6" event={"ID":"6627cfed-7768-4a23-929c-162883bd8b35","Type":"ContainerDied","Data":"b5ac7482be91c0f7e7271c602f4d402f65b02cf6123b6123db3fe24dd8766b7b"}
Jul 22 12:27:43.581360 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:43.581329    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6" event={"ID":"6627cfed-7768-4a23-929c-162883bd8b35","Type":"ContainerDied","Data":"f62248e4c249547d1958739c31193827444ccb0d0ad43c0afccbc3412c56e250"}
Jul 22 12:27:43.581360 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:43.581351    2558 scope.go:117] "RemoveContainer" containerID="b5ac7482be91c0f7e7271c602f4d402f65b02cf6123b6123db3fe24dd8766b7b"
Jul 22 12:27:43.590379 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:43.590364    2558 scope.go:117] "RemoveContainer" containerID="b5ac7482be91c0f7e7271c602f4d402f65b02cf6123b6123db3fe24dd8766b7b"
Jul 22 12:27:43.590611 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:27:43.590593    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5ac7482be91c0f7e7271c602f4d402f65b02cf6123b6123db3fe24dd8766b7b\": container with ID starting with b5ac7482be91c0f7e7271c602f4d402f65b02cf6123b6123db3fe24dd8766b7b not found: ID does not exist" containerID="b5ac7482be91c0f7e7271c602f4d402f65b02cf6123b6123db3fe24dd8766b7b"
Jul 22 12:27:43.590683 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:43.590647    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5ac7482be91c0f7e7271c602f4d402f65b02cf6123b6123db3fe24dd8766b7b"} err="failed to get container status \"b5ac7482be91c0f7e7271c602f4d402f65b02cf6123b6123db3fe24dd8766b7b\": rpc error: code = NotFound desc = could not find container \"b5ac7482be91c0f7e7271c602f4d402f65b02cf6123b6123db3fe24dd8766b7b\": container with ID starting with b5ac7482be91c0f7e7271c602f4d402f65b02cf6123b6123db3fe24dd8766b7b not found: ID does not exist"
Jul 22 12:27:43.604407 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:43.604386    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6"]
Jul 22 12:27:43.610770 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:43.610747    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e96939-599dcb4778-4qsw6"]
Jul 22 12:27:43.632155 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:43.632137    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6627cfed-7768-4a23-929c-162883bd8b35-maas-api-tls\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:27:43.632230 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:43.632156    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6627cfed-7768-4a23-929c-162883bd8b35-openshift-service-ca\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:27:43.632230 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:43.632166    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnvwt\" (UniqueName: \"kubernetes.io/projected/6627cfed-7768-4a23-929c-162883bd8b35-kube-api-access-wnvwt\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:27:44.448253 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:27:44.448219    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6627cfed-7768-4a23-929c-162883bd8b35" path="/var/lib/kubelet/pods/6627cfed-7768-4a23-929c-162883bd8b35/volumes"
Jul 22 12:28:10.406304 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:10.406266    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r"]
Jul 22 12:28:10.406786 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:10.406548    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r" podUID="a1caf3e3-3bbb-4e2d-afd7-c75f54392873" containerName="maas-api" containerID="cri-o://22070975c989465f40cc7e0679f34a27f8cbe64666d059a1c7861132e0b9f486" gracePeriod=30
Jul 22 12:28:10.655373 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:10.655348    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r"
Jul 22 12:28:10.689184 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:10.689110    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpmlj\" (UniqueName: \"kubernetes.io/projected/a1caf3e3-3bbb-4e2d-afd7-c75f54392873-kube-api-access-rpmlj\") pod \"a1caf3e3-3bbb-4e2d-afd7-c75f54392873\" (UID: \"a1caf3e3-3bbb-4e2d-afd7-c75f54392873\") "
Jul 22 12:28:10.689184 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:10.689153    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1caf3e3-3bbb-4e2d-afd7-c75f54392873-openshift-service-ca\") pod \"a1caf3e3-3bbb-4e2d-afd7-c75f54392873\" (UID: \"a1caf3e3-3bbb-4e2d-afd7-c75f54392873\") "
Jul 22 12:28:10.689422 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:10.689276    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1caf3e3-3bbb-4e2d-afd7-c75f54392873-maas-api-tls\") pod \"a1caf3e3-3bbb-4e2d-afd7-c75f54392873\" (UID: \"a1caf3e3-3bbb-4e2d-afd7-c75f54392873\") "
Jul 22 12:28:10.689525 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:10.689504    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1caf3e3-3bbb-4e2d-afd7-c75f54392873-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a1caf3e3-3bbb-4e2d-afd7-c75f54392873" (UID: "a1caf3e3-3bbb-4e2d-afd7-c75f54392873"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:28:10.691950 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:10.691916    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1caf3e3-3bbb-4e2d-afd7-c75f54392873-kube-api-access-rpmlj" (OuterVolumeSpecName: "kube-api-access-rpmlj") pod "a1caf3e3-3bbb-4e2d-afd7-c75f54392873" (UID: "a1caf3e3-3bbb-4e2d-afd7-c75f54392873"). InnerVolumeSpecName "kube-api-access-rpmlj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:28:10.693667 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:10.692480    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1caf3e3-3bbb-4e2d-afd7-c75f54392873-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a1caf3e3-3bbb-4e2d-afd7-c75f54392873" (UID: "a1caf3e3-3bbb-4e2d-afd7-c75f54392873"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:28:10.698450 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:10.697691    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1caf3e3-3bbb-4e2d-afd7-c75f54392873-openshift-service-ca\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:28:10.722043 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:10.722014    2558 generic.go:356] "Generic (PLEG): container finished" podID="a1caf3e3-3bbb-4e2d-afd7-c75f54392873" containerID="22070975c989465f40cc7e0679f34a27f8cbe64666d059a1c7861132e0b9f486" exitCode=0
Jul 22 12:28:10.722174 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:10.722081    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r"
Jul 22 12:28:10.722174 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:10.722099    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r" event={"ID":"a1caf3e3-3bbb-4e2d-afd7-c75f54392873","Type":"ContainerDied","Data":"22070975c989465f40cc7e0679f34a27f8cbe64666d059a1c7861132e0b9f486"}
Jul 22 12:28:10.722287 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:10.722179    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r" event={"ID":"a1caf3e3-3bbb-4e2d-afd7-c75f54392873","Type":"ContainerDied","Data":"fd98fecc32497728c2bc93faff4987d3afbabcbbfa40e8b1373c5b47ce221afa"}
Jul 22 12:28:10.722287 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:10.722202    2558 scope.go:117] "RemoveContainer" containerID="22070975c989465f40cc7e0679f34a27f8cbe64666d059a1c7861132e0b9f486"
Jul 22 12:28:10.731335 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:10.731320    2558 scope.go:117] "RemoveContainer" containerID="22070975c989465f40cc7e0679f34a27f8cbe64666d059a1c7861132e0b9f486"
Jul 22 12:28:10.731646 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:28:10.731594    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22070975c989465f40cc7e0679f34a27f8cbe64666d059a1c7861132e0b9f486\": container with ID starting with 22070975c989465f40cc7e0679f34a27f8cbe64666d059a1c7861132e0b9f486 not found: ID does not exist" containerID="22070975c989465f40cc7e0679f34a27f8cbe64666d059a1c7861132e0b9f486"
Jul 22 12:28:10.731730 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:10.731676    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22070975c989465f40cc7e0679f34a27f8cbe64666d059a1c7861132e0b9f486"} err="failed to get container status \"22070975c989465f40cc7e0679f34a27f8cbe64666d059a1c7861132e0b9f486\": rpc error: code = NotFound desc = could not find container \"22070975c989465f40cc7e0679f34a27f8cbe64666d059a1c7861132e0b9f486\": container with ID starting with 22070975c989465f40cc7e0679f34a27f8cbe64666d059a1c7861132e0b9f486 not found: ID does not exist"
Jul 22 12:28:10.747411 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:10.747389    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r"]
Jul 22 12:28:10.752085 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:10.752065    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9edc58-79f699564d-4gd8r"]
Jul 22 12:28:10.798507 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:10.798477    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpmlj\" (UniqueName: \"kubernetes.io/projected/a1caf3e3-3bbb-4e2d-afd7-c75f54392873-kube-api-access-rpmlj\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:28:10.798507 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:10.798505    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1caf3e3-3bbb-4e2d-afd7-c75f54392873-maas-api-tls\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:28:12.446892 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:12.446860    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1caf3e3-3bbb-4e2d-afd7-c75f54392873" path="/var/lib/kubelet/pods/a1caf3e3-3bbb-4e2d-afd7-c75f54392873/volumes"
Jul 22 12:28:26.365395 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:26.365362    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f"]
Jul 22 12:28:26.365821 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:26.365801    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1caf3e3-3bbb-4e2d-afd7-c75f54392873" containerName="maas-api"
Jul 22 12:28:26.365878 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:26.365825    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1caf3e3-3bbb-4e2d-afd7-c75f54392873" containerName="maas-api"
Jul 22 12:28:26.365878 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:26.365851    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6627cfed-7768-4a23-929c-162883bd8b35" containerName="maas-api"
Jul 22 12:28:26.365878 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:26.365858    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6627cfed-7768-4a23-929c-162883bd8b35" containerName="maas-api"
Jul 22 12:28:26.365979 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:26.365942    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1caf3e3-3bbb-4e2d-afd7-c75f54392873" containerName="maas-api"
Jul 22 12:28:26.365979 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:26.365951    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6627cfed-7768-4a23-929c-162883bd8b35" containerName="maas-api"
Jul 22 12:28:26.369047 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:26.369027    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f"
Jul 22 12:28:26.371988 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:26.371964    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-0b54ae-serving-cert\""
Jul 22 12:28:26.387189 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:26.387160    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f"]
Jul 22 12:28:26.445424 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:26.445397    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52726f56-ab87-4300-a396-0922a5526f76-maas-api-tls\") pod \"maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f\" (UID: \"52726f56-ab87-4300-a396-0922a5526f76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f"
Jul 22 12:28:26.445581 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:26.445514    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52726f56-ab87-4300-a396-0922a5526f76-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f\" (UID: \"52726f56-ab87-4300-a396-0922a5526f76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f"
Jul 22 12:28:26.445581 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:26.445550    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4r7s\" (UniqueName: \"kubernetes.io/projected/52726f56-ab87-4300-a396-0922a5526f76-kube-api-access-k4r7s\") pod \"maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f\" (UID: \"52726f56-ab87-4300-a396-0922a5526f76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f"
Jul 22 12:28:26.546987 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:26.546949    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52726f56-ab87-4300-a396-0922a5526f76-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f\" (UID: \"52726f56-ab87-4300-a396-0922a5526f76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f"
Jul 22 12:28:26.547199 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:26.547152    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4r7s\" (UniqueName: \"kubernetes.io/projected/52726f56-ab87-4300-a396-0922a5526f76-kube-api-access-k4r7s\") pod \"maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f\" (UID: \"52726f56-ab87-4300-a396-0922a5526f76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f"
Jul 22 12:28:26.547275 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:26.547223    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52726f56-ab87-4300-a396-0922a5526f76-maas-api-tls\") pod \"maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f\" (UID: \"52726f56-ab87-4300-a396-0922a5526f76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f"
Jul 22 12:28:26.547338 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:28:26.547314    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-serving-cert: secret "maas-api-e2e-shared-a-0b54ae-serving-cert" not found
Jul 22 12:28:26.547401 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:28:26.547383    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52726f56-ab87-4300-a396-0922a5526f76-maas-api-tls podName:52726f56-ab87-4300-a396-0922a5526f76 nodeName:}" failed. No retries permitted until 2026-07-22 12:28:27.047362919 +0000 UTC m=+2319.413878146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/52726f56-ab87-4300-a396-0922a5526f76-maas-api-tls") pod "maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f" (UID: "52726f56-ab87-4300-a396-0922a5526f76") : secret "maas-api-e2e-shared-a-0b54ae-serving-cert" not found
Jul 22 12:28:26.548253 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:26.548228    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52726f56-ab87-4300-a396-0922a5526f76-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f\" (UID: \"52726f56-ab87-4300-a396-0922a5526f76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f"
Jul 22 12:28:26.557057 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:26.557032    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4r7s\" (UniqueName: \"kubernetes.io/projected/52726f56-ab87-4300-a396-0922a5526f76-kube-api-access-k4r7s\") pod \"maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f\" (UID: \"52726f56-ab87-4300-a396-0922a5526f76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f"
Jul 22 12:28:27.052820 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:27.052777    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52726f56-ab87-4300-a396-0922a5526f76-maas-api-tls\") pod \"maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f\" (UID: \"52726f56-ab87-4300-a396-0922a5526f76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f"
Jul 22 12:28:27.055196 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:27.055169    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52726f56-ab87-4300-a396-0922a5526f76-maas-api-tls\") pod \"maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f\" (UID: \"52726f56-ab87-4300-a396-0922a5526f76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f"
Jul 22 12:28:27.279037 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:27.279000    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f"
Jul 22 12:28:27.424421 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:27.424312    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f"]
Jul 22 12:28:27.426828 ip-10-0-132-166 kubenswrapper[2558]: W0722 12:28:27.426802    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52726f56_ab87_4300_a396_0922a5526f76.slice/crio-2873f631b29fee1b0853a659242d8d667697da60f86c348e4b85e61ca3ba5216 WatchSource:0}: Error finding container 2873f631b29fee1b0853a659242d8d667697da60f86c348e4b85e61ca3ba5216: Status 404 returned error can't find the container with id 2873f631b29fee1b0853a659242d8d667697da60f86c348e4b85e61ca3ba5216
Jul 22 12:28:27.805214 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:27.805183    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f" event={"ID":"52726f56-ab87-4300-a396-0922a5526f76","Type":"ContainerStarted","Data":"2873f631b29fee1b0853a659242d8d667697da60f86c348e4b85e61ca3ba5216"}
Jul 22 12:28:28.811151 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:28.811116    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f" event={"ID":"52726f56-ab87-4300-a396-0922a5526f76","Type":"ContainerStarted","Data":"b0bbd16c1b181a2dbb47b7fd08c9d289c6169a79676d37ef573ecb463b7b3808"}
Jul 22 12:28:28.811558 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:28.811246    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f"
Jul 22 12:28:28.831061 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:28.831007    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f" podStartSLOduration=2.324199749 podStartE2EDuration="2.83098914s" totalImagesPullingTime="506.789391ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:28:28.829161772 +0000 UTC m=+2321.195677056" watchObservedRunningTime="2026-07-22 12:28:28.83098914 +0000 UTC m=+2321.197504417"
Jul 22 12:28:34.361812 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:34.361768    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn"]
Jul 22 12:28:34.365682 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:34.365657    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn"
Jul 22 12:28:34.368292 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:34.368272    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-55573a-serving-cert\""
Jul 22 12:28:34.378787 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:34.378762    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn"]
Jul 22 12:28:34.525001 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:34.524958    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfts6\" (UniqueName: \"kubernetes.io/projected/f6681b22-6bb8-494d-953e-44c9bfd430ea-kube-api-access-xfts6\") pod \"maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn\" (UID: \"f6681b22-6bb8-494d-953e-44c9bfd430ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn"
Jul 22 12:28:34.525283 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:34.525047    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6681b22-6bb8-494d-953e-44c9bfd430ea-openshift-service-ca\") pod \"maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn\" (UID: \"f6681b22-6bb8-494d-953e-44c9bfd430ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn"
Jul 22 12:28:34.525283 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:34.525069    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6681b22-6bb8-494d-953e-44c9bfd430ea-maas-api-tls\") pod \"maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn\" (UID: \"f6681b22-6bb8-494d-953e-44c9bfd430ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn"
Jul 22 12:28:34.625928 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:34.625894    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfts6\" (UniqueName: \"kubernetes.io/projected/f6681b22-6bb8-494d-953e-44c9bfd430ea-kube-api-access-xfts6\") pod \"maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn\" (UID: \"f6681b22-6bb8-494d-953e-44c9bfd430ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn"
Jul 22 12:28:34.626110 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:34.625961    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6681b22-6bb8-494d-953e-44c9bfd430ea-openshift-service-ca\") pod \"maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn\" (UID: \"f6681b22-6bb8-494d-953e-44c9bfd430ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn"
Jul 22 12:28:34.626110 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:34.625988    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6681b22-6bb8-494d-953e-44c9bfd430ea-maas-api-tls\") pod \"maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn\" (UID: \"f6681b22-6bb8-494d-953e-44c9bfd430ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn"
Jul 22 12:28:34.626207 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:28:34.626145    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-serving-cert: secret "maas-api-e2e-shared-b-55573a-serving-cert" not found
Jul 22 12:28:34.626252 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:28:34.626209    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6681b22-6bb8-494d-953e-44c9bfd430ea-maas-api-tls podName:f6681b22-6bb8-494d-953e-44c9bfd430ea nodeName:}" failed. No retries permitted until 2026-07-22 12:28:35.126189967 +0000 UTC m=+2327.492705190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f6681b22-6bb8-494d-953e-44c9bfd430ea-maas-api-tls") pod "maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn" (UID: "f6681b22-6bb8-494d-953e-44c9bfd430ea") : secret "maas-api-e2e-shared-b-55573a-serving-cert" not found
Jul 22 12:28:34.626668 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:34.626648    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6681b22-6bb8-494d-953e-44c9bfd430ea-openshift-service-ca\") pod \"maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn\" (UID: \"f6681b22-6bb8-494d-953e-44c9bfd430ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn"
Jul 22 12:28:34.635454 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:34.635430    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfts6\" (UniqueName: \"kubernetes.io/projected/f6681b22-6bb8-494d-953e-44c9bfd430ea-kube-api-access-xfts6\") pod \"maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn\" (UID: \"f6681b22-6bb8-494d-953e-44c9bfd430ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn"
Jul 22 12:28:34.822798 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:34.822769    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f"
Jul 22 12:28:35.130896 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:35.130861    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6681b22-6bb8-494d-953e-44c9bfd430ea-maas-api-tls\") pod \"maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn\" (UID: \"f6681b22-6bb8-494d-953e-44c9bfd430ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn"
Jul 22 12:28:35.133428 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:35.133399    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6681b22-6bb8-494d-953e-44c9bfd430ea-maas-api-tls\") pod \"maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn\" (UID: \"f6681b22-6bb8-494d-953e-44c9bfd430ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn"
Jul 22 12:28:35.276687 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:35.276657    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn"
Jul 22 12:28:35.418804 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:35.418776    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn"]
Jul 22 12:28:35.420605 ip-10-0-132-166 kubenswrapper[2558]: W0722 12:28:35.420571    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6681b22_6bb8_494d_953e_44c9bfd430ea.slice/crio-dee2b4fa14b7cbf6d38e88cda89c28cda1fd5849bd65e2c51a86fa0e0d8e79f9 WatchSource:0}: Error finding container dee2b4fa14b7cbf6d38e88cda89c28cda1fd5849bd65e2c51a86fa0e0d8e79f9: Status 404 returned error can't find the container with id dee2b4fa14b7cbf6d38e88cda89c28cda1fd5849bd65e2c51a86fa0e0d8e79f9
Jul 22 12:28:35.845661 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:35.845608    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn" event={"ID":"f6681b22-6bb8-494d-953e-44c9bfd430ea","Type":"ContainerStarted","Data":"dee2b4fa14b7cbf6d38e88cda89c28cda1fd5849bd65e2c51a86fa0e0d8e79f9"}
Jul 22 12:28:36.852283 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:36.852241    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn" event={"ID":"f6681b22-6bb8-494d-953e-44c9bfd430ea","Type":"ContainerStarted","Data":"00e96b7cbce02c83aa52bf299819544c734131ac62b85d07f272f93f257cd1c9"}
Jul 22 12:28:36.852730 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:36.852381    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn"
Jul 22 12:28:36.874328 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:36.874286    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn" podStartSLOduration=2.478228772 podStartE2EDuration="2.874271655s" totalImagesPullingTime="396.042883ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:28:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:28:36.872209385 +0000 UTC m=+2329.238724630" watchObservedRunningTime="2026-07-22 12:28:36.874271655 +0000 UTC m=+2329.240786899"
Jul 22 12:28:42.864943 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:42.864873    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn"
Jul 22 12:28:52.495184 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.495151    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"]
Jul 22 12:28:52.500178 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.500156    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"
Jul 22 12:28:52.502952 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.502925    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0b54ae\"/\"openshift-service-ca.crt\""
Jul 22 12:28:52.504235 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.504201    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0b54ae\"/\"default-dockercfg-t29dw\""
Jul 22 12:28:52.504364 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.504299    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0b54ae\"/\"kube-root-ca.crt\""
Jul 22 12:28:52.504364 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.504299    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0b54ae\"/\"auth-test-model-0b54ae-kserve-self-signed-certs\""
Jul 22 12:28:52.510069 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.510047    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"]
Jul 22 12:28:52.608745 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.608712    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be5db916-b6a3-4512-a8d6-5f645915dfc0-dshm\") pod \"auth-test-model-0b54ae-kserve-848997587f-rp2fq\" (UID: \"be5db916-b6a3-4512-a8d6-5f645915dfc0\") " pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"
Jul 22 12:28:52.608959 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.608765    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be5db916-b6a3-4512-a8d6-5f645915dfc0-tmp-dir\") pod \"auth-test-model-0b54ae-kserve-848997587f-rp2fq\" (UID: \"be5db916-b6a3-4512-a8d6-5f645915dfc0\") " pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"
Jul 22 12:28:52.608959 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.608792    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2vlh\" (UniqueName: \"kubernetes.io/projected/be5db916-b6a3-4512-a8d6-5f645915dfc0-kube-api-access-m2vlh\") pod \"auth-test-model-0b54ae-kserve-848997587f-rp2fq\" (UID: \"be5db916-b6a3-4512-a8d6-5f645915dfc0\") " pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"
Jul 22 12:28:52.608959 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.608837    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be5db916-b6a3-4512-a8d6-5f645915dfc0-tls-certs\") pod \"auth-test-model-0b54ae-kserve-848997587f-rp2fq\" (UID: \"be5db916-b6a3-4512-a8d6-5f645915dfc0\") " pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"
Jul 22 12:28:52.608959 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.608915    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be5db916-b6a3-4512-a8d6-5f645915dfc0-home\") pod \"auth-test-model-0b54ae-kserve-848997587f-rp2fq\" (UID: \"be5db916-b6a3-4512-a8d6-5f645915dfc0\") " pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"
Jul 22 12:28:52.608959 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.608950    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be5db916-b6a3-4512-a8d6-5f645915dfc0-model-cache\") pod \"auth-test-model-0b54ae-kserve-848997587f-rp2fq\" (UID: \"be5db916-b6a3-4512-a8d6-5f645915dfc0\") " pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"
Jul 22 12:28:52.710011 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.709978    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be5db916-b6a3-4512-a8d6-5f645915dfc0-tls-certs\") pod \"auth-test-model-0b54ae-kserve-848997587f-rp2fq\" (UID: \"be5db916-b6a3-4512-a8d6-5f645915dfc0\") " pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"
Jul 22 12:28:52.710190 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.710038    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be5db916-b6a3-4512-a8d6-5f645915dfc0-home\") pod \"auth-test-model-0b54ae-kserve-848997587f-rp2fq\" (UID: \"be5db916-b6a3-4512-a8d6-5f645915dfc0\") " pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"
Jul 22 12:28:52.710190 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.710055    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be5db916-b6a3-4512-a8d6-5f645915dfc0-model-cache\") pod \"auth-test-model-0b54ae-kserve-848997587f-rp2fq\" (UID: \"be5db916-b6a3-4512-a8d6-5f645915dfc0\") " pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"
Jul 22 12:28:52.710190 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.710078    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be5db916-b6a3-4512-a8d6-5f645915dfc0-dshm\") pod \"auth-test-model-0b54ae-kserve-848997587f-rp2fq\" (UID: \"be5db916-b6a3-4512-a8d6-5f645915dfc0\") " pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"
Jul 22 12:28:52.710190 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.710126    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be5db916-b6a3-4512-a8d6-5f645915dfc0-tmp-dir\") pod \"auth-test-model-0b54ae-kserve-848997587f-rp2fq\" (UID: \"be5db916-b6a3-4512-a8d6-5f645915dfc0\") " pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"
Jul 22 12:28:52.710190 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.710158    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2vlh\" (UniqueName: \"kubernetes.io/projected/be5db916-b6a3-4512-a8d6-5f645915dfc0-kube-api-access-m2vlh\") pod \"auth-test-model-0b54ae-kserve-848997587f-rp2fq\" (UID: \"be5db916-b6a3-4512-a8d6-5f645915dfc0\") " pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"
Jul 22 12:28:52.710467 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.710443    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be5db916-b6a3-4512-a8d6-5f645915dfc0-home\") pod \"auth-test-model-0b54ae-kserve-848997587f-rp2fq\" (UID: \"be5db916-b6a3-4512-a8d6-5f645915dfc0\") " pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"
Jul 22 12:28:52.710522 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.710500    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be5db916-b6a3-4512-a8d6-5f645915dfc0-tmp-dir\") pod \"auth-test-model-0b54ae-kserve-848997587f-rp2fq\" (UID: \"be5db916-b6a3-4512-a8d6-5f645915dfc0\") " pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"
Jul 22 12:28:52.710522 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.710499    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be5db916-b6a3-4512-a8d6-5f645915dfc0-model-cache\") pod \"auth-test-model-0b54ae-kserve-848997587f-rp2fq\" (UID: \"be5db916-b6a3-4512-a8d6-5f645915dfc0\") " pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"
Jul 22 12:28:52.712405 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.712378    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be5db916-b6a3-4512-a8d6-5f645915dfc0-dshm\") pod \"auth-test-model-0b54ae-kserve-848997587f-rp2fq\" (UID: \"be5db916-b6a3-4512-a8d6-5f645915dfc0\") " pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"
Jul 22 12:28:52.712674 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.712655    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be5db916-b6a3-4512-a8d6-5f645915dfc0-tls-certs\") pod \"auth-test-model-0b54ae-kserve-848997587f-rp2fq\" (UID: \"be5db916-b6a3-4512-a8d6-5f645915dfc0\") " pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"
Jul 22 12:28:52.719606 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.719581    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2vlh\" (UniqueName: \"kubernetes.io/projected/be5db916-b6a3-4512-a8d6-5f645915dfc0-kube-api-access-m2vlh\") pod \"auth-test-model-0b54ae-kserve-848997587f-rp2fq\" (UID: \"be5db916-b6a3-4512-a8d6-5f645915dfc0\") " pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"
Jul 22 12:28:52.811604 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.811527    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"
Jul 22 12:28:52.949749 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:52.949722    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"]
Jul 22 12:28:52.952151 ip-10-0-132-166 kubenswrapper[2558]: W0722 12:28:52.952122    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe5db916_b6a3_4512_a8d6_5f645915dfc0.slice/crio-9e72860c2e23d4b1ef73eee3cdd341bd1f28f6afd71f54d68d2c14d4973054d9 WatchSource:0}: Error finding container 9e72860c2e23d4b1ef73eee3cdd341bd1f28f6afd71f54d68d2c14d4973054d9: Status 404 returned error can't find the container with id 9e72860c2e23d4b1ef73eee3cdd341bd1f28f6afd71f54d68d2c14d4973054d9
Jul 22 12:28:53.939593 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:53.939558    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq" event={"ID":"be5db916-b6a3-4512-a8d6-5f645915dfc0","Type":"ContainerStarted","Data":"db0765158556ea9950bd188f3db9fbb4a201f711119c3f69a47ef274ac699e6e"}
Jul 22 12:28:53.940023 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:53.939604    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq" event={"ID":"be5db916-b6a3-4512-a8d6-5f645915dfc0","Type":"ContainerStarted","Data":"9e72860c2e23d4b1ef73eee3cdd341bd1f28f6afd71f54d68d2c14d4973054d9"}
Jul 22 12:28:53.959217 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:28:53.959167    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq" podStartSLOduration=1.95915309 podStartE2EDuration="1.95915309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:28:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:28:53.957427592 +0000 UTC m=+2346.323942835" watchObservedRunningTime="2026-07-22 12:28:53.95915309 +0000 UTC m=+2346.325668334"
Jul 22 12:29:02.811866 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:29:02.811835    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"
Jul 22 12:29:02.812350 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:29:02.811877    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"
Jul 22 12:29:02.824273 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:29:02.824246    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"
Jul 22 12:29:02.995570 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:29:02.995542    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"
Jul 22 12:31:28.301636 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:28.301573    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"]
Jul 22 12:31:43.321853 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.321764    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq" podUID="be5db916-b6a3-4512-a8d6-5f645915dfc0" containerName="main" containerID="cri-o://db0765158556ea9950bd188f3db9fbb4a201f711119c3f69a47ef274ac699e6e" gracePeriod=45
Jul 22 12:31:43.575716 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.575661    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"
Jul 22 12:31:43.655443 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.655409    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be5db916-b6a3-4512-a8d6-5f645915dfc0-tmp-dir\") pod \"be5db916-b6a3-4512-a8d6-5f645915dfc0\" (UID: \"be5db916-b6a3-4512-a8d6-5f645915dfc0\") "
Jul 22 12:31:43.655593 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.655477    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be5db916-b6a3-4512-a8d6-5f645915dfc0-home\") pod \"be5db916-b6a3-4512-a8d6-5f645915dfc0\" (UID: \"be5db916-b6a3-4512-a8d6-5f645915dfc0\") "
Jul 22 12:31:43.655593 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.655510    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be5db916-b6a3-4512-a8d6-5f645915dfc0-model-cache\") pod \"be5db916-b6a3-4512-a8d6-5f645915dfc0\" (UID: \"be5db916-b6a3-4512-a8d6-5f645915dfc0\") "
Jul 22 12:31:43.655593 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.655540    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be5db916-b6a3-4512-a8d6-5f645915dfc0-dshm\") pod \"be5db916-b6a3-4512-a8d6-5f645915dfc0\" (UID: \"be5db916-b6a3-4512-a8d6-5f645915dfc0\") "
Jul 22 12:31:43.655593 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.655583    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2vlh\" (UniqueName: \"kubernetes.io/projected/be5db916-b6a3-4512-a8d6-5f645915dfc0-kube-api-access-m2vlh\") pod \"be5db916-b6a3-4512-a8d6-5f645915dfc0\" (UID: \"be5db916-b6a3-4512-a8d6-5f645915dfc0\") "
Jul 22 12:31:43.655796 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.655657    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be5db916-b6a3-4512-a8d6-5f645915dfc0-tls-certs\") pod \"be5db916-b6a3-4512-a8d6-5f645915dfc0\" (UID: \"be5db916-b6a3-4512-a8d6-5f645915dfc0\") "
Jul 22 12:31:43.655796 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.655709    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be5db916-b6a3-4512-a8d6-5f645915dfc0-home" (OuterVolumeSpecName: "home") pod "be5db916-b6a3-4512-a8d6-5f645915dfc0" (UID: "be5db916-b6a3-4512-a8d6-5f645915dfc0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:31:43.655796 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.655725    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be5db916-b6a3-4512-a8d6-5f645915dfc0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "be5db916-b6a3-4512-a8d6-5f645915dfc0" (UID: "be5db916-b6a3-4512-a8d6-5f645915dfc0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:31:43.655897 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.655813    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be5db916-b6a3-4512-a8d6-5f645915dfc0-model-cache" (OuterVolumeSpecName: "model-cache") pod "be5db916-b6a3-4512-a8d6-5f645915dfc0" (UID: "be5db916-b6a3-4512-a8d6-5f645915dfc0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:31:43.655992 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.655971    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be5db916-b6a3-4512-a8d6-5f645915dfc0-tmp-dir\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:31:43.655992 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.655988    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be5db916-b6a3-4512-a8d6-5f645915dfc0-home\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:31:43.656140 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.656002    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be5db916-b6a3-4512-a8d6-5f645915dfc0-model-cache\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:31:43.657824 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.657789    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be5db916-b6a3-4512-a8d6-5f645915dfc0-dshm" (OuterVolumeSpecName: "dshm") pod "be5db916-b6a3-4512-a8d6-5f645915dfc0" (UID: "be5db916-b6a3-4512-a8d6-5f645915dfc0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:31:43.657905 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.657822    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be5db916-b6a3-4512-a8d6-5f645915dfc0-kube-api-access-m2vlh" (OuterVolumeSpecName: "kube-api-access-m2vlh") pod "be5db916-b6a3-4512-a8d6-5f645915dfc0" (UID: "be5db916-b6a3-4512-a8d6-5f645915dfc0"). InnerVolumeSpecName "kube-api-access-m2vlh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:31:43.657905 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.657853    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be5db916-b6a3-4512-a8d6-5f645915dfc0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "be5db916-b6a3-4512-a8d6-5f645915dfc0" (UID: "be5db916-b6a3-4512-a8d6-5f645915dfc0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:31:43.756676 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.756645    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be5db916-b6a3-4512-a8d6-5f645915dfc0-tls-certs\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:31:43.756676 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.756672    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be5db916-b6a3-4512-a8d6-5f645915dfc0-dshm\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:31:43.756676 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.756683    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2vlh\" (UniqueName: \"kubernetes.io/projected/be5db916-b6a3-4512-a8d6-5f645915dfc0-kube-api-access-m2vlh\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:31:43.792421 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.792390    2558 generic.go:356] "Generic (PLEG): container finished" podID="be5db916-b6a3-4512-a8d6-5f645915dfc0" containerID="db0765158556ea9950bd188f3db9fbb4a201f711119c3f69a47ef274ac699e6e" exitCode=0
Jul 22 12:31:43.792582 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.792432    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"
Jul 22 12:31:43.792582 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.792472    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq" event={"ID":"be5db916-b6a3-4512-a8d6-5f645915dfc0","Type":"ContainerDied","Data":"db0765158556ea9950bd188f3db9fbb4a201f711119c3f69a47ef274ac699e6e"}
Jul 22 12:31:43.792582 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.792518    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq" event={"ID":"be5db916-b6a3-4512-a8d6-5f645915dfc0","Type":"ContainerDied","Data":"9e72860c2e23d4b1ef73eee3cdd341bd1f28f6afd71f54d68d2c14d4973054d9"}
Jul 22 12:31:43.792582 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.792541    2558 scope.go:117] "RemoveContainer" containerID="db0765158556ea9950bd188f3db9fbb4a201f711119c3f69a47ef274ac699e6e"
Jul 22 12:31:43.801680 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.801657    2558 scope.go:117] "RemoveContainer" containerID="db0765158556ea9950bd188f3db9fbb4a201f711119c3f69a47ef274ac699e6e"
Jul 22 12:31:43.801970 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:31:43.801952    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db0765158556ea9950bd188f3db9fbb4a201f711119c3f69a47ef274ac699e6e\": container with ID starting with db0765158556ea9950bd188f3db9fbb4a201f711119c3f69a47ef274ac699e6e not found: ID does not exist" containerID="db0765158556ea9950bd188f3db9fbb4a201f711119c3f69a47ef274ac699e6e"
Jul 22 12:31:43.802020 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.801989    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db0765158556ea9950bd188f3db9fbb4a201f711119c3f69a47ef274ac699e6e"} err="failed to get container status \"db0765158556ea9950bd188f3db9fbb4a201f711119c3f69a47ef274ac699e6e\": rpc error: code = NotFound desc = could not find container \"db0765158556ea9950bd188f3db9fbb4a201f711119c3f69a47ef274ac699e6e\": container with ID starting with db0765158556ea9950bd188f3db9fbb4a201f711119c3f69a47ef274ac699e6e not found: ID does not exist"
Jul 22 12:31:43.821102 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.821072    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"]
Jul 22 12:31:43.831698 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:43.831632    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0b54ae/auth-test-model-0b54ae-kserve-848997587f-rp2fq"]
Jul 22 12:31:44.447322 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:44.447291    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be5db916-b6a3-4512-a8d6-5f645915dfc0" path="/var/lib/kubelet/pods/be5db916-b6a3-4512-a8d6-5f645915dfc0/volumes"
Jul 22 12:31:53.977432 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:53.977394    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"]
Jul 22 12:31:53.977878 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:53.977864    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be5db916-b6a3-4512-a8d6-5f645915dfc0" containerName="main"
Jul 22 12:31:53.977878 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:53.977879    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="be5db916-b6a3-4512-a8d6-5f645915dfc0" containerName="main"
Jul 22 12:31:53.977966 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:53.977952    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="be5db916-b6a3-4512-a8d6-5f645915dfc0" containerName="main"
Jul 22 12:31:53.982447 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:53.982430    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"
Jul 22 12:31:53.986454 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:53.986427    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-55573a\"/\"default-dockercfg-4ggz6\""
Jul 22 12:31:53.986668 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:53.986606    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-55573a\"/\"openshift-service-ca.crt\""
Jul 22 12:31:53.986771 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:53.986753    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-55573a\"/\"sub-test-model-55573a-kserve-self-signed-certs\""
Jul 22 12:31:53.990648 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:53.990626    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-55573a\"/\"kube-root-ca.crt\""
Jul 22 12:31:54.008207 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:54.008185    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"]
Jul 22 12:31:54.149875 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:54.149834    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlp7s\" (UniqueName: \"kubernetes.io/projected/993d0edb-e992-4acd-bf3b-35dcd5c6114c-kube-api-access-dlp7s\") pod \"sub-test-model-55573a-kserve-6c4d9f8795-z2qxp\" (UID: \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\") " pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"
Jul 22 12:31:54.149875 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:54.149873    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/993d0edb-e992-4acd-bf3b-35dcd5c6114c-model-cache\") pod \"sub-test-model-55573a-kserve-6c4d9f8795-z2qxp\" (UID: \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\") " pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"
Jul 22 12:31:54.150089 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:54.149892    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/993d0edb-e992-4acd-bf3b-35dcd5c6114c-tmp-dir\") pod \"sub-test-model-55573a-kserve-6c4d9f8795-z2qxp\" (UID: \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\") " pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"
Jul 22 12:31:54.150089 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:54.150018    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/993d0edb-e992-4acd-bf3b-35dcd5c6114c-tls-certs\") pod \"sub-test-model-55573a-kserve-6c4d9f8795-z2qxp\" (UID: \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\") " pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"
Jul 22 12:31:54.150161 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:54.150116    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/993d0edb-e992-4acd-bf3b-35dcd5c6114c-dshm\") pod \"sub-test-model-55573a-kserve-6c4d9f8795-z2qxp\" (UID: \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\") " pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"
Jul 22 12:31:54.150161 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:54.150138    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/993d0edb-e992-4acd-bf3b-35dcd5c6114c-home\") pod \"sub-test-model-55573a-kserve-6c4d9f8795-z2qxp\" (UID: \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\") " pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"
Jul 22 12:31:54.251570 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:54.251475    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlp7s\" (UniqueName: \"kubernetes.io/projected/993d0edb-e992-4acd-bf3b-35dcd5c6114c-kube-api-access-dlp7s\") pod \"sub-test-model-55573a-kserve-6c4d9f8795-z2qxp\" (UID: \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\") " pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"
Jul 22 12:31:54.251570 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:54.251513    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/993d0edb-e992-4acd-bf3b-35dcd5c6114c-model-cache\") pod \"sub-test-model-55573a-kserve-6c4d9f8795-z2qxp\" (UID: \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\") " pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"
Jul 22 12:31:54.251570 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:54.251532    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/993d0edb-e992-4acd-bf3b-35dcd5c6114c-tmp-dir\") pod \"sub-test-model-55573a-kserve-6c4d9f8795-z2qxp\" (UID: \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\") " pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"
Jul 22 12:31:54.251850 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:54.251583    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/993d0edb-e992-4acd-bf3b-35dcd5c6114c-tls-certs\") pod \"sub-test-model-55573a-kserve-6c4d9f8795-z2qxp\" (UID: \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\") " pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"
Jul 22 12:31:54.251850 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:54.251675    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/993d0edb-e992-4acd-bf3b-35dcd5c6114c-dshm\") pod \"sub-test-model-55573a-kserve-6c4d9f8795-z2qxp\" (UID: \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\") " pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"
Jul 22 12:31:54.251850 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:54.251691    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/993d0edb-e992-4acd-bf3b-35dcd5c6114c-home\") pod \"sub-test-model-55573a-kserve-6c4d9f8795-z2qxp\" (UID: \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\") " pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"
Jul 22 12:31:54.252012 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:54.251987    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/993d0edb-e992-4acd-bf3b-35dcd5c6114c-model-cache\") pod \"sub-test-model-55573a-kserve-6c4d9f8795-z2qxp\" (UID: \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\") " pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"
Jul 22 12:31:54.252062 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:54.252012    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/993d0edb-e992-4acd-bf3b-35dcd5c6114c-tmp-dir\") pod \"sub-test-model-55573a-kserve-6c4d9f8795-z2qxp\" (UID: \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\") " pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"
Jul 22 12:31:54.252100 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:54.252053    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/993d0edb-e992-4acd-bf3b-35dcd5c6114c-home\") pod \"sub-test-model-55573a-kserve-6c4d9f8795-z2qxp\" (UID: \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\") " pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"
Jul 22 12:31:54.254031 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:54.253998    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/993d0edb-e992-4acd-bf3b-35dcd5c6114c-dshm\") pod \"sub-test-model-55573a-kserve-6c4d9f8795-z2qxp\" (UID: \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\") " pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"
Jul 22 12:31:54.254165 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:54.254119    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/993d0edb-e992-4acd-bf3b-35dcd5c6114c-tls-certs\") pod \"sub-test-model-55573a-kserve-6c4d9f8795-z2qxp\" (UID: \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\") " pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"
Jul 22 12:31:54.275952 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:54.275929    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlp7s\" (UniqueName: \"kubernetes.io/projected/993d0edb-e992-4acd-bf3b-35dcd5c6114c-kube-api-access-dlp7s\") pod \"sub-test-model-55573a-kserve-6c4d9f8795-z2qxp\" (UID: \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\") " pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"
Jul 22 12:31:54.292511 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:54.292486    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"
Jul 22 12:31:54.429460 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:54.429429    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"]
Jul 22 12:31:54.431015 ip-10-0-132-166 kubenswrapper[2558]: W0722 12:31:54.430988    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod993d0edb_e992_4acd_bf3b_35dcd5c6114c.slice/crio-fe3b72f91f8805428ec65efc95f8464fbfdf2e59e5ba3a938c058d7899f4451d WatchSource:0}: Error finding container fe3b72f91f8805428ec65efc95f8464fbfdf2e59e5ba3a938c058d7899f4451d: Status 404 returned error can't find the container with id fe3b72f91f8805428ec65efc95f8464fbfdf2e59e5ba3a938c058d7899f4451d
Jul 22 12:31:54.851949 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:54.851911    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp" event={"ID":"993d0edb-e992-4acd-bf3b-35dcd5c6114c","Type":"ContainerStarted","Data":"5e4f6af6796f84c620ebde56c590c22b36f6594d6a596306d0b6a37cbd9a7231"}
Jul 22 12:31:54.852112 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:54.851958    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp" event={"ID":"993d0edb-e992-4acd-bf3b-35dcd5c6114c","Type":"ContainerStarted","Data":"fe3b72f91f8805428ec65efc95f8464fbfdf2e59e5ba3a938c058d7899f4451d"}
Jul 22 12:31:54.874243 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:31:54.874191    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp" podStartSLOduration=1.874173911 podStartE2EDuration="1.874173911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:31:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:31:54.872686404 +0000 UTC m=+2527.239201648" watchObservedRunningTime="2026-07-22 12:31:54.874173911 +0000 UTC m=+2527.240689183"
Jul 22 12:32:04.293388 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:04.293349    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"
Jul 22 12:32:04.295864 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:04.293444    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"
Jul 22 12:32:04.306158 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:04.306140    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"
Jul 22 12:32:04.912949 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:04.912916    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"
Jul 22 12:32:40.389185 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:40.389149    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"]
Jul 22 12:32:55.409719 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:55.409659    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp" podUID="993d0edb-e992-4acd-bf3b-35dcd5c6114c" containerName="main" containerID="cri-o://5e4f6af6796f84c620ebde56c590c22b36f6594d6a596306d0b6a37cbd9a7231" gracePeriod=45
Jul 22 12:32:55.664208 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:55.664147    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"
Jul 22 12:32:55.742365 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:55.742323    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlp7s\" (UniqueName: \"kubernetes.io/projected/993d0edb-e992-4acd-bf3b-35dcd5c6114c-kube-api-access-dlp7s\") pod \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\" (UID: \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\") "
Jul 22 12:32:55.742646 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:55.742383    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/993d0edb-e992-4acd-bf3b-35dcd5c6114c-home\") pod \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\" (UID: \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\") "
Jul 22 12:32:55.742646 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:55.742416    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/993d0edb-e992-4acd-bf3b-35dcd5c6114c-model-cache\") pod \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\" (UID: \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\") "
Jul 22 12:32:55.742646 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:55.742434    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/993d0edb-e992-4acd-bf3b-35dcd5c6114c-dshm\") pod \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\" (UID: \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\") "
Jul 22 12:32:55.742646 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:55.742465    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/993d0edb-e992-4acd-bf3b-35dcd5c6114c-tls-certs\") pod \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\" (UID: \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\") "
Jul 22 12:32:55.742646 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:55.742489    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/993d0edb-e992-4acd-bf3b-35dcd5c6114c-tmp-dir\") pod \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\" (UID: \"993d0edb-e992-4acd-bf3b-35dcd5c6114c\") "
Jul 22 12:32:55.742943 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:55.742798    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/993d0edb-e992-4acd-bf3b-35dcd5c6114c-model-cache" (OuterVolumeSpecName: "model-cache") pod "993d0edb-e992-4acd-bf3b-35dcd5c6114c" (UID: "993d0edb-e992-4acd-bf3b-35dcd5c6114c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:32:55.742943 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:55.742827    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/993d0edb-e992-4acd-bf3b-35dcd5c6114c-home" (OuterVolumeSpecName: "home") pod "993d0edb-e992-4acd-bf3b-35dcd5c6114c" (UID: "993d0edb-e992-4acd-bf3b-35dcd5c6114c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:32:55.742943 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:55.742866    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/993d0edb-e992-4acd-bf3b-35dcd5c6114c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "993d0edb-e992-4acd-bf3b-35dcd5c6114c" (UID: "993d0edb-e992-4acd-bf3b-35dcd5c6114c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:32:55.744791 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:55.744764    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/993d0edb-e992-4acd-bf3b-35dcd5c6114c-kube-api-access-dlp7s" (OuterVolumeSpecName: "kube-api-access-dlp7s") pod "993d0edb-e992-4acd-bf3b-35dcd5c6114c" (UID: "993d0edb-e992-4acd-bf3b-35dcd5c6114c"). InnerVolumeSpecName "kube-api-access-dlp7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:32:55.744869 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:55.744767    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/993d0edb-e992-4acd-bf3b-35dcd5c6114c-dshm" (OuterVolumeSpecName: "dshm") pod "993d0edb-e992-4acd-bf3b-35dcd5c6114c" (UID: "993d0edb-e992-4acd-bf3b-35dcd5c6114c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:32:55.744869 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:55.744819    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/993d0edb-e992-4acd-bf3b-35dcd5c6114c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "993d0edb-e992-4acd-bf3b-35dcd5c6114c" (UID: "993d0edb-e992-4acd-bf3b-35dcd5c6114c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:32:55.843511 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:55.843468    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlp7s\" (UniqueName: \"kubernetes.io/projected/993d0edb-e992-4acd-bf3b-35dcd5c6114c-kube-api-access-dlp7s\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:32:55.843511 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:55.843508    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/993d0edb-e992-4acd-bf3b-35dcd5c6114c-home\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:32:55.843511 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:55.843520    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/993d0edb-e992-4acd-bf3b-35dcd5c6114c-model-cache\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:32:55.843802 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:55.843528    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/993d0edb-e992-4acd-bf3b-35dcd5c6114c-dshm\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:32:55.843802 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:55.843537    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/993d0edb-e992-4acd-bf3b-35dcd5c6114c-tls-certs\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:32:55.843802 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:55.843565    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/993d0edb-e992-4acd-bf3b-35dcd5c6114c-tmp-dir\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:32:56.154921 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:56.154885    2558 generic.go:356] "Generic (PLEG): container finished" podID="993d0edb-e992-4acd-bf3b-35dcd5c6114c" containerID="5e4f6af6796f84c620ebde56c590c22b36f6594d6a596306d0b6a37cbd9a7231" exitCode=0
Jul 22 12:32:56.155103 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:56.154926    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"
Jul 22 12:32:56.155103 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:56.154969    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp" event={"ID":"993d0edb-e992-4acd-bf3b-35dcd5c6114c","Type":"ContainerDied","Data":"5e4f6af6796f84c620ebde56c590c22b36f6594d6a596306d0b6a37cbd9a7231"}
Jul 22 12:32:56.155103 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:56.155008    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp" event={"ID":"993d0edb-e992-4acd-bf3b-35dcd5c6114c","Type":"ContainerDied","Data":"fe3b72f91f8805428ec65efc95f8464fbfdf2e59e5ba3a938c058d7899f4451d"}
Jul 22 12:32:56.155103 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:56.155027    2558 scope.go:117] "RemoveContainer" containerID="5e4f6af6796f84c620ebde56c590c22b36f6594d6a596306d0b6a37cbd9a7231"
Jul 22 12:32:56.164298 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:56.164280    2558 scope.go:117] "RemoveContainer" containerID="5e4f6af6796f84c620ebde56c590c22b36f6594d6a596306d0b6a37cbd9a7231"
Jul 22 12:32:56.164552 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:32:56.164534    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e4f6af6796f84c620ebde56c590c22b36f6594d6a596306d0b6a37cbd9a7231\": container with ID starting with 5e4f6af6796f84c620ebde56c590c22b36f6594d6a596306d0b6a37cbd9a7231 not found: ID does not exist" containerID="5e4f6af6796f84c620ebde56c590c22b36f6594d6a596306d0b6a37cbd9a7231"
Jul 22 12:32:56.164601 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:56.164561    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e4f6af6796f84c620ebde56c590c22b36f6594d6a596306d0b6a37cbd9a7231"} err="failed to get container status \"5e4f6af6796f84c620ebde56c590c22b36f6594d6a596306d0b6a37cbd9a7231\": rpc error: code = NotFound desc = could not find container \"5e4f6af6796f84c620ebde56c590c22b36f6594d6a596306d0b6a37cbd9a7231\": container with ID starting with 5e4f6af6796f84c620ebde56c590c22b36f6594d6a596306d0b6a37cbd9a7231 not found: ID does not exist"
Jul 22 12:32:56.179074 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:56.179034    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"]
Jul 22 12:32:56.181656 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:56.181632    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-55573a/sub-test-model-55573a-kserve-6c4d9f8795-z2qxp"]
Jul 22 12:32:56.447653 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:32:56.447550    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="993d0edb-e992-4acd-bf3b-35dcd5c6114c" path="/var/lib/kubelet/pods/993d0edb-e992-4acd-bf3b-35dcd5c6114c/volumes"
Jul 22 12:33:16.302842 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.302810    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"]
Jul 22 12:33:16.303300 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.303266    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="993d0edb-e992-4acd-bf3b-35dcd5c6114c" containerName="main"
Jul 22 12:33:16.303300 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.303278    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="993d0edb-e992-4acd-bf3b-35dcd5c6114c" containerName="main"
Jul 22 12:33:16.303374 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.303362    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="993d0edb-e992-4acd-bf3b-35dcd5c6114c" containerName="main"
Jul 22 12:33:16.306410 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.306393    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"
Jul 22 12:33:16.310102 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.310078    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-55573a\"/\"openshift-service-ca.crt\""
Jul 22 12:33:16.310261 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.310165    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-55573a\"/\"kube-root-ca.crt\""
Jul 22 12:33:16.310261 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.310210    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-55573a\"/\"rate-test-model-55573a-kserve-self-signed-certs\""
Jul 22 12:33:16.310261 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.310226    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-55573a\"/\"default-dockercfg-4ggz6\""
Jul 22 12:33:16.317399 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.317377    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"]
Jul 22 12:33:16.436353 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.436319    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1e626e8-4783-4520-b5e2-9598649f331e-dshm\") pod \"rate-test-model-55573a-kserve-fd7d88b67-dmzr5\" (UID: \"c1e626e8-4783-4520-b5e2-9598649f331e\") " pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"
Jul 22 12:33:16.436353 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.436356    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1e626e8-4783-4520-b5e2-9598649f331e-tmp-dir\") pod \"rate-test-model-55573a-kserve-fd7d88b67-dmzr5\" (UID: \"c1e626e8-4783-4520-b5e2-9598649f331e\") " pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"
Jul 22 12:33:16.436589 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.436405    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1e626e8-4783-4520-b5e2-9598649f331e-tls-certs\") pod \"rate-test-model-55573a-kserve-fd7d88b67-dmzr5\" (UID: \"c1e626e8-4783-4520-b5e2-9598649f331e\") " pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"
Jul 22 12:33:16.436589 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.436464    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1e626e8-4783-4520-b5e2-9598649f331e-model-cache\") pod \"rate-test-model-55573a-kserve-fd7d88b67-dmzr5\" (UID: \"c1e626e8-4783-4520-b5e2-9598649f331e\") " pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"
Jul 22 12:33:16.436589 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.436495    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1e626e8-4783-4520-b5e2-9598649f331e-home\") pod \"rate-test-model-55573a-kserve-fd7d88b67-dmzr5\" (UID: \"c1e626e8-4783-4520-b5e2-9598649f331e\") " pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"
Jul 22 12:33:16.436589 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.436523    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv4tq\" (UniqueName: \"kubernetes.io/projected/c1e626e8-4783-4520-b5e2-9598649f331e-kube-api-access-gv4tq\") pod \"rate-test-model-55573a-kserve-fd7d88b67-dmzr5\" (UID: \"c1e626e8-4783-4520-b5e2-9598649f331e\") " pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"
Jul 22 12:33:16.537665 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.537604    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1e626e8-4783-4520-b5e2-9598649f331e-dshm\") pod \"rate-test-model-55573a-kserve-fd7d88b67-dmzr5\" (UID: \"c1e626e8-4783-4520-b5e2-9598649f331e\") " pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"
Jul 22 12:33:16.537665 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.537669    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1e626e8-4783-4520-b5e2-9598649f331e-tmp-dir\") pod \"rate-test-model-55573a-kserve-fd7d88b67-dmzr5\" (UID: \"c1e626e8-4783-4520-b5e2-9598649f331e\") " pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"
Jul 22 12:33:16.537919 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.537715    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1e626e8-4783-4520-b5e2-9598649f331e-tls-certs\") pod \"rate-test-model-55573a-kserve-fd7d88b67-dmzr5\" (UID: \"c1e626e8-4783-4520-b5e2-9598649f331e\") " pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"
Jul 22 12:33:16.537919 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.537770    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1e626e8-4783-4520-b5e2-9598649f331e-model-cache\") pod \"rate-test-model-55573a-kserve-fd7d88b67-dmzr5\" (UID: \"c1e626e8-4783-4520-b5e2-9598649f331e\") " pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"
Jul 22 12:33:16.537919 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.537790    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1e626e8-4783-4520-b5e2-9598649f331e-home\") pod \"rate-test-model-55573a-kserve-fd7d88b67-dmzr5\" (UID: \"c1e626e8-4783-4520-b5e2-9598649f331e\") " pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"
Jul 22 12:33:16.537919 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.537820    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv4tq\" (UniqueName: \"kubernetes.io/projected/c1e626e8-4783-4520-b5e2-9598649f331e-kube-api-access-gv4tq\") pod \"rate-test-model-55573a-kserve-fd7d88b67-dmzr5\" (UID: \"c1e626e8-4783-4520-b5e2-9598649f331e\") " pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"
Jul 22 12:33:16.538192 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.538166    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1e626e8-4783-4520-b5e2-9598649f331e-tmp-dir\") pod \"rate-test-model-55573a-kserve-fd7d88b67-dmzr5\" (UID: \"c1e626e8-4783-4520-b5e2-9598649f331e\") " pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"
Jul 22 12:33:16.538253 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.538193    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1e626e8-4783-4520-b5e2-9598649f331e-model-cache\") pod \"rate-test-model-55573a-kserve-fd7d88b67-dmzr5\" (UID: \"c1e626e8-4783-4520-b5e2-9598649f331e\") " pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"
Jul 22 12:33:16.538294 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.538250    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1e626e8-4783-4520-b5e2-9598649f331e-home\") pod \"rate-test-model-55573a-kserve-fd7d88b67-dmzr5\" (UID: \"c1e626e8-4783-4520-b5e2-9598649f331e\") " pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"
Jul 22 12:33:16.539982 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.539962    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1e626e8-4783-4520-b5e2-9598649f331e-dshm\") pod \"rate-test-model-55573a-kserve-fd7d88b67-dmzr5\" (UID: \"c1e626e8-4783-4520-b5e2-9598649f331e\") " pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"
Jul 22 12:33:16.540249 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.540233    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1e626e8-4783-4520-b5e2-9598649f331e-tls-certs\") pod \"rate-test-model-55573a-kserve-fd7d88b67-dmzr5\" (UID: \"c1e626e8-4783-4520-b5e2-9598649f331e\") " pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"
Jul 22 12:33:16.547060 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.547040    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv4tq\" (UniqueName: \"kubernetes.io/projected/c1e626e8-4783-4520-b5e2-9598649f331e-kube-api-access-gv4tq\") pod \"rate-test-model-55573a-kserve-fd7d88b67-dmzr5\" (UID: \"c1e626e8-4783-4520-b5e2-9598649f331e\") " pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"
Jul 22 12:33:16.616545 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.616519    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"
Jul 22 12:33:16.751432 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:16.751405    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"]
Jul 22 12:33:16.753510 ip-10-0-132-166 kubenswrapper[2558]: W0722 12:33:16.753482    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1e626e8_4783_4520_b5e2_9598649f331e.slice/crio-1040e91700c6eba94df95a98fff0a19df96211f2e8cdf94ddde2141633218a6e WatchSource:0}: Error finding container 1040e91700c6eba94df95a98fff0a19df96211f2e8cdf94ddde2141633218a6e: Status 404 returned error can't find the container with id 1040e91700c6eba94df95a98fff0a19df96211f2e8cdf94ddde2141633218a6e
Jul 22 12:33:17.265030 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:17.264995    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5" event={"ID":"c1e626e8-4783-4520-b5e2-9598649f331e","Type":"ContainerStarted","Data":"1e101b713ac7630f7fbcf9559c540309be2fa083a55770d673de49ff8dfec106"}
Jul 22 12:33:17.265220 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:17.265043    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5" event={"ID":"c1e626e8-4783-4520-b5e2-9598649f331e","Type":"ContainerStarted","Data":"1040e91700c6eba94df95a98fff0a19df96211f2e8cdf94ddde2141633218a6e"}
Jul 22 12:33:17.286798 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:17.286744    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5" podStartSLOduration=1.286725591 podStartE2EDuration="1.286725591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:33:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:33:17.28451715 +0000 UTC m=+2609.651032394" watchObservedRunningTime="2026-07-22 12:33:17.286725591 +0000 UTC m=+2609.653240836"
Jul 22 12:33:26.616651 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:26.616596    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"
Jul 22 12:33:26.616651 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:26.616660    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"
Jul 22 12:33:26.629784 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:26.629754    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"
Jul 22 12:33:27.326743 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:27.326713    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"
Jul 22 12:33:59.833249 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:33:59.833214    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"]
Jul 22 12:34:14.852817 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:14.852771    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5" podUID="c1e626e8-4783-4520-b5e2-9598649f331e" containerName="main" containerID="cri-o://1e101b713ac7630f7fbcf9559c540309be2fa083a55770d673de49ff8dfec106" gracePeriod=45
Jul 22 12:34:15.108841 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.108772    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"
Jul 22 12:34:15.196094 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.196061    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gv4tq\" (UniqueName: \"kubernetes.io/projected/c1e626e8-4783-4520-b5e2-9598649f331e-kube-api-access-gv4tq\") pod \"c1e626e8-4783-4520-b5e2-9598649f331e\" (UID: \"c1e626e8-4783-4520-b5e2-9598649f331e\") "
Jul 22 12:34:15.196293 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.196101    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1e626e8-4783-4520-b5e2-9598649f331e-tmp-dir\") pod \"c1e626e8-4783-4520-b5e2-9598649f331e\" (UID: \"c1e626e8-4783-4520-b5e2-9598649f331e\") "
Jul 22 12:34:15.196293 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.196137    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1e626e8-4783-4520-b5e2-9598649f331e-tls-certs\") pod \"c1e626e8-4783-4520-b5e2-9598649f331e\" (UID: \"c1e626e8-4783-4520-b5e2-9598649f331e\") "
Jul 22 12:34:15.196293 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.196165    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1e626e8-4783-4520-b5e2-9598649f331e-dshm\") pod \"c1e626e8-4783-4520-b5e2-9598649f331e\" (UID: \"c1e626e8-4783-4520-b5e2-9598649f331e\") "
Jul 22 12:34:15.196293 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.196230    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1e626e8-4783-4520-b5e2-9598649f331e-home\") pod \"c1e626e8-4783-4520-b5e2-9598649f331e\" (UID: \"c1e626e8-4783-4520-b5e2-9598649f331e\") "
Jul 22 12:34:15.196293 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.196268    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1e626e8-4783-4520-b5e2-9598649f331e-model-cache\") pod \"c1e626e8-4783-4520-b5e2-9598649f331e\" (UID: \"c1e626e8-4783-4520-b5e2-9598649f331e\") "
Jul 22 12:34:15.196555 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.196423    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1e626e8-4783-4520-b5e2-9598649f331e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c1e626e8-4783-4520-b5e2-9598649f331e" (UID: "c1e626e8-4783-4520-b5e2-9598649f331e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:34:15.196642 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.196536    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1e626e8-4783-4520-b5e2-9598649f331e-home" (OuterVolumeSpecName: "home") pod "c1e626e8-4783-4520-b5e2-9598649f331e" (UID: "c1e626e8-4783-4520-b5e2-9598649f331e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:34:15.196642 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.196593    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1e626e8-4783-4520-b5e2-9598649f331e-model-cache" (OuterVolumeSpecName: "model-cache") pod "c1e626e8-4783-4520-b5e2-9598649f331e" (UID: "c1e626e8-4783-4520-b5e2-9598649f331e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:34:15.196761 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.196708    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1e626e8-4783-4520-b5e2-9598649f331e-tmp-dir\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:34:15.196761 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.196731    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1e626e8-4783-4520-b5e2-9598649f331e-home\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:34:15.198516 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.198489    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1e626e8-4783-4520-b5e2-9598649f331e-kube-api-access-gv4tq" (OuterVolumeSpecName: "kube-api-access-gv4tq") pod "c1e626e8-4783-4520-b5e2-9598649f331e" (UID: "c1e626e8-4783-4520-b5e2-9598649f331e"). InnerVolumeSpecName "kube-api-access-gv4tq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:34:15.198886 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.198861    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1e626e8-4783-4520-b5e2-9598649f331e-dshm" (OuterVolumeSpecName: "dshm") pod "c1e626e8-4783-4520-b5e2-9598649f331e" (UID: "c1e626e8-4783-4520-b5e2-9598649f331e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:34:15.198886 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.198867    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1e626e8-4783-4520-b5e2-9598649f331e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c1e626e8-4783-4520-b5e2-9598649f331e" (UID: "c1e626e8-4783-4520-b5e2-9598649f331e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:34:15.297661 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.297608    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1e626e8-4783-4520-b5e2-9598649f331e-tls-certs\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:34:15.297661 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.297654    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1e626e8-4783-4520-b5e2-9598649f331e-dshm\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:34:15.297661 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.297665    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1e626e8-4783-4520-b5e2-9598649f331e-model-cache\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:34:15.297893 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.297673    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gv4tq\" (UniqueName: \"kubernetes.io/projected/c1e626e8-4783-4520-b5e2-9598649f331e-kube-api-access-gv4tq\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:34:15.552591 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.552556    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7337-139799750154256"]
Jul 22 12:34:15.553035 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.553021    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1e626e8-4783-4520-b5e2-9598649f331e" containerName="main"
Jul 22 12:34:15.553090 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.553037    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1e626e8-4783-4520-b5e2-9598649f331e" containerName="main"
Jul 22 12:34:15.553125 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.553112    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1e626e8-4783-4520-b5e2-9598649f331e" containerName="main"
Jul 22 12:34:15.556276 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.556249    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7337-139799750154256"
Jul 22 12:34:15.559954 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.559933    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-h49wh\""
Jul 22 12:34:15.565542 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.565517    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7337-139799750154256"]
Jul 22 12:34:15.569901 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.569876    2558 generic.go:356] "Generic (PLEG): container finished" podID="c1e626e8-4783-4520-b5e2-9598649f331e" containerID="1e101b713ac7630f7fbcf9559c540309be2fa083a55770d673de49ff8dfec106" exitCode=0
Jul 22 12:34:15.570011 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.569913    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5" event={"ID":"c1e626e8-4783-4520-b5e2-9598649f331e","Type":"ContainerDied","Data":"1e101b713ac7630f7fbcf9559c540309be2fa083a55770d673de49ff8dfec106"}
Jul 22 12:34:15.570011 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.569927    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"
Jul 22 12:34:15.570011 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.569941    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5" event={"ID":"c1e626e8-4783-4520-b5e2-9598649f331e","Type":"ContainerDied","Data":"1040e91700c6eba94df95a98fff0a19df96211f2e8cdf94ddde2141633218a6e"}
Jul 22 12:34:15.570011 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.569965    2558 scope.go:117] "RemoveContainer" containerID="1e101b713ac7630f7fbcf9559c540309be2fa083a55770d673de49ff8dfec106"
Jul 22 12:34:15.579706 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.579687    2558 scope.go:117] "RemoveContainer" containerID="1e101b713ac7630f7fbcf9559c540309be2fa083a55770d673de49ff8dfec106"
Jul 22 12:34:15.579974 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:34:15.579955    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e101b713ac7630f7fbcf9559c540309be2fa083a55770d673de49ff8dfec106\": container with ID starting with 1e101b713ac7630f7fbcf9559c540309be2fa083a55770d673de49ff8dfec106 not found: ID does not exist" containerID="1e101b713ac7630f7fbcf9559c540309be2fa083a55770d673de49ff8dfec106"
Jul 22 12:34:15.580041 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.579985    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e101b713ac7630f7fbcf9559c540309be2fa083a55770d673de49ff8dfec106"} err="failed to get container status \"1e101b713ac7630f7fbcf9559c540309be2fa083a55770d673de49ff8dfec106\": rpc error: code = NotFound desc = could not find container \"1e101b713ac7630f7fbcf9559c540309be2fa083a55770d673de49ff8dfec106\": container with ID starting with 1e101b713ac7630f7fbcf9559c540309be2fa083a55770d673de49ff8dfec106 not found: ID does not exist"
Jul 22 12:34:15.597653 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.597631    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"]
Jul 22 12:34:15.601072 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.601051    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr8kv\" (UniqueName: \"kubernetes.io/projected/522eb84c-61d4-4c0a-b1a5-8ea67ddec91e-kube-api-access-qr8kv\") pod \"test-curl-7337-139799750154256\" (UID: \"522eb84c-61d4-4c0a-b1a5-8ea67ddec91e\") " pod="opendatahub/test-curl-7337-139799750154256"
Jul 22 12:34:15.604371 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.604349    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-55573a/rate-test-model-55573a-kserve-fd7d88b67-dmzr5"]
Jul 22 12:34:15.701712 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.701677    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr8kv\" (UniqueName: \"kubernetes.io/projected/522eb84c-61d4-4c0a-b1a5-8ea67ddec91e-kube-api-access-qr8kv\") pod \"test-curl-7337-139799750154256\" (UID: \"522eb84c-61d4-4c0a-b1a5-8ea67ddec91e\") " pod="opendatahub/test-curl-7337-139799750154256"
Jul 22 12:34:15.713612 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.713581    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr8kv\" (UniqueName: \"kubernetes.io/projected/522eb84c-61d4-4c0a-b1a5-8ea67ddec91e-kube-api-access-qr8kv\") pod \"test-curl-7337-139799750154256\" (UID: \"522eb84c-61d4-4c0a-b1a5-8ea67ddec91e\") " pod="opendatahub/test-curl-7337-139799750154256"
Jul 22 12:34:15.867264 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:15.867230    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7337-139799750154256"
Jul 22 12:34:16.012675 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:16.012650    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7337-139799750154256"]
Jul 22 12:34:16.014714 ip-10-0-132-166 kubenswrapper[2558]: W0722 12:34:16.014683    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod522eb84c_61d4_4c0a_b1a5_8ea67ddec91e.slice/crio-5f3813762caed2cc1bb287aa545e6a0dfd93b83d8175c405faa4c121fef626da WatchSource:0}: Error finding container 5f3813762caed2cc1bb287aa545e6a0dfd93b83d8175c405faa4c121fef626da: Status 404 returned error can't find the container with id 5f3813762caed2cc1bb287aa545e6a0dfd93b83d8175c405faa4c121fef626da
Jul 22 12:34:16.016074 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:16.016054    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 12:34:16.448836 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:16.448806    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1e626e8-4783-4520-b5e2-9598649f331e" path="/var/lib/kubelet/pods/c1e626e8-4783-4520-b5e2-9598649f331e/volumes"
Jul 22 12:34:16.578778 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:16.578738    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7337-139799750154256" event={"ID":"522eb84c-61d4-4c0a-b1a5-8ea67ddec91e","Type":"ContainerStarted","Data":"5f3813762caed2cc1bb287aa545e6a0dfd93b83d8175c405faa4c121fef626da"}
Jul 22 12:34:17.585182 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:17.585138    2558 generic.go:356] "Generic (PLEG): container finished" podID="522eb84c-61d4-4c0a-b1a5-8ea67ddec91e" containerID="6c0eaa48cfd8953cee0bb6b35b27c38bc1a371b86b99915c50eb65434f4966b6" exitCode=0
Jul 22 12:34:17.585592 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:17.585195    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7337-139799750154256" event={"ID":"522eb84c-61d4-4c0a-b1a5-8ea67ddec91e","Type":"ContainerDied","Data":"6c0eaa48cfd8953cee0bb6b35b27c38bc1a371b86b99915c50eb65434f4966b6"}
Jul 22 12:34:18.731546 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:18.731517    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7337-139799750154256"
Jul 22 12:34:18.785519 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:18.785486    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7337-139799750154256_522eb84c-61d4-4c0a-b1a5-8ea67ddec91e/test-curl-7337-139799750154256/0.log"
Jul 22 12:34:18.817086 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:18.817047    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7337-139799750154256"]
Jul 22 12:34:18.821874 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:18.821847    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7337-139799750154256"]
Jul 22 12:34:18.832148 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:18.832120    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qr8kv\" (UniqueName: \"kubernetes.io/projected/522eb84c-61d4-4c0a-b1a5-8ea67ddec91e-kube-api-access-qr8kv\") pod \"522eb84c-61d4-4c0a-b1a5-8ea67ddec91e\" (UID: \"522eb84c-61d4-4c0a-b1a5-8ea67ddec91e\") "
Jul 22 12:34:18.834212 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:18.834191    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/522eb84c-61d4-4c0a-b1a5-8ea67ddec91e-kube-api-access-qr8kv" (OuterVolumeSpecName: "kube-api-access-qr8kv") pod "522eb84c-61d4-4c0a-b1a5-8ea67ddec91e" (UID: "522eb84c-61d4-4c0a-b1a5-8ea67ddec91e"). InnerVolumeSpecName "kube-api-access-qr8kv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:34:18.933703 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:18.933660    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qr8kv\" (UniqueName: \"kubernetes.io/projected/522eb84c-61d4-4c0a-b1a5-8ea67ddec91e-kube-api-access-qr8kv\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:34:19.595553 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:19.595523    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7337-139799750154256"
Jul 22 12:34:19.595553 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:19.595549    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f3813762caed2cc1bb287aa545e6a0dfd93b83d8175c405faa4c121fef626da"
Jul 22 12:34:19.605852 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:34:19.605822    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7337-139799750154256\" is forbidden: User \"system:node:ip-10-0-132-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-166.ec2.internal' and this object" podUID="522eb84c-61d4-4c0a-b1a5-8ea67ddec91e" pod="opendatahub/test-curl-7337-139799750154256"
Jul 22 12:34:20.449081 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:20.448661    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="522eb84c-61d4-4c0a-b1a5-8ea67ddec91e" path="/var/lib/kubelet/pods/522eb84c-61d4-4c0a-b1a5-8ea67ddec91e/volumes"
Jul 22 12:34:29.481918 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:29.481879    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f"]
Jul 22 12:34:29.482889 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:29.482848    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f" podUID="52726f56-ab87-4300-a396-0922a5526f76" containerName="maas-api" containerID="cri-o://b0bbd16c1b181a2dbb47b7fd08c9d289c6169a79676d37ef573ecb463b7b3808" gracePeriod=30
Jul 22 12:34:29.647296 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:29.647264    2558 generic.go:356] "Generic (PLEG): container finished" podID="52726f56-ab87-4300-a396-0922a5526f76" containerID="b0bbd16c1b181a2dbb47b7fd08c9d289c6169a79676d37ef573ecb463b7b3808" exitCode=0
Jul 22 12:34:29.647450 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:29.647338    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f" event={"ID":"52726f56-ab87-4300-a396-0922a5526f76","Type":"ContainerDied","Data":"b0bbd16c1b181a2dbb47b7fd08c9d289c6169a79676d37ef573ecb463b7b3808"}
Jul 22 12:34:29.730319 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:29.730295    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f"
Jul 22 12:34:29.848455 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:29.848372    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52726f56-ab87-4300-a396-0922a5526f76-maas-api-tls\") pod \"52726f56-ab87-4300-a396-0922a5526f76\" (UID: \"52726f56-ab87-4300-a396-0922a5526f76\") "
Jul 22 12:34:29.848600 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:29.848467    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4r7s\" (UniqueName: \"kubernetes.io/projected/52726f56-ab87-4300-a396-0922a5526f76-kube-api-access-k4r7s\") pod \"52726f56-ab87-4300-a396-0922a5526f76\" (UID: \"52726f56-ab87-4300-a396-0922a5526f76\") "
Jul 22 12:34:29.848600 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:29.848491    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52726f56-ab87-4300-a396-0922a5526f76-openshift-service-ca\") pod \"52726f56-ab87-4300-a396-0922a5526f76\" (UID: \"52726f56-ab87-4300-a396-0922a5526f76\") "
Jul 22 12:34:29.848941 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:29.848916    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52726f56-ab87-4300-a396-0922a5526f76-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "52726f56-ab87-4300-a396-0922a5526f76" (UID: "52726f56-ab87-4300-a396-0922a5526f76"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:34:29.850551 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:29.850527    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52726f56-ab87-4300-a396-0922a5526f76-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "52726f56-ab87-4300-a396-0922a5526f76" (UID: "52726f56-ab87-4300-a396-0922a5526f76"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:34:29.850673 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:29.850603    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52726f56-ab87-4300-a396-0922a5526f76-kube-api-access-k4r7s" (OuterVolumeSpecName: "kube-api-access-k4r7s") pod "52726f56-ab87-4300-a396-0922a5526f76" (UID: "52726f56-ab87-4300-a396-0922a5526f76"). InnerVolumeSpecName "kube-api-access-k4r7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:34:29.950059 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:29.950025    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52726f56-ab87-4300-a396-0922a5526f76-maas-api-tls\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:34:29.950059 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:29.950054    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4r7s\" (UniqueName: \"kubernetes.io/projected/52726f56-ab87-4300-a396-0922a5526f76-kube-api-access-k4r7s\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:34:29.950059 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:29.950064    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52726f56-ab87-4300-a396-0922a5526f76-openshift-service-ca\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:34:30.653464 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:30.653430    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f" event={"ID":"52726f56-ab87-4300-a396-0922a5526f76","Type":"ContainerDied","Data":"2873f631b29fee1b0853a659242d8d667697da60f86c348e4b85e61ca3ba5216"}
Jul 22 12:34:30.653464 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:30.653461    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f"
Jul 22 12:34:30.653954 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:30.653491    2558 scope.go:117] "RemoveContainer" containerID="b0bbd16c1b181a2dbb47b7fd08c9d289c6169a79676d37ef573ecb463b7b3808"
Jul 22 12:34:30.673936 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:30.673909    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f"]
Jul 22 12:34:30.675860 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:30.675839    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0b54ae-85767fb8bc-h4p2f"]
Jul 22 12:34:32.451826 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:32.451796    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52726f56-ab87-4300-a396-0922a5526f76" path="/var/lib/kubelet/pods/52726f56-ab87-4300-a396-0922a5526f76/volumes"
Jul 22 12:34:52.487239 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:52.487201    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn"]
Jul 22 12:34:52.487684 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:52.487403    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn" podUID="f6681b22-6bb8-494d-953e-44c9bfd430ea" containerName="maas-api" containerID="cri-o://00e96b7cbce02c83aa52bf299819544c734131ac62b85d07f272f93f257cd1c9" gracePeriod=30
Jul 22 12:34:52.736326 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:52.736299    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn"
Jul 22 12:34:52.762244 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:52.762153    2558 generic.go:356] "Generic (PLEG): container finished" podID="f6681b22-6bb8-494d-953e-44c9bfd430ea" containerID="00e96b7cbce02c83aa52bf299819544c734131ac62b85d07f272f93f257cd1c9" exitCode=0
Jul 22 12:34:52.762244 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:52.762210    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn"
Jul 22 12:34:52.762464 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:52.762328    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn" event={"ID":"f6681b22-6bb8-494d-953e-44c9bfd430ea","Type":"ContainerDied","Data":"00e96b7cbce02c83aa52bf299819544c734131ac62b85d07f272f93f257cd1c9"}
Jul 22 12:34:52.762464 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:52.762379    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn" event={"ID":"f6681b22-6bb8-494d-953e-44c9bfd430ea","Type":"ContainerDied","Data":"dee2b4fa14b7cbf6d38e88cda89c28cda1fd5849bd65e2c51a86fa0e0d8e79f9"}
Jul 22 12:34:52.762464 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:52.762422    2558 scope.go:117] "RemoveContainer" containerID="00e96b7cbce02c83aa52bf299819544c734131ac62b85d07f272f93f257cd1c9"
Jul 22 12:34:52.773820 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:52.773794    2558 scope.go:117] "RemoveContainer" containerID="00e96b7cbce02c83aa52bf299819544c734131ac62b85d07f272f93f257cd1c9"
Jul 22 12:34:52.774131 ip-10-0-132-166 kubenswrapper[2558]: E0722 12:34:52.774106    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00e96b7cbce02c83aa52bf299819544c734131ac62b85d07f272f93f257cd1c9\": container with ID starting with 00e96b7cbce02c83aa52bf299819544c734131ac62b85d07f272f93f257cd1c9 not found: ID does not exist" containerID="00e96b7cbce02c83aa52bf299819544c734131ac62b85d07f272f93f257cd1c9"
Jul 22 12:34:52.774219 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:52.774140    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e96b7cbce02c83aa52bf299819544c734131ac62b85d07f272f93f257cd1c9"} err="failed to get container status \"00e96b7cbce02c83aa52bf299819544c734131ac62b85d07f272f93f257cd1c9\": rpc error: code = NotFound desc = could not find container \"00e96b7cbce02c83aa52bf299819544c734131ac62b85d07f272f93f257cd1c9\": container with ID starting with 00e96b7cbce02c83aa52bf299819544c734131ac62b85d07f272f93f257cd1c9 not found: ID does not exist"
Jul 22 12:34:52.861159 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:52.861130    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfts6\" (UniqueName: \"kubernetes.io/projected/f6681b22-6bb8-494d-953e-44c9bfd430ea-kube-api-access-xfts6\") pod \"f6681b22-6bb8-494d-953e-44c9bfd430ea\" (UID: \"f6681b22-6bb8-494d-953e-44c9bfd430ea\") "
Jul 22 12:34:52.861389 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:52.861185    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6681b22-6bb8-494d-953e-44c9bfd430ea-maas-api-tls\") pod \"f6681b22-6bb8-494d-953e-44c9bfd430ea\" (UID: \"f6681b22-6bb8-494d-953e-44c9bfd430ea\") "
Jul 22 12:34:52.861389 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:52.861210    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6681b22-6bb8-494d-953e-44c9bfd430ea-openshift-service-ca\") pod \"f6681b22-6bb8-494d-953e-44c9bfd430ea\" (UID: \"f6681b22-6bb8-494d-953e-44c9bfd430ea\") "
Jul 22 12:34:52.861709 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:52.861680    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6681b22-6bb8-494d-953e-44c9bfd430ea-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f6681b22-6bb8-494d-953e-44c9bfd430ea" (UID: "f6681b22-6bb8-494d-953e-44c9bfd430ea"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:34:52.863195 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:52.863172    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6681b22-6bb8-494d-953e-44c9bfd430ea-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f6681b22-6bb8-494d-953e-44c9bfd430ea" (UID: "f6681b22-6bb8-494d-953e-44c9bfd430ea"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:34:52.863284 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:52.863221    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6681b22-6bb8-494d-953e-44c9bfd430ea-kube-api-access-xfts6" (OuterVolumeSpecName: "kube-api-access-xfts6") pod "f6681b22-6bb8-494d-953e-44c9bfd430ea" (UID: "f6681b22-6bb8-494d-953e-44c9bfd430ea"). InnerVolumeSpecName "kube-api-access-xfts6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:34:52.962022 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:52.961985    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfts6\" (UniqueName: \"kubernetes.io/projected/f6681b22-6bb8-494d-953e-44c9bfd430ea-kube-api-access-xfts6\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:34:52.962022 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:52.962017    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6681b22-6bb8-494d-953e-44c9bfd430ea-maas-api-tls\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:34:52.962022 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:52.962026    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6681b22-6bb8-494d-953e-44c9bfd430ea-openshift-service-ca\") on node \"ip-10-0-132-166.ec2.internal\" DevicePath \"\""
Jul 22 12:34:53.088585 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:53.088556    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn"]
Jul 22 12:34:53.100951 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:53.100922    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-55573a-5fffcfd779-twhvn"]
Jul 22 12:34:54.447793 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:34:54.447757    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6681b22-6bb8-494d-953e-44c9bfd430ea" path="/var/lib/kubelet/pods/f6681b22-6bb8-494d-953e-44c9bfd430ea/volumes"
Jul 22 12:35:11.621937 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:11.621900    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-bbfbc5ddf-ctrjd_a0d17b02-39a5-4763-863d-fb2078a40d1d/manager/0.log"
Jul 22 12:35:12.250569 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:12.250536    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c4d6d56dd-trt92_1d6bff52-9b53-40d3-a761-ce3321cbbed2/copy-manifests/0.log"
Jul 22 12:35:12.258284 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:12.258258    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c4d6d56dd-trt92_1d6bff52-9b53-40d3-a761-ce3321cbbed2/manager/0.log"
Jul 22 12:35:12.631470 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:12.631429    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5ff8b9d49d-4k76b_727fba9e-71f0-45f1-a676-592c54e16659/maas-api/0.log"
Jul 22 12:35:12.869204 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:12.869171    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29745375-476ts_18e8ad12-688a-4a73-b34b-ce9bef2e6219/cleanup/0.log"
Jul 22 12:35:13.103134 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:13.103047    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-h8f5z_8f1f2b7f-f5d6-442c-a3a2-ef604de77771/postgres/0.log"
Jul 22 12:35:14.760869 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:14.760835    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-wc966_f84478a2-ef1a-4b88-8fd7-ae6eb5517f47/manager/0.log"
Jul 22 12:35:14.892232 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:14.892204    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-svsdg_26354044-1df9-4308-ba21-de9185d935a0/kuadrant-console-plugin/0.log"
Jul 22 12:35:16.051073 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:16.051042    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57559476c9-ttmlt_4b47f7dc-f284-48a9-bc28-2c61b005957e/kube-auth-proxy/0.log"
Jul 22 12:35:16.420081 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:16.420052    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-bdmqc_a838aab7-dd17-4454-ad0f-c1b7f1b85371/payload-pre-processing/0.log"
Jul 22 12:35:16.550238 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:16.550208    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-prd5q_c60c3a5f-a087-4d42-8b18-10f38213268c/payload-processing/0.log"
Jul 22 12:35:17.219412 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:17.219382    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-hhjcf_7c6257b6-2d47-4f1d-bb83-34a27a3d527a/main/0.log"
Jul 22 12:35:17.461683 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:17.461651    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxq229_03cabd1e-21ba-4842-b384-3051fab66e1c/main/0.log"
Jul 22 12:35:27.512006 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:27.511976    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k9p8m_4fc8b4ba-9376-46b3-b29a-5f60380da898/global-pull-secret-syncer/0.log"
Jul 22 12:35:27.770427 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:27.770346    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sdh44_e89ec73b-8401-4834-91f6-c6ee13d5dc74/konnectivity-agent/0.log"
Jul 22 12:35:27.865338 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:27.865303    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-166.ec2.internal_f52713c0287a28d2385b478ed125ac34/haproxy/0.log"
Jul 22 12:35:33.839006 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:33.838923    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-wc966_f84478a2-ef1a-4b88-8fd7-ae6eb5517f47/manager/0.log"
Jul 22 12:35:33.881297 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:33.881274    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-svsdg_26354044-1df9-4308-ba21-de9185d935a0/kuadrant-console-plugin/0.log"
Jul 22 12:35:36.064773 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.064746    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_448c4251-0b21-45fb-8a55-c5ca143da632/alertmanager/0.log"
Jul 22 12:35:36.099225 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.099195    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_448c4251-0b21-45fb-8a55-c5ca143da632/config-reloader/0.log"
Jul 22 12:35:36.126409 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.126376    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_448c4251-0b21-45fb-8a55-c5ca143da632/kube-rbac-proxy-web/0.log"
Jul 22 12:35:36.149281 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.149250    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_448c4251-0b21-45fb-8a55-c5ca143da632/kube-rbac-proxy/0.log"
Jul 22 12:35:36.181698 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.181672    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_448c4251-0b21-45fb-8a55-c5ca143da632/kube-rbac-proxy-metric/0.log"
Jul 22 12:35:36.208286 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.208261    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_448c4251-0b21-45fb-8a55-c5ca143da632/prom-label-proxy/0.log"
Jul 22 12:35:36.232025 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.231995    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_448c4251-0b21-45fb-8a55-c5ca143da632/init-config-reloader/0.log"
Jul 22 12:35:36.307507 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.307438    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-55sg4_dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd/kube-state-metrics/0.log"
Jul 22 12:35:36.325408 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.325370    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-55sg4_dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd/kube-rbac-proxy-main/0.log"
Jul 22 12:35:36.347478 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.347456    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-55sg4_dbf70bda-bf8f-45a1-a4b2-09337ddbe6cd/kube-rbac-proxy-self/0.log"
Jul 22 12:35:36.377515 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.377491    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-d65c64d4-d4g9d_5cb7b92b-f9ff-4786-ad7b-042bb4a48e4c/metrics-server/0.log"
Jul 22 12:35:36.405791 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.405762    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-7p6x2_fe2a97e1-57a6-422c-9645-518aed32d6ec/monitoring-plugin/0.log"
Jul 22 12:35:36.612502 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.612420    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xh4sp_439719dd-e090-4f31-8d3a-7224d68b7343/node-exporter/0.log"
Jul 22 12:35:36.636333 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.636310    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xh4sp_439719dd-e090-4f31-8d3a-7224d68b7343/kube-rbac-proxy/0.log"
Jul 22 12:35:36.660668 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.660644    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xh4sp_439719dd-e090-4f31-8d3a-7224d68b7343/init-textfile/0.log"
Jul 22 12:35:36.689351 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.689321    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-qqxff_704bddee-6ccc-46a9-9c66-83fca35aaf79/kube-rbac-proxy-main/0.log"
Jul 22 12:35:36.714000 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.713971    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-qqxff_704bddee-6ccc-46a9-9c66-83fca35aaf79/kube-rbac-proxy-self/0.log"
Jul 22 12:35:36.740277 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.740256    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-qqxff_704bddee-6ccc-46a9-9c66-83fca35aaf79/openshift-state-metrics/0.log"
Jul 22 12:35:36.781824 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.781793    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_162b08fa-d070-419e-a161-98209f323127/prometheus/0.log"
Jul 22 12:35:36.807420 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.807395    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_162b08fa-d070-419e-a161-98209f323127/config-reloader/0.log"
Jul 22 12:35:36.831628 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.831591    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_162b08fa-d070-419e-a161-98209f323127/thanos-sidecar/0.log"
Jul 22 12:35:36.854653 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.854606    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_162b08fa-d070-419e-a161-98209f323127/kube-rbac-proxy-web/0.log"
Jul 22 12:35:36.877856 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.877834    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_162b08fa-d070-419e-a161-98209f323127/kube-rbac-proxy/0.log"
Jul 22 12:35:36.902205 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.902182    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_162b08fa-d070-419e-a161-98209f323127/kube-rbac-proxy-thanos/0.log"
Jul 22 12:35:36.932840 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.932816    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_162b08fa-d070-419e-a161-98209f323127/init-config-reloader/0.log"
Jul 22 12:35:36.974263 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.974230    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-bd8b2_68c9485f-a278-4f86-a153-2b944f2b4499/prometheus-operator/0.log"
Jul 22 12:35:36.999734 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:36.999709    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-bd8b2_68c9485f-a278-4f86-a153-2b944f2b4499/kube-rbac-proxy/0.log"
Jul 22 12:35:37.034518 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.034482    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mtjsz/perf-node-gather-daemonset-k55bh"]
Jul 22 12:35:37.035031 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.035010    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52726f56-ab87-4300-a396-0922a5526f76" containerName="maas-api"
Jul 22 12:35:37.035031 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.035028    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="52726f56-ab87-4300-a396-0922a5526f76" containerName="maas-api"
Jul 22 12:35:37.035175 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.035038    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6681b22-6bb8-494d-953e-44c9bfd430ea" containerName="maas-api"
Jul 22 12:35:37.035175 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.035043    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6681b22-6bb8-494d-953e-44c9bfd430ea" containerName="maas-api"
Jul 22 12:35:37.035175 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.035060    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="522eb84c-61d4-4c0a-b1a5-8ea67ddec91e" containerName="test-curl-7337-139799750154256"
Jul 22 12:35:37.035175 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.035068    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="522eb84c-61d4-4c0a-b1a5-8ea67ddec91e" containerName="test-curl-7337-139799750154256"
Jul 22 12:35:37.035175 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.035129    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6681b22-6bb8-494d-953e-44c9bfd430ea" containerName="maas-api"
Jul 22 12:35:37.035175 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.035138    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="52726f56-ab87-4300-a396-0922a5526f76" containerName="maas-api"
Jul 22 12:35:37.035175 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.035149    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="522eb84c-61d4-4c0a-b1a5-8ea67ddec91e" containerName="test-curl-7337-139799750154256"
Jul 22 12:35:37.038524 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.038506    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mtjsz/perf-node-gather-daemonset-k55bh"
Jul 22 12:35:37.041601 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.041576    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mtjsz\"/\"default-dockercfg-p49nt\""
Jul 22 12:35:37.041723 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.041655    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mtjsz\"/\"kube-root-ca.crt\""
Jul 22 12:35:37.042552 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.042536    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mtjsz\"/\"openshift-service-ca.crt\""
Jul 22 12:35:37.047645 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.047593    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mtjsz/perf-node-gather-daemonset-k55bh"]
Jul 22 12:35:37.174795 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.174703    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-869bdc6bd9-w965b_26617416-0411-43f4-bcea-5e078f3698d6/thanos-query/0.log"
Jul 22 12:35:37.183644 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.183598    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e457bb52-1b21-4e78-9f71-a299fd1d5fb8-sys\") pod \"perf-node-gather-daemonset-k55bh\" (UID: \"e457bb52-1b21-4e78-9f71-a299fd1d5fb8\") " pod="openshift-must-gather-mtjsz/perf-node-gather-daemonset-k55bh"
Jul 22 12:35:37.183786 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.183662    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e457bb52-1b21-4e78-9f71-a299fd1d5fb8-podres\") pod \"perf-node-gather-daemonset-k55bh\" (UID: \"e457bb52-1b21-4e78-9f71-a299fd1d5fb8\") " pod="openshift-must-gather-mtjsz/perf-node-gather-daemonset-k55bh"
Jul 22 12:35:37.183786 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.183729    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e457bb52-1b21-4e78-9f71-a299fd1d5fb8-proc\") pod \"perf-node-gather-daemonset-k55bh\" (UID: \"e457bb52-1b21-4e78-9f71-a299fd1d5fb8\") " pod="openshift-must-gather-mtjsz/perf-node-gather-daemonset-k55bh"
Jul 22 12:35:37.183884 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.183833    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czdt6\" (UniqueName: \"kubernetes.io/projected/e457bb52-1b21-4e78-9f71-a299fd1d5fb8-kube-api-access-czdt6\") pod \"perf-node-gather-daemonset-k55bh\" (UID: \"e457bb52-1b21-4e78-9f71-a299fd1d5fb8\") " pod="openshift-must-gather-mtjsz/perf-node-gather-daemonset-k55bh"
Jul 22 12:35:37.183884 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.183862    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e457bb52-1b21-4e78-9f71-a299fd1d5fb8-lib-modules\") pod \"perf-node-gather-daemonset-k55bh\" (UID: \"e457bb52-1b21-4e78-9f71-a299fd1d5fb8\") " pod="openshift-must-gather-mtjsz/perf-node-gather-daemonset-k55bh"
Jul 22 12:35:37.201582 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.201551    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-869bdc6bd9-w965b_26617416-0411-43f4-bcea-5e078f3698d6/kube-rbac-proxy-web/0.log"
Jul 22 12:35:37.227719 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.227694    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-869bdc6bd9-w965b_26617416-0411-43f4-bcea-5e078f3698d6/kube-rbac-proxy/0.log"
Jul 22 12:35:37.251276 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.251249    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-869bdc6bd9-w965b_26617416-0411-43f4-bcea-5e078f3698d6/prom-label-proxy/0.log"
Jul 22 12:35:37.274930 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.274908    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-869bdc6bd9-w965b_26617416-0411-43f4-bcea-5e078f3698d6/kube-rbac-proxy-rules/0.log"
Jul 22 12:35:37.285249 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.285224    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czdt6\" (UniqueName: \"kubernetes.io/projected/e457bb52-1b21-4e78-9f71-a299fd1d5fb8-kube-api-access-czdt6\") pod \"perf-node-gather-daemonset-k55bh\" (UID: \"e457bb52-1b21-4e78-9f71-a299fd1d5fb8\") " pod="openshift-must-gather-mtjsz/perf-node-gather-daemonset-k55bh"
Jul 22 12:35:37.285386 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.285261    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e457bb52-1b21-4e78-9f71-a299fd1d5fb8-lib-modules\") pod \"perf-node-gather-daemonset-k55bh\" (UID: \"e457bb52-1b21-4e78-9f71-a299fd1d5fb8\") " pod="openshift-must-gather-mtjsz/perf-node-gather-daemonset-k55bh"
Jul 22 12:35:37.285386 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.285339    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e457bb52-1b21-4e78-9f71-a299fd1d5fb8-sys\") pod \"perf-node-gather-daemonset-k55bh\" (UID: \"e457bb52-1b21-4e78-9f71-a299fd1d5fb8\") " pod="openshift-must-gather-mtjsz/perf-node-gather-daemonset-k55bh"
Jul 22 12:35:37.285485 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.285381    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e457bb52-1b21-4e78-9f71-a299fd1d5fb8-podres\") pod \"perf-node-gather-daemonset-k55bh\" (UID: \"e457bb52-1b21-4e78-9f71-a299fd1d5fb8\") " pod="openshift-must-gather-mtjsz/perf-node-gather-daemonset-k55bh"
Jul 22 12:35:37.285485 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.285419    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e457bb52-1b21-4e78-9f71-a299fd1d5fb8-proc\") pod \"perf-node-gather-daemonset-k55bh\" (UID: \"e457bb52-1b21-4e78-9f71-a299fd1d5fb8\") " pod="openshift-must-gather-mtjsz/perf-node-gather-daemonset-k55bh"
Jul 22 12:35:37.285595 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.285525    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e457bb52-1b21-4e78-9f71-a299fd1d5fb8-proc\") pod \"perf-node-gather-daemonset-k55bh\" (UID: \"e457bb52-1b21-4e78-9f71-a299fd1d5fb8\") " pod="openshift-must-gather-mtjsz/perf-node-gather-daemonset-k55bh"
Jul 22 12:35:37.285595 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.285545    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e457bb52-1b21-4e78-9f71-a299fd1d5fb8-podres\") pod \"perf-node-gather-daemonset-k55bh\" (UID: \"e457bb52-1b21-4e78-9f71-a299fd1d5fb8\") " pod="openshift-must-gather-mtjsz/perf-node-gather-daemonset-k55bh"
Jul 22 12:35:37.285595 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.285557    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e457bb52-1b21-4e78-9f71-a299fd1d5fb8-sys\") pod \"perf-node-gather-daemonset-k55bh\" (UID: \"e457bb52-1b21-4e78-9f71-a299fd1d5fb8\") " pod="openshift-must-gather-mtjsz/perf-node-gather-daemonset-k55bh"
Jul 22 12:35:37.285595 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.285547    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e457bb52-1b21-4e78-9f71-a299fd1d5fb8-lib-modules\") pod \"perf-node-gather-daemonset-k55bh\" (UID: \"e457bb52-1b21-4e78-9f71-a299fd1d5fb8\") " pod="openshift-must-gather-mtjsz/perf-node-gather-daemonset-k55bh"
Jul 22 12:35:37.294506 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.294488    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czdt6\" (UniqueName: \"kubernetes.io/projected/e457bb52-1b21-4e78-9f71-a299fd1d5fb8-kube-api-access-czdt6\") pod \"perf-node-gather-daemonset-k55bh\" (UID: \"e457bb52-1b21-4e78-9f71-a299fd1d5fb8\") " pod="openshift-must-gather-mtjsz/perf-node-gather-daemonset-k55bh"
Jul 22 12:35:37.298761 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.298736    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-869bdc6bd9-w965b_26617416-0411-43f4-bcea-5e078f3698d6/kube-rbac-proxy-metrics/0.log"
Jul 22 12:35:37.350406 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.350374    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mtjsz/perf-node-gather-daemonset-k55bh"
Jul 22 12:35:37.487896 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.487863    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mtjsz/perf-node-gather-daemonset-k55bh"]
Jul 22 12:35:37.489264 ip-10-0-132-166 kubenswrapper[2558]: W0722 12:35:37.489226    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode457bb52_1b21_4e78_9f71_a299fd1d5fb8.slice/crio-5335476efa48b1ba45243c068cd354bc134d8079944738a8e3d8a3f7b48fd863 WatchSource:0}: Error finding container 5335476efa48b1ba45243c068cd354bc134d8079944738a8e3d8a3f7b48fd863: Status 404 returned error can't find the container with id 5335476efa48b1ba45243c068cd354bc134d8079944738a8e3d8a3f7b48fd863
Jul 22 12:35:37.995099 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.995058    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mtjsz/perf-node-gather-daemonset-k55bh" event={"ID":"e457bb52-1b21-4e78-9f71-a299fd1d5fb8","Type":"ContainerStarted","Data":"df699da258b464ae3ed3df4bd36ff3da0daba60776069f595d1570d283e14261"}
Jul 22 12:35:37.995317 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.995107    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mtjsz/perf-node-gather-daemonset-k55bh" event={"ID":"e457bb52-1b21-4e78-9f71-a299fd1d5fb8","Type":"ContainerStarted","Data":"5335476efa48b1ba45243c068cd354bc134d8079944738a8e3d8a3f7b48fd863"}
Jul 22 12:35:37.995317 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:37.995194    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mtjsz/perf-node-gather-daemonset-k55bh"
Jul 22 12:35:38.019934 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:38.019879    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mtjsz/perf-node-gather-daemonset-k55bh" podStartSLOduration=1.019863425 podStartE2EDuration="1.019863425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:35:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:35:38.018782404 +0000 UTC m=+2750.385297677" watchObservedRunningTime="2026-07-22 12:35:38.019863425 +0000 UTC m=+2750.386378668"
Jul 22 12:35:39.571287 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:39.571260    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-78fb454dff-qgtj9_c2f01a8a-0cdd-4d85-86a5-40f42e679098/console/0.log"
Jul 22 12:35:41.544247 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:41.544217    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qh6kt_87178538-8c31-4b16-9bd6-a7b6e903eae4/dns/0.log"
Jul 22 12:35:41.569026 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:41.568998    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qh6kt_87178538-8c31-4b16-9bd6-a7b6e903eae4/kube-rbac-proxy/0.log"
Jul 22 12:35:41.598258 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:41.598231    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-csd5r_9f527d4c-c096-412f-bebc-3f974fe42dc8/dns-node-resolver/0.log"
Jul 22 12:35:42.340379 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:42.340348    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7p2jg_120a973f-3054-418e-94f7-0c38939ae63f/node-ca/0.log"
Jul 22 12:35:43.597304 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:43.597275    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57559476c9-ttmlt_4b47f7dc-f284-48a9-bc28-2c61b005957e/kube-auth-proxy/0.log"
Jul 22 12:35:43.741172 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:43.741135    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-bdmqc_a838aab7-dd17-4454-ad0f-c1b7f1b85371/payload-pre-processing/0.log"
Jul 22 12:35:43.793509 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:43.793471    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-prd5q_c60c3a5f-a087-4d42-8b18-10f38213268c/payload-processing/0.log"
Jul 22 12:35:44.009091 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:44.009060    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mtjsz/perf-node-gather-daemonset-k55bh"
Jul 22 12:35:44.548298 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:44.548228    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-45rc7_815baa25-3ce9-48f6-833a-ba208cd7676b/serve-healthcheck-canary/0.log"
Jul 22 12:35:45.158782 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:45.158747    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4xvzj_25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4/kube-rbac-proxy/0.log"
Jul 22 12:35:45.186955 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:45.186930    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4xvzj_25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4/exporter/0.log"
Jul 22 12:35:45.214501 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:45.214478    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4xvzj_25b9db7f-6b16-4ebc-8eb7-4de63dbb6ea4/extractor/0.log"
Jul 22 12:35:47.564263 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:47.564229    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57559476c9-ttmlt_4b47f7dc-f284-48a9-bc28-2c61b005957e/kube-auth-proxy/0.log"
Jul 22 12:35:47.671836 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:47.671805    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-bdmqc_a838aab7-dd17-4454-ad0f-c1b7f1b85371/payload-pre-processing/0.log"
Jul 22 12:35:47.707179 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:47.707145    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-prd5q_c60c3a5f-a087-4d42-8b18-10f38213268c/payload-processing/0.log"
Jul 22 12:35:48.313553 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:48.313469    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-bbfbc5ddf-ctrjd_a0d17b02-39a5-4763-863d-fb2078a40d1d/manager/0.log"
Jul 22 12:35:48.887668 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:48.887640    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c4d6d56dd-trt92_1d6bff52-9b53-40d3-a761-ce3321cbbed2/manager/0.log"
Jul 22 12:35:48.921663 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:48.921638    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c4d6d56dd-trt92_1d6bff52-9b53-40d3-a761-ce3321cbbed2/copy-manifests/0.log"
Jul 22 12:35:49.092472 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:49.092441    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57559476c9-ttmlt_4b47f7dc-f284-48a9-bc28-2c61b005957e/kube-auth-proxy/0.log"
Jul 22 12:35:49.212741 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:49.212710    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-bdmqc_a838aab7-dd17-4454-ad0f-c1b7f1b85371/payload-pre-processing/0.log"
Jul 22 12:35:49.245765 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:49.245736    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-prd5q_c60c3a5f-a087-4d42-8b18-10f38213268c/payload-processing/0.log"
Jul 22 12:35:50.157359 ip-10-0-132-166 kubenswrapper[2558]: I0722 12:35:50.157330    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-755b658494-99pn5_5fb73dc7-8d2e-49eb-89b2-1d5c17ded52c/manager/0.log"