Jul 21 01:22:20.702294 ip-10-0-131-213 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 01:22:21.058579 ip-10-0-131-213 kubenswrapper[2586]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 01:22:21.058579 ip-10-0-131-213 kubenswrapper[2586]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 01:22:21.058579 ip-10-0-131-213 kubenswrapper[2586]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 01:22:21.058579 ip-10-0-131-213 kubenswrapper[2586]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 01:22:21.058579 ip-10-0-131-213 kubenswrapper[2586]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 01:22:21.059506 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.059412    2586 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 01:22:21.063081 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063061    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 01:22:21.063081 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063081    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 01:22:21.063150 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063085    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 01:22:21.063150 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063089    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 01:22:21.063150 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063092    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 01:22:21.063150 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063094    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 01:22:21.063150 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063097    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 01:22:21.063150 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063100    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 01:22:21.063150 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063102    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 01:22:21.063150 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063105    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 01:22:21.063150 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063108    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 01:22:21.063150 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063110    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 01:22:21.063150 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063113    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 01:22:21.063150 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063115    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 01:22:21.063150 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063118    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 01:22:21.063150 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063120    2586 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 01:22:21.063150 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063123    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 01:22:21.063150 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063127    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 01:22:21.063150 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063131    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 01:22:21.063150 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063134    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 01:22:21.063150 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063137    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 01:22:21.063150 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063140    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 01:22:21.063620 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063143    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 01:22:21.063620 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063145    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 01:22:21.063620 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063148    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 01:22:21.063620 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063151    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 01:22:21.063620 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063154    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 01:22:21.063620 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063157    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 01:22:21.063620 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063163    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 01:22:21.063620 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063166    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 01:22:21.063620 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063169    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 01:22:21.063620 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063171    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 01:22:21.063620 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063179    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 01:22:21.063620 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063182    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 01:22:21.063620 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063185    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 01:22:21.063620 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063187    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 01:22:21.063620 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063190    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 01:22:21.063620 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063192    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 01:22:21.063620 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063194    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 01:22:21.063620 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063197    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 01:22:21.063620 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063199    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 01:22:21.063620 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063202    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 01:22:21.064266 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063204    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 01:22:21.064266 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063206    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 01:22:21.064266 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063209    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 01:22:21.064266 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063211    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 01:22:21.064266 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063213    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 01:22:21.064266 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063216    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 01:22:21.064266 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063220    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 01:22:21.064266 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063222    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 01:22:21.064266 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063230    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 01:22:21.064266 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063233    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 01:22:21.064266 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063236    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 01:22:21.064266 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063238    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 01:22:21.064266 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063241    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 01:22:21.064266 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063244    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 01:22:21.064266 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063246    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 01:22:21.064266 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063249    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 01:22:21.064266 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063251    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 01:22:21.064266 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063254    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 01:22:21.064266 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063256    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 01:22:21.064266 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063258    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 01:22:21.064959 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063261    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 01:22:21.064959 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063264    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 01:22:21.064959 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063266    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 01:22:21.064959 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063275    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 01:22:21.064959 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063278    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 01:22:21.064959 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063280    2586 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 01:22:21.064959 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063284    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 01:22:21.064959 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063287    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 01:22:21.064959 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063290    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 01:22:21.064959 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063292    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 01:22:21.064959 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063295    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 01:22:21.064959 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063298    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 01:22:21.064959 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063301    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 01:22:21.064959 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063303    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 01:22:21.064959 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063306    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 01:22:21.064959 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063308    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 01:22:21.064959 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063311    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 01:22:21.064959 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063314    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 01:22:21.064959 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063317    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 01:22:21.065425 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063320    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 01:22:21.065425 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063322    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 01:22:21.065425 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063324    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 01:22:21.065425 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063327    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 01:22:21.065425 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063329    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 01:22:21.065425 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063333    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 01:22:21.065425 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063336    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 01:22:21.065425 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063338    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 01:22:21.065425 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063341    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 01:22:21.065425 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063343    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 01:22:21.065425 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063345    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 01:22:21.065425 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063348    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 01:22:21.065425 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063350    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 01:22:21.065425 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063353    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 01:22:21.065425 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063355    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 01:22:21.065425 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063357    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 01:22:21.065425 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063360    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 01:22:21.065425 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.063368    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 01:22:21.066234 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066215    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 01:22:21.066234 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066236    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 01:22:21.066301 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066240    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 01:22:21.066301 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066243    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 01:22:21.066301 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066246    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 01:22:21.066301 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066249    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 01:22:21.066301 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066252    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 01:22:21.066301 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066254    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 01:22:21.066301 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066257    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 01:22:21.066301 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066259    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 01:22:21.066301 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066262    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 01:22:21.066301 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066265    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 01:22:21.066301 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066267    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 01:22:21.066301 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066270    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 01:22:21.066301 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066272    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 01:22:21.066301 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066275    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 01:22:21.066301 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066277    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 01:22:21.066301 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066280    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 01:22:21.066301 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066283    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 01:22:21.066301 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066285    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 01:22:21.066301 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066287    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 01:22:21.066301 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066290    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 01:22:21.066785 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066292    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 01:22:21.066785 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066295    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 01:22:21.066785 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066298    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 01:22:21.066785 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066301    2586 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 01:22:21.066785 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066304    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 01:22:21.066785 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066306    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 01:22:21.066785 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066310    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 01:22:21.066785 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066312    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 01:22:21.066785 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066315    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 01:22:21.066785 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066319    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 01:22:21.066785 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066324    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 01:22:21.066785 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066327    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 01:22:21.066785 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066330    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 01:22:21.066785 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066333    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 01:22:21.066785 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066337    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 01:22:21.066785 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066341    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 01:22:21.066785 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066344    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 01:22:21.066785 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066346    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 01:22:21.066785 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066349    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 01:22:21.067371 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066352    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 01:22:21.067371 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066355    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 01:22:21.067371 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066357    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 01:22:21.067371 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066360    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 01:22:21.067371 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066362    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 01:22:21.067371 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066365    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 01:22:21.067371 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066368    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 01:22:21.067371 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066371    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 01:22:21.067371 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066374    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 01:22:21.067371 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066378    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 01:22:21.067371 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066382    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 01:22:21.067371 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066386    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 01:22:21.067371 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066388    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 01:22:21.067371 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066391    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 01:22:21.067371 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066394    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 01:22:21.067371 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066397    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 01:22:21.067371 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066400    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 01:22:21.067371 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066402    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 01:22:21.067371 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066405    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 01:22:21.067371 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066407    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 01:22:21.067858 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066410    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 01:22:21.067858 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066412    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 01:22:21.067858 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066415    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 01:22:21.067858 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066417    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 01:22:21.067858 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066420    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 01:22:21.067858 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066422    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 01:22:21.067858 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066425    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 01:22:21.067858 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066427    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 01:22:21.067858 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066430    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 01:22:21.067858 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066432    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 01:22:21.067858 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066435    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 01:22:21.067858 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066438    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 01:22:21.067858 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066441    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 01:22:21.067858 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066443    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 01:22:21.067858 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066446    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 01:22:21.067858 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066448    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 01:22:21.067858 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066451    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 01:22:21.067858 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066453    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 01:22:21.067858 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066455    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 01:22:21.068331 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066458    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 01:22:21.068331 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066460    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 01:22:21.068331 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066463    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 01:22:21.068331 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066466    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 01:22:21.068331 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066468    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 01:22:21.068331 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066471    2586 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 01:22:21.068331 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066473    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 01:22:21.068331 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066476    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 01:22:21.068331 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066479    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 01:22:21.068331 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066482    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 01:22:21.068331 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066484    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 01:22:21.068331 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066487    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 01:22:21.068331 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066490    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 01:22:21.068331 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066492    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 01:22:21.068331 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066495    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 01:22:21.068331 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066497    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 01:22:21.068331 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066500    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 01:22:21.068331 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066502    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 01:22:21.068331 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066504    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 01:22:21.068331 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066899    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 01:22:21.068833 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066905    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 01:22:21.068833 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066908    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 01:22:21.068833 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066911    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 01:22:21.068833 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066914    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 01:22:21.068833 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066916    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 01:22:21.068833 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066920    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 01:22:21.068833 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066922    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 01:22:21.068833 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066925    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 01:22:21.068833 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066927    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 01:22:21.068833 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066930    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 01:22:21.068833 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066952    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 01:22:21.068833 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066957    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 01:22:21.068833 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066964    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 01:22:21.068833 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066969    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 01:22:21.068833 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066972    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 01:22:21.068833 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066976    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 01:22:21.068833 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066979    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 01:22:21.068833 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066982    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 01:22:21.068833 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066985    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 01:22:21.068833 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066988    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 01:22:21.069330 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066991    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 01:22:21.069330 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066993    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 01:22:21.069330 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066996    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 01:22:21.069330 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.066998    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 01:22:21.069330 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067001    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 01:22:21.069330 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067004    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 01:22:21.069330 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067006    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 01:22:21.069330 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067009    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 01:22:21.069330 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067012    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 01:22:21.069330 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067014    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 01:22:21.069330 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067016    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 01:22:21.069330 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067019    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 01:22:21.069330 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067021    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 01:22:21.069330 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067024    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 01:22:21.069330 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067027    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 01:22:21.069330 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067031    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 01:22:21.069330 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067034    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 01:22:21.069330 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067037    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 01:22:21.069330 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067040    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 01:22:21.069786 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067042    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 01:22:21.069786 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067045    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 01:22:21.069786 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067047    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 01:22:21.069786 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067050    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 01:22:21.069786 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067052    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 01:22:21.069786 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067056    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 01:22:21.069786 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067059    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 01:22:21.069786 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067061    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 01:22:21.069786 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067064    2586 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 01:22:21.069786 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067069    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 01:22:21.069786 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067071    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 01:22:21.069786 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067074    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 01:22:21.069786 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067077    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 01:22:21.069786 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067079    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 01:22:21.069786 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067082    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 01:22:21.069786 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067085    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 01:22:21.069786 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067087    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 01:22:21.069786 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067092    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 01:22:21.069786 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067095    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 01:22:21.069786 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067098    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 01:22:21.070315 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067102    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 01:22:21.070315 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067104    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 01:22:21.070315 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067107    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 01:22:21.070315 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067110    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 01:22:21.070315 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067113    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 01:22:21.070315 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067115    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 01:22:21.070315 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067118    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 01:22:21.070315 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067121    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 01:22:21.070315 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067123    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 01:22:21.070315 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067126    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 01:22:21.070315 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067128    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 01:22:21.070315 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067131    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 01:22:21.070315 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067133    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 01:22:21.070315 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067136    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 01:22:21.070315 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067138    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 01:22:21.070315 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067141    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 01:22:21.070315 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067143    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 01:22:21.070315 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067150    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 01:22:21.070315 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067153    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 01:22:21.070315 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067155    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 01:22:21.070787 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067158    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 01:22:21.070787 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067160    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 01:22:21.070787 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067163    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 01:22:21.070787 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067166    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 01:22:21.070787 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067169    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 01:22:21.070787 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067172    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 01:22:21.070787 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067175    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 01:22:21.070787 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067178    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 01:22:21.070787 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067180    2586 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 01:22:21.070787 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067183    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 01:22:21.070787 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067185    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 01:22:21.070787 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067187    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 01:22:21.070787 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067190    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 01:22:21.070787 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067192    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 01:22:21.070787 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067195    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 01:22:21.070787 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067199    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 01:22:21.070787 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067202    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 01:22:21.070787 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067205    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 01:22:21.070787 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067208    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 01:22:21.071297 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067285    2586 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 01:22:21.071297 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067293    2586 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 01:22:21.071297 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067299    2586 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 01:22:21.071297 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067308    2586 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 01:22:21.071297 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067312    2586 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 01:22:21.071297 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067316    2586 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 01:22:21.071297 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067320    2586 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 01:22:21.071297 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067324    2586 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 01:22:21.071297 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067327    2586 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 01:22:21.071297 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067330    2586 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 01:22:21.071297 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067336    2586 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 01:22:21.071297 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067339    2586 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 01:22:21.071297 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067342    2586 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 01:22:21.071297 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067345    2586 flags.go:64] FLAG: --cgroup-root=""
Jul 21 01:22:21.071297 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067348    2586 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 01:22:21.071297 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067352    2586 flags.go:64] FLAG: --client-ca-file=""
Jul 21 01:22:21.071297 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067356    2586 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 01:22:21.071297 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067359    2586 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 01:22:21.071297 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067364    2586 flags.go:64] FLAG: --cluster-domain=""
Jul 21 01:22:21.071297 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067367    2586 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 01:22:21.071297 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067371    2586 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 01:22:21.071297 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067374    2586 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 01:22:21.071297 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067377    2586 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 01:22:21.071297 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067381    2586 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 01:22:21.071871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067384    2586 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 01:22:21.071871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067387    2586 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 01:22:21.071871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067391    2586 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 01:22:21.071871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067394    2586 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 01:22:21.071871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067397    2586 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 01:22:21.071871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067399    2586 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 01:22:21.071871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067403    2586 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 01:22:21.071871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067406    2586 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 01:22:21.071871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067410    2586 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 01:22:21.071871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067413    2586 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 01:22:21.071871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067416    2586 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 01:22:21.071871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067419    2586 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 01:22:21.071871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067421    2586 flags.go:64] FLAG: --enable-server="true"
Jul 21 01:22:21.071871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067424    2586 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 01:22:21.071871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067429    2586 flags.go:64] FLAG: --event-burst="100"
Jul 21 01:22:21.071871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067432    2586 flags.go:64] FLAG: --event-qps="50"
Jul 21 01:22:21.071871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067435    2586 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 01:22:21.071871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067438    2586 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 01:22:21.071871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067441    2586 flags.go:64] FLAG: --eviction-hard=""
Jul 21 01:22:21.071871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067446    2586 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 01:22:21.071871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067448    2586 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 01:22:21.071871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067451    2586 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 01:22:21.071871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067454    2586 flags.go:64] FLAG: --eviction-soft=""
Jul 21 01:22:21.071871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067458    2586 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 01:22:21.071871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067460    2586 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 01:22:21.072539 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067464    2586 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 01:22:21.072539 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067467    2586 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 01:22:21.072539 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067470    2586 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 01:22:21.072539 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067472    2586 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 01:22:21.072539 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067475    2586 flags.go:64] FLAG: --feature-gates=""
Jul 21 01:22:21.072539 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067479    2586 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 01:22:21.072539 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067481    2586 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 01:22:21.072539 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067484    2586 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 01:22:21.072539 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067487    2586 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 01:22:21.072539 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067490    2586 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 01:22:21.072539 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067493    2586 flags.go:64] FLAG: --help="false"
Jul 21 01:22:21.072539 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067496    2586 flags.go:64] FLAG: --hostname-override="ip-10-0-131-213.ec2.internal"
Jul 21 01:22:21.072539 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067499    2586 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 01:22:21.072539 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067501    2586 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 01:22:21.072539 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067504    2586 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 01:22:21.072539 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067507    2586 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 01:22:21.072539 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067510    2586 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 01:22:21.072539 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067513    2586 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 01:22:21.072539 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067516    2586 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 01:22:21.072539 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067518    2586 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 01:22:21.072539 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067521    2586 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 01:22:21.072539 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067524    2586 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 01:22:21.072539 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067527    2586 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 01:22:21.072539 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067529    2586 flags.go:64] FLAG: --kube-reserved=""
Jul 21 01:22:21.073134 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067532    2586 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 01:22:21.073134 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067535    2586 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 01:22:21.073134 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067538    2586 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 01:22:21.073134 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067540    2586 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 01:22:21.073134 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067543    2586 flags.go:64] FLAG: --lock-file=""
Jul 21 01:22:21.073134 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067546    2586 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 01:22:21.073134 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067549    2586 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 01:22:21.073134 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067552    2586 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 01:22:21.073134 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067558    2586 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 01:22:21.073134 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067562    2586 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 01:22:21.073134 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067565    2586 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 01:22:21.073134 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067568    2586 flags.go:64] FLAG: --logging-format="text"
Jul 21 01:22:21.073134 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067570    2586 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 01:22:21.073134 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067574    2586 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 01:22:21.073134 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067577    2586 flags.go:64] FLAG: --manifest-url=""
Jul 21 01:22:21.073134 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067580    2586 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 01:22:21.073134 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067584    2586 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 01:22:21.073134 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067587    2586 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 01:22:21.073134 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067591    2586 flags.go:64] FLAG: --max-pods="110"
Jul 21 01:22:21.073134 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067594    2586 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 01:22:21.073134 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067596    2586 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 01:22:21.073134 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067599    2586 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 01:22:21.073134 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067602    2586 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 01:22:21.073134 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067605    2586 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 01:22:21.073134 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067608    2586 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 01:22:21.073758 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067611    2586 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 01:22:21.073758 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067618    2586 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 01:22:21.073758 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067621    2586 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 01:22:21.073758 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067624    2586 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 01:22:21.073758 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067627    2586 flags.go:64] FLAG: --pod-cidr=""
Jul 21 01:22:21.073758 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067630    2586 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 01:22:21.073758 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067635    2586 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 01:22:21.073758 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067638    2586 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 01:22:21.073758 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067641    2586 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 01:22:21.073758 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067644    2586 flags.go:64] FLAG: --port="10250"
Jul 21 01:22:21.073758 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067647    2586 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 01:22:21.073758 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067650    2586 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d670bb287c823b11"
Jul 21 01:22:21.073758 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067653    2586 flags.go:64] FLAG: --qos-reserved=""
Jul 21 01:22:21.073758 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067656    2586 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 01:22:21.073758 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067659    2586 flags.go:64] FLAG: --register-node="true"
Jul 21 01:22:21.073758 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067662    2586 flags.go:64] FLAG: --register-with-taints=""
Jul 21 01:22:21.073758 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067665    2586 flags.go:64] FLAG: --registry-burst="10"
Jul 21 01:22:21.073758 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067668    2586 flags.go:64] FLAG: --registry-qps="5"
Jul 21 01:22:21.073758 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067671    2586 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 01:22:21.073758 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067674    2586 flags.go:64] FLAG: --reserved-memory=""
Jul 21 01:22:21.073758 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067678    2586 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 01:22:21.073758 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067680    2586 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 01:22:21.073758 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067683    2586 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 01:22:21.073758 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067686    2586 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 01:22:21.073758 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067689    2586 flags.go:64] FLAG: --runonce="false"
Jul 21 01:22:21.074384 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067692    2586 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 01:22:21.074384 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067694    2586 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 01:22:21.074384 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067697    2586 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 01:22:21.074384 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067700    2586 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 01:22:21.074384 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067703    2586 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 01:22:21.074384 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067705    2586 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 01:22:21.074384 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067708    2586 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 01:22:21.074384 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067711    2586 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 01:22:21.074384 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067714    2586 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 01:22:21.074384 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067717    2586 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 01:22:21.074384 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067719    2586 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 01:22:21.074384 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067722    2586 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 01:22:21.074384 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067725    2586 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 01:22:21.074384 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067728    2586 flags.go:64] FLAG: --system-cgroups=""
Jul 21 01:22:21.074384 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067731    2586 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 01:22:21.074384 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067736    2586 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 01:22:21.074384 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067739    2586 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 01:22:21.074384 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067741    2586 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 01:22:21.074384 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067746    2586 flags.go:64] FLAG: --tls-min-version=""
Jul 21 01:22:21.074384 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067749    2586 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 01:22:21.074384 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067751    2586 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 01:22:21.074384 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067754    2586 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 01:22:21.074384 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067757    2586 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 01:22:21.074384 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067760    2586 flags.go:64] FLAG: --v="2"
Jul 21 01:22:21.074384 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067764    2586 flags.go:64] FLAG: --version="false"
Jul 21 01:22:21.075032 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067768    2586 flags.go:64] FLAG: --vmodule=""
Jul 21 01:22:21.075032 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067772    2586 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 01:22:21.075032 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.067775    2586 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 01:22:21.075032 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067899    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 01:22:21.075032 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067905    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 01:22:21.075032 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067908    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 01:22:21.075032 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067912    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 01:22:21.075032 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067914    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 01:22:21.075032 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067917    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 01:22:21.075032 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067920    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 01:22:21.075032 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067922    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 01:22:21.075032 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067925    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 01:22:21.075032 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067928    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 01:22:21.075032 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067930    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 01:22:21.075032 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067947    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 01:22:21.075032 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067950    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 01:22:21.075032 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067953    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 01:22:21.075032 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067955    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 01:22:21.075032 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067958    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 01:22:21.075032 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067960    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 01:22:21.075520 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067964    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 01:22:21.075520 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067969    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 01:22:21.075520 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067973    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 01:22:21.075520 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067976    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 01:22:21.075520 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067979    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 01:22:21.075520 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067981    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 01:22:21.075520 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067984    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 01:22:21.075520 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067986    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 01:22:21.075520 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067989    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 01:22:21.075520 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067991    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 01:22:21.075520 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067994    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 01:22:21.075520 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.067997    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 01:22:21.075520 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068000    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 01:22:21.075520 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068003    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 01:22:21.075520 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068006    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 01:22:21.075520 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068008    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 01:22:21.075520 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068011    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 01:22:21.075520 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068013    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 01:22:21.075520 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068016    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 01:22:21.076066 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068019    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 01:22:21.076066 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068021    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 01:22:21.076066 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068024    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 01:22:21.076066 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068026    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 01:22:21.076066 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068029    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 01:22:21.076066 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068031    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 01:22:21.076066 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068034    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 01:22:21.076066 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068036    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 01:22:21.076066 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068039    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 01:22:21.076066 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068041    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 01:22:21.076066 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068043    2586 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 01:22:21.076066 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068046    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 01:22:21.076066 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068049    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 01:22:21.076066 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068053    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 01:22:21.076066 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068057    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 01:22:21.076066 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068059    2586 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 01:22:21.076066 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068062    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 01:22:21.076066 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068065    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 01:22:21.076066 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068067    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 01:22:21.076066 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068070    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 01:22:21.076545 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068072    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 01:22:21.076545 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068075    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 01:22:21.076545 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068077    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 01:22:21.076545 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068080    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 01:22:21.076545 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068083    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 01:22:21.076545 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068085    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 01:22:21.076545 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068088    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 01:22:21.076545 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068091    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 01:22:21.076545 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068094    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 01:22:21.076545 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068096    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 01:22:21.076545 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068098    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 01:22:21.076545 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068101    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 01:22:21.076545 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068103    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 01:22:21.076545 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068106    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 01:22:21.076545 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068108    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 01:22:21.076545 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068111    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 01:22:21.076545 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068113    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 01:22:21.076545 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068116    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 01:22:21.076545 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068118    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 01:22:21.076545 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068121    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 01:22:21.077030 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068123    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 01:22:21.077030 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068126    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 01:22:21.077030 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068128    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 01:22:21.077030 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068131    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 01:22:21.077030 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068133    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 01:22:21.077030 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068137    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 01:22:21.077030 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068142    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 01:22:21.077030 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068146    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 01:22:21.077030 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068149    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 01:22:21.077030 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068152    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 01:22:21.077030 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068155    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 01:22:21.077030 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068158    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 01:22:21.077030 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068161    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 01:22:21.077030 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068164    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 01:22:21.077030 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068166    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 01:22:21.077030 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068169    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 01:22:21.077030 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068172    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 01:22:21.077030 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068174    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 01:22:21.077030 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068176    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 01:22:21.077030 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068179    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 01:22:21.077511 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068182    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 01:22:21.077511 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068184    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 01:22:21.077511 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.068187    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 01:22:21.077511 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.068193    2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 01:22:21.077511 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.075193    2586 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 01:22:21.077511 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.075210    2586 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 01:22:21.077511 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.075225    2586 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 01:22:21.077511 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.075232    2586 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 01:22:21.077511 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075290    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 01:22:21.077511 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075295    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 01:22:21.077511 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075299    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 01:22:21.077511 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075302    2586 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 01:22:21.077511 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075305    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 01:22:21.077511 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075308    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 01:22:21.077511 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075311    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 01:22:21.077887 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075313    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 01:22:21.077887 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075316    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 01:22:21.077887 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075319    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 01:22:21.077887 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075321    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 01:22:21.077887 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075324    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 01:22:21.077887 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075326    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 01:22:21.077887 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075329    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 01:22:21.077887 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075332    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 01:22:21.077887 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075334    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 01:22:21.077887 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075337    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 01:22:21.077887 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075339    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 01:22:21.077887 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075342    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 01:22:21.077887 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075344    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 01:22:21.077887 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075347    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 01:22:21.077887 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075350    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 01:22:21.077887 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075352    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 01:22:21.077887 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075355    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 01:22:21.077887 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075357    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 01:22:21.077887 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075360    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 01:22:21.077887 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075362    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 01:22:21.078386 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075365    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 01:22:21.078386 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075368    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 01:22:21.078386 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075374    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 01:22:21.078386 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075377    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 01:22:21.078386 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075380    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 01:22:21.078386 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075382    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 01:22:21.078386 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075385    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 01:22:21.078386 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075387    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 01:22:21.078386 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075390    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 01:22:21.078386 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075392    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 01:22:21.078386 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075395    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 01:22:21.078386 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075398    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 01:22:21.078386 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075400    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 01:22:21.078386 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075403    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 01:22:21.078386 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075407    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 01:22:21.078386 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075410    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 01:22:21.078386 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075414    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 01:22:21.078386 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075417    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 01:22:21.078386 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075420    2586 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 01:22:21.078836 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075424    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 01:22:21.078836 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075428    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 01:22:21.078836 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075431    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 01:22:21.078836 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075434    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 01:22:21.078836 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075437    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 01:22:21.078836 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075439    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 01:22:21.078836 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075442    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 01:22:21.078836 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075446    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 01:22:21.078836 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075448    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 01:22:21.078836 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075451    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 01:22:21.078836 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075453    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 01:22:21.078836 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075457    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 01:22:21.078836 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075460    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 01:22:21.078836 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075463    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 01:22:21.078836 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075466    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 01:22:21.078836 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075468    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 01:22:21.078836 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075479    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 01:22:21.078836 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075482    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 01:22:21.078836 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075485    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 01:22:21.079304 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075487    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 01:22:21.079304 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075490    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 01:22:21.079304 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075492    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 01:22:21.079304 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075495    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 01:22:21.079304 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075498    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 01:22:21.079304 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075501    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 01:22:21.079304 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075503    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 01:22:21.079304 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075506    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 01:22:21.079304 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075509    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 01:22:21.079304 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075511    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 01:22:21.079304 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075514    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 01:22:21.079304 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075516    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 01:22:21.079304 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075519    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 01:22:21.079304 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075521    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 01:22:21.079304 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075524    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 01:22:21.079304 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075527    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 01:22:21.079304 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075529    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 01:22:21.079304 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075532    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 01:22:21.079304 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075535    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 01:22:21.079304 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075537    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 01:22:21.079798 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075540    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 01:22:21.079798 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075542    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 01:22:21.079798 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075545    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 01:22:21.079798 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075547    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 01:22:21.079798 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075550    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 01:22:21.079798 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075553    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 01:22:21.079798 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075556    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 01:22:21.079798 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075559    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 01:22:21.079798 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075562    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 01:22:21.079798 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075564    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 01:22:21.079798 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075567    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 01:22:21.079798 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075569    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 01:22:21.079798 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075572    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 01:22:21.079798 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075574    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 01:22:21.079798 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.075580    2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 01:22:21.080227 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075702    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 01:22:21.080227 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075707    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 01:22:21.080227 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075710    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 01:22:21.080227 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075713    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 01:22:21.080227 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075716    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 01:22:21.080227 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075719    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 01:22:21.080227 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075722    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 01:22:21.080227 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075725    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 01:22:21.080227 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075727    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 01:22:21.080227 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075730    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 01:22:21.080227 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075733    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 01:22:21.080227 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075735    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 01:22:21.080227 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075738    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 01:22:21.080227 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075740    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 01:22:21.080227 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075743    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 01:22:21.080227 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075745    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 01:22:21.080227 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075748    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 01:22:21.080227 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075751    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 01:22:21.080227 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075754    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 01:22:21.080681 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075757    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 01:22:21.080681 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075760    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 01:22:21.080681 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075762    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 01:22:21.080681 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075765    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 01:22:21.080681 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075768    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 01:22:21.080681 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075771    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 01:22:21.080681 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075776    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 01:22:21.080681 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075778    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 01:22:21.080681 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075781    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 01:22:21.080681 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075784    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 01:22:21.080681 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075787    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 01:22:21.080681 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075790    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 01:22:21.080681 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075792    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 01:22:21.080681 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075795    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 01:22:21.080681 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075798    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 01:22:21.080681 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075802    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 01:22:21.080681 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075805    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 01:22:21.080681 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075807    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 01:22:21.080681 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075810    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 01:22:21.081152 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075813    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 01:22:21.081152 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075815    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 01:22:21.081152 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075818    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 01:22:21.081152 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075820    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 01:22:21.081152 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075823    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 01:22:21.081152 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075825    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 01:22:21.081152 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075828    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 01:22:21.081152 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075831    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 01:22:21.081152 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075833    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 01:22:21.081152 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075836    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 01:22:21.081152 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075839    2586 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 01:22:21.081152 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075842    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 01:22:21.081152 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075844    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 01:22:21.081152 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075847    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 01:22:21.081152 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075849    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 01:22:21.081152 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075852    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 01:22:21.081152 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075854    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 01:22:21.081152 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075856    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 01:22:21.081152 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075859    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 01:22:21.081152 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075862    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 01:22:21.081626 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075864    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 01:22:21.081626 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075866    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 01:22:21.081626 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075869    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 01:22:21.081626 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075872    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 01:22:21.081626 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075874    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 01:22:21.081626 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075877    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 01:22:21.081626 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075879    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 01:22:21.081626 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075882    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 01:22:21.081626 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075884    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 01:22:21.081626 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075887    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 01:22:21.081626 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075889    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 01:22:21.081626 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075892    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 01:22:21.081626 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075894    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 01:22:21.081626 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075897    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 01:22:21.081626 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075899    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 01:22:21.081626 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075902    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 01:22:21.081626 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075904    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 01:22:21.081626 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075907    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 01:22:21.081626 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075910    2586 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 01:22:21.081626 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075912    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 01:22:21.082114 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075914    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 01:22:21.082114 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075917    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 01:22:21.082114 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075920    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 01:22:21.082114 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075922    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 01:22:21.082114 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075925    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 01:22:21.082114 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075928    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 01:22:21.082114 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075930    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 01:22:21.082114 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075948    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 01:22:21.082114 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075950    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 01:22:21.082114 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075954    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 01:22:21.082114 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075957    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 01:22:21.082114 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075961    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 01:22:21.082114 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075963    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 01:22:21.082114 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075967    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 01:22:21.082114 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075969    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 01:22:21.082114 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075972    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 01:22:21.082114 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075975    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 01:22:21.082114 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075977    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 01:22:21.082114 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075980    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 01:22:21.082586 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075983    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 01:22:21.082586 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:21.075985    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 01:22:21.082586 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.075990    2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 01:22:21.082586 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.076114    2586 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 01:22:21.082586 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.078172    2586 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 01:22:21.082586 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.079279    2586 server.go:1019] "Starting client certificate rotation"
Jul 21 01:22:21.082586 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.079376    2586 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 01:22:21.082586 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.079415    2586 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 01:22:21.082586 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.081298    2586 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 01:22:21.084826 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.084811    2586 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 01:22:21.093545 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.093521    2586 log.go:25] "Validated CRI v1 runtime API"
Jul 21 01:22:21.095657 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.095635    2586 log.go:25] "Validated CRI v1 image API"
Jul 21 01:22:21.096559 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.096541    2586 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 01:22:21.098728 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.098708    2586 fs.go:135] Filesystem UUIDs: map[01931247-ddbb-4353-892e-5abe0e0a50f2:/dev/nvme0n1p4 6922211d-9c26-4b4a-a4d1-a002666166e4:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 21 01:22:21.098785 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.098728    2586 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 01:22:21.104220 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.104090    2586 manager.go:216] Machine: {Timestamp:2026-07-21 01:22:21.102833642 +0000 UTC m=+0.290873022 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3049557 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec289f21cd279aa66e34d54014f15a3b SystemUUID:ec289f21-cd27-9aa6-6e34-d54014f15a3b BootID:53a79c3a-d320-4f72-b986-bda62385d074 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1c:f2:a0:a1:a7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1c:f2:a0:a1:a7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:03:8c:0b:36:df Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 01:22:21.104220 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.104215    2586 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 01:22:21.104333 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.104309    2586 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 01:22:21.107046 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.107029    2586 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 01:22:21.107332 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.107300    2586 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 01:22:21.107487 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.107337    2586 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-213.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 01:22:21.107998 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.107988    2586 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 01:22:21.108039 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.108001    2586 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 01:22:21.108039 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.108009    2586 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 01:22:21.108606 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.108595    2586 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 01:22:21.109815 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.109801    2586 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 01:22:21.112731 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.112719    2586 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 01:22:21.112873 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.112863    2586 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 01:22:21.112903 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.112897    2586 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 01:22:21.112953 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.112911    2586 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 01:22:21.112953 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.112924    2586 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 01:22:21.112953 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.112947    2586 kubelet.go:398] "Adding apiserver pod source"
Jul 21 01:22:21.113053 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.112960    2586 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 01:22:21.113357 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.113346    2586 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 01:22:21.113409 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.113365    2586 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 01:22:21.115866 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.115850    2586 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 01:22:21.117223 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.117208    2586 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 01:22:21.117278 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.117241    2586 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 01:22:21.117813 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.117803    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 01:22:21.117844 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.117820    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 01:22:21.117844 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.117828    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 01:22:21.117844 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.117838    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 01:22:21.117926 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.117852    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 01:22:21.117926 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.117859    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 01:22:21.117926 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.117867    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 01:22:21.117926 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.117872    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 01:22:21.117926 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.117879    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 01:22:21.117926 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.117884    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 01:22:21.117926 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.117893    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 01:22:21.117926 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.117898    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 01:22:21.117926 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.117921    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 01:22:21.117926 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.117926    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 01:22:21.121423 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.121408    2586 server.go:1268] "Started kubelet"
Jul 21 01:22:21.121572 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.121513    2586 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 01:22:21.121677 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.121571    2586 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 01:22:21.121677 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.121634    2586 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 01:22:21.122478 ip-10-0-131-213 systemd[1]: Started Kubernetes Kubelet.
Jul 21 01:22:21.123237 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.123221    2586 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 01:22:21.124453 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.124433    2586 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 01:22:21.124835 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.124816    2586 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-213.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 01:22:21.125746 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.125712    2586 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-28pj5"
Jul 21 01:22:21.125834 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:21.125756    2586 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 01:22:21.127128 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:21.127106    2586 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 01:22:21.127868 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:21.127844    2586 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 01:22:21.130249 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.130226    2586 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 01:22:21.130315 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.130272    2586 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 01:22:21.130379 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:21.130346    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 21 01:22:21.130911 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.130888    2586 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 01:22:21.130911 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.130908    2586 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 01:22:21.131076 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.130858    2586 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 01:22:21.131076 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.131042    2586 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 01:22:21.131076 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.131053    2586 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 01:22:21.131331 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:21.130237    2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-213.ec2.internal.18c4297676c9dc1d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-213.ec2.internal,UID:ip-10-0-131-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-213.ec2.internal,},FirstTimestamp:2026-07-21 01:22:21.121379357 +0000 UTC m=+0.309418737,LastTimestamp:2026-07-21 01:22:21.121379357 +0000 UTC m=+0.309418737,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-213.ec2.internal,}"
Jul 21 01:22:21.131670 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.131656    2586 factory.go:55] Registering systemd factory
Jul 21 01:22:21.131725 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.131673    2586 factory.go:223] Registration of the systemd container factory successfully
Jul 21 01:22:21.131883 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.131869    2586 factory.go:153] Registering CRI-O factory
Jul 21 01:22:21.131970 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.131887    2586 factory.go:223] Registration of the crio container factory successfully
Jul 21 01:22:21.131970 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.131959    2586 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 01:22:21.132063 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.131986    2586 factory.go:103] Registering Raw factory
Jul 21 01:22:21.132063 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.132006    2586 manager.go:1196] Started watching for new ooms in manager
Jul 21 01:22:21.132699 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.132681    2586 manager.go:349] Starting recovery of all containers
Jul 21 01:22:21.133497 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.133480    2586 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-28pj5"
Jul 21 01:22:21.134518 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:21.134372    2586 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 21 01:22:21.134571 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:21.134482    2586 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 21 01:22:21.145274 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.145102    2586 manager.go:354] Recovery completed
Jul 21 01:22:21.149845 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.149831    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:22:21.151767 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.151746    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:22:21.151855 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.151787    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:22:21.151855 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.151805    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:22:21.152440 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.152420    2586 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 01:22:21.152440 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.152436    2586 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 01:22:21.152440 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.152440    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:22:21.152581 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.152452    2586 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 01:22:21.153296 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.153282    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:22:21.153362 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.153316    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:22:21.153362 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.153329    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:22:21.153721 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.153709    2586 policy_none.go:49] "None policy: Start"
Jul 21 01:22:21.153756 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.153727    2586 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 01:22:21.153756 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.153738    2586 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 01:22:21.154229 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:21.154138    2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-213.ec2.internal.18c4297678998b0b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-213.ec2.internal,UID:ip-10-0-131-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-213.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-213.ec2.internal,},FirstTimestamp:2026-07-21 01:22:21.151767307 +0000 UTC m=+0.339806984,LastTimestamp:2026-07-21 01:22:21.151767307 +0000 UTC m=+0.339806984,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-213.ec2.internal,}"
Jul 21 01:22:21.154790 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.154779    2586 policy_none.go:47] "Start"
Jul 21 01:22:21.195652 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.195624    2586 manager.go:337] "Starting Device Plugin manager"
Jul 21 01:22:21.195775 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:21.195673    2586 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 01:22:21.195775 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.195685    2586 server.go:87] "Starting device plugin registration server"
Jul 21 01:22:21.196024 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.196012    2586 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 01:22:21.196072 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.196028    2586 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 01:22:21.196130 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.196108    2586 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 01:22:21.196216 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.196204    2586 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 01:22:21.196273 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.196218    2586 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 01:22:21.196820 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:21.196795    2586 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 01:22:21.196920 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:21.196841    2586 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 21 01:22:21.296386 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.296348    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:22:21.298461 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.298438    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:22:21.298582 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.298474    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:22:21.298582 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.298485    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:22:21.298582 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.298514    2586 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-213.ec2.internal"
Jul 21 01:22:21.300618 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.300580    2586 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 01:22:21.302102 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.302078    2586 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 01:22:21.302165 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.302136    2586 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 01:22:21.302201 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.302166    2586 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 01:22:21.302245 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:21.302206    2586 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 01:22:21.304527 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.304509    2586 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 01:22:21.306476 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.306460    2586 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-213.ec2.internal"
Jul 21 01:22:21.306547 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:21.306483    2586 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-213.ec2.internal\": node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 21 01:22:21.324026 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:21.323921    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 21 01:22:21.402459 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.402423    2586 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-213.ec2.internal"]
Jul 21 01:22:21.402622 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.402541    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:22:21.404217 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.404195    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:22:21.404328 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.404230    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:22:21.404328 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.404246    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:22:21.405531 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.405519    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:22:21.405667 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.405650    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal"
Jul 21 01:22:21.405718 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.405688    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:22:21.406335 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.406310    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:22:21.406433 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.406347    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:22:21.406433 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.406358    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:22:21.406433 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.406311    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:22:21.406433 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.406420    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:22:21.406433 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.406433    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:22:21.407720 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.407707    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-213.ec2.internal"
Jul 21 01:22:21.407762 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.407735    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:22:21.408558 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.408539    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:22:21.408671 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.408569    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:22:21.408671 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.408579    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:22:21.424598 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:21.424569    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 21 01:22:21.427643 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:21.427630    2586 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-213.ec2.internal\" not found" node="ip-10-0-131-213.ec2.internal"
Jul 21 01:22:21.431983 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:21.431964    2586 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-213.ec2.internal\" not found" node="ip-10-0-131-213.ec2.internal"
Jul 21 01:22:21.432953 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.432921    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ed18834709c390e953a40e1ad5f528c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal\" (UID: \"4ed18834709c390e953a40e1ad5f528c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal"
Jul 21 01:22:21.433032 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.432971    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ed18834709c390e953a40e1ad5f528c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal\" (UID: \"4ed18834709c390e953a40e1ad5f528c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal"
Jul 21 01:22:21.433032 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.433014    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a9e90f2c5cc33581ed2c58ee5030092f-config\") pod \"kube-apiserver-proxy-ip-10-0-131-213.ec2.internal\" (UID: \"a9e90f2c5cc33581ed2c58ee5030092f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-213.ec2.internal"
Jul 21 01:22:21.525392 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:21.525359    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 21 01:22:21.533737 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.533705    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ed18834709c390e953a40e1ad5f528c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal\" (UID: \"4ed18834709c390e953a40e1ad5f528c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal"
Jul 21 01:22:21.533841 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.533744    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ed18834709c390e953a40e1ad5f528c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal\" (UID: \"4ed18834709c390e953a40e1ad5f528c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal"
Jul 21 01:22:21.533841 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.533769    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a9e90f2c5cc33581ed2c58ee5030092f-config\") pod \"kube-apiserver-proxy-ip-10-0-131-213.ec2.internal\" (UID: \"a9e90f2c5cc33581ed2c58ee5030092f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-213.ec2.internal"
Jul 21 01:22:21.533841 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.533810    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ed18834709c390e953a40e1ad5f528c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal\" (UID: \"4ed18834709c390e953a40e1ad5f528c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal"
Jul 21 01:22:21.533975 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.533846    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ed18834709c390e953a40e1ad5f528c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal\" (UID: \"4ed18834709c390e953a40e1ad5f528c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal"
Jul 21 01:22:21.533975 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.533847    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a9e90f2c5cc33581ed2c58ee5030092f-config\") pod \"kube-apiserver-proxy-ip-10-0-131-213.ec2.internal\" (UID: \"a9e90f2c5cc33581ed2c58ee5030092f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-213.ec2.internal"
Jul 21 01:22:21.626308 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:21.626225    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 21 01:22:21.726804 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:21.726765    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 21 01:22:21.729995 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.729971    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal"
Jul 21 01:22:21.736233 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:21.736212    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-213.ec2.internal"
Jul 21 01:22:21.827946 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:21.827886    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 21 01:22:21.928458 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:21.928396    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 21 01:22:22.033212 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:22.033169    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 21 01:22:22.080369 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:22.080330    2586 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 01:22:22.080937 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:22.080533    2586 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 01:22:22.133745 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:22.133713    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 21 01:22:22.138289 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:22.138254    2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 01:17:21 +0000 UTC" deadline="2027-12-15 18:14:00.715400915 +0000 UTC"
Jul 21 01:22:22.138289 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:22.138284    2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12304h51m38.577120636s"
Jul 21 01:22:22.234282 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:22.234250    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 21 01:22:22.335291 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:22.335262    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 21 01:22:22.344906 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:22.344871    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ed18834709c390e953a40e1ad5f528c.slice/crio-6d23a96b86fef91078b3ec25cc608b4bdd8a5fefb6cfeaf593d41764dd930a57 WatchSource:0}: Error finding container 6d23a96b86fef91078b3ec25cc608b4bdd8a5fefb6cfeaf593d41764dd930a57: Status 404 returned error can't find the container with id 6d23a96b86fef91078b3ec25cc608b4bdd8a5fefb6cfeaf593d41764dd930a57
Jul 21 01:22:22.345444 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:22.345419    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9e90f2c5cc33581ed2c58ee5030092f.slice/crio-a8dfdf536872ebc3d0890371693aef6d67a06adb6805b691477d0692dcc74511 WatchSource:0}: Error finding container a8dfdf536872ebc3d0890371693aef6d67a06adb6805b691477d0692dcc74511: Status 404 returned error can't find the container with id a8dfdf536872ebc3d0890371693aef6d67a06adb6805b691477d0692dcc74511
Jul 21 01:22:22.350066 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:22.350046    2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 01:22:22.436094 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:22.436050    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 21 01:22:22.493752 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:22.493669    2586 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 01:22:22.537219 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:22.537177    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 21 01:22:22.615962 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:22.615923    2586 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 01:22:22.638041 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:22.637997    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 21 01:22:22.646832 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:22.646807    2586 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 01:22:22.732072 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:22.732017    2586 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-213.ec2.internal"
Jul 21 01:22:22.742203 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:22.742172    2586 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 01:22:22.743171 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:22.743156    2586 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal"
Jul 21 01:22:22.752817 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:22.752762    2586 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 01:22:23.114464 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.114367    2586 apiserver.go:52] "Watching apiserver"
Jul 21 01:22:23.126779 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.126744    2586 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 01:22:23.132389 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.127812    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-p4bm8","openshift-network-diagnostics/network-check-target-47x5c","openshift-network-operator/iptables-alerter-6l6ss","openshift-ovn-kubernetes/ovnkube-node-pxdmv","kube-system/global-pull-secret-syncer-hm4l8","kube-system/konnectivity-agent-pwgsm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg","openshift-dns/node-resolver-slkgx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal","openshift-multus/multus-s8jbs","kube-system/kube-apiserver-proxy-ip-10-0-131-213.ec2.internal","openshift-cluster-node-tuning-operator/tuned-lnnxc","openshift-image-registry/node-ca-66295","openshift-multus/multus-additional-cni-plugins-kxv64"]
Jul 21 01:22:23.134339 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.134314    2586 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 01:22:23.134916 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.134885    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg"
Jul 21 01:22:23.137333 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.137309    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nkpjj\""
Jul 21 01:22:23.137641 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.137619    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 01:22:23.137880 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.137858    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 01:22:23.138263 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.138098    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 01:22:23.138373 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.138279    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-66295"
Jul 21 01:22:23.140488 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.139951    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6l6ss"
Jul 21 01:22:23.140599 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.140528    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 01:22:23.141282 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.140758    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6r5mg\""
Jul 21 01:22:23.141282 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.140908    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 01:22:23.141282 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.141031    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 01:22:23.141923 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.141889    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 01:22:23.142468 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.142447    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.142905 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.142868    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vjtth\""
Jul 21 01:22:23.143380 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.143347    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 01:22:23.143709 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.143688    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 01:22:23.144172 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.143999    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/636c14e3-44d1-468c-a96e-63d84877660b-registration-dir\") pod \"aws-ebs-csi-driver-node-2kntg\" (UID: \"636c14e3-44d1-468c-a96e-63d84877660b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg"
Jul 21 01:22:23.144262 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.144197    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/636c14e3-44d1-468c-a96e-63d84877660b-device-dir\") pod \"aws-ebs-csi-driver-node-2kntg\" (UID: \"636c14e3-44d1-468c-a96e-63d84877660b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg"
Jul 21 01:22:23.144262 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.144223    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/636c14e3-44d1-468c-a96e-63d84877660b-etc-selinux\") pod \"aws-ebs-csi-driver-node-2kntg\" (UID: \"636c14e3-44d1-468c-a96e-63d84877660b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg"
Jul 21 01:22:23.144262 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.144242    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/636c14e3-44d1-468c-a96e-63d84877660b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2kntg\" (UID: \"636c14e3-44d1-468c-a96e-63d84877660b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg"
Jul 21 01:22:23.144262 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.144260    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/636c14e3-44d1-468c-a96e-63d84877660b-sys-fs\") pod \"aws-ebs-csi-driver-node-2kntg\" (UID: \"636c14e3-44d1-468c-a96e-63d84877660b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg"
Jul 21 01:22:23.144502 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.144277    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2z45\" (UniqueName: \"kubernetes.io/projected/636c14e3-44d1-468c-a96e-63d84877660b-kube-api-access-k2z45\") pod \"aws-ebs-csi-driver-node-2kntg\" (UID: \"636c14e3-44d1-468c-a96e-63d84877660b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg"
Jul 21 01:22:23.144502 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.144303    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/636c14e3-44d1-468c-a96e-63d84877660b-socket-dir\") pod \"aws-ebs-csi-driver-node-2kntg\" (UID: \"636c14e3-44d1-468c-a96e-63d84877660b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg"
Jul 21 01:22:23.144586 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.144530    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 01:22:23.144621 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.144589    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:23.144686 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:23.144654    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:22:23.145682 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.145659    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lfhqh\""
Jul 21 01:22:23.146082 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.145918    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 01:22:23.146197 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.146154    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 01:22:23.146454 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.146429    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 01:22:23.146625 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.146608    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 01:22:23.147910 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.147878    2586 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 01:22:23.148025 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.147975    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 01:22:23.148599 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.148578    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pwgsm"
Jul 21 01:22:23.150430 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.150407    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 01:22:23.151085 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.151066    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6sn85\""
Jul 21 01:22:23.151328 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.151310    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 01:22:23.151635 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.151614    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kxv64"
Jul 21 01:22:23.153380 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.153338    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 01:22:23.154263 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.154246    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:23.154712 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:23.154685    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:22:23.155129 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.155093    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 01:22:23.155317 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.155299    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 01:22:23.155477 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.155459    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 01:22:23.155734 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.155708    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 01:22:23.156608 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.156588    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vs6nd\""
Jul 21 01:22:23.157417 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.157397    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:23.157513 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:23.157467    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:22:23.160496 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.160473    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.162538 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.162517    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 01:22:23.162663 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.162648    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qnsn2\""
Jul 21 01:22:23.163391 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.163369    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-slkgx"
Jul 21 01:22:23.165342 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.165322    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 01:22:23.165735 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.165718    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7dllt\""
Jul 21 01:22:23.165889 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.165875    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 01:22:23.166102 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.166020    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.168479 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.168447    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 01:22:23.168665 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.168643    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 01:22:23.172862 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.172823    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-glftd\""
Jul 21 01:22:23.176588 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.176567    2586 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-smv77"
Jul 21 01:22:23.183785 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.183761    2586 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-smv77"
Jul 21 01:22:23.232976 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.232890    2586 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 01:22:23.245068 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245015    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-multus-socket-dir-parent\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.245068 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245080    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-etc-kubernetes\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.245323 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245106    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhrmt\" (UniqueName: \"kubernetes.io/projected/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-kube-api-access-qhrmt\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.245323 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245153    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhb5b\" (UniqueName: \"kubernetes.io/projected/4dc33e59-dee4-4993-aee2-95bf4940a36c-kube-api-access-rhb5b\") pod \"node-resolver-slkgx\" (UID: \"4dc33e59-dee4-4993-aee2-95bf4940a36c\") " pod="openshift-dns/node-resolver-slkgx"
Jul 21 01:22:23.245323 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245181    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-cnibin\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.245323 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245241    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-host-run-netns\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.245323 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245294    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-host-var-lib-cni-multus\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.245323 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245319    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-run\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.245702 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245344    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-run-ovn\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.245702 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245405    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-node-log\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.245702 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245429    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-log-socket\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.245702 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245472    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e50007d2-ddf9-433f-b3ee-379c4a88b1b7-system-cni-dir\") pod \"multus-additional-cni-plugins-kxv64\" (UID: \"e50007d2-ddf9-433f-b3ee-379c4a88b1b7\") " pod="openshift-multus/multus-additional-cni-plugins-kxv64"
Jul 21 01:22:23.245702 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245500    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-host-run-k8s-cni-cncf-io\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.245702 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245532    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-etc-kubernetes\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.245702 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245557    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/965cd681-5974-4df4-b720-6c897b77b0d7-tmp\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.245702 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245585    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j659\" (UniqueName: \"kubernetes.io/projected/965cd681-5974-4df4-b720-6c897b77b0d7-kube-api-access-5j659\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.245702 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245625    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-kubelet-config\") pod \"global-pull-secret-syncer-hm4l8\" (UID: \"e1ad4368-cb38-4500-9a3c-9d3101bb3e09\") " pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:23.245702 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245657    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-host-run-multus-certs\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.245702 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245682    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-var-lib-kubelet\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.245702 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245706    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58d7de41-3645-4c8a-9250-e174e268c8e9-host\") pod \"node-ca-66295\" (UID: \"58d7de41-3645-4c8a-9250-e174e268c8e9\") " pod="openshift-image-registry/node-ca-66295"
Jul 21 01:22:23.246233 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245731    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-host-run-ovn-kubernetes\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.246233 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245756    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-host-cni-netd\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.246233 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245781    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-original-pull-secret\") pod \"global-pull-secret-syncer-hm4l8\" (UID: \"e1ad4368-cb38-4500-9a3c-9d3101bb3e09\") " pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:23.246233 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245808    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfwlz\" (UniqueName: \"kubernetes.io/projected/4c40807d-20bc-4fa8-957f-ef7712b7d745-kube-api-access-wfwlz\") pod \"network-metrics-daemon-p4bm8\" (UID: \"4c40807d-20bc-4fa8-957f-ef7712b7d745\") " pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:23.246233 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245837    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-os-release\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.246233 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245864    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-host-var-lib-kubelet\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.246233 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245889    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-multus-daemon-config\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.246233 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245923    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-etc-sysctl-conf\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.246233 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245949    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-host-slash\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.246233 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.245997    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e50007d2-ddf9-433f-b3ee-379c4a88b1b7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kxv64\" (UID: \"e50007d2-ddf9-433f-b3ee-379c4a88b1b7\") " pod="openshift-multus/multus-additional-cni-plugins-kxv64"
Jul 21 01:22:23.246233 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246031    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c40807d-20bc-4fa8-957f-ef7712b7d745-metrics-certs\") pod \"network-metrics-daemon-p4bm8\" (UID: \"4c40807d-20bc-4fa8-957f-ef7712b7d745\") " pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:23.246233 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246066    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-system-cni-dir\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.246233 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246094    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.246233 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246124    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dc33e59-dee4-4993-aee2-95bf4940a36c-tmp-dir\") pod \"node-resolver-slkgx\" (UID: \"4dc33e59-dee4-4993-aee2-95bf4940a36c\") " pod="openshift-dns/node-resolver-slkgx"
Jul 21 01:22:23.246233 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246151    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-sys\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.246233 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246176    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-lib-modules\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.246832 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246202    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5qlr\" (UniqueName: \"kubernetes.io/projected/73b11732-583a-494b-82fc-44006012d82a-kube-api-access-c5qlr\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.246832 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246233    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e50007d2-ddf9-433f-b3ee-379c4a88b1b7-cnibin\") pod \"multus-additional-cni-plugins-kxv64\" (UID: \"e50007d2-ddf9-433f-b3ee-379c4a88b1b7\") " pod="openshift-multus/multus-additional-cni-plugins-kxv64"
Jul 21 01:22:23.246832 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246261    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e50007d2-ddf9-433f-b3ee-379c4a88b1b7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kxv64\" (UID: \"e50007d2-ddf9-433f-b3ee-379c4a88b1b7\") " pod="openshift-multus/multus-additional-cni-plugins-kxv64"
Jul 21 01:22:23.246832 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246288    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-multus-conf-dir\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.246832 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246315    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-etc-sysctl-d\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.246832 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246339    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-host\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.246832 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246362    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/58d7de41-3645-4c8a-9250-e174e268c8e9-serviceca\") pod \"node-ca-66295\" (UID: \"58d7de41-3645-4c8a-9250-e174e268c8e9\") " pod="openshift-image-registry/node-ca-66295"
Jul 21 01:22:23.246832 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246386    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-host-kubelet\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.246832 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246411    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/73b11732-583a-494b-82fc-44006012d82a-env-overrides\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.246832 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246444    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/636c14e3-44d1-468c-a96e-63d84877660b-sys-fs\") pod \"aws-ebs-csi-driver-node-2kntg\" (UID: \"636c14e3-44d1-468c-a96e-63d84877660b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg"
Jul 21 01:22:23.246832 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246469    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-systemd-units\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.246832 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246506    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4dc33e59-dee4-4993-aee2-95bf4940a36c-hosts-file\") pod \"node-resolver-slkgx\" (UID: \"4dc33e59-dee4-4993-aee2-95bf4940a36c\") " pod="openshift-dns/node-resolver-slkgx"
Jul 21 01:22:23.246832 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246534    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/60320823-e00f-493d-b728-ca88376eec49-iptables-alerter-script\") pod \"iptables-alerter-6l6ss\" (UID: \"60320823-e00f-493d-b728-ca88376eec49\") " pod="openshift-network-operator/iptables-alerter-6l6ss"
Jul 21 01:22:23.246832 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246564    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/636c14e3-44d1-468c-a96e-63d84877660b-socket-dir\") pod \"aws-ebs-csi-driver-node-2kntg\" (UID: \"636c14e3-44d1-468c-a96e-63d84877660b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg"
Jul 21 01:22:23.246832 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246591    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4c88\" (UniqueName: \"kubernetes.io/projected/e50007d2-ddf9-433f-b3ee-379c4a88b1b7-kube-api-access-w4c88\") pod \"multus-additional-cni-plugins-kxv64\" (UID: \"e50007d2-ddf9-433f-b3ee-379c4a88b1b7\") " pod="openshift-multus/multus-additional-cni-plugins-kxv64"
Jul 21 01:22:23.246832 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246611    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-host-var-lib-cni-bin\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.247480 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246627    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/73b11732-583a-494b-82fc-44006012d82a-ovnkube-script-lib\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.247480 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246644    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/636c14e3-44d1-468c-a96e-63d84877660b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2kntg\" (UID: \"636c14e3-44d1-468c-a96e-63d84877660b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg"
Jul 21 01:22:23.247480 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246662    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2z45\" (UniqueName: \"kubernetes.io/projected/636c14e3-44d1-468c-a96e-63d84877660b-kube-api-access-k2z45\") pod \"aws-ebs-csi-driver-node-2kntg\" (UID: \"636c14e3-44d1-468c-a96e-63d84877660b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg"
Jul 21 01:22:23.247480 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246680    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e50007d2-ddf9-433f-b3ee-379c4a88b1b7-cni-binary-copy\") pod \"multus-additional-cni-plugins-kxv64\" (UID: \"e50007d2-ddf9-433f-b3ee-379c4a88b1b7\") " pod="openshift-multus/multus-additional-cni-plugins-kxv64"
Jul 21 01:22:23.247480 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246696    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-etc-modprobe-d\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.247480 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246712    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-etc-sysconfig\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.247480 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246732    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-etc-systemd\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.247480 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246747    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5m2r\" (UniqueName: \"kubernetes.io/projected/58d7de41-3645-4c8a-9250-e174e268c8e9-kube-api-access-z5m2r\") pod \"node-ca-66295\" (UID: \"58d7de41-3645-4c8a-9250-e174e268c8e9\") " pod="openshift-image-registry/node-ca-66295"
Jul 21 01:22:23.247480 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246767    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e50007d2-ddf9-433f-b3ee-379c4a88b1b7-os-release\") pod \"multus-additional-cni-plugins-kxv64\" (UID: \"e50007d2-ddf9-433f-b3ee-379c4a88b1b7\") " pod="openshift-multus/multus-additional-cni-plugins-kxv64"
Jul 21 01:22:23.247480 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246784    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvrqp\" (UniqueName: \"kubernetes.io/projected/ceb4edb3-7ef3-4281-89fa-3a92610353d1-kube-api-access-qvrqp\") pod \"network-check-target-47x5c\" (UID: \"ceb4edb3-7ef3-4281-89fa-3a92610353d1\") " pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:23.247480 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246806    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-run-openvswitch\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.247480 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246832    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-host-cni-bin\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.247480 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246862    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/73b11732-583a-494b-82fc-44006012d82a-ovnkube-config\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.247480 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246898    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/73b11732-583a-494b-82fc-44006012d82a-ovn-node-metrics-cert\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.247480 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246927    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/be9755bc-dbcf-4698-921c-88db5322a227-agent-certs\") pod \"konnectivity-agent-pwgsm\" (UID: \"be9755bc-dbcf-4698-921c-88db5322a227\") " pod="kube-system/konnectivity-agent-pwgsm"
Jul 21 01:22:23.247480 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246955    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h45ww\" (UniqueName: \"kubernetes.io/projected/60320823-e00f-493d-b728-ca88376eec49-kube-api-access-h45ww\") pod \"iptables-alerter-6l6ss\" (UID: \"60320823-e00f-493d-b728-ca88376eec49\") " pod="openshift-network-operator/iptables-alerter-6l6ss"
Jul 21 01:22:23.248066 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.246989    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/636c14e3-44d1-468c-a96e-63d84877660b-device-dir\") pod \"aws-ebs-csi-driver-node-2kntg\" (UID: \"636c14e3-44d1-468c-a96e-63d84877660b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg"
Jul 21 01:22:23.248066 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.247033    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/636c14e3-44d1-468c-a96e-63d84877660b-etc-selinux\") pod \"aws-ebs-csi-driver-node-2kntg\" (UID: \"636c14e3-44d1-468c-a96e-63d84877660b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg"
Jul 21 01:22:23.248066 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.247061    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/965cd681-5974-4df4-b720-6c897b77b0d7-etc-tuned\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.248066 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.247087    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-run-systemd\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.248066 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.247118    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e50007d2-ddf9-433f-b3ee-379c4a88b1b7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kxv64\" (UID: \"e50007d2-ddf9-433f-b3ee-379c4a88b1b7\") " pod="openshift-multus/multus-additional-cni-plugins-kxv64"
Jul 21 01:22:23.248066 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.247138    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-cni-binary-copy\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.248066 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.247156    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-hostroot\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.248066 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.247180    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-var-lib-openvswitch\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.248066 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.247222    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/be9755bc-dbcf-4698-921c-88db5322a227-konnectivity-ca\") pod \"konnectivity-agent-pwgsm\" (UID: \"be9755bc-dbcf-4698-921c-88db5322a227\") " pod="kube-system/konnectivity-agent-pwgsm"
Jul 21 01:22:23.248066 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.247252    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60320823-e00f-493d-b728-ca88376eec49-host-slash\") pod \"iptables-alerter-6l6ss\" (UID: \"60320823-e00f-493d-b728-ca88376eec49\") " pod="openshift-network-operator/iptables-alerter-6l6ss"
Jul 21 01:22:23.248066 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.247278    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-dbus\") pod \"global-pull-secret-syncer-hm4l8\" (UID: \"e1ad4368-cb38-4500-9a3c-9d3101bb3e09\") " pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:23.248066 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.247309    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/636c14e3-44d1-468c-a96e-63d84877660b-registration-dir\") pod \"aws-ebs-csi-driver-node-2kntg\" (UID: \"636c14e3-44d1-468c-a96e-63d84877660b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg"
Jul 21 01:22:23.248066 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.247336    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-multus-cni-dir\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.248066 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.247366    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-host-run-netns\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.248066 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.247394    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-etc-openvswitch\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.248066 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.247914    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/636c14e3-44d1-468c-a96e-63d84877660b-sys-fs\") pod \"aws-ebs-csi-driver-node-2kntg\" (UID: \"636c14e3-44d1-468c-a96e-63d84877660b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg"
Jul 21 01:22:23.248658 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.248146    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/636c14e3-44d1-468c-a96e-63d84877660b-socket-dir\") pod \"aws-ebs-csi-driver-node-2kntg\" (UID: \"636c14e3-44d1-468c-a96e-63d84877660b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg"
Jul 21 01:22:23.248658 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.248291    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/636c14e3-44d1-468c-a96e-63d84877660b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2kntg\" (UID: \"636c14e3-44d1-468c-a96e-63d84877660b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg"
Jul 21 01:22:23.248991 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.248965    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/636c14e3-44d1-468c-a96e-63d84877660b-device-dir\") pod \"aws-ebs-csi-driver-node-2kntg\" (UID: \"636c14e3-44d1-468c-a96e-63d84877660b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg"
Jul 21 01:22:23.249141 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.249123    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/636c14e3-44d1-468c-a96e-63d84877660b-etc-selinux\") pod \"aws-ebs-csi-driver-node-2kntg\" (UID: \"636c14e3-44d1-468c-a96e-63d84877660b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg"
Jul 21 01:22:23.249291 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.249273    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/636c14e3-44d1-468c-a96e-63d84877660b-registration-dir\") pod \"aws-ebs-csi-driver-node-2kntg\" (UID: \"636c14e3-44d1-468c-a96e-63d84877660b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg"
Jul 21 01:22:23.258085 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.258054    2586 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 01:22:23.262275 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.262248    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2z45\" (UniqueName: \"kubernetes.io/projected/636c14e3-44d1-468c-a96e-63d84877660b-kube-api-access-k2z45\") pod \"aws-ebs-csi-driver-node-2kntg\" (UID: \"636c14e3-44d1-468c-a96e-63d84877660b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg"
Jul 21 01:22:23.308822 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.308755    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal" event={"ID":"4ed18834709c390e953a40e1ad5f528c","Type":"ContainerStarted","Data":"6d23a96b86fef91078b3ec25cc608b4bdd8a5fefb6cfeaf593d41764dd930a57"}
Jul 21 01:22:23.310343 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.310309    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-213.ec2.internal" event={"ID":"a9e90f2c5cc33581ed2c58ee5030092f","Type":"ContainerStarted","Data":"a8dfdf536872ebc3d0890371693aef6d67a06adb6805b691477d0692dcc74511"}
Jul 21 01:22:23.352341 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.352280    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhrmt\" (UniqueName: \"kubernetes.io/projected/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-kube-api-access-qhrmt\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.352855 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.352812    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhb5b\" (UniqueName: \"kubernetes.io/projected/4dc33e59-dee4-4993-aee2-95bf4940a36c-kube-api-access-rhb5b\") pod \"node-resolver-slkgx\" (UID: \"4dc33e59-dee4-4993-aee2-95bf4940a36c\") " pod="openshift-dns/node-resolver-slkgx"
Jul 21 01:22:23.353041 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.352870    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-cnibin\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.353041 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.352930    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-cnibin\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.353172 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353049    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-host-run-netns\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.353172 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353085    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-host-var-lib-cni-multus\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.353172 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353110    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-run\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.353172 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353133    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-run-ovn\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.353172 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353145    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-host-run-netns\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.353432 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353159    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-node-log\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.353432 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353222    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-log-socket\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.353432 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353229    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-node-log\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.353432 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353256    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e50007d2-ddf9-433f-b3ee-379c4a88b1b7-system-cni-dir\") pod \"multus-additional-cni-plugins-kxv64\" (UID: \"e50007d2-ddf9-433f-b3ee-379c4a88b1b7\") " pod="openshift-multus/multus-additional-cni-plugins-kxv64"
Jul 21 01:22:23.353432 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353291    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-host-run-k8s-cni-cncf-io\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.353432 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353322    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-host-var-lib-cni-multus\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.353432 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353343    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-etc-kubernetes\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.353432 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353367    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/965cd681-5974-4df4-b720-6c897b77b0d7-tmp\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.353432 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353376    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-run\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.353432 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353390    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j659\" (UniqueName: \"kubernetes.io/projected/965cd681-5974-4df4-b720-6c897b77b0d7-kube-api-access-5j659\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.353432 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353411    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-run-ovn\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.353432 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353416    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-kubelet-config\") pod \"global-pull-secret-syncer-hm4l8\" (UID: \"e1ad4368-cb38-4500-9a3c-9d3101bb3e09\") " pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:23.354036 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353442    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-host-run-multus-certs\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.354036 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353458    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-host-run-k8s-cni-cncf-io\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.354036 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353466    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-var-lib-kubelet\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.354036 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353489    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58d7de41-3645-4c8a-9250-e174e268c8e9-host\") pod \"node-ca-66295\" (UID: \"58d7de41-3645-4c8a-9250-e174e268c8e9\") " pod="openshift-image-registry/node-ca-66295"
Jul 21 01:22:23.354036 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353494    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-log-socket\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.354036 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353522    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-host-run-ovn-kubernetes\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.354036 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353541    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58d7de41-3645-4c8a-9250-e174e268c8e9-host\") pod \"node-ca-66295\" (UID: \"58d7de41-3645-4c8a-9250-e174e268c8e9\") " pod="openshift-image-registry/node-ca-66295"
Jul 21 01:22:23.354036 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353554    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-host-cni-netd\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.354036 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353579    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-original-pull-secret\") pod \"global-pull-secret-syncer-hm4l8\" (UID: \"e1ad4368-cb38-4500-9a3c-9d3101bb3e09\") " pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:23.354036 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353597    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-etc-kubernetes\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.354036 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353603    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfwlz\" (UniqueName: \"kubernetes.io/projected/4c40807d-20bc-4fa8-957f-ef7712b7d745-kube-api-access-wfwlz\") pod \"network-metrics-daemon-p4bm8\" (UID: \"4c40807d-20bc-4fa8-957f-ef7712b7d745\") " pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:23.354036 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353627    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-os-release\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.354036 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353650    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-host-var-lib-kubelet\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.354036 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353674    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-multus-daemon-config\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.354036 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353696    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-etc-sysctl-conf\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.354036 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353718    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-host-slash\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.354036 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353742    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e50007d2-ddf9-433f-b3ee-379c4a88b1b7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kxv64\" (UID: \"e50007d2-ddf9-433f-b3ee-379c4a88b1b7\") " pod="openshift-multus/multus-additional-cni-plugins-kxv64"
Jul 21 01:22:23.354904 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353766    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c40807d-20bc-4fa8-957f-ef7712b7d745-metrics-certs\") pod \"network-metrics-daemon-p4bm8\" (UID: \"4c40807d-20bc-4fa8-957f-ef7712b7d745\") " pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:23.354904 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353791    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-system-cni-dir\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.354904 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353815    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.354904 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353842    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dc33e59-dee4-4993-aee2-95bf4940a36c-tmp-dir\") pod \"node-resolver-slkgx\" (UID: \"4dc33e59-dee4-4993-aee2-95bf4940a36c\") " pod="openshift-dns/node-resolver-slkgx"
Jul 21 01:22:23.354904 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353864    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-sys\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.354904 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353886    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-lib-modules\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.354904 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353917    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5qlr\" (UniqueName: \"kubernetes.io/projected/73b11732-583a-494b-82fc-44006012d82a-kube-api-access-c5qlr\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.354904 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353941    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e50007d2-ddf9-433f-b3ee-379c4a88b1b7-cnibin\") pod \"multus-additional-cni-plugins-kxv64\" (UID: \"e50007d2-ddf9-433f-b3ee-379c4a88b1b7\") " pod="openshift-multus/multus-additional-cni-plugins-kxv64"
Jul 21 01:22:23.354904 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.353967    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e50007d2-ddf9-433f-b3ee-379c4a88b1b7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kxv64\" (UID: \"e50007d2-ddf9-433f-b3ee-379c4a88b1b7\") " pod="openshift-multus/multus-additional-cni-plugins-kxv64"
Jul 21 01:22:23.354904 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354012    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-multus-conf-dir\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.354904 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354038    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-etc-sysctl-d\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.354904 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354062    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-host\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.354904 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354085    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/58d7de41-3645-4c8a-9250-e174e268c8e9-serviceca\") pod \"node-ca-66295\" (UID: \"58d7de41-3645-4c8a-9250-e174e268c8e9\") " pod="openshift-image-registry/node-ca-66295"
Jul 21 01:22:23.354904 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354128    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-host-kubelet\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.354904 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354163    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/73b11732-583a-494b-82fc-44006012d82a-env-overrides\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.354904 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354212    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-systemd-units\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.354904 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354239    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4dc33e59-dee4-4993-aee2-95bf4940a36c-hosts-file\") pod \"node-resolver-slkgx\" (UID: \"4dc33e59-dee4-4993-aee2-95bf4940a36c\") " pod="openshift-dns/node-resolver-slkgx"
Jul 21 01:22:23.355755 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354319    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/60320823-e00f-493d-b728-ca88376eec49-iptables-alerter-script\") pod \"iptables-alerter-6l6ss\" (UID: \"60320823-e00f-493d-b728-ca88376eec49\") " pod="openshift-network-operator/iptables-alerter-6l6ss"
Jul 21 01:22:23.355755 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354323    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.355755 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354349    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-host-run-multus-certs\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.355755 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354362    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4c88\" (UniqueName: \"kubernetes.io/projected/e50007d2-ddf9-433f-b3ee-379c4a88b1b7-kube-api-access-w4c88\") pod \"multus-additional-cni-plugins-kxv64\" (UID: \"e50007d2-ddf9-433f-b3ee-379c4a88b1b7\") " pod="openshift-multus/multus-additional-cni-plugins-kxv64"
Jul 21 01:22:23.355755 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354402    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-host-var-lib-cni-bin\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.355755 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354432    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/73b11732-583a-494b-82fc-44006012d82a-ovnkube-script-lib\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.355755 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354467    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e50007d2-ddf9-433f-b3ee-379c4a88b1b7-cni-binary-copy\") pod \"multus-additional-cni-plugins-kxv64\" (UID: \"e50007d2-ddf9-433f-b3ee-379c4a88b1b7\") " pod="openshift-multus/multus-additional-cni-plugins-kxv64"
Jul 21 01:22:23.355755 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354482    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-host-var-lib-kubelet\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.355755 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354498    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-etc-modprobe-d\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.355755 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354528    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-etc-sysconfig\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.355755 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354532    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e50007d2-ddf9-433f-b3ee-379c4a88b1b7-system-cni-dir\") pod \"multus-additional-cni-plugins-kxv64\" (UID: \"e50007d2-ddf9-433f-b3ee-379c4a88b1b7\") " pod="openshift-multus/multus-additional-cni-plugins-kxv64"
Jul 21 01:22:23.355755 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354555    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-etc-systemd\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.355755 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354573    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-host-run-ovn-kubernetes\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.355755 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354582    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5m2r\" (UniqueName: \"kubernetes.io/projected/58d7de41-3645-4c8a-9250-e174e268c8e9-kube-api-access-z5m2r\") pod \"node-ca-66295\" (UID: \"58d7de41-3645-4c8a-9250-e174e268c8e9\") " pod="openshift-image-registry/node-ca-66295"
Jul 21 01:22:23.355755 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354609    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e50007d2-ddf9-433f-b3ee-379c4a88b1b7-os-release\") pod \"multus-additional-cni-plugins-kxv64\" (UID: \"e50007d2-ddf9-433f-b3ee-379c4a88b1b7\") " pod="openshift-multus/multus-additional-cni-plugins-kxv64"
Jul 21 01:22:23.355755 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354611    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-host-cni-netd\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.355755 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354637    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvrqp\" (UniqueName: \"kubernetes.io/projected/ceb4edb3-7ef3-4281-89fa-3a92610353d1-kube-api-access-qvrqp\") pod \"network-check-target-47x5c\" (UID: \"ceb4edb3-7ef3-4281-89fa-3a92610353d1\") " pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:23.356630 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354665    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-run-openvswitch\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.356630 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354692    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-host-cni-bin\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.356630 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:23.354696    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:23.356630 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354716    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/73b11732-583a-494b-82fc-44006012d82a-ovnkube-config\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.356630 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354743    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/73b11732-583a-494b-82fc-44006012d82a-ovn-node-metrics-cert\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.356630 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:23.354763    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-original-pull-secret podName:e1ad4368-cb38-4500-9a3c-9d3101bb3e09 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:23.854739906 +0000 UTC m=+3.042779296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-original-pull-secret") pod "global-pull-secret-syncer-hm4l8" (UID: "e1ad4368-cb38-4500-9a3c-9d3101bb3e09") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:23.356630 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354797    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/be9755bc-dbcf-4698-921c-88db5322a227-agent-certs\") pod \"konnectivity-agent-pwgsm\" (UID: \"be9755bc-dbcf-4698-921c-88db5322a227\") " pod="kube-system/konnectivity-agent-pwgsm"
Jul 21 01:22:23.356630 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354829    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h45ww\" (UniqueName: \"kubernetes.io/projected/60320823-e00f-493d-b728-ca88376eec49-kube-api-access-h45ww\") pod \"iptables-alerter-6l6ss\" (UID: \"60320823-e00f-493d-b728-ca88376eec49\") " pod="openshift-network-operator/iptables-alerter-6l6ss"
Jul 21 01:22:23.356630 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354861    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/965cd681-5974-4df4-b720-6c897b77b0d7-etc-tuned\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.356630 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354888    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-run-systemd\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.356630 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354915    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e50007d2-ddf9-433f-b3ee-379c4a88b1b7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kxv64\" (UID: \"e50007d2-ddf9-433f-b3ee-379c4a88b1b7\") " pod="openshift-multus/multus-additional-cni-plugins-kxv64"
Jul 21 01:22:23.356630 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354937    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-multus-daemon-config\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.356630 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354945    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-cni-binary-copy\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.356630 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354974    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-hostroot\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.356630 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.355039    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-hostroot\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.356630 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.355106    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-os-release\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.356630 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.355103    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-host-slash\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.357602 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.355178    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-sys\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.357602 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.355151    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-system-cni-dir\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.357602 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:23.355197    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:23.357602 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.355207    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-lib-modules\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.357602 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.355231    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-run-systemd\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.357602 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:23.355246    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c40807d-20bc-4fa8-957f-ef7712b7d745-metrics-certs podName:4c40807d-20bc-4fa8-957f-ef7712b7d745 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:23.855229357 +0000 UTC m=+3.043268742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c40807d-20bc-4fa8-957f-ef7712b7d745-metrics-certs") pod "network-metrics-daemon-p4bm8" (UID: "4c40807d-20bc-4fa8-957f-ef7712b7d745") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:23.357602 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.355253    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dc33e59-dee4-4993-aee2-95bf4940a36c-tmp-dir\") pod \"node-resolver-slkgx\" (UID: \"4dc33e59-dee4-4993-aee2-95bf4940a36c\") " pod="openshift-dns/node-resolver-slkgx"
Jul 21 01:22:23.357602 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354946    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/60320823-e00f-493d-b728-ca88376eec49-iptables-alerter-script\") pod \"iptables-alerter-6l6ss\" (UID: \"60320823-e00f-493d-b728-ca88376eec49\") " pod="openshift-network-operator/iptables-alerter-6l6ss"
Jul 21 01:22:23.357602 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.355110    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-etc-sysctl-conf\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.357602 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.355341    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-var-lib-kubelet\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.357602 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.355493    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-multus-conf-dir\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.357602 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.355632    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-etc-sysctl-d\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.357602 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.355795    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e50007d2-ddf9-433f-b3ee-379c4a88b1b7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kxv64\" (UID: \"e50007d2-ddf9-433f-b3ee-379c4a88b1b7\") " pod="openshift-multus/multus-additional-cni-plugins-kxv64"
Jul 21 01:22:23.357602 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.355797    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e50007d2-ddf9-433f-b3ee-379c4a88b1b7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kxv64\" (UID: \"e50007d2-ddf9-433f-b3ee-379c4a88b1b7\") " pod="openshift-multus/multus-additional-cni-plugins-kxv64"
Jul 21 01:22:23.357602 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.355813    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e50007d2-ddf9-433f-b3ee-379c4a88b1b7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kxv64\" (UID: \"e50007d2-ddf9-433f-b3ee-379c4a88b1b7\") " pod="openshift-multus/multus-additional-cni-plugins-kxv64"
Jul 21 01:22:23.357602 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.355839    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-cni-binary-copy\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.357602 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.355845    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-host-var-lib-cni-bin\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.358366 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.355919    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-host\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.358366 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.356405    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/58d7de41-3645-4c8a-9250-e174e268c8e9-serviceca\") pod \"node-ca-66295\" (UID: \"58d7de41-3645-4c8a-9250-e174e268c8e9\") " pod="openshift-image-registry/node-ca-66295"
Jul 21 01:22:23.358366 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.356467    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-systemd-units\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.358366 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.356517    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4dc33e59-dee4-4993-aee2-95bf4940a36c-hosts-file\") pod \"node-resolver-slkgx\" (UID: \"4dc33e59-dee4-4993-aee2-95bf4940a36c\") " pod="openshift-dns/node-resolver-slkgx"
Jul 21 01:22:23.358366 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.356566    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-etc-sysconfig\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.358366 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.356682    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-etc-modprobe-d\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.358366 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.356748    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-var-lib-openvswitch\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.358366 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.356788    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/be9755bc-dbcf-4698-921c-88db5322a227-konnectivity-ca\") pod \"konnectivity-agent-pwgsm\" (UID: \"be9755bc-dbcf-4698-921c-88db5322a227\") " pod="kube-system/konnectivity-agent-pwgsm"
Jul 21 01:22:23.358366 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.356816    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60320823-e00f-493d-b728-ca88376eec49-host-slash\") pod \"iptables-alerter-6l6ss\" (UID: \"60320823-e00f-493d-b728-ca88376eec49\") " pod="openshift-network-operator/iptables-alerter-6l6ss"
Jul 21 01:22:23.358366 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.356844    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-dbus\") pod \"global-pull-secret-syncer-hm4l8\" (UID: \"e1ad4368-cb38-4500-9a3c-9d3101bb3e09\") " pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:23.358366 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.356874    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-multus-cni-dir\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.358366 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.356899    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-host-run-netns\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.358366 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.356925    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-etc-openvswitch\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.358366 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.356970    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-multus-socket-dir-parent\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.358366 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.356999    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-etc-kubernetes\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.358366 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.357067    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/73b11732-583a-494b-82fc-44006012d82a-env-overrides\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.358366 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.357094    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-etc-kubernetes\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.358366 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.357140    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-host-kubelet\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.358944 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.357143    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-var-lib-openvswitch\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.358944 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.354135    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-kubelet-config\") pod \"global-pull-secret-syncer-hm4l8\" (UID: \"e1ad4368-cb38-4500-9a3c-9d3101bb3e09\") " pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:23.358944 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.357221    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e50007d2-ddf9-433f-b3ee-379c4a88b1b7-cni-binary-copy\") pod \"multus-additional-cni-plugins-kxv64\" (UID: \"e50007d2-ddf9-433f-b3ee-379c4a88b1b7\") " pod="openshift-multus/multus-additional-cni-plugins-kxv64"
Jul 21 01:22:23.358944 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.357235    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/965cd681-5974-4df4-b720-6c897b77b0d7-etc-systemd\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.358944 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.357278    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e50007d2-ddf9-433f-b3ee-379c4a88b1b7-cnibin\") pod \"multus-additional-cni-plugins-kxv64\" (UID: \"e50007d2-ddf9-433f-b3ee-379c4a88b1b7\") " pod="openshift-multus/multus-additional-cni-plugins-kxv64"
Jul 21 01:22:23.358944 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.357421    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-multus-cni-dir\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.358944 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.357464    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60320823-e00f-493d-b728-ca88376eec49-host-slash\") pod \"iptables-alerter-6l6ss\" (UID: \"60320823-e00f-493d-b728-ca88376eec49\") " pod="openshift-network-operator/iptables-alerter-6l6ss"
Jul 21 01:22:23.358944 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.357523    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e50007d2-ddf9-433f-b3ee-379c4a88b1b7-os-release\") pod \"multus-additional-cni-plugins-kxv64\" (UID: \"e50007d2-ddf9-433f-b3ee-379c4a88b1b7\") " pod="openshift-multus/multus-additional-cni-plugins-kxv64"
Jul 21 01:22:23.358944 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.357566    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-dbus\") pod \"global-pull-secret-syncer-hm4l8\" (UID: \"e1ad4368-cb38-4500-9a3c-9d3101bb3e09\") " pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:23.358944 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.357615    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-etc-openvswitch\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.358944 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.357655    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-host-run-netns\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.358944 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.357685    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/be9755bc-dbcf-4698-921c-88db5322a227-konnectivity-ca\") pod \"konnectivity-agent-pwgsm\" (UID: \"be9755bc-dbcf-4698-921c-88db5322a227\") " pod="kube-system/konnectivity-agent-pwgsm"
Jul 21 01:22:23.358944 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.357700    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-host-cni-bin\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.358944 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.357737    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/73b11732-583a-494b-82fc-44006012d82a-run-openvswitch\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.358944 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.357777    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-multus-socket-dir-parent\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.358944 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.358075    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/73b11732-583a-494b-82fc-44006012d82a-ovnkube-script-lib\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.358944 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.358276    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/73b11732-583a-494b-82fc-44006012d82a-ovnkube-config\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.359589 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.359220    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/73b11732-583a-494b-82fc-44006012d82a-ovn-node-metrics-cert\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.359589 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.359485    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/965cd681-5974-4df4-b720-6c897b77b0d7-tmp\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.359980 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.359959    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/965cd681-5974-4df4-b720-6c897b77b0d7-etc-tuned\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.362934 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.362897    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/be9755bc-dbcf-4698-921c-88db5322a227-agent-certs\") pod \"konnectivity-agent-pwgsm\" (UID: \"be9755bc-dbcf-4698-921c-88db5322a227\") " pod="kube-system/konnectivity-agent-pwgsm"
Jul 21 01:22:23.365228 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.365162    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4c88\" (UniqueName: \"kubernetes.io/projected/e50007d2-ddf9-433f-b3ee-379c4a88b1b7-kube-api-access-w4c88\") pod \"multus-additional-cni-plugins-kxv64\" (UID: \"e50007d2-ddf9-433f-b3ee-379c4a88b1b7\") " pod="openshift-multus/multus-additional-cni-plugins-kxv64"
Jul 21 01:22:23.365228 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.365205    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfwlz\" (UniqueName: \"kubernetes.io/projected/4c40807d-20bc-4fa8-957f-ef7712b7d745-kube-api-access-wfwlz\") pod \"network-metrics-daemon-p4bm8\" (UID: \"4c40807d-20bc-4fa8-957f-ef7712b7d745\") " pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:23.365582 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.365468    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhrmt\" (UniqueName: \"kubernetes.io/projected/b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83-kube-api-access-qhrmt\") pod \"multus-s8jbs\" (UID: \"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83\") " pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.365582 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.365560    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j659\" (UniqueName: \"kubernetes.io/projected/965cd681-5974-4df4-b720-6c897b77b0d7-kube-api-access-5j659\") pod \"tuned-lnnxc\" (UID: \"965cd681-5974-4df4-b720-6c897b77b0d7\") " pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.366284 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:23.366101    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:22:23.366284 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:23.366130    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:22:23.366284 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:23.366149    2586 projected.go:196] Error preparing data for projected volume kube-api-access-qvrqp for pod openshift-network-diagnostics/network-check-target-47x5c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:23.366284 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:23.366246    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ceb4edb3-7ef3-4281-89fa-3a92610353d1-kube-api-access-qvrqp podName:ceb4edb3-7ef3-4281-89fa-3a92610353d1 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:23.866208398 +0000 UTC m=+3.054247797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qvrqp" (UniqueName: "kubernetes.io/projected/ceb4edb3-7ef3-4281-89fa-3a92610353d1-kube-api-access-qvrqp") pod "network-check-target-47x5c" (UID: "ceb4edb3-7ef3-4281-89fa-3a92610353d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:23.369258 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.369231    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5m2r\" (UniqueName: \"kubernetes.io/projected/58d7de41-3645-4c8a-9250-e174e268c8e9-kube-api-access-z5m2r\") pod \"node-ca-66295\" (UID: \"58d7de41-3645-4c8a-9250-e174e268c8e9\") " pod="openshift-image-registry/node-ca-66295"
Jul 21 01:22:23.369374 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.369239    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhb5b\" (UniqueName: \"kubernetes.io/projected/4dc33e59-dee4-4993-aee2-95bf4940a36c-kube-api-access-rhb5b\") pod \"node-resolver-slkgx\" (UID: \"4dc33e59-dee4-4993-aee2-95bf4940a36c\") " pod="openshift-dns/node-resolver-slkgx"
Jul 21 01:22:23.369888 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.369868    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5qlr\" (UniqueName: \"kubernetes.io/projected/73b11732-583a-494b-82fc-44006012d82a-kube-api-access-c5qlr\") pod \"ovnkube-node-pxdmv\" (UID: \"73b11732-583a-494b-82fc-44006012d82a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.371417 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.371397    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h45ww\" (UniqueName: \"kubernetes.io/projected/60320823-e00f-493d-b728-ca88376eec49-kube-api-access-h45ww\") pod \"iptables-alerter-6l6ss\" (UID: \"60320823-e00f-493d-b728-ca88376eec49\") " pod="openshift-network-operator/iptables-alerter-6l6ss"
Jul 21 01:22:23.450195 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.450149    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg"
Jul 21 01:22:23.461753 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.461719    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-66295"
Jul 21 01:22:23.473030 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.472992    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6l6ss"
Jul 21 01:22:23.480243 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.480213    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:23.488536 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.488508    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pwgsm"
Jul 21 01:22:23.499707 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.499682    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kxv64"
Jul 21 01:22:23.508157 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.508134    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s8jbs"
Jul 21 01:22:23.527087 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.527048    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-slkgx"
Jul 21 01:22:23.534521 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.534494    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lnnxc"
Jul 21 01:22:23.642257 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.642162    2586 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 01:22:23.860952 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.860917    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-original-pull-secret\") pod \"global-pull-secret-syncer-hm4l8\" (UID: \"e1ad4368-cb38-4500-9a3c-9d3101bb3e09\") " pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:23.861146 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.861038    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c40807d-20bc-4fa8-957f-ef7712b7d745-metrics-certs\") pod \"network-metrics-daemon-p4bm8\" (UID: \"4c40807d-20bc-4fa8-957f-ef7712b7d745\") " pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:23.861146 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:23.861117    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:23.861146 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:23.861144    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:23.861266 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:23.861193    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c40807d-20bc-4fa8-957f-ef7712b7d745-metrics-certs podName:4c40807d-20bc-4fa8-957f-ef7712b7d745 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:24.861178311 +0000 UTC m=+4.049217694 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c40807d-20bc-4fa8-957f-ef7712b7d745-metrics-certs") pod "network-metrics-daemon-p4bm8" (UID: "4c40807d-20bc-4fa8-957f-ef7712b7d745") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:23.861266 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:23.861206    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-original-pull-secret podName:e1ad4368-cb38-4500-9a3c-9d3101bb3e09 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:24.861200141 +0000 UTC m=+4.049239511 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-original-pull-secret") pod "global-pull-secret-syncer-hm4l8" (UID: "e1ad4368-cb38-4500-9a3c-9d3101bb3e09") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:23.961763 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:23.961672    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvrqp\" (UniqueName: \"kubernetes.io/projected/ceb4edb3-7ef3-4281-89fa-3a92610353d1-kube-api-access-qvrqp\") pod \"network-check-target-47x5c\" (UID: \"ceb4edb3-7ef3-4281-89fa-3a92610353d1\") " pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:23.961927 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:23.961831    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:22:23.961927 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:23.961852    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:22:23.961927 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:23.961866    2586 projected.go:196] Error preparing data for projected volume kube-api-access-qvrqp for pod openshift-network-diagnostics/network-check-target-47x5c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:23.962129 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:23.961935    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ceb4edb3-7ef3-4281-89fa-3a92610353d1-kube-api-access-qvrqp podName:ceb4edb3-7ef3-4281-89fa-3a92610353d1 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:24.961915565 +0000 UTC m=+4.149954958 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qvrqp" (UniqueName: "kubernetes.io/projected/ceb4edb3-7ef3-4281-89fa-3a92610353d1-kube-api-access-qvrqp") pod "network-check-target-47x5c" (UID: "ceb4edb3-7ef3-4281-89fa-3a92610353d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:24.187648 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:24.187590    2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 01:17:23 +0000 UTC" deadline="2028-02-26 23:19:25.662349057 +0000 UTC"
Jul 21 01:22:24.187648 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:24.187637    2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14061h57m1.474715584s"
Jul 21 01:22:24.456260 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:24.456230    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60320823_e00f_493d_b728_ca88376eec49.slice/crio-deb4f76beb3a778ce25a3b4a599b06f63d2c91f227cec3e2f9c409b932f8974c WatchSource:0}: Error finding container deb4f76beb3a778ce25a3b4a599b06f63d2c91f227cec3e2f9c409b932f8974c: Status 404 returned error can't find the container with id deb4f76beb3a778ce25a3b4a599b06f63d2c91f227cec3e2f9c409b932f8974c
Jul 21 01:22:24.458265 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:24.458215    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58d7de41_3645_4c8a_9250_e174e268c8e9.slice/crio-1075ddc5ab36b6aaaef7b0485b91ee0fe0489abbbe30b4023d8cf714f708eb1a WatchSource:0}: Error finding container 1075ddc5ab36b6aaaef7b0485b91ee0fe0489abbbe30b4023d8cf714f708eb1a: Status 404 returned error can't find the container with id 1075ddc5ab36b6aaaef7b0485b91ee0fe0489abbbe30b4023d8cf714f708eb1a
Jul 21 01:22:24.461643 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:24.461618    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode50007d2_ddf9_433f_b3ee_379c4a88b1b7.slice/crio-95374b56816990f8fadf3e565053861740454f89d43dca08ffdba57afa3adff5 WatchSource:0}: Error finding container 95374b56816990f8fadf3e565053861740454f89d43dca08ffdba57afa3adff5: Status 404 returned error can't find the container with id 95374b56816990f8fadf3e565053861740454f89d43dca08ffdba57afa3adff5
Jul 21 01:22:24.465288 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:24.465244    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73b11732_583a_494b_82fc_44006012d82a.slice/crio-d0f35248d7d311611f2ea11a7d00d662ca49993dc5a2eb7b9f7c141b21180725 WatchSource:0}: Error finding container d0f35248d7d311611f2ea11a7d00d662ca49993dc5a2eb7b9f7c141b21180725: Status 404 returned error can't find the container with id d0f35248d7d311611f2ea11a7d00d662ca49993dc5a2eb7b9f7c141b21180725
Jul 21 01:22:24.472669 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:24.472090    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb525b4f3_47fe_4d16_b2bc_d8ce41ea6c83.slice/crio-85ec905d8d2a95221d0e9a94bd46a38af4e031656356cd75098e13616b0c946e WatchSource:0}: Error finding container 85ec905d8d2a95221d0e9a94bd46a38af4e031656356cd75098e13616b0c946e: Status 404 returned error can't find the container with id 85ec905d8d2a95221d0e9a94bd46a38af4e031656356cd75098e13616b0c946e
Jul 21 01:22:24.474097 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:22:24.473808    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe9755bc_dbcf_4698_921c_88db5322a227.slice/crio-fd191d88306ba43540d74f702c1e183fdc79dcfaa1de4715317416409dfb0e90 WatchSource:0}: Error finding container fd191d88306ba43540d74f702c1e183fdc79dcfaa1de4715317416409dfb0e90: Status 404 returned error can't find the container with id fd191d88306ba43540d74f702c1e183fdc79dcfaa1de4715317416409dfb0e90
Jul 21 01:22:24.869254 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:24.869051    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-original-pull-secret\") pod \"global-pull-secret-syncer-hm4l8\" (UID: \"e1ad4368-cb38-4500-9a3c-9d3101bb3e09\") " pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:24.869411 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:24.869267    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c40807d-20bc-4fa8-957f-ef7712b7d745-metrics-certs\") pod \"network-metrics-daemon-p4bm8\" (UID: \"4c40807d-20bc-4fa8-957f-ef7712b7d745\") " pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:24.869411 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:24.869229    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:24.869411 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:24.869394    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:24.869560 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:24.869399    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-original-pull-secret podName:e1ad4368-cb38-4500-9a3c-9d3101bb3e09 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:26.869380861 +0000 UTC m=+6.057420244 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-original-pull-secret") pod "global-pull-secret-syncer-hm4l8" (UID: "e1ad4368-cb38-4500-9a3c-9d3101bb3e09") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:24.869560 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:24.869447    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c40807d-20bc-4fa8-957f-ef7712b7d745-metrics-certs podName:4c40807d-20bc-4fa8-957f-ef7712b7d745 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:26.869434793 +0000 UTC m=+6.057474161 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c40807d-20bc-4fa8-957f-ef7712b7d745-metrics-certs") pod "network-metrics-daemon-p4bm8" (UID: "4c40807d-20bc-4fa8-957f-ef7712b7d745") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:24.970822 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:24.970735    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvrqp\" (UniqueName: \"kubernetes.io/projected/ceb4edb3-7ef3-4281-89fa-3a92610353d1-kube-api-access-qvrqp\") pod \"network-check-target-47x5c\" (UID: \"ceb4edb3-7ef3-4281-89fa-3a92610353d1\") " pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:24.971098 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:24.971071    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:22:24.971098 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:24.971098    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:22:24.971304 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:24.971115    2586 projected.go:196] Error preparing data for projected volume kube-api-access-qvrqp for pod openshift-network-diagnostics/network-check-target-47x5c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:24.971304 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:24.971213    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ceb4edb3-7ef3-4281-89fa-3a92610353d1-kube-api-access-qvrqp podName:ceb4edb3-7ef3-4281-89fa-3a92610353d1 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:26.971190683 +0000 UTC m=+6.159230072 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qvrqp" (UniqueName: "kubernetes.io/projected/ceb4edb3-7ef3-4281-89fa-3a92610353d1-kube-api-access-qvrqp") pod "network-check-target-47x5c" (UID: "ceb4edb3-7ef3-4281-89fa-3a92610353d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:25.188313 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:25.188209    2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 01:17:23 +0000 UTC" deadline="2028-01-06 16:00:19.923642547 +0000 UTC"
Jul 21 01:22:25.188313 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:25.188278    2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12830h37m54.735369504s"
Jul 21 01:22:25.305004 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:25.304152    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:25.305004 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:25.304293    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:22:25.305004 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:25.304727    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:25.305004 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:25.304846    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:22:25.305360 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:25.305052    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:25.305360 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:25.305164    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:22:25.318194 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:25.318106    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6l6ss" event={"ID":"60320823-e00f-493d-b728-ca88376eec49","Type":"ContainerStarted","Data":"deb4f76beb3a778ce25a3b4a599b06f63d2c91f227cec3e2f9c409b932f8974c"}
Jul 21 01:22:25.320778 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:25.320691    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg" event={"ID":"636c14e3-44d1-468c-a96e-63d84877660b","Type":"ContainerStarted","Data":"f6abca7332ce006f755c706f56b8678f5175a971de3e942f71e1f7606b788a64"}
Jul 21 01:22:25.333081 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:25.332730    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-213.ec2.internal" event={"ID":"a9e90f2c5cc33581ed2c58ee5030092f","Type":"ContainerStarted","Data":"a1b00d8b4868360f250654005edd17dff17e81d041295a83f336427067eaa56c"}
Jul 21 01:22:25.344047 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:25.343981    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lnnxc" event={"ID":"965cd681-5974-4df4-b720-6c897b77b0d7","Type":"ContainerStarted","Data":"760f8357775574664746525b980af6e9fe23209e66fb689a797c51a98b03a0e9"}
Jul 21 01:22:25.347628 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:25.347539    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-213.ec2.internal" podStartSLOduration=2.34751622 podStartE2EDuration="2.34751622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:25.347355881 +0000 UTC m=+4.535395275" watchObservedRunningTime="2026-07-21 01:22:25.34751622 +0000 UTC m=+4.535555618"
Jul 21 01:22:25.384506 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:25.384327    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv" event={"ID":"73b11732-583a-494b-82fc-44006012d82a","Type":"ContainerStarted","Data":"d0f35248d7d311611f2ea11a7d00d662ca49993dc5a2eb7b9f7c141b21180725"}
Jul 21 01:22:25.387134 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:25.387098    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s8jbs" event={"ID":"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83","Type":"ContainerStarted","Data":"85ec905d8d2a95221d0e9a94bd46a38af4e031656356cd75098e13616b0c946e"}
Jul 21 01:22:25.390773 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:25.390742    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-slkgx" event={"ID":"4dc33e59-dee4-4993-aee2-95bf4940a36c","Type":"ContainerStarted","Data":"853c0035396de5e39d0d15cf2820adbce305f8338943500b5d3c6a2eb335a440"}
Jul 21 01:22:25.397774 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:25.397736    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-66295" event={"ID":"58d7de41-3645-4c8a-9250-e174e268c8e9","Type":"ContainerStarted","Data":"1075ddc5ab36b6aaaef7b0485b91ee0fe0489abbbe30b4023d8cf714f708eb1a"}
Jul 21 01:22:25.402070 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:25.402034    2586 generic.go:356] "Generic (PLEG): container finished" podID="4ed18834709c390e953a40e1ad5f528c" containerID="038d513b1fd2049da523dc1ee6df638696efda346d2963c2c3dc93ced9239e7d" exitCode=0
Jul 21 01:22:25.402255 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:25.402133    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal" event={"ID":"4ed18834709c390e953a40e1ad5f528c","Type":"ContainerDied","Data":"038d513b1fd2049da523dc1ee6df638696efda346d2963c2c3dc93ced9239e7d"}
Jul 21 01:22:25.425615 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:25.425574    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pwgsm" event={"ID":"be9755bc-dbcf-4698-921c-88db5322a227","Type":"ContainerStarted","Data":"fd191d88306ba43540d74f702c1e183fdc79dcfaa1de4715317416409dfb0e90"}
Jul 21 01:22:25.441053 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:25.440993    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kxv64" event={"ID":"e50007d2-ddf9-433f-b3ee-379c4a88b1b7","Type":"ContainerStarted","Data":"95374b56816990f8fadf3e565053861740454f89d43dca08ffdba57afa3adff5"}
Jul 21 01:22:26.463677 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:26.463636    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal" event={"ID":"4ed18834709c390e953a40e1ad5f528c","Type":"ContainerStarted","Data":"217effc467acbefadb61c2d48a1add071f1474f4eb464478934b171dd5cfd088"}
Jul 21 01:22:26.478147 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:26.478079    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal" podStartSLOduration=3.478053322 podStartE2EDuration="3.478053322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:26.478052769 +0000 UTC m=+5.666092165" watchObservedRunningTime="2026-07-21 01:22:26.478053322 +0000 UTC m=+5.666092711"
Jul 21 01:22:26.892239 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:26.891482    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-original-pull-secret\") pod \"global-pull-secret-syncer-hm4l8\" (UID: \"e1ad4368-cb38-4500-9a3c-9d3101bb3e09\") " pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:26.892239 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:26.891523    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c40807d-20bc-4fa8-957f-ef7712b7d745-metrics-certs\") pod \"network-metrics-daemon-p4bm8\" (UID: \"4c40807d-20bc-4fa8-957f-ef7712b7d745\") " pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:26.892239 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:26.891644    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:26.892239 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:26.891715    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c40807d-20bc-4fa8-957f-ef7712b7d745-metrics-certs podName:4c40807d-20bc-4fa8-957f-ef7712b7d745 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:30.891692865 +0000 UTC m=+10.079732260 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c40807d-20bc-4fa8-957f-ef7712b7d745-metrics-certs") pod "network-metrics-daemon-p4bm8" (UID: "4c40807d-20bc-4fa8-957f-ef7712b7d745") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:26.892239 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:26.892069    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:26.892239 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:26.892126    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-original-pull-secret podName:e1ad4368-cb38-4500-9a3c-9d3101bb3e09 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:30.892107638 +0000 UTC m=+10.080147023 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-original-pull-secret") pod "global-pull-secret-syncer-hm4l8" (UID: "e1ad4368-cb38-4500-9a3c-9d3101bb3e09") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:26.992396 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:26.992357    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvrqp\" (UniqueName: \"kubernetes.io/projected/ceb4edb3-7ef3-4281-89fa-3a92610353d1-kube-api-access-qvrqp\") pod \"network-check-target-47x5c\" (UID: \"ceb4edb3-7ef3-4281-89fa-3a92610353d1\") " pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:26.992603 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:26.992565    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:22:26.992603 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:26.992588    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:22:26.992717 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:26.992607    2586 projected.go:196] Error preparing data for projected volume kube-api-access-qvrqp for pod openshift-network-diagnostics/network-check-target-47x5c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:26.992717 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:26.992689    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ceb4edb3-7ef3-4281-89fa-3a92610353d1-kube-api-access-qvrqp podName:ceb4edb3-7ef3-4281-89fa-3a92610353d1 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:30.992667379 +0000 UTC m=+10.180706762 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qvrqp" (UniqueName: "kubernetes.io/projected/ceb4edb3-7ef3-4281-89fa-3a92610353d1-kube-api-access-qvrqp") pod "network-check-target-47x5c" (UID: "ceb4edb3-7ef3-4281-89fa-3a92610353d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:27.305828 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:27.305121    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:27.305828 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:27.305172    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:27.305828 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:27.305121    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:27.305828 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:27.305271    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:22:27.305828 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:27.305430    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:22:27.305828 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:27.305539    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:22:29.303200 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:29.303168    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:29.303661 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:29.303181    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:29.303661 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:29.303274    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:22:29.303661 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:29.303409    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:22:29.303661 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:29.303558    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:29.303661 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:29.303636    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:22:30.927068 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:30.927033    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-original-pull-secret\") pod \"global-pull-secret-syncer-hm4l8\" (UID: \"e1ad4368-cb38-4500-9a3c-9d3101bb3e09\") " pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:30.927068 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:30.927083    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c40807d-20bc-4fa8-957f-ef7712b7d745-metrics-certs\") pod \"network-metrics-daemon-p4bm8\" (UID: \"4c40807d-20bc-4fa8-957f-ef7712b7d745\") " pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:30.927562 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:30.927202    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:30.927562 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:30.927285    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-original-pull-secret podName:e1ad4368-cb38-4500-9a3c-9d3101bb3e09 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:38.92725967 +0000 UTC m=+18.115299037 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-original-pull-secret") pod "global-pull-secret-syncer-hm4l8" (UID: "e1ad4368-cb38-4500-9a3c-9d3101bb3e09") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:30.927562 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:30.927206    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:30.927562 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:30.927529    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c40807d-20bc-4fa8-957f-ef7712b7d745-metrics-certs podName:4c40807d-20bc-4fa8-957f-ef7712b7d745 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:38.927507301 +0000 UTC m=+18.115546693 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c40807d-20bc-4fa8-957f-ef7712b7d745-metrics-certs") pod "network-metrics-daemon-p4bm8" (UID: "4c40807d-20bc-4fa8-957f-ef7712b7d745") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:31.028218 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:31.028095    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvrqp\" (UniqueName: \"kubernetes.io/projected/ceb4edb3-7ef3-4281-89fa-3a92610353d1-kube-api-access-qvrqp\") pod \"network-check-target-47x5c\" (UID: \"ceb4edb3-7ef3-4281-89fa-3a92610353d1\") " pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:31.028383 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:31.028261    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:22:31.028383 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:31.028281    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:22:31.028383 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:31.028291    2586 projected.go:196] Error preparing data for projected volume kube-api-access-qvrqp for pod openshift-network-diagnostics/network-check-target-47x5c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:31.028383 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:31.028349    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ceb4edb3-7ef3-4281-89fa-3a92610353d1-kube-api-access-qvrqp podName:ceb4edb3-7ef3-4281-89fa-3a92610353d1 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:39.028333555 +0000 UTC m=+18.216372923 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qvrqp" (UniqueName: "kubernetes.io/projected/ceb4edb3-7ef3-4281-89fa-3a92610353d1-kube-api-access-qvrqp") pod "network-check-target-47x5c" (UID: "ceb4edb3-7ef3-4281-89fa-3a92610353d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:31.304083 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:31.303546    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:31.304083 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:31.303559    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:31.304083 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:31.303559    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:31.304083 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:31.303675    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:22:31.304083 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:31.303812    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:22:31.304083 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:31.303894    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:22:33.303964 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:33.303103    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:33.303964 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:33.303177    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:33.303964 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:33.303193    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:33.303964 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:33.303297    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:22:33.303964 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:33.303718    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:22:33.303964 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:33.303841    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:22:35.302993 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:35.302954    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:35.303442 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:35.303008    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:35.303442 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:35.302954    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:35.303442 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:35.303099    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:22:35.303442 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:35.303197    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:22:35.303442 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:35.303310    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:22:37.303388 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:37.303347    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:37.303783 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:37.303347    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:37.303783 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:37.303489    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:22:37.303783 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:37.303583    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:22:37.303783 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:37.303357    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:37.303783 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:37.303682    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:22:38.995248 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:38.995212    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-original-pull-secret\") pod \"global-pull-secret-syncer-hm4l8\" (UID: \"e1ad4368-cb38-4500-9a3c-9d3101bb3e09\") " pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:38.995248 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:38.995255    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c40807d-20bc-4fa8-957f-ef7712b7d745-metrics-certs\") pod \"network-metrics-daemon-p4bm8\" (UID: \"4c40807d-20bc-4fa8-957f-ef7712b7d745\") " pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:38.995870 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:38.995383    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:38.995870 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:38.995391    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:38.995870 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:38.995444    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c40807d-20bc-4fa8-957f-ef7712b7d745-metrics-certs podName:4c40807d-20bc-4fa8-957f-ef7712b7d745 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:54.995425604 +0000 UTC m=+34.183464973 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c40807d-20bc-4fa8-957f-ef7712b7d745-metrics-certs") pod "network-metrics-daemon-p4bm8" (UID: "4c40807d-20bc-4fa8-957f-ef7712b7d745") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:38.995870 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:38.995458    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-original-pull-secret podName:e1ad4368-cb38-4500-9a3c-9d3101bb3e09 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:54.995452453 +0000 UTC m=+34.183491821 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-original-pull-secret") pod "global-pull-secret-syncer-hm4l8" (UID: "e1ad4368-cb38-4500-9a3c-9d3101bb3e09") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:39.096333 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:39.096298    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvrqp\" (UniqueName: \"kubernetes.io/projected/ceb4edb3-7ef3-4281-89fa-3a92610353d1-kube-api-access-qvrqp\") pod \"network-check-target-47x5c\" (UID: \"ceb4edb3-7ef3-4281-89fa-3a92610353d1\") " pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:39.096516 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:39.096443    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:22:39.096516 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:39.096469    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:22:39.096516 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:39.096482    2586 projected.go:196] Error preparing data for projected volume kube-api-access-qvrqp for pod openshift-network-diagnostics/network-check-target-47x5c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:39.096671 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:39.096542    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ceb4edb3-7ef3-4281-89fa-3a92610353d1-kube-api-access-qvrqp podName:ceb4edb3-7ef3-4281-89fa-3a92610353d1 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:55.096524177 +0000 UTC m=+34.284563564 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qvrqp" (UniqueName: "kubernetes.io/projected/ceb4edb3-7ef3-4281-89fa-3a92610353d1-kube-api-access-qvrqp") pod "network-check-target-47x5c" (UID: "ceb4edb3-7ef3-4281-89fa-3a92610353d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:39.303027 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:39.302922    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:39.303027 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:39.302992    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:39.303221 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:39.302929    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:39.303221 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:39.303076    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:22:39.303221 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:39.303187    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:22:39.303355 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:39.303273    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:22:41.304242 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:41.304192    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:41.304699 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:41.304401    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:41.304699 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:41.304436    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:41.304699 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:41.304425    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:22:41.304699 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:41.304584    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:22:41.304699 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:41.304670    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:22:43.303967 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:43.302587    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:43.303967 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:43.302599    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:43.303967 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:43.302728    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:22:43.303967 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:43.302772    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:43.303967 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:43.302898    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:22:43.303967 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:43.303015    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:22:44.502064 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:44.501747    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lnnxc" event={"ID":"965cd681-5974-4df4-b720-6c897b77b0d7","Type":"ContainerStarted","Data":"0c8974df5ca68f6443b29efac440211a5106f422375cc3edec33394090fea086"}
Jul 21 01:22:44.506057 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:44.506024    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv" event={"ID":"73b11732-583a-494b-82fc-44006012d82a","Type":"ContainerStarted","Data":"5ac996a22f7f99438c8930af50e28f4a914252d5247e5053ba9f38314a3258f4"}
Jul 21 01:22:44.506232 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:44.506116    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv" event={"ID":"73b11732-583a-494b-82fc-44006012d82a","Type":"ContainerStarted","Data":"6aae55b52b63a6905e508425cfeb5f43f06d9e76470a0ebfb0d3d9f1493f120f"}
Jul 21 01:22:44.506232 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:44.506164    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv" event={"ID":"73b11732-583a-494b-82fc-44006012d82a","Type":"ContainerStarted","Data":"5ba49046614a8da6971f0af93fa9853386030d4dcfdfbfafc511bbe1cd7f09ce"}
Jul 21 01:22:44.506232 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:44.506202    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv" event={"ID":"73b11732-583a-494b-82fc-44006012d82a","Type":"ContainerStarted","Data":"4f37c5fa03db1c05b90213010008fc1f053f45dc9cc035853dcbae3199d15f8f"}
Jul 21 01:22:44.506395 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:44.506251    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv" event={"ID":"73b11732-583a-494b-82fc-44006012d82a","Type":"ContainerStarted","Data":"2bae4c89caf74821c8908cdb007a870a0a325b1c45125f89ef6163c17a63b096"}
Jul 21 01:22:44.506395 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:44.506292    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv" event={"ID":"73b11732-583a-494b-82fc-44006012d82a","Type":"ContainerStarted","Data":"ae5d174af68de0c478165371afbac93ca548ba166f0ef4bdfce752f5c340db41"}
Jul 21 01:22:44.507677 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:44.507626    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s8jbs" event={"ID":"b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83","Type":"ContainerStarted","Data":"59a3df5256ded561bb796de8ae63f33380842f64d884a83637d93363a6343df7"}
Jul 21 01:22:44.509562 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:44.509286    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-slkgx" event={"ID":"4dc33e59-dee4-4993-aee2-95bf4940a36c","Type":"ContainerStarted","Data":"4ea2a31a8313ff96e6ec6a9188b3cb67ab8e41db7d78464252c32eee6c71ed0f"}
Jul 21 01:22:44.510898 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:44.510870    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-66295" event={"ID":"58d7de41-3645-4c8a-9250-e174e268c8e9","Type":"ContainerStarted","Data":"9a2cfb84a2d6ffb9cc9b86d0616a59336580a46997428710b9910a3b3c942558"}
Jul 21 01:22:44.512618 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:44.512591    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pwgsm" event={"ID":"be9755bc-dbcf-4698-921c-88db5322a227","Type":"ContainerStarted","Data":"e19db27a80abfcccc313fea8aa324e8c9bcf6265c1452dfa37e0dc8bd5979424"}
Jul 21 01:22:44.516696 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:44.514318    2586 generic.go:356] "Generic (PLEG): container finished" podID="e50007d2-ddf9-433f-b3ee-379c4a88b1b7" containerID="15d6dccf4607dd91f73382d075fcdb07bee7a1d753951a858689718f8883dda9" exitCode=0
Jul 21 01:22:44.516696 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:44.514403    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kxv64" event={"ID":"e50007d2-ddf9-433f-b3ee-379c4a88b1b7","Type":"ContainerDied","Data":"15d6dccf4607dd91f73382d075fcdb07bee7a1d753951a858689718f8883dda9"}
Jul 21 01:22:44.516696 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:44.516137    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg" event={"ID":"636c14e3-44d1-468c-a96e-63d84877660b","Type":"ContainerStarted","Data":"5f013b1f8bae18d9855fb24de1d095419632c5a907697e7e42b6ae519bcf847d"}
Jul 21 01:22:44.518339 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:44.518284    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lnnxc" podStartSLOduration=4.193229806 podStartE2EDuration="23.518266339s" totalImagesPullingTime="19.325036533s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:44.517558932 +0000 UTC m=+23.705598321" watchObservedRunningTime="2026-07-21 01:22:44.518266339 +0000 UTC m=+23.706305730"
Jul 21 01:22:44.530084 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:44.530035    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-slkgx" podStartSLOduration=4.205202517 podStartE2EDuration="23.53001793s" totalImagesPullingTime="19.324815413s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:44.529342826 +0000 UTC m=+23.717382217" watchObservedRunningTime="2026-07-21 01:22:44.53001793 +0000 UTC m=+23.718057320"
Jul 21 01:22:44.545146 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:44.545095    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-66295" podStartSLOduration=4.207604484 podStartE2EDuration="23.545077571s" totalImagesPullingTime="19.337473087s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:44.545047277 +0000 UTC m=+23.733086704" watchObservedRunningTime="2026-07-21 01:22:44.545077571 +0000 UTC m=+23.733116960"
Jul 21 01:22:44.558656 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:44.558566    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pwgsm" podStartSLOduration=12.27222034 podStartE2EDuration="23.558548406s" totalImagesPullingTime="11.286328066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:44.557853906 +0000 UTC m=+23.745893298" watchObservedRunningTime="2026-07-21 01:22:44.558548406 +0000 UTC m=+23.746587822"
Jul 21 01:22:44.593926 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:44.593857    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-s8jbs" podStartSLOduration=4.211907604 podStartE2EDuration="23.593839836s" totalImagesPullingTime="19.381932232s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:44.593321004 +0000 UTC m=+23.781360394" watchObservedRunningTime="2026-07-21 01:22:44.593839836 +0000 UTC m=+23.781879225"
Jul 21 01:22:45.288211 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:45.288177    2586 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 01:22:45.302830 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:45.302802    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:45.302830 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:45.302821    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:45.303165 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:45.302802    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:45.303165 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:45.302952    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:22:45.303165 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:45.303045    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:22:45.303281 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:45.303161    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:22:45.520580 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:45.520492    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6l6ss" event={"ID":"60320823-e00f-493d-b728-ca88376eec49","Type":"ContainerStarted","Data":"52ace04180288a39706766bedd7f77548e2e87221f332c220bb2640d9915c096"}
Jul 21 01:22:45.522855 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:45.522806    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg" event={"ID":"636c14e3-44d1-468c-a96e-63d84877660b","Type":"ContainerStarted","Data":"458014b495b078d2143f605abdbce4e855152d300c880c58c7088a20198fa32f"}
Jul 21 01:22:45.534088 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:45.534034    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6l6ss" podStartSLOduration=13.22799235 podStartE2EDuration="24.534016471s" totalImagesPullingTime="11.306024121s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:45.533971259 +0000 UTC m=+24.722010649" watchObservedRunningTime="2026-07-21 01:22:45.534016471 +0000 UTC m=+24.722055905"
Jul 21 01:22:46.209032 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:46.208910    2586 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T01:22:45.28820087Z","UUID":"563b5755-3943-4453-94a2-c9a629c24072","Handler":null,"Name":"","Endpoint":""}
Jul 21 01:22:46.210690 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:46.210665    2586 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 01:22:46.210845 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:46.210713    2586 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 01:22:46.532396 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:46.532359    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg" event={"ID":"636c14e3-44d1-468c-a96e-63d84877660b","Type":"ContainerStarted","Data":"6eec7a6f09315eeaf4b6532e7fa3d23e288b4c36c59df4767a20a249d6ad2236"}
Jul 21 01:22:46.548803 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:46.548735    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2kntg" podStartSLOduration=3.952782182 podStartE2EDuration="25.548711843s" totalImagesPullingTime="21.595929661s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:46.548168609 +0000 UTC m=+25.736208022" watchObservedRunningTime="2026-07-21 01:22:46.548711843 +0000 UTC m=+25.736751236"
Jul 21 01:22:47.302918 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:47.302730    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:47.303128 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:47.302730    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:47.303128 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:47.303029    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:22:47.303128 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:47.302738    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:47.303128 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:47.303096    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:22:47.303347 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:47.303166    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:22:47.540092 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:47.540044    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv" event={"ID":"73b11732-583a-494b-82fc-44006012d82a","Type":"ContainerStarted","Data":"d8e9e34911bc1894855c02956ad90a30e3d24d79966b9bba86b9435654b63b3a"}
Jul 21 01:22:47.878328 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:47.878291    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pwgsm"
Jul 21 01:22:47.878973 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:47.878930    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pwgsm"
Jul 21 01:22:48.542249 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:48.542223    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pwgsm"
Jul 21 01:22:48.542779 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:48.542700    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pwgsm"
Jul 21 01:22:49.303354 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:49.303313    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:49.303649 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:49.303324    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:49.303649 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:49.303429    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:22:49.303649 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:49.303463    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:49.303649 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:49.303581    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:22:49.303822 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:49.303665    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:22:49.549612 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:49.549355    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv" event={"ID":"73b11732-583a-494b-82fc-44006012d82a","Type":"ContainerStarted","Data":"f28cd034810cc79195d7e8654e2d76ffdc65b6f1243f80c1c80aa0d1309c4eaa"}
Jul 21 01:22:49.573412 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:49.573362    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv" podStartSLOduration=9.184696543 podStartE2EDuration="28.573345549s" totalImagesPullingTime="19.388649006s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:49.57282634 +0000 UTC m=+28.760865743" watchObservedRunningTime="2026-07-21 01:22:49.573345549 +0000 UTC m=+28.761385026"
Jul 21 01:22:50.553411 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:50.553377    2586 generic.go:356] "Generic (PLEG): container finished" podID="e50007d2-ddf9-433f-b3ee-379c4a88b1b7" containerID="b436a99e870e152b67d41fa317d990c263dc81d46cea83e4b51376d971c36e95" exitCode=0
Jul 21 01:22:50.554015 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:50.553465    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kxv64" event={"ID":"e50007d2-ddf9-433f-b3ee-379c4a88b1b7","Type":"ContainerDied","Data":"b436a99e870e152b67d41fa317d990c263dc81d46cea83e4b51376d971c36e95"}
Jul 21 01:22:50.554015 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:50.553664    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:50.554015 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:50.553734    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:50.556358 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:50.556097    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:50.571398 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:50.571371    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:50.573498 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:50.573472    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:22:51.303135 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:51.303101    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:51.303423 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:51.303213    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:22:51.303423 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:51.303226    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:51.303423 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:51.303240    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:51.303423 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:51.303373    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:22:51.303609 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:51.303423    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:22:51.641518 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:51.641335    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hm4l8"]
Jul 21 01:22:51.641818 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:51.641597    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:51.641818 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:51.641683    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:22:51.646069 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:51.645996    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p4bm8"]
Jul 21 01:22:51.646214 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:51.646152    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:51.646327 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:51.646304    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:22:51.646634 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:51.646607    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-47x5c"]
Jul 21 01:22:51.646909 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:51.646699    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:51.646909 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:51.646792    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:22:52.008663 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:52.008635    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-slkgx_4dc33e59-dee4-4993-aee2-95bf4940a36c/dns-node-resolver/0.log"
Jul 21 01:22:52.539619 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:52.539588    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-66295_58d7de41-3645-4c8a-9250-e174e268c8e9/node-ca/0.log"
Jul 21 01:22:52.560402 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:52.560373    2586 generic.go:356] "Generic (PLEG): container finished" podID="e50007d2-ddf9-433f-b3ee-379c4a88b1b7" containerID="ece85b5d27988fd9b52395b97edc7edfef756fe654fbe16129ae9c1bb7d3a442" exitCode=0
Jul 21 01:22:52.560556 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:52.560460    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kxv64" event={"ID":"e50007d2-ddf9-433f-b3ee-379c4a88b1b7","Type":"ContainerDied","Data":"ece85b5d27988fd9b52395b97edc7edfef756fe654fbe16129ae9c1bb7d3a442"}
Jul 21 01:22:53.302492 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:53.302459    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:53.303043 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:53.302467    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:53.303043 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:53.302563    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:22:53.303043 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:53.302582    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:53.303043 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:53.302690    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:22:53.303043 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:53.302780    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:22:53.565355 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:53.565323    2586 generic.go:356] "Generic (PLEG): container finished" podID="e50007d2-ddf9-433f-b3ee-379c4a88b1b7" containerID="64cbc1303f95d97293cb7ad27fee6f57b6331d9b82ab6df97ed0b7810a425b1e" exitCode=0
Jul 21 01:22:53.565513 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:53.565365    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kxv64" event={"ID":"e50007d2-ddf9-433f-b3ee-379c4a88b1b7","Type":"ContainerDied","Data":"64cbc1303f95d97293cb7ad27fee6f57b6331d9b82ab6df97ed0b7810a425b1e"}
Jul 21 01:22:55.014013 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:55.013974    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-original-pull-secret\") pod \"global-pull-secret-syncer-hm4l8\" (UID: \"e1ad4368-cb38-4500-9a3c-9d3101bb3e09\") " pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:55.014013 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:55.014021    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c40807d-20bc-4fa8-957f-ef7712b7d745-metrics-certs\") pod \"network-metrics-daemon-p4bm8\" (UID: \"4c40807d-20bc-4fa8-957f-ef7712b7d745\") " pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:55.014692 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:55.014138    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:55.014692 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:55.014143    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:55.014692 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:55.014202    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c40807d-20bc-4fa8-957f-ef7712b7d745-metrics-certs podName:4c40807d-20bc-4fa8-957f-ef7712b7d745 nodeName:}" failed. No retries permitted until 2026-07-21 01:23:27.014185228 +0000 UTC m=+66.202224596 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c40807d-20bc-4fa8-957f-ef7712b7d745-metrics-certs") pod "network-metrics-daemon-p4bm8" (UID: "4c40807d-20bc-4fa8-957f-ef7712b7d745") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:55.014692 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:55.014226    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-original-pull-secret podName:e1ad4368-cb38-4500-9a3c-9d3101bb3e09 nodeName:}" failed. No retries permitted until 2026-07-21 01:23:27.014208784 +0000 UTC m=+66.202248157 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-original-pull-secret") pod "global-pull-secret-syncer-hm4l8" (UID: "e1ad4368-cb38-4500-9a3c-9d3101bb3e09") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:55.115324 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:55.115290    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvrqp\" (UniqueName: \"kubernetes.io/projected/ceb4edb3-7ef3-4281-89fa-3a92610353d1-kube-api-access-qvrqp\") pod \"network-check-target-47x5c\" (UID: \"ceb4edb3-7ef3-4281-89fa-3a92610353d1\") " pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:55.115498 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:55.115438    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:22:55.115498 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:55.115458    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:22:55.115498 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:55.115470    2586 projected.go:196] Error preparing data for projected volume kube-api-access-qvrqp for pod openshift-network-diagnostics/network-check-target-47x5c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:55.115648 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:55.115530    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ceb4edb3-7ef3-4281-89fa-3a92610353d1-kube-api-access-qvrqp podName:ceb4edb3-7ef3-4281-89fa-3a92610353d1 nodeName:}" failed. No retries permitted until 2026-07-21 01:23:27.115511531 +0000 UTC m=+66.303550898 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qvrqp" (UniqueName: "kubernetes.io/projected/ceb4edb3-7ef3-4281-89fa-3a92610353d1-kube-api-access-qvrqp") pod "network-check-target-47x5c" (UID: "ceb4edb3-7ef3-4281-89fa-3a92610353d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:55.302962 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:55.302864    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:55.302962 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:55.302906    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:55.303170 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:55.302864    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:55.303170 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:55.303025    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:22:55.303170 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:55.303135    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:22:55.303323 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:55.303213    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:22:57.302600 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:57.302561    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:57.303046 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:57.302683    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:57.303046 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:57.302695    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:22:57.303046 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:57.302786    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:22:57.303046 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:57.302569    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:57.303046 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:57.302870    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:22:58.578625 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:58.578544    2586 generic.go:356] "Generic (PLEG): container finished" podID="e50007d2-ddf9-433f-b3ee-379c4a88b1b7" containerID="d547235d8217ea6f887dba66ffe58d09d612b888e6102d4f7b7f48189991e702" exitCode=0
Jul 21 01:22:58.578625 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:58.578602    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kxv64" event={"ID":"e50007d2-ddf9-433f-b3ee-379c4a88b1b7","Type":"ContainerDied","Data":"d547235d8217ea6f887dba66ffe58d09d612b888e6102d4f7b7f48189991e702"}
Jul 21 01:22:59.302454 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:59.302420    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:22:59.302643 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:59.302420    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:22:59.302643 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:59.302553    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:22:59.302643 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:59.302420    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:22:59.302643 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:59.302622    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:22:59.302851 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:22:59.302686    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:22:59.584471 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:59.584374    2586 generic.go:356] "Generic (PLEG): container finished" podID="e50007d2-ddf9-433f-b3ee-379c4a88b1b7" containerID="7d8f49b88884a1eed1034770467d42d379a46259f66e4860ae8a79bc55bc66c4" exitCode=0
Jul 21 01:22:59.584471 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:22:59.584445    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kxv64" event={"ID":"e50007d2-ddf9-433f-b3ee-379c4a88b1b7","Type":"ContainerDied","Data":"7d8f49b88884a1eed1034770467d42d379a46259f66e4860ae8a79bc55bc66c4"}
Jul 21 01:23:00.590801 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:00.590591    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kxv64" event={"ID":"e50007d2-ddf9-433f-b3ee-379c4a88b1b7","Type":"ContainerStarted","Data":"4990ffb3c10b1631596358ce1bb9ea260d969c90f5244ad917e1370ad0679b3a"}
Jul 21 01:23:00.610776 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:00.610725    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kxv64" podStartSLOduration=8.848681468 podStartE2EDuration="39.610710781s" totalImagesPullingTime="30.762029313s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:00.610491113 +0000 UTC m=+39.798530503" watchObservedRunningTime="2026-07-21 01:23:00.610710781 +0000 UTC m=+39.798750170"
Jul 21 01:23:01.306273 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:01.306243    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:23:01.306415 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:01.306333    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:23:01.306415 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:01.306338    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:23:01.306415 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:01.306359    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:23:01.306530 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:01.306439    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:23:01.306530 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:01.306511    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:23:03.305946 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:03.305893    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:23:03.306315 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:03.306019    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:23:03.306315 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:03.306030    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:23:03.306315 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:03.306047    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:23:03.306315 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:03.306118    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:23:03.306315 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:03.306192    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:23:05.306382 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:05.306357    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:23:05.306861 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:05.306459    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:23:05.306861 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:05.306552    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:23:05.306861 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:05.306621    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:23:05.306861 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:05.306735    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:23:05.306861 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:05.306839    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:23:07.307788 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:07.307756    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:23:07.308343 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:07.307843    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:23:07.308343 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:07.307850    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:23:07.308343 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:07.307866    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:23:07.308343 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:07.307943    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:23:07.308343 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:07.308006    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:23:09.302650 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:09.302617    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:23:09.303122 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:09.302617    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:23:09.303122 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:09.302730    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:23:09.303122 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:09.302617    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:23:09.303122 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:09.302827    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:23:09.303122 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:09.302874    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:23:11.303903 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:11.303867    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:23:11.304391 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:11.303970    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:23:11.304391 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:11.304005    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:23:11.304391 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:11.304014    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:23:11.304391 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:11.304079    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:23:11.304391 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:11.304174    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:23:13.303392 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:13.303349    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:23:13.303795 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:13.303349    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:23:13.303795 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:13.303474    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4bm8" podUID="4c40807d-20bc-4fa8-957f-ef7712b7d745"
Jul 21 01:23:13.303795 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:13.303366    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:23:13.303795 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:13.303537    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hm4l8" podUID="e1ad4368-cb38-4500-9a3c-9d3101bb3e09"
Jul 21 01:23:13.303795 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:13.303619    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47x5c" podUID="ceb4edb3-7ef3-4281-89fa-3a92610353d1"
Jul 21 01:23:14.650944 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.650911    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeReady"
Jul 21 01:23:14.651331 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.651080    2586 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 01:23:14.696275 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.696234    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-svwc8"]
Jul 21 01:23:14.718218 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.718190    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vwk5q"]
Jul 21 01:23:14.718389 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.718336    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-svwc8"
Jul 21 01:23:14.720899 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.720875    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 01:23:14.721067 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.720918    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wtqvb\""
Jul 21 01:23:14.721067 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.720994    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 01:23:14.740121 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.740093    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-svwc8"]
Jul 21 01:23:14.740265 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.740137    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vwk5q"]
Jul 21 01:23:14.740265 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.740157    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xhmg6"]
Jul 21 01:23:14.740265 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.740195    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vwk5q"
Jul 21 01:23:14.744436 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.742475    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 01:23:14.744436 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.742814    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 01:23:14.744436 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.743171    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 01:23:14.744436 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.743286    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gltw9\""
Jul 21 01:23:14.751721 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.751698    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e54512b1-3bc4-4d65-abcb-0d95573cbc51-cert\") pod \"ingress-canary-vwk5q\" (UID: \"e54512b1-3bc4-4d65-abcb-0d95573cbc51\") " pod="openshift-ingress-canary/ingress-canary-vwk5q"
Jul 21 01:23:14.751905 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.751767    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/46b75d82-7430-4a0c-aaba-10b7e2458f74-config-volume\") pod \"dns-default-svwc8\" (UID: \"46b75d82-7430-4a0c-aaba-10b7e2458f74\") " pod="openshift-dns/dns-default-svwc8"
Jul 21 01:23:14.751905 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.751796    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46b75d82-7430-4a0c-aaba-10b7e2458f74-tmp-dir\") pod \"dns-default-svwc8\" (UID: \"46b75d82-7430-4a0c-aaba-10b7e2458f74\") " pod="openshift-dns/dns-default-svwc8"
Jul 21 01:23:14.751905 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.751837    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46b75d82-7430-4a0c-aaba-10b7e2458f74-metrics-tls\") pod \"dns-default-svwc8\" (UID: \"46b75d82-7430-4a0c-aaba-10b7e2458f74\") " pod="openshift-dns/dns-default-svwc8"
Jul 21 01:23:14.751905 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.751883    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t82r\" (UniqueName: \"kubernetes.io/projected/e54512b1-3bc4-4d65-abcb-0d95573cbc51-kube-api-access-5t82r\") pod \"ingress-canary-vwk5q\" (UID: \"e54512b1-3bc4-4d65-abcb-0d95573cbc51\") " pod="openshift-ingress-canary/ingress-canary-vwk5q"
Jul 21 01:23:14.752081 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.751909    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pksfv\" (UniqueName: \"kubernetes.io/projected/46b75d82-7430-4a0c-aaba-10b7e2458f74-kube-api-access-pksfv\") pod \"dns-default-svwc8\" (UID: \"46b75d82-7430-4a0c-aaba-10b7e2458f74\") " pod="openshift-dns/dns-default-svwc8"
Jul 21 01:23:14.764284 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.764241    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xhmg6"]
Jul 21 01:23:14.764447 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.764354    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xhmg6"
Jul 21 01:23:14.766329 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.766306    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 01:23:14.766848 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.766820    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 01:23:14.766986 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.766845    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 01:23:14.766986 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.766889    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 01:23:14.766986 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.766845    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fx296\""
Jul 21 01:23:14.853062 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.853021    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/46b75d82-7430-4a0c-aaba-10b7e2458f74-config-volume\") pod \"dns-default-svwc8\" (UID: \"46b75d82-7430-4a0c-aaba-10b7e2458f74\") " pod="openshift-dns/dns-default-svwc8"
Jul 21 01:23:14.853062 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.853058    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46b75d82-7430-4a0c-aaba-10b7e2458f74-tmp-dir\") pod \"dns-default-svwc8\" (UID: \"46b75d82-7430-4a0c-aaba-10b7e2458f74\") " pod="openshift-dns/dns-default-svwc8"
Jul 21 01:23:14.853280 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.853079    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwbtv\" (UniqueName: \"kubernetes.io/projected/46007ddc-a719-426e-9aa0-04acd11a3bd6-kube-api-access-vwbtv\") pod \"insights-runtime-extractor-xhmg6\" (UID: \"46007ddc-a719-426e-9aa0-04acd11a3bd6\") " pod="openshift-insights/insights-runtime-extractor-xhmg6"
Jul 21 01:23:14.853280 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.853113    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46b75d82-7430-4a0c-aaba-10b7e2458f74-metrics-tls\") pod \"dns-default-svwc8\" (UID: \"46b75d82-7430-4a0c-aaba-10b7e2458f74\") " pod="openshift-dns/dns-default-svwc8"
Jul 21 01:23:14.853280 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.853129    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/46007ddc-a719-426e-9aa0-04acd11a3bd6-crio-socket\") pod \"insights-runtime-extractor-xhmg6\" (UID: \"46007ddc-a719-426e-9aa0-04acd11a3bd6\") " pod="openshift-insights/insights-runtime-extractor-xhmg6"
Jul 21 01:23:14.853280 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.853197    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t82r\" (UniqueName: \"kubernetes.io/projected/e54512b1-3bc4-4d65-abcb-0d95573cbc51-kube-api-access-5t82r\") pod \"ingress-canary-vwk5q\" (UID: \"e54512b1-3bc4-4d65-abcb-0d95573cbc51\") " pod="openshift-ingress-canary/ingress-canary-vwk5q"
Jul 21 01:23:14.853280 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.853240    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/46007ddc-a719-426e-9aa0-04acd11a3bd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xhmg6\" (UID: \"46007ddc-a719-426e-9aa0-04acd11a3bd6\") " pod="openshift-insights/insights-runtime-extractor-xhmg6"
Jul 21 01:23:14.853483 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.853323    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pksfv\" (UniqueName: \"kubernetes.io/projected/46b75d82-7430-4a0c-aaba-10b7e2458f74-kube-api-access-pksfv\") pod \"dns-default-svwc8\" (UID: \"46b75d82-7430-4a0c-aaba-10b7e2458f74\") " pod="openshift-dns/dns-default-svwc8"
Jul 21 01:23:14.853483 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.853350    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/46007ddc-a719-426e-9aa0-04acd11a3bd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xhmg6\" (UID: \"46007ddc-a719-426e-9aa0-04acd11a3bd6\") " pod="openshift-insights/insights-runtime-extractor-xhmg6"
Jul 21 01:23:14.853483 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.853398    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/46007ddc-a719-426e-9aa0-04acd11a3bd6-data-volume\") pod \"insights-runtime-extractor-xhmg6\" (UID: \"46007ddc-a719-426e-9aa0-04acd11a3bd6\") " pod="openshift-insights/insights-runtime-extractor-xhmg6"
Jul 21 01:23:14.853483 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.853465    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46b75d82-7430-4a0c-aaba-10b7e2458f74-tmp-dir\") pod \"dns-default-svwc8\" (UID: \"46b75d82-7430-4a0c-aaba-10b7e2458f74\") " pod="openshift-dns/dns-default-svwc8"
Jul 21 01:23:14.853664 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.853541    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e54512b1-3bc4-4d65-abcb-0d95573cbc51-cert\") pod \"ingress-canary-vwk5q\" (UID: \"e54512b1-3bc4-4d65-abcb-0d95573cbc51\") " pod="openshift-ingress-canary/ingress-canary-vwk5q"
Jul 21 01:23:14.853741 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.853725    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/46b75d82-7430-4a0c-aaba-10b7e2458f74-config-volume\") pod \"dns-default-svwc8\" (UID: \"46b75d82-7430-4a0c-aaba-10b7e2458f74\") " pod="openshift-dns/dns-default-svwc8"
Jul 21 01:23:14.857531 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.857506    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e54512b1-3bc4-4d65-abcb-0d95573cbc51-cert\") pod \"ingress-canary-vwk5q\" (UID: \"e54512b1-3bc4-4d65-abcb-0d95573cbc51\") " pod="openshift-ingress-canary/ingress-canary-vwk5q"
Jul 21 01:23:14.857656 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.857511    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46b75d82-7430-4a0c-aaba-10b7e2458f74-metrics-tls\") pod \"dns-default-svwc8\" (UID: \"46b75d82-7430-4a0c-aaba-10b7e2458f74\") " pod="openshift-dns/dns-default-svwc8"
Jul 21 01:23:14.860702 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.860677    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t82r\" (UniqueName: \"kubernetes.io/projected/e54512b1-3bc4-4d65-abcb-0d95573cbc51-kube-api-access-5t82r\") pod \"ingress-canary-vwk5q\" (UID: \"e54512b1-3bc4-4d65-abcb-0d95573cbc51\") " pod="openshift-ingress-canary/ingress-canary-vwk5q"
Jul 21 01:23:14.860985 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.860963    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pksfv\" (UniqueName: \"kubernetes.io/projected/46b75d82-7430-4a0c-aaba-10b7e2458f74-kube-api-access-pksfv\") pod \"dns-default-svwc8\" (UID: \"46b75d82-7430-4a0c-aaba-10b7e2458f74\") " pod="openshift-dns/dns-default-svwc8"
Jul 21 01:23:14.954224 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.954133    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/46007ddc-a719-426e-9aa0-04acd11a3bd6-crio-socket\") pod \"insights-runtime-extractor-xhmg6\" (UID: \"46007ddc-a719-426e-9aa0-04acd11a3bd6\") " pod="openshift-insights/insights-runtime-extractor-xhmg6"
Jul 21 01:23:14.954224 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.954173    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/46007ddc-a719-426e-9aa0-04acd11a3bd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xhmg6\" (UID: \"46007ddc-a719-426e-9aa0-04acd11a3bd6\") " pod="openshift-insights/insights-runtime-extractor-xhmg6"
Jul 21 01:23:14.954224 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.954193    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/46007ddc-a719-426e-9aa0-04acd11a3bd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xhmg6\" (UID: \"46007ddc-a719-426e-9aa0-04acd11a3bd6\") " pod="openshift-insights/insights-runtime-extractor-xhmg6"
Jul 21 01:23:14.954498 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.954274    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/46007ddc-a719-426e-9aa0-04acd11a3bd6-data-volume\") pod \"insights-runtime-extractor-xhmg6\" (UID: \"46007ddc-a719-426e-9aa0-04acd11a3bd6\") " pod="openshift-insights/insights-runtime-extractor-xhmg6"
Jul 21 01:23:14.954498 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.954368    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/46007ddc-a719-426e-9aa0-04acd11a3bd6-crio-socket\") pod \"insights-runtime-extractor-xhmg6\" (UID: \"46007ddc-a719-426e-9aa0-04acd11a3bd6\") " pod="openshift-insights/insights-runtime-extractor-xhmg6"
Jul 21 01:23:14.954498 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.954381    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwbtv\" (UniqueName: \"kubernetes.io/projected/46007ddc-a719-426e-9aa0-04acd11a3bd6-kube-api-access-vwbtv\") pod \"insights-runtime-extractor-xhmg6\" (UID: \"46007ddc-a719-426e-9aa0-04acd11a3bd6\") " pod="openshift-insights/insights-runtime-extractor-xhmg6"
Jul 21 01:23:14.954631 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.954600    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/46007ddc-a719-426e-9aa0-04acd11a3bd6-data-volume\") pod \"insights-runtime-extractor-xhmg6\" (UID: \"46007ddc-a719-426e-9aa0-04acd11a3bd6\") " pod="openshift-insights/insights-runtime-extractor-xhmg6"
Jul 21 01:23:14.954716 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.954684    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/46007ddc-a719-426e-9aa0-04acd11a3bd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xhmg6\" (UID: \"46007ddc-a719-426e-9aa0-04acd11a3bd6\") " pod="openshift-insights/insights-runtime-extractor-xhmg6"
Jul 21 01:23:14.956679 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.956657    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/46007ddc-a719-426e-9aa0-04acd11a3bd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xhmg6\" (UID: \"46007ddc-a719-426e-9aa0-04acd11a3bd6\") " pod="openshift-insights/insights-runtime-extractor-xhmg6"
Jul 21 01:23:14.962544 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:14.962517    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwbtv\" (UniqueName: \"kubernetes.io/projected/46007ddc-a719-426e-9aa0-04acd11a3bd6-kube-api-access-vwbtv\") pod \"insights-runtime-extractor-xhmg6\" (UID: \"46007ddc-a719-426e-9aa0-04acd11a3bd6\") " pod="openshift-insights/insights-runtime-extractor-xhmg6"
Jul 21 01:23:15.028084 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:15.028047    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-svwc8"
Jul 21 01:23:15.051346 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:15.051309    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vwk5q"
Jul 21 01:23:15.073672 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:15.073643    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xhmg6"
Jul 21 01:23:15.272050 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:15.272018    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vwk5q"]
Jul 21 01:23:15.275409 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:23:15.275384    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode54512b1_3bc4_4d65_abcb_0d95573cbc51.slice/crio-2af5b7b846fec1512a0f8950a501073fa2f05bca8515e72dccc6d9962955c957 WatchSource:0}: Error finding container 2af5b7b846fec1512a0f8950a501073fa2f05bca8515e72dccc6d9962955c957: Status 404 returned error can't find the container with id 2af5b7b846fec1512a0f8950a501073fa2f05bca8515e72dccc6d9962955c957
Jul 21 01:23:15.279000 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:15.278977    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xhmg6"]
Jul 21 01:23:15.281624 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:15.281603    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-svwc8"]
Jul 21 01:23:15.282166 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:23:15.282145    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46007ddc_a719_426e_9aa0_04acd11a3bd6.slice/crio-20b8ff6e779227ccb0e07dda6a44a2c5d53b9bd710ee294715f8913e3139ae13 WatchSource:0}: Error finding container 20b8ff6e779227ccb0e07dda6a44a2c5d53b9bd710ee294715f8913e3139ae13: Status 404 returned error can't find the container with id 20b8ff6e779227ccb0e07dda6a44a2c5d53b9bd710ee294715f8913e3139ae13
Jul 21 01:23:15.284789 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:23:15.284767    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46b75d82_7430_4a0c_aaba_10b7e2458f74.slice/crio-de338ed9d784fad73334a23d07c482e7b63d5164a5aa8aefb2dfd85955bff430 WatchSource:0}: Error finding container de338ed9d784fad73334a23d07c482e7b63d5164a5aa8aefb2dfd85955bff430: Status 404 returned error can't find the container with id de338ed9d784fad73334a23d07c482e7b63d5164a5aa8aefb2dfd85955bff430
Jul 21 01:23:15.303459 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:15.303423    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:23:15.303636 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:15.303423    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:23:15.303636 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:15.303423    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:23:15.306001 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:15.305976    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qrsnk\""
Jul 21 01:23:15.306001 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:15.305996    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 01:23:15.306215 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:15.306053    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 01:23:15.306215 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:15.306061    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 01:23:15.306215 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:15.306054    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 01:23:15.306215 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:15.306104    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-48mr4\""
Jul 21 01:23:15.624996 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:15.624956    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xhmg6" event={"ID":"46007ddc-a719-426e-9aa0-04acd11a3bd6","Type":"ContainerStarted","Data":"20b8ff6e779227ccb0e07dda6a44a2c5d53b9bd710ee294715f8913e3139ae13"}
Jul 21 01:23:15.626092 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:15.626069    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vwk5q" event={"ID":"e54512b1-3bc4-4d65-abcb-0d95573cbc51","Type":"ContainerStarted","Data":"2af5b7b846fec1512a0f8950a501073fa2f05bca8515e72dccc6d9962955c957"}
Jul 21 01:23:15.627018 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:15.626997    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-svwc8" event={"ID":"46b75d82-7430-4a0c-aaba-10b7e2458f74","Type":"ContainerStarted","Data":"de338ed9d784fad73334a23d07c482e7b63d5164a5aa8aefb2dfd85955bff430"}
Jul 21 01:23:17.636340 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:17.636303    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-svwc8" event={"ID":"46b75d82-7430-4a0c-aaba-10b7e2458f74","Type":"ContainerStarted","Data":"02ff004fa7e0385ba1aa4ef0f300f4a3b30843149160251cf356c884e7b71474"}
Jul 21 01:23:17.636780 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:17.636369    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-svwc8" event={"ID":"46b75d82-7430-4a0c-aaba-10b7e2458f74","Type":"ContainerStarted","Data":"04c6cb40fb563c512c876f285706c10af772ce1ff8f6776a62c8744f162873fd"}
Jul 21 01:23:17.636780 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:17.636440    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-svwc8"
Jul 21 01:23:17.656261 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:17.655719    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-svwc8" podStartSLOduration=1.732043075 podStartE2EDuration="3.655701169s" totalImagesPullingTime="1.923658094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:23:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:17.655239104 +0000 UTC m=+56.843278495" watchObservedRunningTime="2026-07-21 01:23:17.655701169 +0000 UTC m=+56.843740561"
Jul 21 01:23:21.649786 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:21.649734    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xhmg6" event={"ID":"46007ddc-a719-426e-9aa0-04acd11a3bd6","Type":"ContainerStarted","Data":"c0007a1c1ab72d194e40031b845c19b8080b7ebffeca6f4d69744020f4677153"}
Jul 21 01:23:21.651709 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:21.651668    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vwk5q" event={"ID":"e54512b1-3bc4-4d65-abcb-0d95573cbc51","Type":"ContainerStarted","Data":"a555a74cf5eaba849c82c98829aed89749c50a6870edaee890f2904bb64a1cce"}
Jul 21 01:23:21.676424 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:21.676365    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vwk5q" podStartSLOduration=1.879307675 podStartE2EDuration="7.676343745s" totalImagesPullingTime="5.79703607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:23:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:21.675280493 +0000 UTC m=+60.863319884" watchObservedRunningTime="2026-07-21 01:23:21.676343745 +0000 UTC m=+60.864383136"
Jul 21 01:23:21.677002 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:21.676981    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pqctg"]
Jul 21 01:23:21.692714 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:21.690789    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pqctg"
Jul 21 01:23:21.694834 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:21.694705    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-4s9md\""
Jul 21 01:23:21.695011 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:21.694928    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 21 01:23:21.695433 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:21.695408    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pqctg"]
Jul 21 01:23:21.710819 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:21.710775    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d33b4cd3-495d-4f1a-8041-a074d098526b-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-pqctg\" (UID: \"d33b4cd3-495d-4f1a-8041-a074d098526b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pqctg"
Jul 21 01:23:21.811819 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:21.811783    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d33b4cd3-495d-4f1a-8041-a074d098526b-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-pqctg\" (UID: \"d33b4cd3-495d-4f1a-8041-a074d098526b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pqctg"
Jul 21 01:23:21.812060 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:21.811994    2586 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 21 01:23:21.812122 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:21.812063    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d33b4cd3-495d-4f1a-8041-a074d098526b-tls-certificates podName:d33b4cd3-495d-4f1a-8041-a074d098526b nodeName:}" failed. No retries permitted until 2026-07-21 01:23:22.31204712 +0000 UTC m=+61.500086501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/d33b4cd3-495d-4f1a-8041-a074d098526b-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-pqctg" (UID: "d33b4cd3-495d-4f1a-8041-a074d098526b") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 21 01:23:22.315711 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:22.315672    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d33b4cd3-495d-4f1a-8041-a074d098526b-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-pqctg\" (UID: \"d33b4cd3-495d-4f1a-8041-a074d098526b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pqctg"
Jul 21 01:23:22.318681 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:22.318643    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d33b4cd3-495d-4f1a-8041-a074d098526b-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-pqctg\" (UID: \"d33b4cd3-495d-4f1a-8041-a074d098526b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pqctg"
Jul 21 01:23:22.575497 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:22.575405    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pxdmv"
Jul 21 01:23:22.607451 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:22.607410    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pqctg"
Jul 21 01:23:22.765781 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:22.765739    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pqctg"]
Jul 21 01:23:22.770285 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:23:22.770255    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd33b4cd3_495d_4f1a_8041_a074d098526b.slice/crio-9cc7af8eba6e37d35b09f8cce294fdab33018995ea7189b7690123c004c5170b WatchSource:0}: Error finding container 9cc7af8eba6e37d35b09f8cce294fdab33018995ea7189b7690123c004c5170b: Status 404 returned error can't find the container with id 9cc7af8eba6e37d35b09f8cce294fdab33018995ea7189b7690123c004c5170b
Jul 21 01:23:23.659370 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:23.659327    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pqctg" event={"ID":"d33b4cd3-495d-4f1a-8041-a074d098526b","Type":"ContainerStarted","Data":"9cc7af8eba6e37d35b09f8cce294fdab33018995ea7189b7690123c004c5170b"}
Jul 21 01:23:25.666685 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:25.666646    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xhmg6" event={"ID":"46007ddc-a719-426e-9aa0-04acd11a3bd6","Type":"ContainerStarted","Data":"9fa9299e8362e56a20c2d5b3a7916ac7476da10b30f091daf2cf8b99ee6f9592"}
Jul 21 01:23:26.672302 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:26.672259    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pqctg" event={"ID":"d33b4cd3-495d-4f1a-8041-a074d098526b","Type":"ContainerStarted","Data":"809de224913c86258bc73bc8193348965f34d3d95ec8cc29b685518d13505938"}
Jul 21 01:23:26.672764 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:26.672431    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pqctg"
Jul 21 01:23:26.677709 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:26.677683    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pqctg"
Jul 21 01:23:26.688713 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:26.688660    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pqctg" podStartSLOduration=2.7863208310000003 podStartE2EDuration="5.688639847s" totalImagesPullingTime="2.902319016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:23:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:26.688158547 +0000 UTC m=+65.876197941" watchObservedRunningTime="2026-07-21 01:23:26.688639847 +0000 UTC m=+65.876679236"
Jul 21 01:23:27.053643 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.053559    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-original-pull-secret\") pod \"global-pull-secret-syncer-hm4l8\" (UID: \"e1ad4368-cb38-4500-9a3c-9d3101bb3e09\") " pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:23:27.053643 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.053600    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c40807d-20bc-4fa8-957f-ef7712b7d745-metrics-certs\") pod \"network-metrics-daemon-p4bm8\" (UID: \"4c40807d-20bc-4fa8-957f-ef7712b7d745\") " pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:23:27.055881 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.055731    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 01:23:27.055881 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.055763    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 01:23:27.066895 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.066857    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c40807d-20bc-4fa8-957f-ef7712b7d745-metrics-certs\") pod \"network-metrics-daemon-p4bm8\" (UID: \"4c40807d-20bc-4fa8-957f-ef7712b7d745\") " pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:23:27.066895 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.066871    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1ad4368-cb38-4500-9a3c-9d3101bb3e09-original-pull-secret\") pod \"global-pull-secret-syncer-hm4l8\" (UID: \"e1ad4368-cb38-4500-9a3c-9d3101bb3e09\") " pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:23:27.154365 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.154325    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvrqp\" (UniqueName: \"kubernetes.io/projected/ceb4edb3-7ef3-4281-89fa-3a92610353d1-kube-api-access-qvrqp\") pod \"network-check-target-47x5c\" (UID: \"ceb4edb3-7ef3-4281-89fa-3a92610353d1\") " pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:23:27.156477 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.156442    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 01:23:27.167090 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.167065    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 01:23:27.178325 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.178299    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvrqp\" (UniqueName: \"kubernetes.io/projected/ceb4edb3-7ef3-4281-89fa-3a92610353d1-kube-api-access-qvrqp\") pod \"network-check-target-47x5c\" (UID: \"ceb4edb3-7ef3-4281-89fa-3a92610353d1\") " pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:23:27.315975 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.315873    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-48mr4\""
Jul 21 01:23:27.321345 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.321323    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qrsnk\""
Jul 21 01:23:27.324047 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.324023    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:23:27.324180 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.324051    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hm4l8"
Jul 21 01:23:27.330456 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.330425    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4bm8"
Jul 21 01:23:27.642409 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.642379    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-svwc8"
Jul 21 01:23:27.741556 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.741523    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-tfzfd"]
Jul 21 01:23:27.747966 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.747921    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tfzfd"
Jul 21 01:23:27.750409 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.750384    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 21 01:23:27.750532 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.750419    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 21 01:23:27.750532 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.750484    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-x9djm\""
Jul 21 01:23:27.750532 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.750514    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 01:23:27.750719 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.750653    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 01:23:27.750908 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.750887    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 01:23:27.754222 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.754198    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-tfzfd"]
Jul 21 01:23:27.860089 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.860055    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30c3c093-0067-43df-abc1-491950269dc0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-tfzfd\" (UID: \"30c3c093-0067-43df-abc1-491950269dc0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tfzfd"
Jul 21 01:23:27.860306 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.860109    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfwtt\" (UniqueName: \"kubernetes.io/projected/30c3c093-0067-43df-abc1-491950269dc0-kube-api-access-bfwtt\") pod \"prometheus-operator-5945b5cfd-tfzfd\" (UID: \"30c3c093-0067-43df-abc1-491950269dc0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tfzfd"
Jul 21 01:23:27.860306 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.860154    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/30c3c093-0067-43df-abc1-491950269dc0-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-tfzfd\" (UID: \"30c3c093-0067-43df-abc1-491950269dc0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tfzfd"
Jul 21 01:23:27.860306 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.860174    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30c3c093-0067-43df-abc1-491950269dc0-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-tfzfd\" (UID: \"30c3c093-0067-43df-abc1-491950269dc0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tfzfd"
Jul 21 01:23:27.960872 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.960786    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfwtt\" (UniqueName: \"kubernetes.io/projected/30c3c093-0067-43df-abc1-491950269dc0-kube-api-access-bfwtt\") pod \"prometheus-operator-5945b5cfd-tfzfd\" (UID: \"30c3c093-0067-43df-abc1-491950269dc0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tfzfd"
Jul 21 01:23:27.960872 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.960845    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/30c3c093-0067-43df-abc1-491950269dc0-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-tfzfd\" (UID: \"30c3c093-0067-43df-abc1-491950269dc0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tfzfd"
Jul 21 01:23:27.960872 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.960873    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30c3c093-0067-43df-abc1-491950269dc0-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-tfzfd\" (UID: \"30c3c093-0067-43df-abc1-491950269dc0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tfzfd"
Jul 21 01:23:27.961123 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.960899    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30c3c093-0067-43df-abc1-491950269dc0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-tfzfd\" (UID: \"30c3c093-0067-43df-abc1-491950269dc0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tfzfd"
Jul 21 01:23:27.961996 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.961899    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30c3c093-0067-43df-abc1-491950269dc0-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-tfzfd\" (UID: \"30c3c093-0067-43df-abc1-491950269dc0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tfzfd"
Jul 21 01:23:27.963659 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.963634    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/30c3c093-0067-43df-abc1-491950269dc0-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-tfzfd\" (UID: \"30c3c093-0067-43df-abc1-491950269dc0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tfzfd"
Jul 21 01:23:27.964031 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.964010    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30c3c093-0067-43df-abc1-491950269dc0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-tfzfd\" (UID: \"30c3c093-0067-43df-abc1-491950269dc0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tfzfd"
Jul 21 01:23:27.969224 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:27.969198    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfwtt\" (UniqueName: \"kubernetes.io/projected/30c3c093-0067-43df-abc1-491950269dc0-kube-api-access-bfwtt\") pod \"prometheus-operator-5945b5cfd-tfzfd\" (UID: \"30c3c093-0067-43df-abc1-491950269dc0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tfzfd"
Jul 21 01:23:28.060003 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:28.059961    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tfzfd"
Jul 21 01:23:28.615440 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:28.615397    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-47x5c"]
Jul 21 01:23:28.619845 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:23:28.619818    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceb4edb3_7ef3_4281_89fa_3a92610353d1.slice/crio-188b6e69ac6ffdb76f17820dad309c4b02996d3fa6ad473b007ef31a5581cbd2 WatchSource:0}: Error finding container 188b6e69ac6ffdb76f17820dad309c4b02996d3fa6ad473b007ef31a5581cbd2: Status 404 returned error can't find the container with id 188b6e69ac6ffdb76f17820dad309c4b02996d3fa6ad473b007ef31a5581cbd2
Jul 21 01:23:28.681068 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:28.681024    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xhmg6" event={"ID":"46007ddc-a719-426e-9aa0-04acd11a3bd6","Type":"ContainerStarted","Data":"725470d1d3462a046a70b13d206dc5c096c1a9a219b0f412831c81ca4af46b6a"}
Jul 21 01:23:28.682243 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:28.682214    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-47x5c" event={"ID":"ceb4edb3-7ef3-4281-89fa-3a92610353d1","Type":"ContainerStarted","Data":"188b6e69ac6ffdb76f17820dad309c4b02996d3fa6ad473b007ef31a5581cbd2"}
Jul 21 01:23:28.698851 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:28.698744    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xhmg6" podStartSLOduration=1.594142192 podStartE2EDuration="14.698726295s" totalImagesPullingTime="13.104584103s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:23:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:28.698397049 +0000 UTC m=+67.886436439" watchObservedRunningTime="2026-07-21 01:23:28.698726295 +0000 UTC m=+67.886765685"
Jul 21 01:23:28.838568 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:28.838533    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p4bm8"]
Jul 21 01:23:28.842189 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:28.842160    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hm4l8"]
Jul 21 01:23:28.842587 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:23:28.842559    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c40807d_20bc_4fa8_957f_ef7712b7d745.slice/crio-3653564af00743b6ac867b4ea543d05c01512565e65229b500f39b6056ddccc9 WatchSource:0}: Error finding container 3653564af00743b6ac867b4ea543d05c01512565e65229b500f39b6056ddccc9: Status 404 returned error can't find the container with id 3653564af00743b6ac867b4ea543d05c01512565e65229b500f39b6056ddccc9
Jul 21 01:23:28.843045 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:28.842877    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-tfzfd"]
Jul 21 01:23:28.845619 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:23:28.845594    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30c3c093_0067_43df_abc1_491950269dc0.slice/crio-f1cb4a92f82f36b8ed7092e98a92a383dd284f4d1ee03b78c29b7de8725aa48e WatchSource:0}: Error finding container f1cb4a92f82f36b8ed7092e98a92a383dd284f4d1ee03b78c29b7de8725aa48e: Status 404 returned error can't find the container with id f1cb4a92f82f36b8ed7092e98a92a383dd284f4d1ee03b78c29b7de8725aa48e
Jul 21 01:23:28.846968 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:23:28.846643    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1ad4368_cb38_4500_9a3c_9d3101bb3e09.slice/crio-ba8e6915d0b3347a27c58799d7c50dd5b8b5d488a881e2368c168b06b8208a17 WatchSource:0}: Error finding container ba8e6915d0b3347a27c58799d7c50dd5b8b5d488a881e2368c168b06b8208a17: Status 404 returned error can't find the container with id ba8e6915d0b3347a27c58799d7c50dd5b8b5d488a881e2368c168b06b8208a17
Jul 21 01:23:29.687901 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:29.687855    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p4bm8" event={"ID":"4c40807d-20bc-4fa8-957f-ef7712b7d745","Type":"ContainerStarted","Data":"3653564af00743b6ac867b4ea543d05c01512565e65229b500f39b6056ddccc9"}
Jul 21 01:23:29.689592 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:29.689488    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tfzfd" event={"ID":"30c3c093-0067-43df-abc1-491950269dc0","Type":"ContainerStarted","Data":"f1cb4a92f82f36b8ed7092e98a92a383dd284f4d1ee03b78c29b7de8725aa48e"}
Jul 21 01:23:29.691492 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:29.691466    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hm4l8" event={"ID":"e1ad4368-cb38-4500-9a3c-9d3101bb3e09","Type":"ContainerStarted","Data":"ba8e6915d0b3347a27c58799d7c50dd5b8b5d488a881e2368c168b06b8208a17"}
Jul 21 01:23:30.713908 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:30.713868    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tfzfd" event={"ID":"30c3c093-0067-43df-abc1-491950269dc0","Type":"ContainerStarted","Data":"1824ea28cfc59c7da767ea730c7b1214c9903b2f39c3c373e9ff895cb33202ab"}
Jul 21 01:23:30.715616 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:30.715586    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p4bm8" event={"ID":"4c40807d-20bc-4fa8-957f-ef7712b7d745","Type":"ContainerStarted","Data":"5ad40e731e6d3aac0b2f9952c62a5699ac7bf25d8c6b7d083c42601f41673811"}
Jul 21 01:23:31.722713 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:31.722668    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p4bm8" event={"ID":"4c40807d-20bc-4fa8-957f-ef7712b7d745","Type":"ContainerStarted","Data":"a4268073f746c0fb2041d35d3f100ec0f7c3c1b01a2a605808e0887a40eda8ac"}
Jul 21 01:23:31.725549 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:31.725506    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tfzfd" event={"ID":"30c3c093-0067-43df-abc1-491950269dc0","Type":"ContainerStarted","Data":"34317547cd3cee638bfadaa813ad98117669941930da8733272428ccb8375cd9"}
Jul 21 01:23:31.738507 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:31.738449    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-p4bm8" podStartSLOduration=69.02605247 podStartE2EDuration="1m10.738426425s" totalImagesPullingTime="1.712373955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:31.73755069 +0000 UTC m=+70.925590102" watchObservedRunningTime="2026-07-21 01:23:31.738426425 +0000 UTC m=+70.926465819"
Jul 21 01:23:31.754347 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:31.754294    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tfzfd" podStartSLOduration=3.043092166 podStartE2EDuration="4.754272134s" totalImagesPullingTime="1.711179968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:23:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:31.753024695 +0000 UTC m=+70.941064086" watchObservedRunningTime="2026-07-21 01:23:31.754272134 +0000 UTC m=+70.942311523"
Jul 21 01:23:33.734026 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:33.733985    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hm4l8" event={"ID":"e1ad4368-cb38-4500-9a3c-9d3101bb3e09","Type":"ContainerStarted","Data":"dd41ffb5a495df4346af9b68db48f6f19dd75d2b4d148ed9bdeba5afb4a94f54"}
Jul 21 01:23:33.735670 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:33.735639    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-47x5c" event={"ID":"ceb4edb3-7ef3-4281-89fa-3a92610353d1","Type":"ContainerStarted","Data":"9cf6167c5b8c0e4df3620ee854d52c21ba4fb86563a2fab328cf22ff6744de2e"}
Jul 21 01:23:33.735830 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:33.735790    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:23:33.748513 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:33.748424    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hm4l8" podStartSLOduration=68.01533952 podStartE2EDuration="1m12.748402095s" totalImagesPullingTime="4.733062575s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:33.748118881 +0000 UTC m=+72.936158272" watchObservedRunningTime="2026-07-21 01:23:33.748402095 +0000 UTC m=+72.936441489"
Jul 21 01:23:33.764829 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:33.764776    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-47x5c" podStartSLOduration=67.80986925 podStartE2EDuration="1m12.76475944s" totalImagesPullingTime="4.95489019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:33.764367036 +0000 UTC m=+72.952406430" watchObservedRunningTime="2026-07-21 01:23:33.76475944 +0000 UTC m=+72.952798809"
Jul 21 01:23:34.089883 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.089842    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-g4djk"]
Jul 21 01:23:34.093152 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.093129    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4djk"
Jul 21 01:23:34.095163 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.095141    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 21 01:23:34.095535 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.095518    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 21 01:23:34.095599 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.095520    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-hlncs\""
Jul 21 01:23:34.096903 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.096880    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-r2jpf"]
Jul 21 01:23:34.100110 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.099866    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-r2jpf"
Jul 21 01:23:34.102203 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.102178    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 21 01:23:34.102625 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.102604    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-hsh77\""
Jul 21 01:23:34.102720 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.102661    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 21 01:23:34.102720 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.102704    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 21 01:23:34.103481 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.103462    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-g4djk"]
Jul 21 01:23:34.109894 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.109871    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-r2jpf"]
Jul 21 01:23:34.132288 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.132254    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9x8ct"]
Jul 21 01:23:34.135364 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.135347    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.137200 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.137178    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 01:23:34.137200 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.137195    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 01:23:34.137327 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.137301    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6twlm\""
Jul 21 01:23:34.137423 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.137410    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 01:23:34.206526 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.206485    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cab82bae-b077-47fe-8725-04a2d39bea10-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-r2jpf\" (UID: \"cab82bae-b077-47fe-8725-04a2d39bea10\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2jpf"
Jul 21 01:23:34.206526 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.206525    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-node-exporter-wtmp\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.206741 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.206552    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cab82bae-b077-47fe-8725-04a2d39bea10-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-r2jpf\" (UID: \"cab82bae-b077-47fe-8725-04a2d39bea10\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2jpf"
Jul 21 01:23:34.206741 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.206571    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv642\" (UniqueName: \"kubernetes.io/projected/a929fe7b-0020-4b58-bdde-4a15366bfec9-kube-api-access-nv642\") pod \"openshift-state-metrics-79f6958cdf-g4djk\" (UID: \"a929fe7b-0020-4b58-bdde-4a15366bfec9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4djk"
Jul 21 01:23:34.206741 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.206588    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-node-exporter-tls\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.206741 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.206626    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cab82bae-b077-47fe-8725-04a2d39bea10-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-r2jpf\" (UID: \"cab82bae-b077-47fe-8725-04a2d39bea10\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2jpf"
Jul 21 01:23:34.206741 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.206663    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqr96\" (UniqueName: \"kubernetes.io/projected/cab82bae-b077-47fe-8725-04a2d39bea10-kube-api-access-fqr96\") pod \"kube-state-metrics-56c5594674-r2jpf\" (UID: \"cab82bae-b077-47fe-8725-04a2d39bea10\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2jpf"
Jul 21 01:23:34.206741 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.206683    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a929fe7b-0020-4b58-bdde-4a15366bfec9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-g4djk\" (UID: \"a929fe7b-0020-4b58-bdde-4a15366bfec9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4djk"
Jul 21 01:23:34.206741 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.206699    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cab82bae-b077-47fe-8725-04a2d39bea10-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-r2jpf\" (UID: \"cab82bae-b077-47fe-8725-04a2d39bea10\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2jpf"
Jul 21 01:23:34.206741 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.206716    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a929fe7b-0020-4b58-bdde-4a15366bfec9-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-g4djk\" (UID: \"a929fe7b-0020-4b58-bdde-4a15366bfec9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4djk"
Jul 21 01:23:34.206741 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.206736    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-node-exporter-textfile\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.207042 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.206754    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.207042 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.206810    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z92kw\" (UniqueName: \"kubernetes.io/projected/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-kube-api-access-z92kw\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.207042 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.206850    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cab82bae-b077-47fe-8725-04a2d39bea10-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-r2jpf\" (UID: \"cab82bae-b077-47fe-8725-04a2d39bea10\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2jpf"
Jul 21 01:23:34.207042 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.206883    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-metrics-client-ca\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.207042 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.206909    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-root\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.207042 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.206930    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-node-exporter-accelerators-collector-config\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.207042 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.207005    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a929fe7b-0020-4b58-bdde-4a15366bfec9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-g4djk\" (UID: \"a929fe7b-0020-4b58-bdde-4a15366bfec9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4djk"
Jul 21 01:23:34.207042 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.207027    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-sys\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.308310 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.308269    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a929fe7b-0020-4b58-bdde-4a15366bfec9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-g4djk\" (UID: \"a929fe7b-0020-4b58-bdde-4a15366bfec9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4djk"
Jul 21 01:23:34.308310 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.308307    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-sys\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.308571 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.308328    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cab82bae-b077-47fe-8725-04a2d39bea10-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-r2jpf\" (UID: \"cab82bae-b077-47fe-8725-04a2d39bea10\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2jpf"
Jul 21 01:23:34.308571 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.308349    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-node-exporter-wtmp\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.308571 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.308368    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cab82bae-b077-47fe-8725-04a2d39bea10-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-r2jpf\" (UID: \"cab82bae-b077-47fe-8725-04a2d39bea10\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2jpf"
Jul 21 01:23:34.308571 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.308388    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv642\" (UniqueName: \"kubernetes.io/projected/a929fe7b-0020-4b58-bdde-4a15366bfec9-kube-api-access-nv642\") pod \"openshift-state-metrics-79f6958cdf-g4djk\" (UID: \"a929fe7b-0020-4b58-bdde-4a15366bfec9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4djk"
Jul 21 01:23:34.308571 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.308402    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-node-exporter-tls\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.308571 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.308406    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-sys\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.308571 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:34.308441    2586 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 21 01:23:34.308571 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.308457    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cab82bae-b077-47fe-8725-04a2d39bea10-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-r2jpf\" (UID: \"cab82bae-b077-47fe-8725-04a2d39bea10\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2jpf"
Jul 21 01:23:34.308571 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:34.308494    2586 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 21 01:23:34.308571 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.308498    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqr96\" (UniqueName: \"kubernetes.io/projected/cab82bae-b077-47fe-8725-04a2d39bea10-kube-api-access-fqr96\") pod \"kube-state-metrics-56c5594674-r2jpf\" (UID: \"cab82bae-b077-47fe-8725-04a2d39bea10\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2jpf"
Jul 21 01:23:34.308571 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.308508    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-node-exporter-wtmp\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.308571 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.308533    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a929fe7b-0020-4b58-bdde-4a15366bfec9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-g4djk\" (UID: \"a929fe7b-0020-4b58-bdde-4a15366bfec9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4djk"
Jul 21 01:23:34.308571 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:34.308556    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-node-exporter-tls podName:2b565020-4cb1-4d9b-8557-3a99d1c3ddb3 nodeName:}" failed. No retries permitted until 2026-07-21 01:23:34.808537787 +0000 UTC m=+73.996577155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-node-exporter-tls") pod "node-exporter-9x8ct" (UID: "2b565020-4cb1-4d9b-8557-3a99d1c3ddb3") : secret "node-exporter-tls" not found
Jul 21 01:23:34.308571 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.308580    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cab82bae-b077-47fe-8725-04a2d39bea10-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-r2jpf\" (UID: \"cab82bae-b077-47fe-8725-04a2d39bea10\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2jpf"
Jul 21 01:23:34.309600 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.308610    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a929fe7b-0020-4b58-bdde-4a15366bfec9-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-g4djk\" (UID: \"a929fe7b-0020-4b58-bdde-4a15366bfec9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4djk"
Jul 21 01:23:34.309600 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.308636    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-node-exporter-textfile\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.309600 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:34.308650    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a929fe7b-0020-4b58-bdde-4a15366bfec9-openshift-state-metrics-tls podName:a929fe7b-0020-4b58-bdde-4a15366bfec9 nodeName:}" failed. No retries permitted until 2026-07-21 01:23:34.80863076 +0000 UTC m=+73.996670128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a929fe7b-0020-4b58-bdde-4a15366bfec9-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-g4djk" (UID: "a929fe7b-0020-4b58-bdde-4a15366bfec9") : secret "openshift-state-metrics-tls" not found
Jul 21 01:23:34.309600 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.308682    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.309600 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.308736    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z92kw\" (UniqueName: \"kubernetes.io/projected/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-kube-api-access-z92kw\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.309600 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.308822    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cab82bae-b077-47fe-8725-04a2d39bea10-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-r2jpf\" (UID: \"cab82bae-b077-47fe-8725-04a2d39bea10\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2jpf"
Jul 21 01:23:34.309600 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.308868    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-metrics-client-ca\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.309600 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.308915    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-node-exporter-textfile\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.309600 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.308914    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cab82bae-b077-47fe-8725-04a2d39bea10-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-r2jpf\" (UID: \"cab82bae-b077-47fe-8725-04a2d39bea10\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2jpf"
Jul 21 01:23:34.309600 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.309008    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-root\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.309600 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.309246    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cab82bae-b077-47fe-8725-04a2d39bea10-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-r2jpf\" (UID: \"cab82bae-b077-47fe-8725-04a2d39bea10\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2jpf"
Jul 21 01:23:34.310203 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.309615    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cab82bae-b077-47fe-8725-04a2d39bea10-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-r2jpf\" (UID: \"cab82bae-b077-47fe-8725-04a2d39bea10\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2jpf"
Jul 21 01:23:34.310203 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.309628    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a929fe7b-0020-4b58-bdde-4a15366bfec9-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-g4djk\" (UID: \"a929fe7b-0020-4b58-bdde-4a15366bfec9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4djk"
Jul 21 01:23:34.310203 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.308898    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-root\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.310203 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.309691    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-node-exporter-accelerators-collector-config\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.310203 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.309711    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-metrics-client-ca\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.310203 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.310082    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-node-exporter-accelerators-collector-config\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.311406 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.311381    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a929fe7b-0020-4b58-bdde-4a15366bfec9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-g4djk\" (UID: \"a929fe7b-0020-4b58-bdde-4a15366bfec9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4djk"
Jul 21 01:23:34.311516 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.311491    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.311681 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.311660    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cab82bae-b077-47fe-8725-04a2d39bea10-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-r2jpf\" (UID: \"cab82bae-b077-47fe-8725-04a2d39bea10\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2jpf"
Jul 21 01:23:34.311681 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.311672    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cab82bae-b077-47fe-8725-04a2d39bea10-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-r2jpf\" (UID: \"cab82bae-b077-47fe-8725-04a2d39bea10\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2jpf"
Jul 21 01:23:34.316803 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.316776    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqr96\" (UniqueName: \"kubernetes.io/projected/cab82bae-b077-47fe-8725-04a2d39bea10-kube-api-access-fqr96\") pod \"kube-state-metrics-56c5594674-r2jpf\" (UID: \"cab82bae-b077-47fe-8725-04a2d39bea10\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2jpf"
Jul 21 01:23:34.317362 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.317339    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z92kw\" (UniqueName: \"kubernetes.io/projected/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-kube-api-access-z92kw\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.318575 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.318555    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv642\" (UniqueName: \"kubernetes.io/projected/a929fe7b-0020-4b58-bdde-4a15366bfec9-kube-api-access-nv642\") pod \"openshift-state-metrics-79f6958cdf-g4djk\" (UID: \"a929fe7b-0020-4b58-bdde-4a15366bfec9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4djk"
Jul 21 01:23:34.410413 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.410372    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-r2jpf"
Jul 21 01:23:34.544035 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.544003    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-r2jpf"]
Jul 21 01:23:34.547130 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:23:34.547101    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcab82bae_b077_47fe_8725_04a2d39bea10.slice/crio-cc276c99ba12b6b02ddf1ed5f948355f1c78cb74b7c8dccc466fecc7604dc986 WatchSource:0}: Error finding container cc276c99ba12b6b02ddf1ed5f948355f1c78cb74b7c8dccc466fecc7604dc986: Status 404 returned error can't find the container with id cc276c99ba12b6b02ddf1ed5f948355f1c78cb74b7c8dccc466fecc7604dc986
Jul 21 01:23:34.739918 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.739822    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-r2jpf" event={"ID":"cab82bae-b077-47fe-8725-04a2d39bea10","Type":"ContainerStarted","Data":"cc276c99ba12b6b02ddf1ed5f948355f1c78cb74b7c8dccc466fecc7604dc986"}
Jul 21 01:23:34.813894 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.813859    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-node-exporter-tls\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:34.814096 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.813990    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a929fe7b-0020-4b58-bdde-4a15366bfec9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-g4djk\" (UID: \"a929fe7b-0020-4b58-bdde-4a15366bfec9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4djk"
Jul 21 01:23:34.816536 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.816508    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a929fe7b-0020-4b58-bdde-4a15366bfec9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-g4djk\" (UID: \"a929fe7b-0020-4b58-bdde-4a15366bfec9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4djk"
Jul 21 01:23:34.816644 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:34.816539    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2b565020-4cb1-4d9b-8557-3a99d1c3ddb3-node-exporter-tls\") pod \"node-exporter-9x8ct\" (UID: \"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3\") " pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:35.003720 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.003634    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4djk"
Jul 21 01:23:35.044206 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.044172    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9x8ct"
Jul 21 01:23:35.061691 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:23:35.061664    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b565020_4cb1_4d9b_8557_3a99d1c3ddb3.slice/crio-824e88a6bdfe74a60c4eb038eee00ff458647064d7f653ba8abcbefbc734796e WatchSource:0}: Error finding container 824e88a6bdfe74a60c4eb038eee00ff458647064d7f653ba8abcbefbc734796e: Status 404 returned error can't find the container with id 824e88a6bdfe74a60c4eb038eee00ff458647064d7f653ba8abcbefbc734796e
Jul 21 01:23:35.168919 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.168883    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-g4djk"]
Jul 21 01:23:35.172656 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:23:35.172622    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda929fe7b_0020_4b58_bdde_4a15366bfec9.slice/crio-aa1882e239acdd6ee59f798834b1576a04d7703293286c94ac2eb3117e984e20 WatchSource:0}: Error finding container aa1882e239acdd6ee59f798834b1576a04d7703293286c94ac2eb3117e984e20: Status 404 returned error can't find the container with id aa1882e239acdd6ee59f798834b1576a04d7703293286c94ac2eb3117e984e20
Jul 21 01:23:35.186354 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.186322    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 01:23:35.190790 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.190771    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.192806 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.192756    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 21 01:23:35.192806 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.192776    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 21 01:23:35.192806 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.192800    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ndmht\""
Jul 21 01:23:35.193073 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.192951    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 21 01:23:35.193129 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.193119    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 21 01:23:35.193224 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.193204    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 21 01:23:35.193301 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.193270    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 21 01:23:35.193448 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.193435    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 21 01:23:35.193518 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.193451    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 21 01:23:35.193518 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.193454    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 21 01:23:35.206333 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.206306    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 01:23:35.318839 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.318805    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/35e53882-6496-4eae-8c17-1b092447ea76-config-out\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.319018 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.318857    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35e53882-6496-4eae-8c17-1b092447ea76-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.319018 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.318888    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l42sb\" (UniqueName: \"kubernetes.io/projected/35e53882-6496-4eae-8c17-1b092447ea76-kube-api-access-l42sb\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.319018 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.318925    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/35e53882-6496-4eae-8c17-1b092447ea76-tls-assets\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.319018 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.318976    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.319018 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.319003    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.319308 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.319025    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/35e53882-6496-4eae-8c17-1b092447ea76-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.319308 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.319060    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.319308 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.319097    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-config-volume\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.319308 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.319136    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35e53882-6496-4eae-8c17-1b092447ea76-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.319308 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.319165    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-web-config\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.319308 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.319294    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.319594 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.319349    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.419808 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.419770    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-config-volume\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.419808 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.419814    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35e53882-6496-4eae-8c17-1b092447ea76-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.420018 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.419836    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-web-config\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.420018 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.419860    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.420018 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.419998    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.420141 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.420052    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/35e53882-6496-4eae-8c17-1b092447ea76-config-out\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.420141 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.420084    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35e53882-6496-4eae-8c17-1b092447ea76-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.420141 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.420113    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l42sb\" (UniqueName: \"kubernetes.io/projected/35e53882-6496-4eae-8c17-1b092447ea76-kube-api-access-l42sb\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.420286 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.420160    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/35e53882-6496-4eae-8c17-1b092447ea76-tls-assets\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.420286 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.420183    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.420286 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.420207    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.420286 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.420231    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/35e53882-6496-4eae-8c17-1b092447ea76-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.420286 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.420271    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.420692 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.420659    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35e53882-6496-4eae-8c17-1b092447ea76-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.421333 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.421305    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/35e53882-6496-4eae-8c17-1b092447ea76-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.421700 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.421654    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35e53882-6496-4eae-8c17-1b092447ea76-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.423507 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.423341    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-web-config\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.423507 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.423438    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/35e53882-6496-4eae-8c17-1b092447ea76-tls-assets\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.423507 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.423462    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.423787 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.423752    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-config-volume\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.423787 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.423767    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.423925 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.423899    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.424177 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.424161    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.424509 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.424490    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.424805 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.424788    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/35e53882-6496-4eae-8c17-1b092447ea76-config-out\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.430798 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.430777    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l42sb\" (UniqueName: \"kubernetes.io/projected/35e53882-6496-4eae-8c17-1b092447ea76-kube-api-access-l42sb\") pod \"alertmanager-main-0\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.559122 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.559041    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:23:35.746711 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.746674    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4djk" event={"ID":"a929fe7b-0020-4b58-bdde-4a15366bfec9","Type":"ContainerStarted","Data":"755f7030fe3cfac0762af1154d3daa6b8779a87a5fab89e080a80e8f41198d02"}
Jul 21 01:23:35.747225 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.746741    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4djk" event={"ID":"a929fe7b-0020-4b58-bdde-4a15366bfec9","Type":"ContainerStarted","Data":"66f869c7015b4fd9984a95bb91a709ce1952cbcece9fe98d6681fcb721a9e0a9"}
Jul 21 01:23:35.747225 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.746772    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4djk" event={"ID":"a929fe7b-0020-4b58-bdde-4a15366bfec9","Type":"ContainerStarted","Data":"aa1882e239acdd6ee59f798834b1576a04d7703293286c94ac2eb3117e984e20"}
Jul 21 01:23:35.748259 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:35.748224    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9x8ct" event={"ID":"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3","Type":"ContainerStarted","Data":"824e88a6bdfe74a60c4eb038eee00ff458647064d7f653ba8abcbefbc734796e"}
Jul 21 01:23:36.166163 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.166136    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"]
Jul 21 01:23:36.170082 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.170059    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:36.173124 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.173060    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 21 01:23:36.173124 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.173085    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-9l8sw\""
Jul 21 01:23:36.173124 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.173094    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 21 01:23:36.173124 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.173114    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 21 01:23:36.173469 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.173063    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 21 01:23:36.173469 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.173431    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 21 01:23:36.173629 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.173514    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bbkoj08ijsqca\""
Jul 21 01:23:36.182304 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.182279    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"]
Jul 21 01:23:36.228251 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.228219    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/209b6aee-e2c6-43dc-8eef-bf23f5c31103-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bdb586f8b-8ssc6\" (UID: \"209b6aee-e2c6-43dc-8eef-bf23f5c31103\") " pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:36.228392 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.228262    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kczc\" (UniqueName: \"kubernetes.io/projected/209b6aee-e2c6-43dc-8eef-bf23f5c31103-kube-api-access-6kczc\") pod \"thanos-querier-5bdb586f8b-8ssc6\" (UID: \"209b6aee-e2c6-43dc-8eef-bf23f5c31103\") " pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:36.228392 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.228360    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/209b6aee-e2c6-43dc-8eef-bf23f5c31103-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bdb586f8b-8ssc6\" (UID: \"209b6aee-e2c6-43dc-8eef-bf23f5c31103\") " pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:36.228462 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.228391    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/209b6aee-e2c6-43dc-8eef-bf23f5c31103-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bdb586f8b-8ssc6\" (UID: \"209b6aee-e2c6-43dc-8eef-bf23f5c31103\") " pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:36.228462 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.228411    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/209b6aee-e2c6-43dc-8eef-bf23f5c31103-secret-grpc-tls\") pod \"thanos-querier-5bdb586f8b-8ssc6\" (UID: \"209b6aee-e2c6-43dc-8eef-bf23f5c31103\") " pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:36.228526 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.228465    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/209b6aee-e2c6-43dc-8eef-bf23f5c31103-secret-thanos-querier-tls\") pod \"thanos-querier-5bdb586f8b-8ssc6\" (UID: \"209b6aee-e2c6-43dc-8eef-bf23f5c31103\") " pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:36.228526 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.228491    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/209b6aee-e2c6-43dc-8eef-bf23f5c31103-metrics-client-ca\") pod \"thanos-querier-5bdb586f8b-8ssc6\" (UID: \"209b6aee-e2c6-43dc-8eef-bf23f5c31103\") " pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:36.228586 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.228558    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/209b6aee-e2c6-43dc-8eef-bf23f5c31103-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bdb586f8b-8ssc6\" (UID: \"209b6aee-e2c6-43dc-8eef-bf23f5c31103\") " pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:36.311431 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.311373    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 01:23:36.313802 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:23:36.313757    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35e53882_6496_4eae_8c17_1b092447ea76.slice/crio-c6f7e9619639f3934061f8e83bc2d5878bdcf05333cb5e65c2bb17c15c0bf85b WatchSource:0}: Error finding container c6f7e9619639f3934061f8e83bc2d5878bdcf05333cb5e65c2bb17c15c0bf85b: Status 404 returned error can't find the container with id c6f7e9619639f3934061f8e83bc2d5878bdcf05333cb5e65c2bb17c15c0bf85b
Jul 21 01:23:36.331168 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.329904    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/209b6aee-e2c6-43dc-8eef-bf23f5c31103-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bdb586f8b-8ssc6\" (UID: \"209b6aee-e2c6-43dc-8eef-bf23f5c31103\") " pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:36.331168 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.329976    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kczc\" (UniqueName: \"kubernetes.io/projected/209b6aee-e2c6-43dc-8eef-bf23f5c31103-kube-api-access-6kczc\") pod \"thanos-querier-5bdb586f8b-8ssc6\" (UID: \"209b6aee-e2c6-43dc-8eef-bf23f5c31103\") " pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:36.331168 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.330043    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/209b6aee-e2c6-43dc-8eef-bf23f5c31103-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bdb586f8b-8ssc6\" (UID: \"209b6aee-e2c6-43dc-8eef-bf23f5c31103\") " pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:36.331168 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.330077    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/209b6aee-e2c6-43dc-8eef-bf23f5c31103-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bdb586f8b-8ssc6\" (UID: \"209b6aee-e2c6-43dc-8eef-bf23f5c31103\") " pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:36.331168 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.330110    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/209b6aee-e2c6-43dc-8eef-bf23f5c31103-secret-grpc-tls\") pod \"thanos-querier-5bdb586f8b-8ssc6\" (UID: \"209b6aee-e2c6-43dc-8eef-bf23f5c31103\") " pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:36.331168 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.330147    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/209b6aee-e2c6-43dc-8eef-bf23f5c31103-secret-thanos-querier-tls\") pod \"thanos-querier-5bdb586f8b-8ssc6\" (UID: \"209b6aee-e2c6-43dc-8eef-bf23f5c31103\") " pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:36.331168 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.330175    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/209b6aee-e2c6-43dc-8eef-bf23f5c31103-metrics-client-ca\") pod \"thanos-querier-5bdb586f8b-8ssc6\" (UID: \"209b6aee-e2c6-43dc-8eef-bf23f5c31103\") " pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:36.331168 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.330245    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/209b6aee-e2c6-43dc-8eef-bf23f5c31103-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bdb586f8b-8ssc6\" (UID: \"209b6aee-e2c6-43dc-8eef-bf23f5c31103\") " pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:36.333615 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.333557    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/209b6aee-e2c6-43dc-8eef-bf23f5c31103-metrics-client-ca\") pod \"thanos-querier-5bdb586f8b-8ssc6\" (UID: \"209b6aee-e2c6-43dc-8eef-bf23f5c31103\") " pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:36.336438 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.335976    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/209b6aee-e2c6-43dc-8eef-bf23f5c31103-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bdb586f8b-8ssc6\" (UID: \"209b6aee-e2c6-43dc-8eef-bf23f5c31103\") " pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:36.337205 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.337181    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/209b6aee-e2c6-43dc-8eef-bf23f5c31103-secret-grpc-tls\") pod \"thanos-querier-5bdb586f8b-8ssc6\" (UID: \"209b6aee-e2c6-43dc-8eef-bf23f5c31103\") " pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:36.337735 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.337698    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/209b6aee-e2c6-43dc-8eef-bf23f5c31103-secret-thanos-querier-tls\") pod \"thanos-querier-5bdb586f8b-8ssc6\" (UID: \"209b6aee-e2c6-43dc-8eef-bf23f5c31103\") " pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:36.338622 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.337837    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/209b6aee-e2c6-43dc-8eef-bf23f5c31103-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bdb586f8b-8ssc6\" (UID: \"209b6aee-e2c6-43dc-8eef-bf23f5c31103\") " pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:36.340129 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.340090    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/209b6aee-e2c6-43dc-8eef-bf23f5c31103-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bdb586f8b-8ssc6\" (UID: \"209b6aee-e2c6-43dc-8eef-bf23f5c31103\") " pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:36.341246 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.341205    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/209b6aee-e2c6-43dc-8eef-bf23f5c31103-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bdb586f8b-8ssc6\" (UID: \"209b6aee-e2c6-43dc-8eef-bf23f5c31103\") " pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:36.343138 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.343090    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kczc\" (UniqueName: \"kubernetes.io/projected/209b6aee-e2c6-43dc-8eef-bf23f5c31103-kube-api-access-6kczc\") pod \"thanos-querier-5bdb586f8b-8ssc6\" (UID: \"209b6aee-e2c6-43dc-8eef-bf23f5c31103\") " pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:36.488543 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.488493    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:36.755714 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.755622    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35e53882-6496-4eae-8c17-1b092447ea76","Type":"ContainerStarted","Data":"c6f7e9619639f3934061f8e83bc2d5878bdcf05333cb5e65c2bb17c15c0bf85b"}
Jul 21 01:23:36.758767 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.758624    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-r2jpf" event={"ID":"cab82bae-b077-47fe-8725-04a2d39bea10","Type":"ContainerStarted","Data":"22d43a29ae5ba22eb04f6122ecbe632d8abb7cc376bd6c32140c0e4cc8b66dda"}
Jul 21 01:23:36.758767 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.758686    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-r2jpf" event={"ID":"cab82bae-b077-47fe-8725-04a2d39bea10","Type":"ContainerStarted","Data":"5da7bc5dc8b4c394702a99f7e899f66cf7a36d26ee74d10d0aa4f8b7d7fb0687"}
Jul 21 01:23:36.758767 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.758716    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-r2jpf" event={"ID":"cab82bae-b077-47fe-8725-04a2d39bea10","Type":"ContainerStarted","Data":"45691ccc6f102b5ea4f3f904172d187566b6bce2f756cd028babc8cc4e6a4b74"}
Jul 21 01:23:36.760459 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.760428    2586 generic.go:356] "Generic (PLEG): container finished" podID="2b565020-4cb1-4d9b-8557-3a99d1c3ddb3" containerID="ea8443dc938858d3127484e16b27eb114e91781e98d7b29fc0fd9b4b1748ef38" exitCode=0
Jul 21 01:23:36.760569 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.760491    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9x8ct" event={"ID":"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3","Type":"ContainerDied","Data":"ea8443dc938858d3127484e16b27eb114e91781e98d7b29fc0fd9b4b1748ef38"}
Jul 21 01:23:36.779453 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.779406    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-r2jpf" podStartSLOduration=1.167649541 podStartE2EDuration="2.779387546s" totalImagesPullingTime="1.611738005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:36.777841204 +0000 UTC m=+75.965880595" watchObservedRunningTime="2026-07-21 01:23:36.779387546 +0000 UTC m=+75.967426936"
Jul 21 01:23:36.901994 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:23:36.901952    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod209b6aee_e2c6_43dc_8eef_bf23f5c31103.slice/crio-f517c5e5b4ae5e4e05490fe2adff7f7431f5c27852f33d20df9bcc762d4b76b8 WatchSource:0}: Error finding container f517c5e5b4ae5e4e05490fe2adff7f7431f5c27852f33d20df9bcc762d4b76b8: Status 404 returned error can't find the container with id f517c5e5b4ae5e4e05490fe2adff7f7431f5c27852f33d20df9bcc762d4b76b8
Jul 21 01:23:36.924903 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.924863    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"]
Jul 21 01:23:36.937785 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.937752    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-fjv8z"]
Jul 21 01:23:36.941245 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.941225    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-fjv8z"
Jul 21 01:23:36.943428 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.943407    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-8kj52\""
Jul 21 01:23:36.943747 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.943732    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 21 01:23:36.943908 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.943896    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 21 01:23:36.951330 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:36.951304    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-fjv8z"]
Jul 21 01:23:37.038514 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:37.038423    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp855\" (UniqueName: \"kubernetes.io/projected/c096a789-958f-4e95-900f-5737ba498889-kube-api-access-sp855\") pod \"downloads-5bc67dcd46-fjv8z\" (UID: \"c096a789-958f-4e95-900f-5737ba498889\") " pod="openshift-console/downloads-5bc67dcd46-fjv8z"
Jul 21 01:23:37.139873 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:37.139843    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp855\" (UniqueName: \"kubernetes.io/projected/c096a789-958f-4e95-900f-5737ba498889-kube-api-access-sp855\") pod \"downloads-5bc67dcd46-fjv8z\" (UID: \"c096a789-958f-4e95-900f-5737ba498889\") " pod="openshift-console/downloads-5bc67dcd46-fjv8z"
Jul 21 01:23:37.151382 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:37.151313    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp855\" (UniqueName: \"kubernetes.io/projected/c096a789-958f-4e95-900f-5737ba498889-kube-api-access-sp855\") pod \"downloads-5bc67dcd46-fjv8z\" (UID: \"c096a789-958f-4e95-900f-5737ba498889\") " pod="openshift-console/downloads-5bc67dcd46-fjv8z"
Jul 21 01:23:37.253571 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:37.253516    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-fjv8z"
Jul 21 01:23:37.554862 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:37.554824    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-fjv8z"]
Jul 21 01:23:37.558465 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:23:37.558438    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc096a789_958f_4e95_900f_5737ba498889.slice/crio-52f78a5b914026d33247586c688c5d5577b6e6f74261783d144d4d0179f438d5 WatchSource:0}: Error finding container 52f78a5b914026d33247586c688c5d5577b6e6f74261783d144d4d0179f438d5: Status 404 returned error can't find the container with id 52f78a5b914026d33247586c688c5d5577b6e6f74261783d144d4d0179f438d5
Jul 21 01:23:37.766429 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:37.766344    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6" event={"ID":"209b6aee-e2c6-43dc-8eef-bf23f5c31103","Type":"ContainerStarted","Data":"f517c5e5b4ae5e4e05490fe2adff7f7431f5c27852f33d20df9bcc762d4b76b8"}
Jul 21 01:23:37.768351 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:37.768326    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4djk" event={"ID":"a929fe7b-0020-4b58-bdde-4a15366bfec9","Type":"ContainerStarted","Data":"44bd6b978f0a071593cab0ba2a43ab30cd8a692179e57da25f0685969d83799a"}
Jul 21 01:23:37.769891 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:37.769867    2586 generic.go:356] "Generic (PLEG): container finished" podID="35e53882-6496-4eae-8c17-1b092447ea76" containerID="ee1aadf9af706f94a47e8eabcd133c52f01c72984a78019c717d44057d9e1855" exitCode=0
Jul 21 01:23:37.770063 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:37.769971    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35e53882-6496-4eae-8c17-1b092447ea76","Type":"ContainerDied","Data":"ee1aadf9af706f94a47e8eabcd133c52f01c72984a78019c717d44057d9e1855"}
Jul 21 01:23:37.771277 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:37.771249    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-fjv8z" event={"ID":"c096a789-958f-4e95-900f-5737ba498889","Type":"ContainerStarted","Data":"52f78a5b914026d33247586c688c5d5577b6e6f74261783d144d4d0179f438d5"}
Jul 21 01:23:37.773492 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:37.773459    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9x8ct" event={"ID":"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3","Type":"ContainerStarted","Data":"70448fb096c9238aa09aabddc939bebd047c95fa55cf8d8bbaaf418153bc1908"}
Jul 21 01:23:37.773585 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:37.773512    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9x8ct" event={"ID":"2b565020-4cb1-4d9b-8557-3a99d1c3ddb3","Type":"ContainerStarted","Data":"932224132ac47b29e8619f2e2c419374816af41b1fe74f4bbf36c80ed52da684"}
Jul 21 01:23:37.784799 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:37.784748    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4djk" podStartSLOduration=2.440162678 podStartE2EDuration="3.784726085s" totalImagesPullingTime="1.344563407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:37.784040597 +0000 UTC m=+76.972079995" watchObservedRunningTime="2026-07-21 01:23:37.784726085 +0000 UTC m=+76.972765475"
Jul 21 01:23:37.803596 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:37.803543    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9x8ct" podStartSLOduration=2.59004249 podStartE2EDuration="3.803521229s" totalImagesPullingTime="1.099020956s" totalInitContainerRuntime="114.457783ms" isStatefulPod=true podCreationTimestamp="2026-07-21 01:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:37.80296686 +0000 UTC m=+76.991006251" watchObservedRunningTime="2026-07-21 01:23:37.803521229 +0000 UTC m=+76.991560627"
Jul 21 01:23:38.580990 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.580952    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7598f45dc6-9sh89"]
Jul 21 01:23:38.586401 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.586372    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:23:38.588738 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.588714    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-7lz68\""
Jul 21 01:23:38.588864 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.588736    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 21 01:23:38.589098 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.589083    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 21 01:23:38.589644 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.589424    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 21 01:23:38.589644 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.589422    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4tm549amgbcuj\""
Jul 21 01:23:38.589644 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.589449    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 21 01:23:38.596190 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.596159    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7598f45dc6-9sh89"]
Jul 21 01:23:38.655476 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.655434    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chl5l\" (UniqueName: \"kubernetes.io/projected/eb8bad2b-774d-4994-a91f-ce3e46533608-kube-api-access-chl5l\") pod \"metrics-server-7598f45dc6-9sh89\" (UID: \"eb8bad2b-774d-4994-a91f-ce3e46533608\") " pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:23:38.655631 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.655504    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eb8bad2b-774d-4994-a91f-ce3e46533608-metrics-server-audit-profiles\") pod \"metrics-server-7598f45dc6-9sh89\" (UID: \"eb8bad2b-774d-4994-a91f-ce3e46533608\") " pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:23:38.655631 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.655536    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb8bad2b-774d-4994-a91f-ce3e46533608-client-ca-bundle\") pod \"metrics-server-7598f45dc6-9sh89\" (UID: \"eb8bad2b-774d-4994-a91f-ce3e46533608\") " pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:23:38.655631 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.655584    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb8bad2b-774d-4994-a91f-ce3e46533608-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7598f45dc6-9sh89\" (UID: \"eb8bad2b-774d-4994-a91f-ce3e46533608\") " pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:23:38.655631 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.655610    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eb8bad2b-774d-4994-a91f-ce3e46533608-audit-log\") pod \"metrics-server-7598f45dc6-9sh89\" (UID: \"eb8bad2b-774d-4994-a91f-ce3e46533608\") " pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:23:38.655851 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.655665    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eb8bad2b-774d-4994-a91f-ce3e46533608-secret-metrics-server-client-certs\") pod \"metrics-server-7598f45dc6-9sh89\" (UID: \"eb8bad2b-774d-4994-a91f-ce3e46533608\") " pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:23:38.655851 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.655688    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eb8bad2b-774d-4994-a91f-ce3e46533608-secret-metrics-server-tls\") pod \"metrics-server-7598f45dc6-9sh89\" (UID: \"eb8bad2b-774d-4994-a91f-ce3e46533608\") " pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:23:38.756274 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.756235    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eb8bad2b-774d-4994-a91f-ce3e46533608-secret-metrics-server-client-certs\") pod \"metrics-server-7598f45dc6-9sh89\" (UID: \"eb8bad2b-774d-4994-a91f-ce3e46533608\") " pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:23:38.756274 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.756279    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eb8bad2b-774d-4994-a91f-ce3e46533608-secret-metrics-server-tls\") pod \"metrics-server-7598f45dc6-9sh89\" (UID: \"eb8bad2b-774d-4994-a91f-ce3e46533608\") " pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:23:38.756514 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.756311    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chl5l\" (UniqueName: \"kubernetes.io/projected/eb8bad2b-774d-4994-a91f-ce3e46533608-kube-api-access-chl5l\") pod \"metrics-server-7598f45dc6-9sh89\" (UID: \"eb8bad2b-774d-4994-a91f-ce3e46533608\") " pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:23:38.756514 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.756352    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eb8bad2b-774d-4994-a91f-ce3e46533608-metrics-server-audit-profiles\") pod \"metrics-server-7598f45dc6-9sh89\" (UID: \"eb8bad2b-774d-4994-a91f-ce3e46533608\") " pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:23:38.756514 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.756375    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb8bad2b-774d-4994-a91f-ce3e46533608-client-ca-bundle\") pod \"metrics-server-7598f45dc6-9sh89\" (UID: \"eb8bad2b-774d-4994-a91f-ce3e46533608\") " pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:23:38.756514 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.756423    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb8bad2b-774d-4994-a91f-ce3e46533608-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7598f45dc6-9sh89\" (UID: \"eb8bad2b-774d-4994-a91f-ce3e46533608\") " pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:23:38.756514 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.756448    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eb8bad2b-774d-4994-a91f-ce3e46533608-audit-log\") pod \"metrics-server-7598f45dc6-9sh89\" (UID: \"eb8bad2b-774d-4994-a91f-ce3e46533608\") " pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:23:38.756861 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.756827    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eb8bad2b-774d-4994-a91f-ce3e46533608-audit-log\") pod \"metrics-server-7598f45dc6-9sh89\" (UID: \"eb8bad2b-774d-4994-a91f-ce3e46533608\") " pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:23:38.757365 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.757338    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb8bad2b-774d-4994-a91f-ce3e46533608-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7598f45dc6-9sh89\" (UID: \"eb8bad2b-774d-4994-a91f-ce3e46533608\") " pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:23:38.757476 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.757455    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eb8bad2b-774d-4994-a91f-ce3e46533608-metrics-server-audit-profiles\") pod \"metrics-server-7598f45dc6-9sh89\" (UID: \"eb8bad2b-774d-4994-a91f-ce3e46533608\") " pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:23:38.758972 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.758950    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eb8bad2b-774d-4994-a91f-ce3e46533608-secret-metrics-server-tls\") pod \"metrics-server-7598f45dc6-9sh89\" (UID: \"eb8bad2b-774d-4994-a91f-ce3e46533608\") " pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:23:38.759120 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.759099    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eb8bad2b-774d-4994-a91f-ce3e46533608-secret-metrics-server-client-certs\") pod \"metrics-server-7598f45dc6-9sh89\" (UID: \"eb8bad2b-774d-4994-a91f-ce3e46533608\") " pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:23:38.759174 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.759133    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb8bad2b-774d-4994-a91f-ce3e46533608-client-ca-bundle\") pod \"metrics-server-7598f45dc6-9sh89\" (UID: \"eb8bad2b-774d-4994-a91f-ce3e46533608\") " pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:23:38.764853 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.764828    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chl5l\" (UniqueName: \"kubernetes.io/projected/eb8bad2b-774d-4994-a91f-ce3e46533608-kube-api-access-chl5l\") pod \"metrics-server-7598f45dc6-9sh89\" (UID: \"eb8bad2b-774d-4994-a91f-ce3e46533608\") " pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:23:38.857015 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.856975    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cn4ts"]
Jul 21 01:23:38.861510 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.861482    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cn4ts"
Jul 21 01:23:38.864224 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.863803    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-h4bht\""
Jul 21 01:23:38.864224 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.864060    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 21 01:23:38.872163 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.872135    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cn4ts"]
Jul 21 01:23:38.907116 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.907083    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:23:38.958573 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.958532    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/746eabd4-7e64-4632-8ce8-f13dc1cd4549-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-cn4ts\" (UID: \"746eabd4-7e64-4632-8ce8-f13dc1cd4549\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cn4ts"
Jul 21 01:23:38.958765 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:38.958695    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cddfv\" (UniqueName: \"kubernetes.io/projected/746eabd4-7e64-4632-8ce8-f13dc1cd4549-kube-api-access-cddfv\") pod \"monitoring-plugin-7b7b7bc8bf-cn4ts\" (UID: \"746eabd4-7e64-4632-8ce8-f13dc1cd4549\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cn4ts"
Jul 21 01:23:39.060278 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:39.060236    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/746eabd4-7e64-4632-8ce8-f13dc1cd4549-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-cn4ts\" (UID: \"746eabd4-7e64-4632-8ce8-f13dc1cd4549\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cn4ts"
Jul 21 01:23:39.060452 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:39.060355    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cddfv\" (UniqueName: \"kubernetes.io/projected/746eabd4-7e64-4632-8ce8-f13dc1cd4549-kube-api-access-cddfv\") pod \"monitoring-plugin-7b7b7bc8bf-cn4ts\" (UID: \"746eabd4-7e64-4632-8ce8-f13dc1cd4549\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cn4ts"
Jul 21 01:23:39.060799 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:39.060770    2586 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 21 01:23:39.060929 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:23:39.060844    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/746eabd4-7e64-4632-8ce8-f13dc1cd4549-monitoring-plugin-cert podName:746eabd4-7e64-4632-8ce8-f13dc1cd4549 nodeName:}" failed. No retries permitted until 2026-07-21 01:23:39.560823433 +0000 UTC m=+78.748862801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/746eabd4-7e64-4632-8ce8-f13dc1cd4549-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-cn4ts" (UID: "746eabd4-7e64-4632-8ce8-f13dc1cd4549") : secret "monitoring-plugin-cert" not found
Jul 21 01:23:39.072738 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:39.072670    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cddfv\" (UniqueName: \"kubernetes.io/projected/746eabd4-7e64-4632-8ce8-f13dc1cd4549-kube-api-access-cddfv\") pod \"monitoring-plugin-7b7b7bc8bf-cn4ts\" (UID: \"746eabd4-7e64-4632-8ce8-f13dc1cd4549\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cn4ts"
Jul 21 01:23:39.565294 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:39.565256    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/746eabd4-7e64-4632-8ce8-f13dc1cd4549-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-cn4ts\" (UID: \"746eabd4-7e64-4632-8ce8-f13dc1cd4549\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cn4ts"
Jul 21 01:23:39.568107 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:39.568079    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/746eabd4-7e64-4632-8ce8-f13dc1cd4549-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-cn4ts\" (UID: \"746eabd4-7e64-4632-8ce8-f13dc1cd4549\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cn4ts"
Jul 21 01:23:39.778896 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:39.778864    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cn4ts"
Jul 21 01:23:40.196889 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.196817    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cn4ts"]
Jul 21 01:23:40.218190 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.218164    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7598f45dc6-9sh89"]
Jul 21 01:23:40.224087 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:23:40.224043    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb8bad2b_774d_4994_a91f_ce3e46533608.slice/crio-aa8ecf77c81e1723c8ae3b9602ce3f3290285aa3ab0dcbc72b3c88f289df1f3e WatchSource:0}: Error finding container aa8ecf77c81e1723c8ae3b9602ce3f3290285aa3ab0dcbc72b3c88f289df1f3e: Status 404 returned error can't find the container with id aa8ecf77c81e1723c8ae3b9602ce3f3290285aa3ab0dcbc72b3c88f289df1f3e
Jul 21 01:23:40.515522 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.515436    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 01:23:40.520453 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.520419    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.525478 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.525150    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b2t0g42cckooc\""
Jul 21 01:23:40.525478 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.525182    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 21 01:23:40.525478 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.525317    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 21 01:23:40.525478 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.525351    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 21 01:23:40.525759 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.525570    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 21 01:23:40.525759 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.525728    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 21 01:23:40.525891 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.525150    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wbknd\""
Jul 21 01:23:40.526289 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.526266    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 21 01:23:40.526358 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.526279    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 21 01:23:40.528545 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.526717    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 21 01:23:40.529035 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.529016    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 21 01:23:40.529220 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.529191    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 21 01:23:40.529323 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.529302    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 21 01:23:40.531881 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.531855    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 21 01:23:40.532991 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.532972    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 21 01:23:40.536212 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.536192    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 21 01:23:40.542721 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.542697    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 01:23:40.573310 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.573269    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.573476 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.573316    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-web-config\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.573476 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.573348    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.573476 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.573376    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.573476 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.573405    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-config\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.573476 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.573433    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b48z4\" (UniqueName: \"kubernetes.io/projected/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-kube-api-access-b48z4\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.573476 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.573459    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.573744 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.573494    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.573744 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.573519    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.573744 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.573550    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.573744 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.573576    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.573744 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.573626    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.573744 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.573651    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.573744 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.573674    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-config-out\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.573744 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.573696    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.573744 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.573725    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.574065 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.573746    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.574065 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.573784    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.574065 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.573827    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.574065 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.573850    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.674837 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.674795    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.675026 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.674847    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.675026 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.674877    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-config-out\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.675026 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.674902    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.675026 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.674962    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.675026 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.674987    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.675026 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.675021    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.675439 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.675062    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.675439 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.675089    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.675439 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.675119    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.675439 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.675142    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-web-config\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.675439 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.675170    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.675439 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.675194    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.675439 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.675227    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-config\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.675439 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.675256    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b48z4\" (UniqueName: \"kubernetes.io/projected/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-kube-api-access-b48z4\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.675439 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.675283    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.675439 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.675318    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.675439 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.675341    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.675439 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.675376    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.675439 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.675404    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.676848 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.676537    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.676848 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.676835    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.677186 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.677158    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.686153 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.681562    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.686153 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.681719    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.686153 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.681807    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.686153 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.682225    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.686153 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.683327    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.686153 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.684163    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.686153 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.684753    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.686153 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.685247    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.686153 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.686094    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.686153 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.686094    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.686965 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.686854    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.687430 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.687383    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b48z4\" (UniqueName: \"kubernetes.io/projected/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-kube-api-access-b48z4\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.688732 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.688680    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-config-out\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.688904 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.688878    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.689418 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.689382    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-config\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.690042 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.689710    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-web-config\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.691506 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.691355    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:40.794066 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.793984    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6" event={"ID":"209b6aee-e2c6-43dc-8eef-bf23f5c31103","Type":"ContainerStarted","Data":"ae9454db4428dc3e4867582da6bb28bae5a279f36d30186cd0033e3c4c6b1c93"}
Jul 21 01:23:40.794210 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.794070    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6" event={"ID":"209b6aee-e2c6-43dc-8eef-bf23f5c31103","Type":"ContainerStarted","Data":"f06b42dc5455fc128facabe000f3c8f9703b342a0df571c2a6867bce074a13c5"}
Jul 21 01:23:40.794210 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.794111    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6" event={"ID":"209b6aee-e2c6-43dc-8eef-bf23f5c31103","Type":"ContainerStarted","Data":"9858b4fbb426d25e68d1c6a5fa4fa7bb48d82c720dbc19ce6208e66c09551629"}
Jul 21 01:23:40.795919 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.795880    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89" event={"ID":"eb8bad2b-774d-4994-a91f-ce3e46533608","Type":"ContainerStarted","Data":"aa8ecf77c81e1723c8ae3b9602ce3f3290285aa3ab0dcbc72b3c88f289df1f3e"}
Jul 21 01:23:40.804400 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.804350    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35e53882-6496-4eae-8c17-1b092447ea76","Type":"ContainerStarted","Data":"fde7b06605e54c681cd2fe89d9f4603b99058593aed1bb2b995bde5430992194"}
Jul 21 01:23:40.804554 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.804431    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35e53882-6496-4eae-8c17-1b092447ea76","Type":"ContainerStarted","Data":"b4751d6312b70a8308f5d09fef8997df7d5669ae139926add1513563bbed071a"}
Jul 21 01:23:40.804554 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.804473    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35e53882-6496-4eae-8c17-1b092447ea76","Type":"ContainerStarted","Data":"01167d4c8456d5023ac650fc1a9870536913d89db630c5347cde86419c320592"}
Jul 21 01:23:40.804554 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.804511    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35e53882-6496-4eae-8c17-1b092447ea76","Type":"ContainerStarted","Data":"526c98188936b5d9b23b698927261e05a0d29cee8abe395a92240b9d10c48b36"}
Jul 21 01:23:40.804554 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.804550    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35e53882-6496-4eae-8c17-1b092447ea76","Type":"ContainerStarted","Data":"10df76c36d5790f8218f82b4d1f07d6f23236ee5bcdf8cfdf63557578e4fda03"}
Jul 21 01:23:40.805959 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.805908    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cn4ts" event={"ID":"746eabd4-7e64-4632-8ce8-f13dc1cd4549","Type":"ContainerStarted","Data":"046fb6a7ca6789249f9c1c04fa9c1ccfbffbce5bc88f1b52a3740d66d6e474e2"}
Jul 21 01:23:40.839610 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:40.839341    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:41.042683 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:41.042562    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 01:23:41.051106 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:23:41.051055    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bbdc410_66d4_493f_9d1f_67bd4dbcca2c.slice/crio-62f9da94aaeeec062480426c3cb262bcdf87f5b536848b1364e0149124c3913b WatchSource:0}: Error finding container 62f9da94aaeeec062480426c3cb262bcdf87f5b536848b1364e0149124c3913b: Status 404 returned error can't find the container with id 62f9da94aaeeec062480426c3cb262bcdf87f5b536848b1364e0149124c3913b
Jul 21 01:23:41.813512 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:41.813468    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c","Type":"ContainerStarted","Data":"650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e"}
Jul 21 01:23:41.813997 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:41.813628    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c","Type":"ContainerStarted","Data":"62f9da94aaeeec062480426c3cb262bcdf87f5b536848b1364e0149124c3913b"}
Jul 21 01:23:42.822920 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:42.822824    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6" event={"ID":"209b6aee-e2c6-43dc-8eef-bf23f5c31103","Type":"ContainerStarted","Data":"6622c834b640d719df2e4ca194052d8565cfbd79a30f0d30f778f430517343b8"}
Jul 21 01:23:42.822920 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:42.822910    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6" event={"ID":"209b6aee-e2c6-43dc-8eef-bf23f5c31103","Type":"ContainerStarted","Data":"a8978af71add7ddf8a3cdcb1a6adfecb711fab4a40b67a20162f8c11e8456a37"}
Jul 21 01:23:42.823444 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:42.822977    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6" event={"ID":"209b6aee-e2c6-43dc-8eef-bf23f5c31103","Type":"ContainerStarted","Data":"672838c57382891d98af3ed21669522cc25cab227e870b96cbc388634e38294e"}
Jul 21 01:23:42.823444 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:42.823117    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:42.824863 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:42.824835    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89" event={"ID":"eb8bad2b-774d-4994-a91f-ce3e46533608","Type":"ContainerStarted","Data":"6502570b7ed443ee6e03128def71d922ebeb54197619f1116d525545f3bad7ac"}
Jul 21 01:23:42.829435 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:42.829355    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35e53882-6496-4eae-8c17-1b092447ea76","Type":"ContainerStarted","Data":"c7d7634cdf8eb1228cbe33c542fab71d09ebbdd4b5e4075aaa0ed9f6f2e04078"}
Jul 21 01:23:42.831184 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:42.831153    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cn4ts" event={"ID":"746eabd4-7e64-4632-8ce8-f13dc1cd4549","Type":"ContainerStarted","Data":"2b7fc3f2790c48a838bec63da87074de182e743a41bb84d4c665ebe9154492b3"}
Jul 21 01:23:42.831479 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:42.831452    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cn4ts"
Jul 21 01:23:42.834660 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:42.833332    2586 generic.go:356] "Generic (PLEG): container finished" podID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerID="650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e" exitCode=0
Jul 21 01:23:42.834660 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:42.833395    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c","Type":"ContainerDied","Data":"650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e"}
Jul 21 01:23:42.837559 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:42.837539    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cn4ts"
Jul 21 01:23:42.846335 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:42.846278    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6" podStartSLOduration=1.7550204329999999 podStartE2EDuration="6.846257167s" totalImagesPullingTime="5.091236734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:23:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:42.845579975 +0000 UTC m=+82.033619365" watchObservedRunningTime="2026-07-21 01:23:42.846257167 +0000 UTC m=+82.034296559"
Jul 21 01:23:42.863450 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:42.863387    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cn4ts" podStartSLOduration=2.770883459 podStartE2EDuration="4.863363375s" totalImagesPullingTime="2.092479916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:42.862136045 +0000 UTC m=+82.050175436" watchObservedRunningTime="2026-07-21 01:23:42.863363375 +0000 UTC m=+82.051402746"
Jul 21 01:23:42.917561 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:42.917493    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.670220409 podStartE2EDuration="7.917468921s" totalImagesPullingTime="5.227373898s" totalInitContainerRuntime="19.874614ms" isStatefulPod=false podCreationTimestamp="2026-07-21 01:23:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:42.915670012 +0000 UTC m=+82.103709403" watchObservedRunningTime="2026-07-21 01:23:42.917468921 +0000 UTC m=+82.105508314"
Jul 21 01:23:42.938449 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:42.938386    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89" podStartSLOduration=2.816444611 podStartE2EDuration="4.938361195s" totalImagesPullingTime="2.121916584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:42.937672523 +0000 UTC m=+82.125711918" watchObservedRunningTime="2026-07-21 01:23:42.938361195 +0000 UTC m=+82.126400577"
Jul 21 01:23:47.868643 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:47.868596    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c","Type":"ContainerStarted","Data":"830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea"}
Jul 21 01:23:47.869108 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:47.868689    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c","Type":"ContainerStarted","Data":"3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84"}
Jul 21 01:23:47.869108 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:47.868732    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c","Type":"ContainerStarted","Data":"90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c"}
Jul 21 01:23:47.869108 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:47.868757    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c","Type":"ContainerStarted","Data":"731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7"}
Jul 21 01:23:47.869108 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:47.868781    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c","Type":"ContainerStarted","Data":"980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba"}
Jul 21 01:23:47.869108 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:47.868804    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c","Type":"ContainerStarted","Data":"f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc"}
Jul 21 01:23:47.898826 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:47.898732    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.92369971 podStartE2EDuration="7.898709258s" totalImagesPullingTime="3.945351699s" totalInitContainerRuntime="29.657849ms" isStatefulPod=false podCreationTimestamp="2026-07-21 01:23:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:47.89662959 +0000 UTC m=+87.084668981" watchObservedRunningTime="2026-07-21 01:23:47.898709258 +0000 UTC m=+87.086748650"
Jul 21 01:23:48.847265 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:48.847233    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5bdb586f8b-8ssc6"
Jul 21 01:23:50.839950 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:50.839899    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:23:57.920173 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:57.920133    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-fjv8z" event={"ID":"c096a789-958f-4e95-900f-5737ba498889","Type":"ContainerStarted","Data":"a7acc28dc52f465f31eb3bd59e2506faa0638d956c5fc1d6b3fdca2321558618"}
Jul 21 01:23:57.920706 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:57.920358    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-fjv8z"
Jul 21 01:23:57.938906 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:57.938844    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-fjv8z" podStartSLOduration=2.105132147 podStartE2EDuration="21.938827332s" totalImagesPullingTime="19.833695185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:23:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:57.937831263 +0000 UTC m=+97.125870654" watchObservedRunningTime="2026-07-21 01:23:57.938827332 +0000 UTC m=+97.126866721"
Jul 21 01:23:57.940918 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:57.940892    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-fjv8z"
Jul 21 01:23:58.908103 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:58.908065    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:23:58.908800 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:23:58.908773    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:24:04.742657 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:04.742625    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-47x5c"
Jul 21 01:24:18.912657 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:18.912625    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:24:18.916824 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:18.916804    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7598f45dc6-9sh89"
Jul 21 01:24:40.839635 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:40.839588    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:40.900207 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:40.900174    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:41.123055 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:41.123028    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:54.492237 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:54.492199    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 01:24:54.492769 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:54.492494    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="35e53882-6496-4eae-8c17-1b092447ea76" containerName="alertmanager" containerID="cri-o://10df76c36d5790f8218f82b4d1f07d6f23236ee5bcdf8cfdf63557578e4fda03" gracePeriod=120
Jul 21 01:24:54.492769 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:54.492577    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="35e53882-6496-4eae-8c17-1b092447ea76" containerName="kube-rbac-proxy-metric" containerID="cri-o://fde7b06605e54c681cd2fe89d9f4603b99058593aed1bb2b995bde5430992194" gracePeriod=120
Jul 21 01:24:54.492769 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:54.492602    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="35e53882-6496-4eae-8c17-1b092447ea76" containerName="kube-rbac-proxy-web" containerID="cri-o://01167d4c8456d5023ac650fc1a9870536913d89db630c5347cde86419c320592" gracePeriod=120
Jul 21 01:24:54.492769 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:54.492653    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="35e53882-6496-4eae-8c17-1b092447ea76" containerName="kube-rbac-proxy" containerID="cri-o://b4751d6312b70a8308f5d09fef8997df7d5669ae139926add1513563bbed071a" gracePeriod=120
Jul 21 01:24:54.492769 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:54.492691    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="35e53882-6496-4eae-8c17-1b092447ea76" containerName="prom-label-proxy" containerID="cri-o://c7d7634cdf8eb1228cbe33c542fab71d09ebbdd4b5e4075aaa0ed9f6f2e04078" gracePeriod=120
Jul 21 01:24:54.492769 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:54.492650    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="35e53882-6496-4eae-8c17-1b092447ea76" containerName="config-reloader" containerID="cri-o://526c98188936b5d9b23b698927261e05a0d29cee8abe395a92240b9d10c48b36" gracePeriod=120
Jul 21 01:24:55.167505 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.167472    2586 generic.go:356] "Generic (PLEG): container finished" podID="35e53882-6496-4eae-8c17-1b092447ea76" containerID="c7d7634cdf8eb1228cbe33c542fab71d09ebbdd4b5e4075aaa0ed9f6f2e04078" exitCode=0
Jul 21 01:24:55.167505 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.167496    2586 generic.go:356] "Generic (PLEG): container finished" podID="35e53882-6496-4eae-8c17-1b092447ea76" containerID="b4751d6312b70a8308f5d09fef8997df7d5669ae139926add1513563bbed071a" exitCode=0
Jul 21 01:24:55.167505 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.167505    2586 generic.go:356] "Generic (PLEG): container finished" podID="35e53882-6496-4eae-8c17-1b092447ea76" containerID="526c98188936b5d9b23b698927261e05a0d29cee8abe395a92240b9d10c48b36" exitCode=0
Jul 21 01:24:55.167505 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.167511    2586 generic.go:356] "Generic (PLEG): container finished" podID="35e53882-6496-4eae-8c17-1b092447ea76" containerID="10df76c36d5790f8218f82b4d1f07d6f23236ee5bcdf8cfdf63557578e4fda03" exitCode=0
Jul 21 01:24:55.167773 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.167542    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35e53882-6496-4eae-8c17-1b092447ea76","Type":"ContainerDied","Data":"c7d7634cdf8eb1228cbe33c542fab71d09ebbdd4b5e4075aaa0ed9f6f2e04078"}
Jul 21 01:24:55.167773 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.167608    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35e53882-6496-4eae-8c17-1b092447ea76","Type":"ContainerDied","Data":"b4751d6312b70a8308f5d09fef8997df7d5669ae139926add1513563bbed071a"}
Jul 21 01:24:55.167773 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.167635    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35e53882-6496-4eae-8c17-1b092447ea76","Type":"ContainerDied","Data":"526c98188936b5d9b23b698927261e05a0d29cee8abe395a92240b9d10c48b36"}
Jul 21 01:24:55.167773 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.167662    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35e53882-6496-4eae-8c17-1b092447ea76","Type":"ContainerDied","Data":"10df76c36d5790f8218f82b4d1f07d6f23236ee5bcdf8cfdf63557578e4fda03"}
Jul 21 01:24:55.750642 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.750612    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:55.765239 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.765209    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-cluster-tls-config\") pod \"35e53882-6496-4eae-8c17-1b092447ea76\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") "
Jul 21 01:24:55.765423 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.765252    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/35e53882-6496-4eae-8c17-1b092447ea76-alertmanager-main-db\") pod \"35e53882-6496-4eae-8c17-1b092447ea76\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") "
Jul 21 01:24:55.765423 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.765272    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-secret-alertmanager-kube-rbac-proxy-web\") pod \"35e53882-6496-4eae-8c17-1b092447ea76\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") "
Jul 21 01:24:55.765423 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.765292    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/35e53882-6496-4eae-8c17-1b092447ea76-config-out\") pod \"35e53882-6496-4eae-8c17-1b092447ea76\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") "
Jul 21 01:24:55.765423 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.765315    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-secret-alertmanager-main-tls\") pod \"35e53882-6496-4eae-8c17-1b092447ea76\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") "
Jul 21 01:24:55.765423 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.765351    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-config-volume\") pod \"35e53882-6496-4eae-8c17-1b092447ea76\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") "
Jul 21 01:24:55.765423 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.765405    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-secret-alertmanager-kube-rbac-proxy\") pod \"35e53882-6496-4eae-8c17-1b092447ea76\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") "
Jul 21 01:24:55.765719 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.765435    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-secret-alertmanager-kube-rbac-proxy-metric\") pod \"35e53882-6496-4eae-8c17-1b092447ea76\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") "
Jul 21 01:24:55.765719 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.765460    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-web-config\") pod \"35e53882-6496-4eae-8c17-1b092447ea76\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") "
Jul 21 01:24:55.765719 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.765482    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/35e53882-6496-4eae-8c17-1b092447ea76-tls-assets\") pod \"35e53882-6496-4eae-8c17-1b092447ea76\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") "
Jul 21 01:24:55.765719 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.765520    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l42sb\" (UniqueName: \"kubernetes.io/projected/35e53882-6496-4eae-8c17-1b092447ea76-kube-api-access-l42sb\") pod \"35e53882-6496-4eae-8c17-1b092447ea76\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") "
Jul 21 01:24:55.765719 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.765549    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35e53882-6496-4eae-8c17-1b092447ea76-metrics-client-ca\") pod \"35e53882-6496-4eae-8c17-1b092447ea76\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") "
Jul 21 01:24:55.765719 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.765592    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35e53882-6496-4eae-8c17-1b092447ea76-alertmanager-trusted-ca-bundle\") pod \"35e53882-6496-4eae-8c17-1b092447ea76\" (UID: \"35e53882-6496-4eae-8c17-1b092447ea76\") "
Jul 21 01:24:55.765719 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.765599    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35e53882-6496-4eae-8c17-1b092447ea76-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "35e53882-6496-4eae-8c17-1b092447ea76" (UID: "35e53882-6496-4eae-8c17-1b092447ea76"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:24:55.766381 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.766209    2586 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/35e53882-6496-4eae-8c17-1b092447ea76-alertmanager-main-db\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:55.767031 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.767000    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35e53882-6496-4eae-8c17-1b092447ea76-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "35e53882-6496-4eae-8c17-1b092447ea76" (UID: "35e53882-6496-4eae-8c17-1b092447ea76"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:24:55.767230 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.767191    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35e53882-6496-4eae-8c17-1b092447ea76-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "35e53882-6496-4eae-8c17-1b092447ea76" (UID: "35e53882-6496-4eae-8c17-1b092447ea76"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:24:55.768813 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.768680    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "35e53882-6496-4eae-8c17-1b092447ea76" (UID: "35e53882-6496-4eae-8c17-1b092447ea76"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:24:55.768813 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.768786    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35e53882-6496-4eae-8c17-1b092447ea76-config-out" (OuterVolumeSpecName: "config-out") pod "35e53882-6496-4eae-8c17-1b092447ea76" (UID: "35e53882-6496-4eae-8c17-1b092447ea76"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:24:55.769193 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.769167    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-config-volume" (OuterVolumeSpecName: "config-volume") pod "35e53882-6496-4eae-8c17-1b092447ea76" (UID: "35e53882-6496-4eae-8c17-1b092447ea76"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:24:55.769863 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.769836    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "35e53882-6496-4eae-8c17-1b092447ea76" (UID: "35e53882-6496-4eae-8c17-1b092447ea76"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:24:55.770147 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.769924    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "35e53882-6496-4eae-8c17-1b092447ea76" (UID: "35e53882-6496-4eae-8c17-1b092447ea76"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:24:55.770147 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.770098    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35e53882-6496-4eae-8c17-1b092447ea76-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "35e53882-6496-4eae-8c17-1b092447ea76" (UID: "35e53882-6496-4eae-8c17-1b092447ea76"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:24:55.770838 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.770808    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35e53882-6496-4eae-8c17-1b092447ea76-kube-api-access-l42sb" (OuterVolumeSpecName: "kube-api-access-l42sb") pod "35e53882-6496-4eae-8c17-1b092447ea76" (UID: "35e53882-6496-4eae-8c17-1b092447ea76"). InnerVolumeSpecName "kube-api-access-l42sb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:24:55.770925 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.770844    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "35e53882-6496-4eae-8c17-1b092447ea76" (UID: "35e53882-6496-4eae-8c17-1b092447ea76"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:24:55.773985 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.773922    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "35e53882-6496-4eae-8c17-1b092447ea76" (UID: "35e53882-6496-4eae-8c17-1b092447ea76"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:24:55.784288 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.784245    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-web-config" (OuterVolumeSpecName: "web-config") pod "35e53882-6496-4eae-8c17-1b092447ea76" (UID: "35e53882-6496-4eae-8c17-1b092447ea76"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:24:55.867424 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.867380    2586 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-cluster-tls-config\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:55.867424 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.867415    2586 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:55.867424 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.867426    2586 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/35e53882-6496-4eae-8c17-1b092447ea76-config-out\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:55.867424 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.867435    2586 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-secret-alertmanager-main-tls\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:55.867697 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.867444    2586 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:55.867697 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.867453    2586 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:55.867697 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.867464    2586 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:55.867697 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.867472    2586 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/35e53882-6496-4eae-8c17-1b092447ea76-web-config\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:55.867697 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.867481    2586 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/35e53882-6496-4eae-8c17-1b092447ea76-tls-assets\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:55.867697 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.867488    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l42sb\" (UniqueName: \"kubernetes.io/projected/35e53882-6496-4eae-8c17-1b092447ea76-kube-api-access-l42sb\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:55.867697 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.867498    2586 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35e53882-6496-4eae-8c17-1b092447ea76-metrics-client-ca\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:55.867697 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:55.867507    2586 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35e53882-6496-4eae-8c17-1b092447ea76-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:56.174950 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.174834    2586 generic.go:356] "Generic (PLEG): container finished" podID="35e53882-6496-4eae-8c17-1b092447ea76" containerID="fde7b06605e54c681cd2fe89d9f4603b99058593aed1bb2b995bde5430992194" exitCode=0
Jul 21 01:24:56.174950 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.174862    2586 generic.go:356] "Generic (PLEG): container finished" podID="35e53882-6496-4eae-8c17-1b092447ea76" containerID="01167d4c8456d5023ac650fc1a9870536913d89db630c5347cde86419c320592" exitCode=0
Jul 21 01:24:56.174950 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.174919    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35e53882-6496-4eae-8c17-1b092447ea76","Type":"ContainerDied","Data":"fde7b06605e54c681cd2fe89d9f4603b99058593aed1bb2b995bde5430992194"}
Jul 21 01:24:56.175232 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.174973    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.175232 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.175006    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35e53882-6496-4eae-8c17-1b092447ea76","Type":"ContainerDied","Data":"01167d4c8456d5023ac650fc1a9870536913d89db630c5347cde86419c320592"}
Jul 21 01:24:56.175232 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.175036    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35e53882-6496-4eae-8c17-1b092447ea76","Type":"ContainerDied","Data":"c6f7e9619639f3934061f8e83bc2d5878bdcf05333cb5e65c2bb17c15c0bf85b"}
Jul 21 01:24:56.175232 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.175053    2586 scope.go:117] "RemoveContainer" containerID="c7d7634cdf8eb1228cbe33c542fab71d09ebbdd4b5e4075aaa0ed9f6f2e04078"
Jul 21 01:24:56.183727 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.183702    2586 scope.go:117] "RemoveContainer" containerID="fde7b06605e54c681cd2fe89d9f4603b99058593aed1bb2b995bde5430992194"
Jul 21 01:24:56.191583 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.191562    2586 scope.go:117] "RemoveContainer" containerID="b4751d6312b70a8308f5d09fef8997df7d5669ae139926add1513563bbed071a"
Jul 21 01:24:56.198044 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.197983    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 01:24:56.200865 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.200841    2586 scope.go:117] "RemoveContainer" containerID="01167d4c8456d5023ac650fc1a9870536913d89db630c5347cde86419c320592"
Jul 21 01:24:56.202027 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.202007    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 01:24:56.208624 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.208605    2586 scope.go:117] "RemoveContainer" containerID="526c98188936b5d9b23b698927261e05a0d29cee8abe395a92240b9d10c48b36"
Jul 21 01:24:56.216796 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.216772    2586 scope.go:117] "RemoveContainer" containerID="10df76c36d5790f8218f82b4d1f07d6f23236ee5bcdf8cfdf63557578e4fda03"
Jul 21 01:24:56.225309 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.225289    2586 scope.go:117] "RemoveContainer" containerID="ee1aadf9af706f94a47e8eabcd133c52f01c72984a78019c717d44057d9e1855"
Jul 21 01:24:56.230345 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.230315    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 01:24:56.230784 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.230765    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35e53882-6496-4eae-8c17-1b092447ea76" containerName="init-config-reloader"
Jul 21 01:24:56.230845 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.230789    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="35e53882-6496-4eae-8c17-1b092447ea76" containerName="init-config-reloader"
Jul 21 01:24:56.230845 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.230809    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35e53882-6496-4eae-8c17-1b092447ea76" containerName="alertmanager"
Jul 21 01:24:56.230845 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.230815    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="35e53882-6496-4eae-8c17-1b092447ea76" containerName="alertmanager"
Jul 21 01:24:56.230845 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.230823    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35e53882-6496-4eae-8c17-1b092447ea76" containerName="kube-rbac-proxy-metric"
Jul 21 01:24:56.230845 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.230829    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="35e53882-6496-4eae-8c17-1b092447ea76" containerName="kube-rbac-proxy-metric"
Jul 21 01:24:56.230845 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.230836    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35e53882-6496-4eae-8c17-1b092447ea76" containerName="kube-rbac-proxy"
Jul 21 01:24:56.230845 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.230842    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="35e53882-6496-4eae-8c17-1b092447ea76" containerName="kube-rbac-proxy"
Jul 21 01:24:56.231075 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.230848    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35e53882-6496-4eae-8c17-1b092447ea76" containerName="kube-rbac-proxy-web"
Jul 21 01:24:56.231075 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.230854    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="35e53882-6496-4eae-8c17-1b092447ea76" containerName="kube-rbac-proxy-web"
Jul 21 01:24:56.231075 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.230860    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35e53882-6496-4eae-8c17-1b092447ea76" containerName="prom-label-proxy"
Jul 21 01:24:56.231075 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.230865    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="35e53882-6496-4eae-8c17-1b092447ea76" containerName="prom-label-proxy"
Jul 21 01:24:56.231075 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.230876    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35e53882-6496-4eae-8c17-1b092447ea76" containerName="config-reloader"
Jul 21 01:24:56.231075 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.230881    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="35e53882-6496-4eae-8c17-1b092447ea76" containerName="config-reloader"
Jul 21 01:24:56.231075 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.230926    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="35e53882-6496-4eae-8c17-1b092447ea76" containerName="prom-label-proxy"
Jul 21 01:24:56.231075 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.230963    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="35e53882-6496-4eae-8c17-1b092447ea76" containerName="config-reloader"
Jul 21 01:24:56.231075 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.230970    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="35e53882-6496-4eae-8c17-1b092447ea76" containerName="alertmanager"
Jul 21 01:24:56.231075 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.230976    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="35e53882-6496-4eae-8c17-1b092447ea76" containerName="kube-rbac-proxy-web"
Jul 21 01:24:56.231075 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.230983    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="35e53882-6496-4eae-8c17-1b092447ea76" containerName="kube-rbac-proxy"
Jul 21 01:24:56.231075 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.230989    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="35e53882-6496-4eae-8c17-1b092447ea76" containerName="kube-rbac-proxy-metric"
Jul 21 01:24:56.234802 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.234784    2586 scope.go:117] "RemoveContainer" containerID="c7d7634cdf8eb1228cbe33c542fab71d09ebbdd4b5e4075aaa0ed9f6f2e04078"
Jul 21 01:24:56.235105 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.235088    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.235181 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:24:56.235113    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7d7634cdf8eb1228cbe33c542fab71d09ebbdd4b5e4075aaa0ed9f6f2e04078\": container with ID starting with c7d7634cdf8eb1228cbe33c542fab71d09ebbdd4b5e4075aaa0ed9f6f2e04078 not found: ID does not exist" containerID="c7d7634cdf8eb1228cbe33c542fab71d09ebbdd4b5e4075aaa0ed9f6f2e04078"
Jul 21 01:24:56.235237 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.235155    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7d7634cdf8eb1228cbe33c542fab71d09ebbdd4b5e4075aaa0ed9f6f2e04078"} err="failed to get container status \"c7d7634cdf8eb1228cbe33c542fab71d09ebbdd4b5e4075aaa0ed9f6f2e04078\": rpc error: code = NotFound desc = could not find container \"c7d7634cdf8eb1228cbe33c542fab71d09ebbdd4b5e4075aaa0ed9f6f2e04078\": container with ID starting with c7d7634cdf8eb1228cbe33c542fab71d09ebbdd4b5e4075aaa0ed9f6f2e04078 not found: ID does not exist"
Jul 21 01:24:56.235237 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.235203    2586 scope.go:117] "RemoveContainer" containerID="fde7b06605e54c681cd2fe89d9f4603b99058593aed1bb2b995bde5430992194"
Jul 21 01:24:56.235510 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:24:56.235483    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fde7b06605e54c681cd2fe89d9f4603b99058593aed1bb2b995bde5430992194\": container with ID starting with fde7b06605e54c681cd2fe89d9f4603b99058593aed1bb2b995bde5430992194 not found: ID does not exist" containerID="fde7b06605e54c681cd2fe89d9f4603b99058593aed1bb2b995bde5430992194"
Jul 21 01:24:56.235629 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.235519    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fde7b06605e54c681cd2fe89d9f4603b99058593aed1bb2b995bde5430992194"} err="failed to get container status \"fde7b06605e54c681cd2fe89d9f4603b99058593aed1bb2b995bde5430992194\": rpc error: code = NotFound desc = could not find container \"fde7b06605e54c681cd2fe89d9f4603b99058593aed1bb2b995bde5430992194\": container with ID starting with fde7b06605e54c681cd2fe89d9f4603b99058593aed1bb2b995bde5430992194 not found: ID does not exist"
Jul 21 01:24:56.235629 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.235541    2586 scope.go:117] "RemoveContainer" containerID="b4751d6312b70a8308f5d09fef8997df7d5669ae139926add1513563bbed071a"
Jul 21 01:24:56.235800 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:24:56.235784    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4751d6312b70a8308f5d09fef8997df7d5669ae139926add1513563bbed071a\": container with ID starting with b4751d6312b70a8308f5d09fef8997df7d5669ae139926add1513563bbed071a not found: ID does not exist" containerID="b4751d6312b70a8308f5d09fef8997df7d5669ae139926add1513563bbed071a"
Jul 21 01:24:56.235838 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.235805    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4751d6312b70a8308f5d09fef8997df7d5669ae139926add1513563bbed071a"} err="failed to get container status \"b4751d6312b70a8308f5d09fef8997df7d5669ae139926add1513563bbed071a\": rpc error: code = NotFound desc = could not find container \"b4751d6312b70a8308f5d09fef8997df7d5669ae139926add1513563bbed071a\": container with ID starting with b4751d6312b70a8308f5d09fef8997df7d5669ae139926add1513563bbed071a not found: ID does not exist"
Jul 21 01:24:56.235838 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.235819    2586 scope.go:117] "RemoveContainer" containerID="01167d4c8456d5023ac650fc1a9870536913d89db630c5347cde86419c320592"
Jul 21 01:24:56.236063 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:24:56.236048    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01167d4c8456d5023ac650fc1a9870536913d89db630c5347cde86419c320592\": container with ID starting with 01167d4c8456d5023ac650fc1a9870536913d89db630c5347cde86419c320592 not found: ID does not exist" containerID="01167d4c8456d5023ac650fc1a9870536913d89db630c5347cde86419c320592"
Jul 21 01:24:56.236132 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.236066    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01167d4c8456d5023ac650fc1a9870536913d89db630c5347cde86419c320592"} err="failed to get container status \"01167d4c8456d5023ac650fc1a9870536913d89db630c5347cde86419c320592\": rpc error: code = NotFound desc = could not find container \"01167d4c8456d5023ac650fc1a9870536913d89db630c5347cde86419c320592\": container with ID starting with 01167d4c8456d5023ac650fc1a9870536913d89db630c5347cde86419c320592 not found: ID does not exist"
Jul 21 01:24:56.236132 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.236080    2586 scope.go:117] "RemoveContainer" containerID="526c98188936b5d9b23b698927261e05a0d29cee8abe395a92240b9d10c48b36"
Jul 21 01:24:56.236318 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:24:56.236303    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"526c98188936b5d9b23b698927261e05a0d29cee8abe395a92240b9d10c48b36\": container with ID starting with 526c98188936b5d9b23b698927261e05a0d29cee8abe395a92240b9d10c48b36 not found: ID does not exist" containerID="526c98188936b5d9b23b698927261e05a0d29cee8abe395a92240b9d10c48b36"
Jul 21 01:24:56.236379 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.236320    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"526c98188936b5d9b23b698927261e05a0d29cee8abe395a92240b9d10c48b36"} err="failed to get container status \"526c98188936b5d9b23b698927261e05a0d29cee8abe395a92240b9d10c48b36\": rpc error: code = NotFound desc = could not find container \"526c98188936b5d9b23b698927261e05a0d29cee8abe395a92240b9d10c48b36\": container with ID starting with 526c98188936b5d9b23b698927261e05a0d29cee8abe395a92240b9d10c48b36 not found: ID does not exist"
Jul 21 01:24:56.236379 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.236335    2586 scope.go:117] "RemoveContainer" containerID="10df76c36d5790f8218f82b4d1f07d6f23236ee5bcdf8cfdf63557578e4fda03"
Jul 21 01:24:56.236611 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:24:56.236594    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10df76c36d5790f8218f82b4d1f07d6f23236ee5bcdf8cfdf63557578e4fda03\": container with ID starting with 10df76c36d5790f8218f82b4d1f07d6f23236ee5bcdf8cfdf63557578e4fda03 not found: ID does not exist" containerID="10df76c36d5790f8218f82b4d1f07d6f23236ee5bcdf8cfdf63557578e4fda03"
Jul 21 01:24:56.236702 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.236614    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10df76c36d5790f8218f82b4d1f07d6f23236ee5bcdf8cfdf63557578e4fda03"} err="failed to get container status \"10df76c36d5790f8218f82b4d1f07d6f23236ee5bcdf8cfdf63557578e4fda03\": rpc error: code = NotFound desc = could not find container \"10df76c36d5790f8218f82b4d1f07d6f23236ee5bcdf8cfdf63557578e4fda03\": container with ID starting with 10df76c36d5790f8218f82b4d1f07d6f23236ee5bcdf8cfdf63557578e4fda03 not found: ID does not exist"
Jul 21 01:24:56.236702 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.236632    2586 scope.go:117] "RemoveContainer" containerID="ee1aadf9af706f94a47e8eabcd133c52f01c72984a78019c717d44057d9e1855"
Jul 21 01:24:56.236927 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:24:56.236902    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee1aadf9af706f94a47e8eabcd133c52f01c72984a78019c717d44057d9e1855\": container with ID starting with ee1aadf9af706f94a47e8eabcd133c52f01c72984a78019c717d44057d9e1855 not found: ID does not exist" containerID="ee1aadf9af706f94a47e8eabcd133c52f01c72984a78019c717d44057d9e1855"
Jul 21 01:24:56.237043 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.236972    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee1aadf9af706f94a47e8eabcd133c52f01c72984a78019c717d44057d9e1855"} err="failed to get container status \"ee1aadf9af706f94a47e8eabcd133c52f01c72984a78019c717d44057d9e1855\": rpc error: code = NotFound desc = could not find container \"ee1aadf9af706f94a47e8eabcd133c52f01c72984a78019c717d44057d9e1855\": container with ID starting with ee1aadf9af706f94a47e8eabcd133c52f01c72984a78019c717d44057d9e1855 not found: ID does not exist"
Jul 21 01:24:56.237043 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.236995    2586 scope.go:117] "RemoveContainer" containerID="c7d7634cdf8eb1228cbe33c542fab71d09ebbdd4b5e4075aaa0ed9f6f2e04078"
Jul 21 01:24:56.237170 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.237152    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 21 01:24:56.237305 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.237280    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7d7634cdf8eb1228cbe33c542fab71d09ebbdd4b5e4075aaa0ed9f6f2e04078"} err="failed to get container status \"c7d7634cdf8eb1228cbe33c542fab71d09ebbdd4b5e4075aaa0ed9f6f2e04078\": rpc error: code = NotFound desc = could not find container \"c7d7634cdf8eb1228cbe33c542fab71d09ebbdd4b5e4075aaa0ed9f6f2e04078\": container with ID starting with c7d7634cdf8eb1228cbe33c542fab71d09ebbdd4b5e4075aaa0ed9f6f2e04078 not found: ID does not exist"
Jul 21 01:24:56.237381 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.237308    2586 scope.go:117] "RemoveContainer" containerID="fde7b06605e54c681cd2fe89d9f4603b99058593aed1bb2b995bde5430992194"
Jul 21 01:24:56.237381 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.237311    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 21 01:24:56.237470 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.237414    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 21 01:24:56.237519 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.237500    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 21 01:24:56.237519 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.237506    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 21 01:24:56.237608 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.237589    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ndmht\""
Jul 21 01:24:56.237725 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.237707    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 21 01:24:56.237789 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.237747    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fde7b06605e54c681cd2fe89d9f4603b99058593aed1bb2b995bde5430992194"} err="failed to get container status \"fde7b06605e54c681cd2fe89d9f4603b99058593aed1bb2b995bde5430992194\": rpc error: code = NotFound desc = could not find container \"fde7b06605e54c681cd2fe89d9f4603b99058593aed1bb2b995bde5430992194\": container with ID starting with fde7b06605e54c681cd2fe89d9f4603b99058593aed1bb2b995bde5430992194 not found: ID does not exist"
Jul 21 01:24:56.237789 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.237773    2586 scope.go:117] "RemoveContainer" containerID="b4751d6312b70a8308f5d09fef8997df7d5669ae139926add1513563bbed071a"
Jul 21 01:24:56.237896 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.237789    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 21 01:24:56.237896 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.237761    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 21 01:24:56.238326 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.238300    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4751d6312b70a8308f5d09fef8997df7d5669ae139926add1513563bbed071a"} err="failed to get container status \"b4751d6312b70a8308f5d09fef8997df7d5669ae139926add1513563bbed071a\": rpc error: code = NotFound desc = could not find container \"b4751d6312b70a8308f5d09fef8997df7d5669ae139926add1513563bbed071a\": container with ID starting with b4751d6312b70a8308f5d09fef8997df7d5669ae139926add1513563bbed071a not found: ID does not exist"
Jul 21 01:24:56.238392 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.238327    2586 scope.go:117] "RemoveContainer" containerID="01167d4c8456d5023ac650fc1a9870536913d89db630c5347cde86419c320592"
Jul 21 01:24:56.238617 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.238589    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01167d4c8456d5023ac650fc1a9870536913d89db630c5347cde86419c320592"} err="failed to get container status \"01167d4c8456d5023ac650fc1a9870536913d89db630c5347cde86419c320592\": rpc error: code = NotFound desc = could not find container \"01167d4c8456d5023ac650fc1a9870536913d89db630c5347cde86419c320592\": container with ID starting with 01167d4c8456d5023ac650fc1a9870536913d89db630c5347cde86419c320592 not found: ID does not exist"
Jul 21 01:24:56.238699 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.238619    2586 scope.go:117] "RemoveContainer" containerID="526c98188936b5d9b23b698927261e05a0d29cee8abe395a92240b9d10c48b36"
Jul 21 01:24:56.238957 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.238914    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"526c98188936b5d9b23b698927261e05a0d29cee8abe395a92240b9d10c48b36"} err="failed to get container status \"526c98188936b5d9b23b698927261e05a0d29cee8abe395a92240b9d10c48b36\": rpc error: code = NotFound desc = could not find container \"526c98188936b5d9b23b698927261e05a0d29cee8abe395a92240b9d10c48b36\": container with ID starting with 526c98188936b5d9b23b698927261e05a0d29cee8abe395a92240b9d10c48b36 not found: ID does not exist"
Jul 21 01:24:56.238957 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.238954    2586 scope.go:117] "RemoveContainer" containerID="10df76c36d5790f8218f82b4d1f07d6f23236ee5bcdf8cfdf63557578e4fda03"
Jul 21 01:24:56.239230 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.239211    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10df76c36d5790f8218f82b4d1f07d6f23236ee5bcdf8cfdf63557578e4fda03"} err="failed to get container status \"10df76c36d5790f8218f82b4d1f07d6f23236ee5bcdf8cfdf63557578e4fda03\": rpc error: code = NotFound desc = could not find container \"10df76c36d5790f8218f82b4d1f07d6f23236ee5bcdf8cfdf63557578e4fda03\": container with ID starting with 10df76c36d5790f8218f82b4d1f07d6f23236ee5bcdf8cfdf63557578e4fda03 not found: ID does not exist"
Jul 21 01:24:56.239230 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.239230    2586 scope.go:117] "RemoveContainer" containerID="ee1aadf9af706f94a47e8eabcd133c52f01c72984a78019c717d44057d9e1855"
Jul 21 01:24:56.240123 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.239820    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee1aadf9af706f94a47e8eabcd133c52f01c72984a78019c717d44057d9e1855"} err="failed to get container status \"ee1aadf9af706f94a47e8eabcd133c52f01c72984a78019c717d44057d9e1855\": rpc error: code = NotFound desc = could not find container \"ee1aadf9af706f94a47e8eabcd133c52f01c72984a78019c717d44057d9e1855\": container with ID starting with ee1aadf9af706f94a47e8eabcd133c52f01c72984a78019c717d44057d9e1855 not found: ID does not exist"
Jul 21 01:24:56.246979 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.246952    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 21 01:24:56.249860 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.249832    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 01:24:56.272226 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.272186    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d51b72a6-91a3-43e5-8690-31855abe4967-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.272402 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.272234    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d51b72a6-91a3-43e5-8690-31855abe4967-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.272402 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.272264    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d51b72a6-91a3-43e5-8690-31855abe4967-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.272402 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.272319    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d51b72a6-91a3-43e5-8690-31855abe4967-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.272402 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.272361    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvmzw\" (UniqueName: \"kubernetes.io/projected/d51b72a6-91a3-43e5-8690-31855abe4967-kube-api-access-fvmzw\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.272402 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.272388    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d51b72a6-91a3-43e5-8690-31855abe4967-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.272560 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.272406    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d51b72a6-91a3-43e5-8690-31855abe4967-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.272560 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.272460    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d51b72a6-91a3-43e5-8690-31855abe4967-config-out\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.272560 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.272488    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d51b72a6-91a3-43e5-8690-31855abe4967-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.272560 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.272505    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d51b72a6-91a3-43e5-8690-31855abe4967-web-config\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.272560 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.272528    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d51b72a6-91a3-43e5-8690-31855abe4967-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.272701 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.272587    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d51b72a6-91a3-43e5-8690-31855abe4967-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.272701 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.272606    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d51b72a6-91a3-43e5-8690-31855abe4967-config-volume\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.373335 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.373290    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d51b72a6-91a3-43e5-8690-31855abe4967-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.373540 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.373346    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d51b72a6-91a3-43e5-8690-31855abe4967-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.373540 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.373466    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d51b72a6-91a3-43e5-8690-31855abe4967-config-volume\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.373540 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.373528    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d51b72a6-91a3-43e5-8690-31855abe4967-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.373708 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.373585    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d51b72a6-91a3-43e5-8690-31855abe4967-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.373708 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.373611    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d51b72a6-91a3-43e5-8690-31855abe4967-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.373708 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.373654    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d51b72a6-91a3-43e5-8690-31855abe4967-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.373708 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.373699    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvmzw\" (UniqueName: \"kubernetes.io/projected/d51b72a6-91a3-43e5-8690-31855abe4967-kube-api-access-fvmzw\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.373899 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.373742    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d51b72a6-91a3-43e5-8690-31855abe4967-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.373899 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.373770    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d51b72a6-91a3-43e5-8690-31855abe4967-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.373899 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.373854    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d51b72a6-91a3-43e5-8690-31855abe4967-config-out\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.373899 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.373888    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d51b72a6-91a3-43e5-8690-31855abe4967-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.374172 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.373915    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d51b72a6-91a3-43e5-8690-31855abe4967-web-config\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.374172 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.373996    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d51b72a6-91a3-43e5-8690-31855abe4967-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.374277 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.374178    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d51b72a6-91a3-43e5-8690-31855abe4967-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.377052 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.376969    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d51b72a6-91a3-43e5-8690-31855abe4967-config-volume\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.377052 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.376971    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d51b72a6-91a3-43e5-8690-31855abe4967-config-out\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.377052 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.377019    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d51b72a6-91a3-43e5-8690-31855abe4967-web-config\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.377052 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.377038    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d51b72a6-91a3-43e5-8690-31855abe4967-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.377366 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.377236    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d51b72a6-91a3-43e5-8690-31855abe4967-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.377366 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.377291    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d51b72a6-91a3-43e5-8690-31855abe4967-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.377431 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.377377    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d51b72a6-91a3-43e5-8690-31855abe4967-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.377557 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.377529    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d51b72a6-91a3-43e5-8690-31855abe4967-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.377727 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.377712    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d51b72a6-91a3-43e5-8690-31855abe4967-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.379167 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.379146    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d51b72a6-91a3-43e5-8690-31855abe4967-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.382261 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.382238    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvmzw\" (UniqueName: \"kubernetes.io/projected/d51b72a6-91a3-43e5-8690-31855abe4967-kube-api-access-fvmzw\") pod \"alertmanager-main-0\" (UID: \"d51b72a6-91a3-43e5-8690-31855abe4967\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.548061 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.547966    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 01:24:56.690285 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:56.690186    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 01:24:56.692830 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:24:56.692801    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd51b72a6_91a3_43e5_8690_31855abe4967.slice/crio-b0126ed831ba97e79d0d3099a38073533aff61bff2e96874f280b7795c250083 WatchSource:0}: Error finding container b0126ed831ba97e79d0d3099a38073533aff61bff2e96874f280b7795c250083: Status 404 returned error can't find the container with id b0126ed831ba97e79d0d3099a38073533aff61bff2e96874f280b7795c250083
Jul 21 01:24:57.182385 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:57.182352    2586 generic.go:356] "Generic (PLEG): container finished" podID="d51b72a6-91a3-43e5-8690-31855abe4967" containerID="b3af65e2bb70de4c26a0e251ea9312c89df2d4e4a573592719752842e7a91fa0" exitCode=0
Jul 21 01:24:57.182772 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:57.182399    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d51b72a6-91a3-43e5-8690-31855abe4967","Type":"ContainerDied","Data":"b3af65e2bb70de4c26a0e251ea9312c89df2d4e4a573592719752842e7a91fa0"}
Jul 21 01:24:57.182772 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:57.182450    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d51b72a6-91a3-43e5-8690-31855abe4967","Type":"ContainerStarted","Data":"b0126ed831ba97e79d0d3099a38073533aff61bff2e96874f280b7795c250083"}
Jul 21 01:24:57.308716 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:57.308688    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35e53882-6496-4eae-8c17-1b092447ea76" path="/var/lib/kubelet/pods/35e53882-6496-4eae-8c17-1b092447ea76/volumes"
Jul 21 01:24:58.191033 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.190984    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d51b72a6-91a3-43e5-8690-31855abe4967","Type":"ContainerStarted","Data":"d18344c54482d921df09db0c13d9f2bcfe93e05ea549a767a6f4de8880d0b0a0"}
Jul 21 01:24:58.191532 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.191073    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d51b72a6-91a3-43e5-8690-31855abe4967","Type":"ContainerStarted","Data":"3f83ae0abc98d75cca0f913f43e83198518eb213a6085501ce0d282600411bf4"}
Jul 21 01:24:58.191532 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.191117    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d51b72a6-91a3-43e5-8690-31855abe4967","Type":"ContainerStarted","Data":"beab32171e024b65d7fbb99ab5ef38ddb56f49bfc938a1ea377a4cfa2702296b"}
Jul 21 01:24:58.191532 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.191157    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d51b72a6-91a3-43e5-8690-31855abe4967","Type":"ContainerStarted","Data":"3b348a6c962014321d1660c77f4000740852b4d557448d19481d27ad9056d676"}
Jul 21 01:24:58.191532 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.191206    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d51b72a6-91a3-43e5-8690-31855abe4967","Type":"ContainerStarted","Data":"3f1106b35022fa37c7cfe8eb5a34d72638f4f358cb15a5227b6779bf3f0af0b8"}
Jul 21 01:24:58.191532 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.191244    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d51b72a6-91a3-43e5-8690-31855abe4967","Type":"ContainerStarted","Data":"05bc234370bb109ca9136502b575a74260c6a59ad9b78f56c57b96c7d8c0aa05"}
Jul 21 01:24:58.218999 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.218893    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.199678985 podStartE2EDuration="2.218872474s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.193489ms" isStatefulPod=false podCreationTimestamp="2026-07-21 01:24:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:24:58.218594297 +0000 UTC m=+157.406633688" watchObservedRunningTime="2026-07-21 01:24:58.218872474 +0000 UTC m=+157.406911865"
Jul 21 01:24:58.514307 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.514218    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-546b48bcfd-s56gb"]
Jul 21 01:24:58.517412 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.517384    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb"
Jul 21 01:24:58.519700 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.519669    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 21 01:24:58.519700 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.519682    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 21 01:24:58.519895 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.519749    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 21 01:24:58.519895 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.519669    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 21 01:24:58.519895 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.519669    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 21 01:24:58.519895 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.519669    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qdwj7\""
Jul 21 01:24:58.525718 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.525360    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 21 01:24:58.531399 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.531365    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-546b48bcfd-s56gb"]
Jul 21 01:24:58.593320 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.593280    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrz4h\" (UniqueName: \"kubernetes.io/projected/1637fafd-f6b0-4869-827e-07ba5263c89e-kube-api-access-rrz4h\") pod \"telemeter-client-546b48bcfd-s56gb\" (UID: \"1637fafd-f6b0-4869-827e-07ba5263c89e\") " pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb"
Jul 21 01:24:58.593320 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.593322    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1637fafd-f6b0-4869-827e-07ba5263c89e-secret-telemeter-client\") pod \"telemeter-client-546b48bcfd-s56gb\" (UID: \"1637fafd-f6b0-4869-827e-07ba5263c89e\") " pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb"
Jul 21 01:24:58.593538 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.593365    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1637fafd-f6b0-4869-827e-07ba5263c89e-federate-client-tls\") pod \"telemeter-client-546b48bcfd-s56gb\" (UID: \"1637fafd-f6b0-4869-827e-07ba5263c89e\") " pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb"
Jul 21 01:24:58.593538 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.593426    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1637fafd-f6b0-4869-827e-07ba5263c89e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-546b48bcfd-s56gb\" (UID: \"1637fafd-f6b0-4869-827e-07ba5263c89e\") " pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb"
Jul 21 01:24:58.593538 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.593461    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1637fafd-f6b0-4869-827e-07ba5263c89e-metrics-client-ca\") pod \"telemeter-client-546b48bcfd-s56gb\" (UID: \"1637fafd-f6b0-4869-827e-07ba5263c89e\") " pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb"
Jul 21 01:24:58.593538 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.593483    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1637fafd-f6b0-4869-827e-07ba5263c89e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-546b48bcfd-s56gb\" (UID: \"1637fafd-f6b0-4869-827e-07ba5263c89e\") " pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb"
Jul 21 01:24:58.593668 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.593590    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1637fafd-f6b0-4869-827e-07ba5263c89e-telemeter-client-tls\") pod \"telemeter-client-546b48bcfd-s56gb\" (UID: \"1637fafd-f6b0-4869-827e-07ba5263c89e\") " pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb"
Jul 21 01:24:58.593668 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.593628    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1637fafd-f6b0-4869-827e-07ba5263c89e-serving-certs-ca-bundle\") pod \"telemeter-client-546b48bcfd-s56gb\" (UID: \"1637fafd-f6b0-4869-827e-07ba5263c89e\") " pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb"
Jul 21 01:24:58.694582 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.694535    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1637fafd-f6b0-4869-827e-07ba5263c89e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-546b48bcfd-s56gb\" (UID: \"1637fafd-f6b0-4869-827e-07ba5263c89e\") " pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb"
Jul 21 01:24:58.694790 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.694616    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1637fafd-f6b0-4869-827e-07ba5263c89e-telemeter-client-tls\") pod \"telemeter-client-546b48bcfd-s56gb\" (UID: \"1637fafd-f6b0-4869-827e-07ba5263c89e\") " pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb"
Jul 21 01:24:58.694790 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.694649    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1637fafd-f6b0-4869-827e-07ba5263c89e-serving-certs-ca-bundle\") pod \"telemeter-client-546b48bcfd-s56gb\" (UID: \"1637fafd-f6b0-4869-827e-07ba5263c89e\") " pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb"
Jul 21 01:24:58.694790 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.694686    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrz4h\" (UniqueName: \"kubernetes.io/projected/1637fafd-f6b0-4869-827e-07ba5263c89e-kube-api-access-rrz4h\") pod \"telemeter-client-546b48bcfd-s56gb\" (UID: \"1637fafd-f6b0-4869-827e-07ba5263c89e\") " pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb"
Jul 21 01:24:58.694790 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.694713    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1637fafd-f6b0-4869-827e-07ba5263c89e-secret-telemeter-client\") pod \"telemeter-client-546b48bcfd-s56gb\" (UID: \"1637fafd-f6b0-4869-827e-07ba5263c89e\") " pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb"
Jul 21 01:24:58.694790 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.694758    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1637fafd-f6b0-4869-827e-07ba5263c89e-federate-client-tls\") pod \"telemeter-client-546b48bcfd-s56gb\" (UID: \"1637fafd-f6b0-4869-827e-07ba5263c89e\") " pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb"
Jul 21 01:24:58.695082 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.694791    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1637fafd-f6b0-4869-827e-07ba5263c89e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-546b48bcfd-s56gb\" (UID: \"1637fafd-f6b0-4869-827e-07ba5263c89e\") " pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb"
Jul 21 01:24:58.695082 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.694825    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1637fafd-f6b0-4869-827e-07ba5263c89e-metrics-client-ca\") pod \"telemeter-client-546b48bcfd-s56gb\" (UID: \"1637fafd-f6b0-4869-827e-07ba5263c89e\") " pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb"
Jul 21 01:24:58.695638 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.695581    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1637fafd-f6b0-4869-827e-07ba5263c89e-serving-certs-ca-bundle\") pod \"telemeter-client-546b48bcfd-s56gb\" (UID: \"1637fafd-f6b0-4869-827e-07ba5263c89e\") " pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb"
Jul 21 01:24:58.695963 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.695914    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1637fafd-f6b0-4869-827e-07ba5263c89e-metrics-client-ca\") pod \"telemeter-client-546b48bcfd-s56gb\" (UID: \"1637fafd-f6b0-4869-827e-07ba5263c89e\") " pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb"
Jul 21 01:24:58.696053 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.695976    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1637fafd-f6b0-4869-827e-07ba5263c89e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-546b48bcfd-s56gb\" (UID: \"1637fafd-f6b0-4869-827e-07ba5263c89e\") " pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb"
Jul 21 01:24:58.698041 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.697978    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1637fafd-f6b0-4869-827e-07ba5263c89e-telemeter-client-tls\") pod \"telemeter-client-546b48bcfd-s56gb\" (UID: \"1637fafd-f6b0-4869-827e-07ba5263c89e\") " pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb"
Jul 21 01:24:58.698041 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.698019    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1637fafd-f6b0-4869-827e-07ba5263c89e-secret-telemeter-client\") pod \"telemeter-client-546b48bcfd-s56gb\" (UID: \"1637fafd-f6b0-4869-827e-07ba5263c89e\") " pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb"
Jul 21 01:24:58.698041 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.698031    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1637fafd-f6b0-4869-827e-07ba5263c89e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-546b48bcfd-s56gb\" (UID: \"1637fafd-f6b0-4869-827e-07ba5263c89e\") " pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb"
Jul 21 01:24:58.699028 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.699000    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1637fafd-f6b0-4869-827e-07ba5263c89e-federate-client-tls\") pod \"telemeter-client-546b48bcfd-s56gb\" (UID: \"1637fafd-f6b0-4869-827e-07ba5263c89e\") " pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb"
Jul 21 01:24:58.703118 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.703091    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrz4h\" (UniqueName: \"kubernetes.io/projected/1637fafd-f6b0-4869-827e-07ba5263c89e-kube-api-access-rrz4h\") pod \"telemeter-client-546b48bcfd-s56gb\" (UID: \"1637fafd-f6b0-4869-827e-07ba5263c89e\") " pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb"
Jul 21 01:24:58.816006 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.815866    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 01:24:58.816375 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.816338    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerName="kube-rbac-proxy-thanos" containerID="cri-o://830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea" gracePeriod=600
Jul 21 01:24:58.816522 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.816491    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerName="prometheus" containerID="cri-o://f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc" gracePeriod=600
Jul 21 01:24:58.816732 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.816706    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerName="kube-rbac-proxy" containerID="cri-o://3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84" gracePeriod=600
Jul 21 01:24:58.816832 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.816818    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerName="kube-rbac-proxy-web" containerID="cri-o://90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c" gracePeriod=600
Jul 21 01:24:58.816883 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.816842    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerName="thanos-sidecar" containerID="cri-o://731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7" gracePeriod=600
Jul 21 01:24:58.816923 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.816823    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerName="config-reloader" containerID="cri-o://980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba" gracePeriod=600
Jul 21 01:24:58.830012 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:58.829424    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb"
Jul 21 01:24:59.005772 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.005730    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-546b48bcfd-s56gb"]
Jul 21 01:24:59.009818 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:24:59.009780    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1637fafd_f6b0_4869_827e_07ba5263c89e.slice/crio-35a0c6a46ed290ec03b9d2d36f257b36cb5f936731ada04bac7c0e98d861e7e3 WatchSource:0}: Error finding container 35a0c6a46ed290ec03b9d2d36f257b36cb5f936731ada04bac7c0e98d861e7e3: Status 404 returned error can't find the container with id 35a0c6a46ed290ec03b9d2d36f257b36cb5f936731ada04bac7c0e98d861e7e3
Jul 21 01:24:59.091607 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.091581    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.097827 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.097789    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-thanos-prometheus-http-client-file\") pod \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") "
Jul 21 01:24:59.097827 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.097826    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-configmap-metrics-client-ca\") pod \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") "
Jul 21 01:24:59.098100 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.097847    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") "
Jul 21 01:24:59.098100 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.097977    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-config-out\") pod \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") "
Jul 21 01:24:59.098100 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.098023    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-kube-rbac-proxy\") pod \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") "
Jul 21 01:24:59.098100 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.098071    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b48z4\" (UniqueName: \"kubernetes.io/projected/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-kube-api-access-b48z4\") pod \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") "
Jul 21 01:24:59.098301 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.098139    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-trusted-ca-bundle\") pod \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") "
Jul 21 01:24:59.098301 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.098166    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-k8s-rulefiles-2\") pod \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") "
Jul 21 01:24:59.098301 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.098258    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" (UID: "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:24:59.098522 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.098490    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-grpc-tls\") pod \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") "
Jul 21 01:24:59.098574 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.098521    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-k8s-db\") pod \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") "
Jul 21 01:24:59.098647 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.098619    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" (UID: "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:24:59.098813 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.098760    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" (UID: "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:24:59.098813 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.098799    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-config\") pod \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") "
Jul 21 01:24:59.099469 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.098848    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") "
Jul 21 01:24:59.099469 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.098882    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-k8s-rulefiles-0\") pod \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") "
Jul 21 01:24:59.099469 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.098923    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-prometheus-k8s-tls\") pod \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") "
Jul 21 01:24:59.099469 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.098966    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-tls-assets\") pod \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") "
Jul 21 01:24:59.099469 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.099014    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-metrics-client-certs\") pod \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") "
Jul 21 01:24:59.099469 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.099054    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-configmap-kubelet-serving-ca-bundle\") pod \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") "
Jul 21 01:24:59.099469 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.099126    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-k8s-rulefiles-1\") pod \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") "
Jul 21 01:24:59.099469 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.099189    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-web-config\") pod \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") "
Jul 21 01:24:59.099469 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.099214    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-configmap-serving-certs-ca-bundle\") pod \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\" (UID: \"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c\") "
Jul 21 01:24:59.099915 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.099592    2586 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-configmap-metrics-client-ca\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:59.099915 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.099610    2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:59.099915 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.099640    2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:59.100079 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.100043    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" (UID: "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:24:59.100079 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.100057    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" (UID: "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:24:59.100664 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.100634    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" (UID: "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:24:59.102062 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.101685    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" (UID: "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:24:59.102062 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.101771    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" (UID: "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:24:59.102476 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.102259    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" (UID: "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:24:59.102476 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.102327    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" (UID: "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:24:59.103219 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.103115    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" (UID: "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:24:59.103219 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.103140    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" (UID: "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:24:59.103557 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.103525    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-config-out" (OuterVolumeSpecName: "config-out") pod "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" (UID: "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:24:59.103557 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.103546    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-kube-api-access-b48z4" (OuterVolumeSpecName: "kube-api-access-b48z4") pod "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" (UID: "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c"). InnerVolumeSpecName "kube-api-access-b48z4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:24:59.103692 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.103583    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" (UID: "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:24:59.103692 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.103626    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" (UID: "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:24:59.103806 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.103726    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" (UID: "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:24:59.103908 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.103884    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-config" (OuterVolumeSpecName: "config") pod "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" (UID: "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:24:59.106954 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.106908    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" (UID: "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:24:59.120039 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.119999    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-web-config" (OuterVolumeSpecName: "web-config") pod "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" (UID: "1bbdc410-66d4-493f-9d1f-67bd4dbcca2c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:24:59.199822 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.199782    2586 generic.go:356] "Generic (PLEG): container finished" podID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerID="830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea" exitCode=0
Jul 21 01:24:59.199822 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.199815    2586 generic.go:356] "Generic (PLEG): container finished" podID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerID="3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84" exitCode=0
Jul 21 01:24:59.199822 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.199825    2586 generic.go:356] "Generic (PLEG): container finished" podID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerID="90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c" exitCode=0
Jul 21 01:24:59.200388 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.199834    2586 generic.go:356] "Generic (PLEG): container finished" podID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerID="731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7" exitCode=0
Jul 21 01:24:59.200388 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.199842    2586 generic.go:356] "Generic (PLEG): container finished" podID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerID="980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba" exitCode=0
Jul 21 01:24:59.200388 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.199850    2586 generic.go:356] "Generic (PLEG): container finished" podID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerID="f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc" exitCode=0
Jul 21 01:24:59.200388 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.199862    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c","Type":"ContainerDied","Data":"830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea"}
Jul 21 01:24:59.200388 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.199880    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.200388 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.199978    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c","Type":"ContainerDied","Data":"3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84"}
Jul 21 01:24:59.200388 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.200024    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c","Type":"ContainerDied","Data":"90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c"}
Jul 21 01:24:59.200388 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.200046    2586 scope.go:117] "RemoveContainer" containerID="830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea"
Jul 21 01:24:59.200388 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.200063    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c","Type":"ContainerDied","Data":"731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7"}
Jul 21 01:24:59.200388 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.200080    2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:59.200388 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.200099    2586 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-web-config\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:59.200388 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.200114    2586 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:59.200388 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.200127    2586 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:59.200388 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.200138    2586 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:59.200388 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.200146    2586 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-config-out\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:59.200388 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.200155    2586 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-kube-rbac-proxy\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:59.200388 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.200101    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c","Type":"ContainerDied","Data":"980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba"}
Jul 21 01:24:59.200388 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.200204    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c","Type":"ContainerDied","Data":"f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc"}
Jul 21 01:24:59.200388 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.200232    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bbdc410-66d4-493f-9d1f-67bd4dbcca2c","Type":"ContainerDied","Data":"62f9da94aaeeec062480426c3cb262bcdf87f5b536848b1364e0149124c3913b"}
Jul 21 01:24:59.200388 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.200166    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b48z4\" (UniqueName: \"kubernetes.io/projected/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-kube-api-access-b48z4\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:59.200388 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.200279    2586 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-grpc-tls\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:59.200388 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.200362    2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-k8s-db\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:59.200388 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.200378    2586 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-config\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:59.200388 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.200395    2586 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:59.201506 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.200412    2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:59.201506 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.200429    2586 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:59.201506 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.200447    2586 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-tls-assets\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:59.201506 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.200459    2586 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-secret-metrics-client-certs\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:59.201506 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.200474    2586 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:24:59.201506 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.201402    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb" event={"ID":"1637fafd-f6b0-4869-827e-07ba5263c89e","Type":"ContainerStarted","Data":"35a0c6a46ed290ec03b9d2d36f257b36cb5f936731ada04bac7c0e98d861e7e3"}
Jul 21 01:24:59.208800 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.208784    2586 scope.go:117] "RemoveContainer" containerID="3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84"
Jul 21 01:24:59.216819 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.216788    2586 scope.go:117] "RemoveContainer" containerID="90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c"
Jul 21 01:24:59.223402 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.223371    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 01:24:59.226749 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.226722    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 01:24:59.227903 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.227883    2586 scope.go:117] "RemoveContainer" containerID="731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7"
Jul 21 01:24:59.235995 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.235969    2586 scope.go:117] "RemoveContainer" containerID="980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba"
Jul 21 01:24:59.244144 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.244119    2586 scope.go:117] "RemoveContainer" containerID="f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc"
Jul 21 01:24:59.254072 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.254042    2586 scope.go:117] "RemoveContainer" containerID="650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e"
Jul 21 01:24:59.256888 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.256861    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 01:24:59.257475 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.257455    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerName="init-config-reloader"
Jul 21 01:24:59.257558 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.257478    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerName="init-config-reloader"
Jul 21 01:24:59.257625 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.257505    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerName="prometheus"
Jul 21 01:24:59.257625 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.257597    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerName="prometheus"
Jul 21 01:24:59.257625 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.257621    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerName="config-reloader"
Jul 21 01:24:59.257760 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.257630    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerName="config-reloader"
Jul 21 01:24:59.257760 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.257672    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerName="thanos-sidecar"
Jul 21 01:24:59.257760 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.257683    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerName="thanos-sidecar"
Jul 21 01:24:59.257760 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.257711    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerName="kube-rbac-proxy-web"
Jul 21 01:24:59.257760 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.257720    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerName="kube-rbac-proxy-web"
Jul 21 01:24:59.257760 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.257756    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerName="kube-rbac-proxy"
Jul 21 01:24:59.258035 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.257767    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerName="kube-rbac-proxy"
Jul 21 01:24:59.258035 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.257782    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerName="kube-rbac-proxy-thanos"
Jul 21 01:24:59.258035 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.257791    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerName="kube-rbac-proxy-thanos"
Jul 21 01:24:59.258479 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.258462    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerName="kube-rbac-proxy-thanos"
Jul 21 01:24:59.258551 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.258483    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerName="kube-rbac-proxy"
Jul 21 01:24:59.258551 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.258495    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerName="prometheus"
Jul 21 01:24:59.258551 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.258509    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerName="thanos-sidecar"
Jul 21 01:24:59.258551 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.258518    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerName="config-reloader"
Jul 21 01:24:59.258551 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.258525    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" containerName="kube-rbac-proxy-web"
Jul 21 01:24:59.262707 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.262687    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.264987 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.264961    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 21 01:24:59.265202 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.265167    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 21 01:24:59.265282 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.265229    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 21 01:24:59.265282 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.265232    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wbknd\""
Jul 21 01:24:59.265387 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.265313    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 21 01:24:59.265462 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.265441    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 21 01:24:59.265462 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.265452    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 21 01:24:59.265617 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.265524    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 21 01:24:59.265723 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.265657    2586 scope.go:117] "RemoveContainer" containerID="830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea"
Jul 21 01:24:59.265776 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.265726    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 21 01:24:59.265776 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.265751    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 21 01:24:59.265876 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.265791    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 21 01:24:59.265876 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.265846    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 21 01:24:59.265996 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.265968    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b2t0g42cckooc\""
Jul 21 01:24:59.266059 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:24:59.265986    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea\": container with ID starting with 830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea not found: ID does not exist" containerID="830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea"
Jul 21 01:24:59.266059 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.266018    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea"} err="failed to get container status \"830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea\": rpc error: code = NotFound desc = could not find container \"830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea\": container with ID starting with 830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea not found: ID does not exist"
Jul 21 01:24:59.266059 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.266044    2586 scope.go:117] "RemoveContainer" containerID="3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84"
Jul 21 01:24:59.266215 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.266100    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 21 01:24:59.266382 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:24:59.266359    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84\": container with ID starting with 3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84 not found: ID does not exist" containerID="3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84"
Jul 21 01:24:59.266449 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.266392    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84"} err="failed to get container status \"3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84\": rpc error: code = NotFound desc = could not find container \"3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84\": container with ID starting with 3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84 not found: ID does not exist"
Jul 21 01:24:59.266449 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.266417    2586 scope.go:117] "RemoveContainer" containerID="90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c"
Jul 21 01:24:59.266729 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:24:59.266705    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c\": container with ID starting with 90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c not found: ID does not exist" containerID="90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c"
Jul 21 01:24:59.266883 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.266735    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c"} err="failed to get container status \"90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c\": rpc error: code = NotFound desc = could not find container \"90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c\": container with ID starting with 90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c not found: ID does not exist"
Jul 21 01:24:59.266883 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.266756    2586 scope.go:117] "RemoveContainer" containerID="731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7"
Jul 21 01:24:59.267116 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:24:59.267087    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7\": container with ID starting with 731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7 not found: ID does not exist" containerID="731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7"
Jul 21 01:24:59.267208 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.267117    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7"} err="failed to get container status \"731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7\": rpc error: code = NotFound desc = could not find container \"731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7\": container with ID starting with 731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7 not found: ID does not exist"
Jul 21 01:24:59.267208 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.267137    2586 scope.go:117] "RemoveContainer" containerID="980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba"
Jul 21 01:24:59.267432 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:24:59.267411    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba\": container with ID starting with 980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba not found: ID does not exist" containerID="980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba"
Jul 21 01:24:59.267476 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.267442    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba"} err="failed to get container status \"980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba\": rpc error: code = NotFound desc = could not find container \"980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba\": container with ID starting with 980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba not found: ID does not exist"
Jul 21 01:24:59.267476 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.267462    2586 scope.go:117] "RemoveContainer" containerID="f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc"
Jul 21 01:24:59.267745 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:24:59.267721    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc\": container with ID starting with f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc not found: ID does not exist" containerID="f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc"
Jul 21 01:24:59.267882 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.267750    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc"} err="failed to get container status \"f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc\": rpc error: code = NotFound desc = could not find container \"f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc\": container with ID starting with f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc not found: ID does not exist"
Jul 21 01:24:59.267882 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.267769    2586 scope.go:117] "RemoveContainer" containerID="650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e"
Jul 21 01:24:59.268257 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:24:59.268226    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e\": container with ID starting with 650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e not found: ID does not exist" containerID="650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e"
Jul 21 01:24:59.268257 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.268249    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e"} err="failed to get container status \"650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e\": rpc error: code = NotFound desc = could not find container \"650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e\": container with ID starting with 650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e not found: ID does not exist"
Jul 21 01:24:59.268392 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.268264    2586 scope.go:117] "RemoveContainer" containerID="830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea"
Jul 21 01:24:59.268528 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.268509    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea"} err="failed to get container status \"830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea\": rpc error: code = NotFound desc = could not find container \"830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea\": container with ID starting with 830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea not found: ID does not exist"
Jul 21 01:24:59.268597 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.268528    2586 scope.go:117] "RemoveContainer" containerID="3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84"
Jul 21 01:24:59.268785 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.268762    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84"} err="failed to get container status \"3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84\": rpc error: code = NotFound desc = could not find container \"3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84\": container with ID starting with 3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84 not found: ID does not exist"
Jul 21 01:24:59.268852 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.268787    2586 scope.go:117] "RemoveContainer" containerID="90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c"
Jul 21 01:24:59.269099 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.269080    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c"} err="failed to get container status \"90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c\": rpc error: code = NotFound desc = could not find container \"90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c\": container with ID starting with 90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c not found: ID does not exist"
Jul 21 01:24:59.269099 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.269099    2586 scope.go:117] "RemoveContainer" containerID="731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7"
Jul 21 01:24:59.269243 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.269067    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 21 01:24:59.269381 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.269361    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7"} err="failed to get container status \"731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7\": rpc error: code = NotFound desc = could not find container \"731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7\": container with ID starting with 731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7 not found: ID does not exist"
Jul 21 01:24:59.269381 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.269381    2586 scope.go:117] "RemoveContainer" containerID="980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba"
Jul 21 01:24:59.269631 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.269613    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba"} err="failed to get container status \"980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba\": rpc error: code = NotFound desc = could not find container \"980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba\": container with ID starting with 980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba not found: ID does not exist"
Jul 21 01:24:59.269631 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.269631    2586 scope.go:117] "RemoveContainer" containerID="f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc"
Jul 21 01:24:59.269895 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.269873    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc"} err="failed to get container status \"f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc\": rpc error: code = NotFound desc = could not find container \"f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc\": container with ID starting with f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc not found: ID does not exist"
Jul 21 01:24:59.269992 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.269895    2586 scope.go:117] "RemoveContainer" containerID="650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e"
Jul 21 01:24:59.271778 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.270351    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e"} err="failed to get container status \"650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e\": rpc error: code = NotFound desc = could not find container \"650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e\": container with ID starting with 650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e not found: ID does not exist"
Jul 21 01:24:59.271778 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.270379    2586 scope.go:117] "RemoveContainer" containerID="830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea"
Jul 21 01:24:59.272045 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.271800    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea"} err="failed to get container status \"830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea\": rpc error: code = NotFound desc = could not find container \"830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea\": container with ID starting with 830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea not found: ID does not exist"
Jul 21 01:24:59.272045 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.271823    2586 scope.go:117] "RemoveContainer" containerID="3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84"
Jul 21 01:24:59.272179 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.272158    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84"} err="failed to get container status \"3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84\": rpc error: code = NotFound desc = could not find container \"3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84\": container with ID starting with 3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84 not found: ID does not exist"
Jul 21 01:24:59.272244 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.272182    2586 scope.go:117] "RemoveContainer" containerID="90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c"
Jul 21 01:24:59.272295 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.272274    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 21 01:24:59.272830 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.272809    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c"} err="failed to get container status \"90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c\": rpc error: code = NotFound desc = could not find container \"90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c\": container with ID starting with 90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c not found: ID does not exist"
Jul 21 01:24:59.272907 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.272831    2586 scope.go:117] "RemoveContainer" containerID="731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7"
Jul 21 01:24:59.273179 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.273155    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7"} err="failed to get container status \"731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7\": rpc error: code = NotFound desc = could not find container \"731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7\": container with ID starting with 731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7 not found: ID does not exist"
Jul 21 01:24:59.273239 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.273183    2586 scope.go:117] "RemoveContainer" containerID="980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba"
Jul 21 01:24:59.273478 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.273460    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba"} err="failed to get container status \"980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba\": rpc error: code = NotFound desc = could not find container \"980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba\": container with ID starting with 980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba not found: ID does not exist"
Jul 21 01:24:59.273533 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.273480    2586 scope.go:117] "RemoveContainer" containerID="f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc"
Jul 21 01:24:59.273668 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.273649    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 01:24:59.273733 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.273710    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc"} err="failed to get container status \"f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc\": rpc error: code = NotFound desc = could not find container \"f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc\": container with ID starting with f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc not found: ID does not exist"
Jul 21 01:24:59.273733 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.273725    2586 scope.go:117] "RemoveContainer" containerID="650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e"
Jul 21 01:24:59.273962 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.273923    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e"} err="failed to get container status \"650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e\": rpc error: code = NotFound desc = could not find container \"650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e\": container with ID starting with 650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e not found: ID does not exist"
Jul 21 01:24:59.274018 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.273963    2586 scope.go:117] "RemoveContainer" containerID="830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea"
Jul 21 01:24:59.274234 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.274211    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea"} err="failed to get container status \"830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea\": rpc error: code = NotFound desc = could not find container \"830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea\": container with ID starting with 830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea not found: ID does not exist"
Jul 21 01:24:59.274330 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.274237    2586 scope.go:117] "RemoveContainer" containerID="3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84"
Jul 21 01:24:59.274503 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.274485    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84"} err="failed to get container status \"3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84\": rpc error: code = NotFound desc = could not find container \"3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84\": container with ID starting with 3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84 not found: ID does not exist"
Jul 21 01:24:59.274503 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.274503    2586 scope.go:117] "RemoveContainer" containerID="90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c"
Jul 21 01:24:59.274766 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.274743    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c"} err="failed to get container status \"90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c\": rpc error: code = NotFound desc = could not find container \"90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c\": container with ID starting with 90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c not found: ID does not exist"
Jul 21 01:24:59.274766 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.274765    2586 scope.go:117] "RemoveContainer" containerID="731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7"
Jul 21 01:24:59.275084 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.275058    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7"} err="failed to get container status \"731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7\": rpc error: code = NotFound desc = could not find container \"731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7\": container with ID starting with 731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7 not found: ID does not exist"
Jul 21 01:24:59.275177 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.275086    2586 scope.go:117] "RemoveContainer" containerID="980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba"
Jul 21 01:24:59.275380 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.275359    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba"} err="failed to get container status \"980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba\": rpc error: code = NotFound desc = could not find container \"980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba\": container with ID starting with 980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba not found: ID does not exist"
Jul 21 01:24:59.275380 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.275379    2586 scope.go:117] "RemoveContainer" containerID="f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc"
Jul 21 01:24:59.275666 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.275645    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc"} err="failed to get container status \"f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc\": rpc error: code = NotFound desc = could not find container \"f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc\": container with ID starting with f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc not found: ID does not exist"
Jul 21 01:24:59.278363 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.275668    2586 scope.go:117] "RemoveContainer" containerID="650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e"
Jul 21 01:24:59.278363 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.276092    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e"} err="failed to get container status \"650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e\": rpc error: code = NotFound desc = could not find container \"650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e\": container with ID starting with 650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e not found: ID does not exist"
Jul 21 01:24:59.278363 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.276115    2586 scope.go:117] "RemoveContainer" containerID="830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea"
Jul 21 01:24:59.278363 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.276317    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea"} err="failed to get container status \"830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea\": rpc error: code = NotFound desc = could not find container \"830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea\": container with ID starting with 830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea not found: ID does not exist"
Jul 21 01:24:59.278363 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.276335    2586 scope.go:117] "RemoveContainer" containerID="3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84"
Jul 21 01:24:59.278363 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.276522    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84"} err="failed to get container status \"3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84\": rpc error: code = NotFound desc = could not find container \"3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84\": container with ID starting with 3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84 not found: ID does not exist"
Jul 21 01:24:59.278363 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.276539    2586 scope.go:117] "RemoveContainer" containerID="90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c"
Jul 21 01:24:59.278363 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.276711    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c"} err="failed to get container status \"90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c\": rpc error: code = NotFound desc = could not find container \"90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c\": container with ID starting with 90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c not found: ID does not exist"
Jul 21 01:24:59.278363 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.276728    2586 scope.go:117] "RemoveContainer" containerID="731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7"
Jul 21 01:24:59.278363 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.276961    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7"} err="failed to get container status \"731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7\": rpc error: code = NotFound desc = could not find container \"731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7\": container with ID starting with 731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7 not found: ID does not exist"
Jul 21 01:24:59.278363 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.276979    2586 scope.go:117] "RemoveContainer" containerID="980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba"
Jul 21 01:24:59.278363 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.277195    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba"} err="failed to get container status \"980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba\": rpc error: code = NotFound desc = could not find container \"980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba\": container with ID starting with 980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba not found: ID does not exist"
Jul 21 01:24:59.278363 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.277214    2586 scope.go:117] "RemoveContainer" containerID="f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc"
Jul 21 01:24:59.278363 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.277389    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc"} err="failed to get container status \"f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc\": rpc error: code = NotFound desc = could not find container \"f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc\": container with ID starting with f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc not found: ID does not exist"
Jul 21 01:24:59.278363 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.277408    2586 scope.go:117] "RemoveContainer" containerID="650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e"
Jul 21 01:24:59.278363 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.277582    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e"} err="failed to get container status \"650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e\": rpc error: code = NotFound desc = could not find container \"650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e\": container with ID starting with 650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e not found: ID does not exist"
Jul 21 01:24:59.278363 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.277601    2586 scope.go:117] "RemoveContainer" containerID="830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea"
Jul 21 01:24:59.279094 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.277781    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea"} err="failed to get container status \"830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea\": rpc error: code = NotFound desc = could not find container \"830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea\": container with ID starting with 830c7c520e8e1d277c177d359b425260161658e79513ae6b37afe21a1a5fd3ea not found: ID does not exist"
Jul 21 01:24:59.279094 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.277798    2586 scope.go:117] "RemoveContainer" containerID="3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84"
Jul 21 01:24:59.279094 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.278007    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84"} err="failed to get container status \"3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84\": rpc error: code = NotFound desc = could not find container \"3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84\": container with ID starting with 3b46b1956156cc59c89b0f763ad37b1f5012dba9a6a64664d8fbb1bc491ebe84 not found: ID does not exist"
Jul 21 01:24:59.279094 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.278025    2586 scope.go:117] "RemoveContainer" containerID="90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c"
Jul 21 01:24:59.279094 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.278219    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c"} err="failed to get container status \"90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c\": rpc error: code = NotFound desc = could not find container \"90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c\": container with ID starting with 90a53ff5a9d3e72ee5f7c8dbb76a8433d6c9eeeb89e33befc9725cbc8fd2ca3c not found: ID does not exist"
Jul 21 01:24:59.279094 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.278238    2586 scope.go:117] "RemoveContainer" containerID="731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7"
Jul 21 01:24:59.279094 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.278490    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7"} err="failed to get container status \"731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7\": rpc error: code = NotFound desc = could not find container \"731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7\": container with ID starting with 731bf7b2ce75cbb65ac134f2430bd171d74c9ce5216385ce2b81855fe5cc07a7 not found: ID does not exist"
Jul 21 01:24:59.279094 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.278538    2586 scope.go:117] "RemoveContainer" containerID="980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba"
Jul 21 01:24:59.279094 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.278848    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba"} err="failed to get container status \"980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba\": rpc error: code = NotFound desc = could not find container \"980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba\": container with ID starting with 980345511a93085c767a4c89bca05e9ae1e2f7a888185cb03f02a7ba925a97ba not found: ID does not exist"
Jul 21 01:24:59.279094 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.278874    2586 scope.go:117] "RemoveContainer" containerID="f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc"
Jul 21 01:24:59.279447 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.279141    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc"} err="failed to get container status \"f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc\": rpc error: code = NotFound desc = could not find container \"f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc\": container with ID starting with f6a4158a67bc0eb5728b0be33a658c31ab02b04f666fd6eabb3b9704c6bd4ebc not found: ID does not exist"
Jul 21 01:24:59.279447 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.279158    2586 scope.go:117] "RemoveContainer" containerID="650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e"
Jul 21 01:24:59.279447 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.279407    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e"} err="failed to get container status \"650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e\": rpc error: code = NotFound desc = could not find container \"650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e\": container with ID starting with 650e8785021340eb948c1bf58acbf0a3344e415defacc86c16df901c64d94e0e not found: ID does not exist"
Jul 21 01:24:59.301122 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.301085    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.301122 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.301119    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.301323 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.301138    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.301323 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.301260    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.301394 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.301327    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.301394 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.301356    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.301394 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.301383    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-config\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.301543 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.301524    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.301587 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.301564    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.301587 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.301582    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.301693 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.301677    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-web-config\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.301779 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.301765    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-config-out\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.301817 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.301785    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.301817 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.301799    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.301895 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.301834    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.301968 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.301885    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cvqn\" (UniqueName: \"kubernetes.io/projected/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-kube-api-access-5cvqn\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.302003 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.301984    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.302052 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.302019    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.302088 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.302074    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.302178 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.302156    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.308801 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.308772    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bbdc410-66d4-493f-9d1f-67bd4dbcca2c" path="/var/lib/kubelet/pods/1bbdc410-66d4-493f-9d1f-67bd4dbcca2c/volumes"
Jul 21 01:24:59.402891 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.402855    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-config-out\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.402891 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.402890    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.403140 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.402910    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.403140 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.403067    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.403140 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.403110    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cvqn\" (UniqueName: \"kubernetes.io/projected/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-kube-api-access-5cvqn\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.403311 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.403143    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.403311 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.403171    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.403311 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.403207    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.403311 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.403238    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.403311 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.403280    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.403311 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.403284    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.403311 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.403307    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.403649 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.403331    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.403649 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.403374    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.403649 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.403406    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.403649 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.403438    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.403649 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.403481    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-config\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.403649 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.403516    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.403649 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.403553    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.403649 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.403576    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.403649 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.403617    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-web-config\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.404952 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.404904    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.405482 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.405451    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.406025 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.405890    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.406129 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.405918    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-config-out\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.406455 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.406423    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.406455 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.406441    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.407272 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.406746    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-web-config\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.407272 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.406809    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.407272 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.406831    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.407272 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.407002    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.407754 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.407335    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.407754 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.407543    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.407928 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.407905    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.408233 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.408214    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.409076 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.409055    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.409260 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.409231    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.409478 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.409460    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-config\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.410034 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.410015    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.410964 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.410922    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cvqn\" (UniqueName: \"kubernetes.io/projected/b0ce746d-5d3b-40dc-864d-c0799ac7dc66-kube-api-access-5cvqn\") pod \"prometheus-k8s-0\" (UID: \"b0ce746d-5d3b-40dc-864d-c0799ac7dc66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.575345 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.575299    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:24:59.737414 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:24:59.737376    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 01:24:59.740402 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:24:59.740379    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ce746d_5d3b_40dc_864d_c0799ac7dc66.slice/crio-5f1659cfdded0d9274774683bf0f87f2e5c02822a2cb39cd8a60973117c9a95c WatchSource:0}: Error finding container 5f1659cfdded0d9274774683bf0f87f2e5c02822a2cb39cd8a60973117c9a95c: Status 404 returned error can't find the container with id 5f1659cfdded0d9274774683bf0f87f2e5c02822a2cb39cd8a60973117c9a95c
Jul 21 01:25:00.208125 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:25:00.208087    2586 generic.go:356] "Generic (PLEG): container finished" podID="b0ce746d-5d3b-40dc-864d-c0799ac7dc66" containerID="6939138922ed06eda4b98073b26ca457300464ad587db433d1919ef18ccbcad3" exitCode=0
Jul 21 01:25:00.208125 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:25:00.208126    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b0ce746d-5d3b-40dc-864d-c0799ac7dc66","Type":"ContainerDied","Data":"6939138922ed06eda4b98073b26ca457300464ad587db433d1919ef18ccbcad3"}
Jul 21 01:25:00.208568 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:25:00.208175    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b0ce746d-5d3b-40dc-864d-c0799ac7dc66","Type":"ContainerStarted","Data":"5f1659cfdded0d9274774683bf0f87f2e5c02822a2cb39cd8a60973117c9a95c"}
Jul 21 01:25:01.218144 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:25:01.218109    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b0ce746d-5d3b-40dc-864d-c0799ac7dc66","Type":"ContainerStarted","Data":"04624de0659b5c087da140d37b970c579272006bedd676245ed803bcbb6bce90"}
Jul 21 01:25:01.218547 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:25:01.218241    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b0ce746d-5d3b-40dc-864d-c0799ac7dc66","Type":"ContainerStarted","Data":"5c0125588a214a7156085d874ca0ce57c65b45add3af6e529145b46fc24a9018"}
Jul 21 01:25:01.218547 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:25:01.218291    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b0ce746d-5d3b-40dc-864d-c0799ac7dc66","Type":"ContainerStarted","Data":"6031ed9cadd6899fb884f43ba62bbfc8bd3f0358592afed487f8dba37d87041d"}
Jul 21 01:25:01.218547 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:25:01.218330    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b0ce746d-5d3b-40dc-864d-c0799ac7dc66","Type":"ContainerStarted","Data":"0f66baeb934d55d176d2fd72e70e2d57d1123ddf8629b94fce6d4a1bc52a2c1b"}
Jul 21 01:25:01.218547 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:25:01.218369    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b0ce746d-5d3b-40dc-864d-c0799ac7dc66","Type":"ContainerStarted","Data":"a3563c5c96dc06b13581358063de14eeff319eed0173c76d1d821047aa1666c8"}
Jul 21 01:25:01.218547 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:25:01.218409    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b0ce746d-5d3b-40dc-864d-c0799ac7dc66","Type":"ContainerStarted","Data":"845e5a938096a6352f259498700c7c3042a16774e2675e4cb709a563c25b2bca"}
Jul 21 01:25:01.243893 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:25:01.243754    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.21906504 podStartE2EDuration="2.243733285s" totalImagesPullingTime="0s" totalInitContainerRuntime="24.668245ms" isStatefulPod=false podCreationTimestamp="2026-07-21 01:24:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:25:01.24241944 +0000 UTC m=+160.430458840" watchObservedRunningTime="2026-07-21 01:25:01.243733285 +0000 UTC m=+160.431772677"
Jul 21 01:25:02.225020 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:25:02.224978    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb" event={"ID":"1637fafd-f6b0-4869-827e-07ba5263c89e","Type":"ContainerStarted","Data":"2884b2cef3bad75c64b83967d2cf8d06d6ea820aaaa33acfd0c8c823e6e5fda7"}
Jul 21 01:25:02.225458 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:25:02.225055    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb" event={"ID":"1637fafd-f6b0-4869-827e-07ba5263c89e","Type":"ContainerStarted","Data":"8ad6fc20c95f5a45c7b3dd474bc3c77748fc6917209860b728c065ae90db9b95"}
Jul 21 01:25:02.225458 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:25:02.225087    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb" event={"ID":"1637fafd-f6b0-4869-827e-07ba5263c89e","Type":"ContainerStarted","Data":"96a1ef05bca858f11b6cffc93c16f68d72a5d92aa95a45f1150c6bab63396834"}
Jul 21 01:25:02.246946 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:25:02.246879    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-546b48bcfd-s56gb" podStartSLOduration=2.104215553 podStartE2EDuration="4.246856854s" totalImagesPullingTime="2.142641301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:25:02.246202758 +0000 UTC m=+161.434242149" watchObservedRunningTime="2026-07-21 01:25:02.246856854 +0000 UTC m=+161.434896244"
Jul 21 01:25:04.575753 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:25:04.575696    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:25:59.576502 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:25:59.576460    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:25:59.593281 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:25:59.593242    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:26:00.476683 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:26:00.476657    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 01:27:21.163021 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:27:21.162994    2586 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 01:28:17.750576 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:17.750488    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-x78m6"]
Jul 21 01:28:17.753826 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:17.753807    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-x78m6"
Jul 21 01:28:17.755757 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:17.755737    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 21 01:28:17.756129 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:17.756114    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 21 01:28:17.756208 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:17.756132    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-9ssmh\""
Jul 21 01:28:17.762972 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:17.762928    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-x78m6"]
Jul 21 01:28:17.851287 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:17.851252    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50d77557-fbf7-406b-840b-2054e444eb69-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-x78m6\" (UID: \"50d77557-fbf7-406b-840b-2054e444eb69\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-x78m6"
Jul 21 01:28:17.851480 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:17.851336    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqn2g\" (UniqueName: \"kubernetes.io/projected/50d77557-fbf7-406b-840b-2054e444eb69-kube-api-access-wqn2g\") pod \"cert-manager-cainjector-559cdd8c87-x78m6\" (UID: \"50d77557-fbf7-406b-840b-2054e444eb69\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-x78m6"
Jul 21 01:28:17.951965 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:17.951898    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqn2g\" (UniqueName: \"kubernetes.io/projected/50d77557-fbf7-406b-840b-2054e444eb69-kube-api-access-wqn2g\") pod \"cert-manager-cainjector-559cdd8c87-x78m6\" (UID: \"50d77557-fbf7-406b-840b-2054e444eb69\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-x78m6"
Jul 21 01:28:17.952143 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:17.952009    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50d77557-fbf7-406b-840b-2054e444eb69-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-x78m6\" (UID: \"50d77557-fbf7-406b-840b-2054e444eb69\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-x78m6"
Jul 21 01:28:17.961392 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:17.961356    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50d77557-fbf7-406b-840b-2054e444eb69-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-x78m6\" (UID: \"50d77557-fbf7-406b-840b-2054e444eb69\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-x78m6"
Jul 21 01:28:17.961513 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:17.961418    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqn2g\" (UniqueName: \"kubernetes.io/projected/50d77557-fbf7-406b-840b-2054e444eb69-kube-api-access-wqn2g\") pod \"cert-manager-cainjector-559cdd8c87-x78m6\" (UID: \"50d77557-fbf7-406b-840b-2054e444eb69\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-x78m6"
Jul 21 01:28:18.075398 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:18.075294    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-x78m6"
Jul 21 01:28:18.206901 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:18.206826    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-x78m6"]
Jul 21 01:28:18.209657 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:28:18.209633    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50d77557_fbf7_406b_840b_2054e444eb69.slice/crio-33fe2f018e8c4d377760c96ef1f57564176b8832e5200f9a58cf9cbb6b694c19 WatchSource:0}: Error finding container 33fe2f018e8c4d377760c96ef1f57564176b8832e5200f9a58cf9cbb6b694c19: Status 404 returned error can't find the container with id 33fe2f018e8c4d377760c96ef1f57564176b8832e5200f9a58cf9cbb6b694c19
Jul 21 01:28:18.211521 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:18.211501    2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 01:28:19.015209 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:19.015174    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-x78m6" event={"ID":"50d77557-fbf7-406b-840b-2054e444eb69","Type":"ContainerStarted","Data":"33fe2f018e8c4d377760c96ef1f57564176b8832e5200f9a58cf9cbb6b694c19"}
Jul 21 01:28:22.032022 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:22.031978    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-x78m6" event={"ID":"50d77557-fbf7-406b-840b-2054e444eb69","Type":"ContainerStarted","Data":"455c341bea5d7651207c8fa33830f9c6c9517f29cb0ad1e4a653fb6e3eac866e"}
Jul 21 01:28:22.046993 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:22.046917    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-x78m6" podStartSLOduration=1.7282019499999999 podStartE2EDuration="5.046899777s" totalImagesPullingTime="3.318697827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:28:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:28:22.045533716 +0000 UTC m=+361.233573108" watchObservedRunningTime="2026-07-21 01:28:22.046899777 +0000 UTC m=+361.234939168"
Jul 21 01:28:25.511844 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:25.511799    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-j22wd"]
Jul 21 01:28:25.515791 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:25.515765    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-j22wd"
Jul 21 01:28:25.517972 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:25.517929    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-bzdsl\""
Jul 21 01:28:25.525287 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:25.525261    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-j22wd"]
Jul 21 01:28:25.617583 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:25.617552    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/154fad3c-f13a-44f0-9652-b2c153aadc53-bound-sa-token\") pod \"cert-manager-55b4d954d5-j22wd\" (UID: \"154fad3c-f13a-44f0-9652-b2c153aadc53\") " pod="cert-manager/cert-manager-55b4d954d5-j22wd"
Jul 21 01:28:25.617761 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:25.617602    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dlls\" (UniqueName: \"kubernetes.io/projected/154fad3c-f13a-44f0-9652-b2c153aadc53-kube-api-access-2dlls\") pod \"cert-manager-55b4d954d5-j22wd\" (UID: \"154fad3c-f13a-44f0-9652-b2c153aadc53\") " pod="cert-manager/cert-manager-55b4d954d5-j22wd"
Jul 21 01:28:25.719030 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:25.718972    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/154fad3c-f13a-44f0-9652-b2c153aadc53-bound-sa-token\") pod \"cert-manager-55b4d954d5-j22wd\" (UID: \"154fad3c-f13a-44f0-9652-b2c153aadc53\") " pod="cert-manager/cert-manager-55b4d954d5-j22wd"
Jul 21 01:28:25.719201 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:25.719051    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dlls\" (UniqueName: \"kubernetes.io/projected/154fad3c-f13a-44f0-9652-b2c153aadc53-kube-api-access-2dlls\") pod \"cert-manager-55b4d954d5-j22wd\" (UID: \"154fad3c-f13a-44f0-9652-b2c153aadc53\") " pod="cert-manager/cert-manager-55b4d954d5-j22wd"
Jul 21 01:28:25.726432 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:25.726392    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/154fad3c-f13a-44f0-9652-b2c153aadc53-bound-sa-token\") pod \"cert-manager-55b4d954d5-j22wd\" (UID: \"154fad3c-f13a-44f0-9652-b2c153aadc53\") " pod="cert-manager/cert-manager-55b4d954d5-j22wd"
Jul 21 01:28:25.726576 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:25.726560    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dlls\" (UniqueName: \"kubernetes.io/projected/154fad3c-f13a-44f0-9652-b2c153aadc53-kube-api-access-2dlls\") pod \"cert-manager-55b4d954d5-j22wd\" (UID: \"154fad3c-f13a-44f0-9652-b2c153aadc53\") " pod="cert-manager/cert-manager-55b4d954d5-j22wd"
Jul 21 01:28:25.825647 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:25.825529    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-j22wd"
Jul 21 01:28:25.961185 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:25.961116    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-j22wd"]
Jul 21 01:28:25.964728 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:28:25.964700    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod154fad3c_f13a_44f0_9652_b2c153aadc53.slice/crio-12f9503a37d04bfb77977c4cfd00c75ec7368ced02a0e16bbcc5c3374fc4911e WatchSource:0}: Error finding container 12f9503a37d04bfb77977c4cfd00c75ec7368ced02a0e16bbcc5c3374fc4911e: Status 404 returned error can't find the container with id 12f9503a37d04bfb77977c4cfd00c75ec7368ced02a0e16bbcc5c3374fc4911e
Jul 21 01:28:26.052258 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:26.052218    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-j22wd" event={"ID":"154fad3c-f13a-44f0-9652-b2c153aadc53","Type":"ContainerStarted","Data":"375100a658a49d68022bea3004fbb41d71055ee78af32bf074acd990058e7ff1"}
Jul 21 01:28:26.052258 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:26.052260    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-j22wd" event={"ID":"154fad3c-f13a-44f0-9652-b2c153aadc53","Type":"ContainerStarted","Data":"12f9503a37d04bfb77977c4cfd00c75ec7368ced02a0e16bbcc5c3374fc4911e"}
Jul 21 01:28:26.069250 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:26.069193    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-j22wd" podStartSLOduration=1.069173239 podStartE2EDuration="1.069173239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:28:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:28:26.06823179 +0000 UTC m=+365.256271215" watchObservedRunningTime="2026-07-21 01:28:26.069173239 +0000 UTC m=+365.257212628"
Jul 21 01:28:45.142452 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:45.142416    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd"]
Jul 21 01:28:45.145922 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:45.145900    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd"
Jul 21 01:28:45.147815 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:45.147790    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 01:28:45.148011 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:45.147993    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6gbcd\""
Jul 21 01:28:45.148142 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:45.148124    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 01:28:45.148209 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:45.148141    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 01:28:45.148261 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:45.148216    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 01:28:45.182683 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:45.182654    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd"]
Jul 21 01:28:45.295643 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:45.295601    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f4e7245a-0cc0-4c37-ac08-c2175d421ee9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-8vbqd\" (UID: \"f4e7245a-0cc0-4c37-ac08-c2175d421ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd"
Jul 21 01:28:45.295846 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:45.295652    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q58x4\" (UniqueName: \"kubernetes.io/projected/f4e7245a-0cc0-4c37-ac08-c2175d421ee9-kube-api-access-q58x4\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-8vbqd\" (UID: \"f4e7245a-0cc0-4c37-ac08-c2175d421ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd"
Jul 21 01:28:45.295846 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:45.295699    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4e7245a-0cc0-4c37-ac08-c2175d421ee9-tmp\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-8vbqd\" (UID: \"f4e7245a-0cc0-4c37-ac08-c2175d421ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd"
Jul 21 01:28:45.295846 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:45.295751    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f4e7245a-0cc0-4c37-ac08-c2175d421ee9-manifests\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-8vbqd\" (UID: \"f4e7245a-0cc0-4c37-ac08-c2175d421ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd"
Jul 21 01:28:45.295846 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:45.295785    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f4e7245a-0cc0-4c37-ac08-c2175d421ee9-webhook-cert\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-8vbqd\" (UID: \"f4e7245a-0cc0-4c37-ac08-c2175d421ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd"
Jul 21 01:28:45.397397 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:45.397297    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f4e7245a-0cc0-4c37-ac08-c2175d421ee9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-8vbqd\" (UID: \"f4e7245a-0cc0-4c37-ac08-c2175d421ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd"
Jul 21 01:28:45.397397 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:45.397346    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q58x4\" (UniqueName: \"kubernetes.io/projected/f4e7245a-0cc0-4c37-ac08-c2175d421ee9-kube-api-access-q58x4\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-8vbqd\" (UID: \"f4e7245a-0cc0-4c37-ac08-c2175d421ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd"
Jul 21 01:28:45.397397 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:45.397395    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4e7245a-0cc0-4c37-ac08-c2175d421ee9-tmp\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-8vbqd\" (UID: \"f4e7245a-0cc0-4c37-ac08-c2175d421ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd"
Jul 21 01:28:45.397686 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:45.397415    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f4e7245a-0cc0-4c37-ac08-c2175d421ee9-manifests\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-8vbqd\" (UID: \"f4e7245a-0cc0-4c37-ac08-c2175d421ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd"
Jul 21 01:28:45.397686 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:45.397434    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f4e7245a-0cc0-4c37-ac08-c2175d421ee9-webhook-cert\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-8vbqd\" (UID: \"f4e7245a-0cc0-4c37-ac08-c2175d421ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd"
Jul 21 01:28:45.397982 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:45.397960    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f4e7245a-0cc0-4c37-ac08-c2175d421ee9-manifests\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-8vbqd\" (UID: \"f4e7245a-0cc0-4c37-ac08-c2175d421ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd"
Jul 21 01:28:45.400016 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:45.399985    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4e7245a-0cc0-4c37-ac08-c2175d421ee9-tmp\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-8vbqd\" (UID: \"f4e7245a-0cc0-4c37-ac08-c2175d421ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd"
Jul 21 01:28:45.400320 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:45.400297    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f4e7245a-0cc0-4c37-ac08-c2175d421ee9-webhook-cert\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-8vbqd\" (UID: \"f4e7245a-0cc0-4c37-ac08-c2175d421ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd"
Jul 21 01:28:45.400469 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:45.400451    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f4e7245a-0cc0-4c37-ac08-c2175d421ee9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-8vbqd\" (UID: \"f4e7245a-0cc0-4c37-ac08-c2175d421ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd"
Jul 21 01:28:45.405884 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:45.405858    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q58x4\" (UniqueName: \"kubernetes.io/projected/f4e7245a-0cc0-4c37-ac08-c2175d421ee9-kube-api-access-q58x4\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-8vbqd\" (UID: \"f4e7245a-0cc0-4c37-ac08-c2175d421ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd"
Jul 21 01:28:45.457304 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:45.457252    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd"
Jul 21 01:28:45.614515 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:45.614483    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd"]
Jul 21 01:28:45.618504 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:28:45.618479    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4e7245a_0cc0_4c37_ac08_c2175d421ee9.slice/crio-4134ce2a61e76f54be050cb755648458c5e04c90110ea531d04ec6c78e633e3d WatchSource:0}: Error finding container 4134ce2a61e76f54be050cb755648458c5e04c90110ea531d04ec6c78e633e3d: Status 404 returned error can't find the container with id 4134ce2a61e76f54be050cb755648458c5e04c90110ea531d04ec6c78e633e3d
Jul 21 01:28:46.146592 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:46.146556    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd" event={"ID":"f4e7245a-0cc0-4c37-ac08-c2175d421ee9","Type":"ContainerStarted","Data":"4134ce2a61e76f54be050cb755648458c5e04c90110ea531d04ec6c78e633e3d"}
Jul 21 01:28:49.163122 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:49.163028    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd" event={"ID":"f4e7245a-0cc0-4c37-ac08-c2175d421ee9","Type":"ContainerStarted","Data":"4b52bfcbbbe6843ea90d68acddc2e19e777ce5592aeeec3eb3e44da5ee5d2aa5"}
Jul 21 01:28:50.169111 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:50.169066    2586 generic.go:356] "Generic (PLEG): container finished" podID="f4e7245a-0cc0-4c37-ac08-c2175d421ee9" containerID="4b52bfcbbbe6843ea90d68acddc2e19e777ce5592aeeec3eb3e44da5ee5d2aa5" exitCode=0
Jul 21 01:28:50.169491 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:50.169147    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd" event={"ID":"f4e7245a-0cc0-4c37-ac08-c2175d421ee9","Type":"ContainerDied","Data":"4b52bfcbbbe6843ea90d68acddc2e19e777ce5592aeeec3eb3e44da5ee5d2aa5"}
Jul 21 01:28:51.175506 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:51.175467    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd" event={"ID":"f4e7245a-0cc0-4c37-ac08-c2175d421ee9","Type":"ContainerStarted","Data":"3f33ca849eb52e6b30188b4de51e5c46c10e7cfb6ea7c1a1d8c0e9eab69aeacf"}
Jul 21 01:28:51.175910 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:51.175589    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd"
Jul 21 01:28:51.196492 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:28:51.196443    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd" podStartSLOduration=1.419130413 podStartE2EDuration="6.19642173s" totalImagesPullingTime="3.676195017s" totalInitContainerRuntime="1.1010963s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:28:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:28:51.195265802 +0000 UTC m=+390.383305191" watchObservedRunningTime="2026-07-21 01:28:51.19642173 +0000 UTC m=+390.384461120"
Jul 21 01:29:02.183089 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:02.183056    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-8vbqd"
Jul 21 01:29:03.661920 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:03.661878    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c984b598c-8r4qk"]
Jul 21 01:29:03.670711 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:03.670671    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c984b598c-8r4qk"
Jul 21 01:29:03.673227 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:03.673199    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-62jbl\""
Jul 21 01:29:03.673227 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:03.673215    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 01:29:03.673227 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:03.673229    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 01:29:03.673505 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:03.673496    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 21 01:29:03.673607 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:03.673588    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 21 01:29:03.673670 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:03.673654    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 21 01:29:03.677656 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:03.677634    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c984b598c-8r4qk"]
Jul 21 01:29:03.761496 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:03.761460    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7269df4b-2549-42a1-91d2-4dc525f92dda-cert\") pod \"lws-controller-manager-7c984b598c-8r4qk\" (UID: \"7269df4b-2549-42a1-91d2-4dc525f92dda\") " pod="openshift-lws-operator/lws-controller-manager-7c984b598c-8r4qk"
Jul 21 01:29:03.761496 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:03.761495    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbf2m\" (UniqueName: \"kubernetes.io/projected/7269df4b-2549-42a1-91d2-4dc525f92dda-kube-api-access-zbf2m\") pod \"lws-controller-manager-7c984b598c-8r4qk\" (UID: \"7269df4b-2549-42a1-91d2-4dc525f92dda\") " pod="openshift-lws-operator/lws-controller-manager-7c984b598c-8r4qk"
Jul 21 01:29:03.761721 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:03.761581    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7269df4b-2549-42a1-91d2-4dc525f92dda-metrics-cert\") pod \"lws-controller-manager-7c984b598c-8r4qk\" (UID: \"7269df4b-2549-42a1-91d2-4dc525f92dda\") " pod="openshift-lws-operator/lws-controller-manager-7c984b598c-8r4qk"
Jul 21 01:29:03.761721 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:03.761621    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7269df4b-2549-42a1-91d2-4dc525f92dda-manager-config\") pod \"lws-controller-manager-7c984b598c-8r4qk\" (UID: \"7269df4b-2549-42a1-91d2-4dc525f92dda\") " pod="openshift-lws-operator/lws-controller-manager-7c984b598c-8r4qk"
Jul 21 01:29:03.862864 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:03.862830    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7269df4b-2549-42a1-91d2-4dc525f92dda-metrics-cert\") pod \"lws-controller-manager-7c984b598c-8r4qk\" (UID: \"7269df4b-2549-42a1-91d2-4dc525f92dda\") " pod="openshift-lws-operator/lws-controller-manager-7c984b598c-8r4qk"
Jul 21 01:29:03.863065 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:03.862885    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7269df4b-2549-42a1-91d2-4dc525f92dda-manager-config\") pod \"lws-controller-manager-7c984b598c-8r4qk\" (UID: \"7269df4b-2549-42a1-91d2-4dc525f92dda\") " pod="openshift-lws-operator/lws-controller-manager-7c984b598c-8r4qk"
Jul 21 01:29:03.863065 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:03.862902    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7269df4b-2549-42a1-91d2-4dc525f92dda-cert\") pod \"lws-controller-manager-7c984b598c-8r4qk\" (UID: \"7269df4b-2549-42a1-91d2-4dc525f92dda\") " pod="openshift-lws-operator/lws-controller-manager-7c984b598c-8r4qk"
Jul 21 01:29:03.863065 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:03.862919    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbf2m\" (UniqueName: \"kubernetes.io/projected/7269df4b-2549-42a1-91d2-4dc525f92dda-kube-api-access-zbf2m\") pod \"lws-controller-manager-7c984b598c-8r4qk\" (UID: \"7269df4b-2549-42a1-91d2-4dc525f92dda\") " pod="openshift-lws-operator/lws-controller-manager-7c984b598c-8r4qk"
Jul 21 01:29:03.863734 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:03.863651    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7269df4b-2549-42a1-91d2-4dc525f92dda-manager-config\") pod \"lws-controller-manager-7c984b598c-8r4qk\" (UID: \"7269df4b-2549-42a1-91d2-4dc525f92dda\") " pod="openshift-lws-operator/lws-controller-manager-7c984b598c-8r4qk"
Jul 21 01:29:03.865505 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:03.865475    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7269df4b-2549-42a1-91d2-4dc525f92dda-metrics-cert\") pod \"lws-controller-manager-7c984b598c-8r4qk\" (UID: \"7269df4b-2549-42a1-91d2-4dc525f92dda\") " pod="openshift-lws-operator/lws-controller-manager-7c984b598c-8r4qk"
Jul 21 01:29:03.865697 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:03.865677    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7269df4b-2549-42a1-91d2-4dc525f92dda-cert\") pod \"lws-controller-manager-7c984b598c-8r4qk\" (UID: \"7269df4b-2549-42a1-91d2-4dc525f92dda\") " pod="openshift-lws-operator/lws-controller-manager-7c984b598c-8r4qk"
Jul 21 01:29:03.879416 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:03.879391    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbf2m\" (UniqueName: \"kubernetes.io/projected/7269df4b-2549-42a1-91d2-4dc525f92dda-kube-api-access-zbf2m\") pod \"lws-controller-manager-7c984b598c-8r4qk\" (UID: \"7269df4b-2549-42a1-91d2-4dc525f92dda\") " pod="openshift-lws-operator/lws-controller-manager-7c984b598c-8r4qk"
Jul 21 01:29:03.982253 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:03.982155    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c984b598c-8r4qk"
Jul 21 01:29:04.137136 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:04.137112    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c984b598c-8r4qk"]
Jul 21 01:29:04.140528 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:29:04.140502    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7269df4b_2549_42a1_91d2_4dc525f92dda.slice/crio-ee6f47b1cbb6ae3fa7fb4e67216a92e3f5c46a5018e8daf17e15a9058714d3b7 WatchSource:0}: Error finding container ee6f47b1cbb6ae3fa7fb4e67216a92e3f5c46a5018e8daf17e15a9058714d3b7: Status 404 returned error can't find the container with id ee6f47b1cbb6ae3fa7fb4e67216a92e3f5c46a5018e8daf17e15a9058714d3b7
Jul 21 01:29:04.238839 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:04.238756    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c984b598c-8r4qk" event={"ID":"7269df4b-2549-42a1-91d2-4dc525f92dda","Type":"ContainerStarted","Data":"ee6f47b1cbb6ae3fa7fb4e67216a92e3f5c46a5018e8daf17e15a9058714d3b7"}
Jul 21 01:29:04.918172 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:04.918101    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-545dd4bbd9-4dg6d"]
Jul 21 01:29:04.922394 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:04.922357    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-4dg6d"
Jul 21 01:29:04.924580 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:04.924555    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 21 01:29:04.924972 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:04.924913    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 21 01:29:04.925465 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:04.925440    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 01:29:04.925651 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:04.925635    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dl5td\""
Jul 21 01:29:04.925907 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:04.925886    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 01:29:04.934265 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:04.934239    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-545dd4bbd9-4dg6d"]
Jul 21 01:29:04.979727 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:04.973222    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e7b6130-64d4-41a2-ba36-33fbac91d602-tmp\") pod \"kube-auth-proxy-545dd4bbd9-4dg6d\" (UID: \"7e7b6130-64d4-41a2-ba36-33fbac91d602\") " pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-4dg6d"
Jul 21 01:29:04.979727 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:04.973328    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e7b6130-64d4-41a2-ba36-33fbac91d602-tls-certs\") pod \"kube-auth-proxy-545dd4bbd9-4dg6d\" (UID: \"7e7b6130-64d4-41a2-ba36-33fbac91d602\") " pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-4dg6d"
Jul 21 01:29:04.979727 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:04.973405    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jb5b\" (UniqueName: \"kubernetes.io/projected/7e7b6130-64d4-41a2-ba36-33fbac91d602-kube-api-access-7jb5b\") pod \"kube-auth-proxy-545dd4bbd9-4dg6d\" (UID: \"7e7b6130-64d4-41a2-ba36-33fbac91d602\") " pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-4dg6d"
Jul 21 01:29:05.074733 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:05.074693    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e7b6130-64d4-41a2-ba36-33fbac91d602-tls-certs\") pod \"kube-auth-proxy-545dd4bbd9-4dg6d\" (UID: \"7e7b6130-64d4-41a2-ba36-33fbac91d602\") " pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-4dg6d"
Jul 21 01:29:05.074955 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:05.074777    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jb5b\" (UniqueName: \"kubernetes.io/projected/7e7b6130-64d4-41a2-ba36-33fbac91d602-kube-api-access-7jb5b\") pod \"kube-auth-proxy-545dd4bbd9-4dg6d\" (UID: \"7e7b6130-64d4-41a2-ba36-33fbac91d602\") " pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-4dg6d"
Jul 21 01:29:05.074955 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:05.074867    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e7b6130-64d4-41a2-ba36-33fbac91d602-tmp\") pod \"kube-auth-proxy-545dd4bbd9-4dg6d\" (UID: \"7e7b6130-64d4-41a2-ba36-33fbac91d602\") " pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-4dg6d"
Jul 21 01:29:05.078008 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:05.077970    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e7b6130-64d4-41a2-ba36-33fbac91d602-tmp\") pod \"kube-auth-proxy-545dd4bbd9-4dg6d\" (UID: \"7e7b6130-64d4-41a2-ba36-33fbac91d602\") " pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-4dg6d"
Jul 21 01:29:05.078205 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:05.078180    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e7b6130-64d4-41a2-ba36-33fbac91d602-tls-certs\") pod \"kube-auth-proxy-545dd4bbd9-4dg6d\" (UID: \"7e7b6130-64d4-41a2-ba36-33fbac91d602\") " pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-4dg6d"
Jul 21 01:29:05.092318 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:05.092277    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jb5b\" (UniqueName: \"kubernetes.io/projected/7e7b6130-64d4-41a2-ba36-33fbac91d602-kube-api-access-7jb5b\") pod \"kube-auth-proxy-545dd4bbd9-4dg6d\" (UID: \"7e7b6130-64d4-41a2-ba36-33fbac91d602\") " pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-4dg6d"
Jul 21 01:29:05.237505 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:05.237416    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-4dg6d"
Jul 21 01:29:05.421319 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:05.421241    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-545dd4bbd9-4dg6d"]
Jul 21 01:29:05.423434 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:29:05.423396    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e7b6130_64d4_41a2_ba36_33fbac91d602.slice/crio-ac2b62f65942df72bd0b0ba358722fb17ed9409fb38e32bdb0c08429062f04f8 WatchSource:0}: Error finding container ac2b62f65942df72bd0b0ba358722fb17ed9409fb38e32bdb0c08429062f04f8: Status 404 returned error can't find the container with id ac2b62f65942df72bd0b0ba358722fb17ed9409fb38e32bdb0c08429062f04f8
Jul 21 01:29:06.252004 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:06.251954    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-4dg6d" event={"ID":"7e7b6130-64d4-41a2-ba36-33fbac91d602","Type":"ContainerStarted","Data":"ac2b62f65942df72bd0b0ba358722fb17ed9409fb38e32bdb0c08429062f04f8"}
Jul 21 01:29:07.263527 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:07.263485    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c984b598c-8r4qk" event={"ID":"7269df4b-2549-42a1-91d2-4dc525f92dda","Type":"ContainerStarted","Data":"f03d2e3fd92cd31656ee69ec4365829e6c8e30c2b280372d63f1396c9ff2a06f"}
Jul 21 01:29:07.264046 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:07.263595    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c984b598c-8r4qk"
Jul 21 01:29:07.279874 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:07.279785    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c984b598c-8r4qk" podStartSLOduration=1.774518882 podStartE2EDuration="4.279764649s" totalImagesPullingTime="2.505245767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:29:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:29:07.279305941 +0000 UTC m=+406.467345331" watchObservedRunningTime="2026-07-21 01:29:07.279764649 +0000 UTC m=+406.467804036"
Jul 21 01:29:09.274213 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:09.274173    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-4dg6d" event={"ID":"7e7b6130-64d4-41a2-ba36-33fbac91d602","Type":"ContainerStarted","Data":"7124f7536478b43a78d972c70be1d09a4478b55a3fd7052eaec3c6d5bf7fd1fb"}
Jul 21 01:29:09.290026 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:09.289966    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-545dd4bbd9-4dg6d" podStartSLOduration=2.5023030779999997 podStartE2EDuration="5.28992903s" totalImagesPullingTime="2.787625952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:29:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:29:09.288169523 +0000 UTC m=+408.476208914" watchObservedRunningTime="2026-07-21 01:29:09.28992903 +0000 UTC m=+408.477968420"
Jul 21 01:29:18.270350 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:29:18.270316    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c984b598c-8r4qk"
Jul 21 01:30:56.199221 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:30:56.199185    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zjg7s"]
Jul 21 01:30:56.202180 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:30:56.202158    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zjg7s"
Jul 21 01:30:56.204185 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:30:56.204160    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 01:30:56.204322 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:30:56.204184    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z6sgp\""
Jul 21 01:30:56.204322 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:30:56.204163    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 21 01:30:56.204322 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:30:56.204159    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 21 01:30:56.204600 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:30:56.204585    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 01:30:56.212977 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:30:56.212954    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zjg7s"]
Jul 21 01:30:56.268545 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:30:56.268497    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/32b56443-fe9e-43f3-965b-fc607578ac39-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zjg7s\" (UID: \"32b56443-fe9e-43f3-965b-fc607578ac39\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zjg7s"
Jul 21 01:30:56.268545 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:30:56.268540    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjcwb\" (UniqueName: \"kubernetes.io/projected/32b56443-fe9e-43f3-965b-fc607578ac39-kube-api-access-vjcwb\") pod \"kuadrant-console-plugin-66b5774985-zjg7s\" (UID: \"32b56443-fe9e-43f3-965b-fc607578ac39\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zjg7s"
Jul 21 01:30:56.268769 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:30:56.268573    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/32b56443-fe9e-43f3-965b-fc607578ac39-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zjg7s\" (UID: \"32b56443-fe9e-43f3-965b-fc607578ac39\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zjg7s"
Jul 21 01:30:56.370115 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:30:56.370081    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/32b56443-fe9e-43f3-965b-fc607578ac39-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zjg7s\" (UID: \"32b56443-fe9e-43f3-965b-fc607578ac39\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zjg7s"
Jul 21 01:30:56.370326 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:30:56.370224    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjcwb\" (UniqueName: \"kubernetes.io/projected/32b56443-fe9e-43f3-965b-fc607578ac39-kube-api-access-vjcwb\") pod \"kuadrant-console-plugin-66b5774985-zjg7s\" (UID: \"32b56443-fe9e-43f3-965b-fc607578ac39\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zjg7s"
Jul 21 01:30:56.370326 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:30:56.370267    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/32b56443-fe9e-43f3-965b-fc607578ac39-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zjg7s\" (UID: \"32b56443-fe9e-43f3-965b-fc607578ac39\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zjg7s"
Jul 21 01:30:56.370834 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:30:56.370812    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/32b56443-fe9e-43f3-965b-fc607578ac39-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zjg7s\" (UID: \"32b56443-fe9e-43f3-965b-fc607578ac39\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zjg7s"
Jul 21 01:30:56.372871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:30:56.372848    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/32b56443-fe9e-43f3-965b-fc607578ac39-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zjg7s\" (UID: \"32b56443-fe9e-43f3-965b-fc607578ac39\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zjg7s"
Jul 21 01:30:56.379006 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:30:56.378981    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjcwb\" (UniqueName: \"kubernetes.io/projected/32b56443-fe9e-43f3-965b-fc607578ac39-kube-api-access-vjcwb\") pod \"kuadrant-console-plugin-66b5774985-zjg7s\" (UID: \"32b56443-fe9e-43f3-965b-fc607578ac39\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zjg7s"
Jul 21 01:30:56.512486 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:30:56.512396    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zjg7s"
Jul 21 01:30:56.649119 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:30:56.649090    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zjg7s"]
Jul 21 01:30:56.651928 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:30:56.651902    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32b56443_fe9e_43f3_965b_fc607578ac39.slice/crio-5c311ab4011f7f27dda620e6da7e6cf1adfafe7385059a5e2ba4120a22e01965 WatchSource:0}: Error finding container 5c311ab4011f7f27dda620e6da7e6cf1adfafe7385059a5e2ba4120a22e01965: Status 404 returned error can't find the container with id 5c311ab4011f7f27dda620e6da7e6cf1adfafe7385059a5e2ba4120a22e01965
Jul 21 01:30:56.776477 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:30:56.776386    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zjg7s" event={"ID":"32b56443-fe9e-43f3-965b-fc607578ac39","Type":"ContainerStarted","Data":"5c311ab4011f7f27dda620e6da7e6cf1adfafe7385059a5e2ba4120a22e01965"}
Jul 21 01:31:20.923474 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:20.923436    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zjg7s" event={"ID":"32b56443-fe9e-43f3-965b-fc607578ac39","Type":"ContainerStarted","Data":"6ce81b2591b0fcee465ea1c37d94143c8e4c535713d311be438811676c36e6ae"}
Jul 21 01:31:20.939626 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:20.939565    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zjg7s" podStartSLOduration=1.6954224409999998 podStartE2EDuration="24.939546618s" totalImagesPullingTime="23.244124177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:30:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:31:20.938798556 +0000 UTC m=+540.126837949" watchObservedRunningTime="2026-07-21 01:31:20.939546618 +0000 UTC m=+540.127586044"
Jul 21 01:31:51.777475 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:51.777439    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:31:51.839111 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:51.839047    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:31:51.839280 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:51.839142    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:31:51.839280 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:51.839216    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"
Jul 21 01:31:51.841605 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:51.841581    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 21 01:31:51.891712 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:51.891675    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/31462a27-cc4f-42b7-8cf2-6462d4596e52-config-file\") pod \"limitador-limitador-54d6d988d5-w8v8m\" (UID: \"31462a27-cc4f-42b7-8cf2-6462d4596e52\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"
Jul 21 01:31:51.891893 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:51.891729    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wnrd\" (UniqueName: \"kubernetes.io/projected/31462a27-cc4f-42b7-8cf2-6462d4596e52-kube-api-access-7wnrd\") pod \"limitador-limitador-54d6d988d5-w8v8m\" (UID: \"31462a27-cc4f-42b7-8cf2-6462d4596e52\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"
Jul 21 01:31:51.992981 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:51.992915    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/31462a27-cc4f-42b7-8cf2-6462d4596e52-config-file\") pod \"limitador-limitador-54d6d988d5-w8v8m\" (UID: \"31462a27-cc4f-42b7-8cf2-6462d4596e52\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"
Jul 21 01:31:51.993139 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:51.993023    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wnrd\" (UniqueName: \"kubernetes.io/projected/31462a27-cc4f-42b7-8cf2-6462d4596e52-kube-api-access-7wnrd\") pod \"limitador-limitador-54d6d988d5-w8v8m\" (UID: \"31462a27-cc4f-42b7-8cf2-6462d4596e52\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"
Jul 21 01:31:51.993654 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:51.993635    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/31462a27-cc4f-42b7-8cf2-6462d4596e52-config-file\") pod \"limitador-limitador-54d6d988d5-w8v8m\" (UID: \"31462a27-cc4f-42b7-8cf2-6462d4596e52\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"
Jul 21 01:31:52.001044 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:52.001013    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wnrd\" (UniqueName: \"kubernetes.io/projected/31462a27-cc4f-42b7-8cf2-6462d4596e52-kube-api-access-7wnrd\") pod \"limitador-limitador-54d6d988d5-w8v8m\" (UID: \"31462a27-cc4f-42b7-8cf2-6462d4596e52\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"
Jul 21 01:31:52.149400 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:52.149359    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"
Jul 21 01:31:52.287769 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:52.287741    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:31:52.290558 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:52.290527    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-bfk9j"]
Jul 21 01:31:52.290904 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:31:52.290874    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31462a27_cc4f_42b7_8cf2_6462d4596e52.slice/crio-852fef73af66cbdd99591cb20f6eb7df10e63695df51590ff70a309c877ce7b5 WatchSource:0}: Error finding container 852fef73af66cbdd99591cb20f6eb7df10e63695df51590ff70a309c877ce7b5: Status 404 returned error can't find the container with id 852fef73af66cbdd99591cb20f6eb7df10e63695df51590ff70a309c877ce7b5
Jul 21 01:31:52.295680 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:52.295662    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bfk9j"
Jul 21 01:31:52.297952 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:52.297911    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-87zpl\""
Jul 21 01:31:52.299818 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:52.299781    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bfk9j"]
Jul 21 01:31:52.396882 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:52.396835    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxjcc\" (UniqueName: \"kubernetes.io/projected/9e192620-da10-4b1d-9411-4ecf5221acf5-kube-api-access-wxjcc\") pod \"authorino-75d556bd77-bfk9j\" (UID: \"9e192620-da10-4b1d-9411-4ecf5221acf5\") " pod="kuadrant-system/authorino-75d556bd77-bfk9j"
Jul 21 01:31:52.498250 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:52.498161    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxjcc\" (UniqueName: \"kubernetes.io/projected/9e192620-da10-4b1d-9411-4ecf5221acf5-kube-api-access-wxjcc\") pod \"authorino-75d556bd77-bfk9j\" (UID: \"9e192620-da10-4b1d-9411-4ecf5221acf5\") " pod="kuadrant-system/authorino-75d556bd77-bfk9j"
Jul 21 01:31:52.505877 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:52.505852    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxjcc\" (UniqueName: \"kubernetes.io/projected/9e192620-da10-4b1d-9411-4ecf5221acf5-kube-api-access-wxjcc\") pod \"authorino-75d556bd77-bfk9j\" (UID: \"9e192620-da10-4b1d-9411-4ecf5221acf5\") " pod="kuadrant-system/authorino-75d556bd77-bfk9j"
Jul 21 01:31:52.611131 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:52.611103    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bfk9j"
Jul 21 01:31:52.748431 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:52.748372    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bfk9j"]
Jul 21 01:31:52.750795 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:31:52.750767    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e192620_da10_4b1d_9411_4ecf5221acf5.slice/crio-5256ab9c0c2079c46f4bcb63b4979b7038dc99aee3aaca60987bfd6a4bb70449 WatchSource:0}: Error finding container 5256ab9c0c2079c46f4bcb63b4979b7038dc99aee3aaca60987bfd6a4bb70449: Status 404 returned error can't find the container with id 5256ab9c0c2079c46f4bcb63b4979b7038dc99aee3aaca60987bfd6a4bb70449
Jul 21 01:31:53.081005 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:53.080828    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-w8v8m" event={"ID":"31462a27-cc4f-42b7-8cf2-6462d4596e52","Type":"ContainerStarted","Data":"852fef73af66cbdd99591cb20f6eb7df10e63695df51590ff70a309c877ce7b5"}
Jul 21 01:31:53.082302 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:53.082271    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bfk9j" event={"ID":"9e192620-da10-4b1d-9411-4ecf5221acf5","Type":"ContainerStarted","Data":"5256ab9c0c2079c46f4bcb63b4979b7038dc99aee3aaca60987bfd6a4bb70449"}
Jul 21 01:31:57.105782 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:57.105736    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bfk9j" event={"ID":"9e192620-da10-4b1d-9411-4ecf5221acf5","Type":"ContainerStarted","Data":"41d4a9fecea059385c8887347930d54b85506eee095aea7929782923abcfb64d"}
Jul 21 01:31:57.107308 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:57.107282    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-w8v8m" event={"ID":"31462a27-cc4f-42b7-8cf2-6462d4596e52","Type":"ContainerStarted","Data":"20a1518d605b7d3e7e24303d265fd7b19917d6a72fa2c4a2622a5244b60a2a5f"}
Jul 21 01:31:57.107419 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:57.107402    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"
Jul 21 01:31:57.120458 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:57.120402    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-bfk9j" podStartSLOduration=1.109387204 podStartE2EDuration="5.120384939s" totalImagesPullingTime="4.010997735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:31:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:31:57.119559117 +0000 UTC m=+576.307598511" watchObservedRunningTime="2026-07-21 01:31:57.120384939 +0000 UTC m=+576.308424328"
Jul 21 01:31:57.137335 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:31:57.137264    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-w8v8m" podStartSLOduration=1.668169238 podStartE2EDuration="6.137238402s" totalImagesPullingTime="4.469069164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:31:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:31:57.135171643 +0000 UTC m=+576.323211033" watchObservedRunningTime="2026-07-21 01:31:57.137238402 +0000 UTC m=+576.325277794"
Jul 21 01:32:08.114110 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:08.114075    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"
Jul 21 01:32:23.131031 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:23.131000    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d767cccf-zwdlv"]
Jul 21 01:32:23.136971 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:23.136947    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d767cccf-zwdlv"
Jul 21 01:32:23.141388 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:32:23.141347    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"authorino-75d767cccf-zwdlv\" is forbidden: User \"system:node:ip-10-0-131-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-213.ec2.internal' and this object" podUID="7714225b-6ad4-44f8-a646-847d4b67d604" pod="kuadrant-system/authorino-75d767cccf-zwdlv"
Jul 21 01:32:23.141525 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:32:23.141450    2586 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"authorino-server-cert\" is forbidden: User \"system:node:ip-10-0-131-213.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-213.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" type="*v1.Secret"
Jul 21 01:32:23.153642 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:23.153615    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d767cccf-zwdlv"]
Jul 21 01:32:23.186716 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:23.186681    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7714225b-6ad4-44f8-a646-847d4b67d604-tls-cert\") pod \"authorino-75d767cccf-zwdlv\" (UID: \"7714225b-6ad4-44f8-a646-847d4b67d604\") " pod="kuadrant-system/authorino-75d767cccf-zwdlv"
Jul 21 01:32:23.186891 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:23.186762    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs897\" (UniqueName: \"kubernetes.io/projected/7714225b-6ad4-44f8-a646-847d4b67d604-kube-api-access-xs897\") pod \"authorino-75d767cccf-zwdlv\" (UID: \"7714225b-6ad4-44f8-a646-847d4b67d604\") " pod="kuadrant-system/authorino-75d767cccf-zwdlv"
Jul 21 01:32:23.287835 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:23.287798    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs897\" (UniqueName: \"kubernetes.io/projected/7714225b-6ad4-44f8-a646-847d4b67d604-kube-api-access-xs897\") pod \"authorino-75d767cccf-zwdlv\" (UID: \"7714225b-6ad4-44f8-a646-847d4b67d604\") " pod="kuadrant-system/authorino-75d767cccf-zwdlv"
Jul 21 01:32:23.288052 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:23.287885    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7714225b-6ad4-44f8-a646-847d4b67d604-tls-cert\") pod \"authorino-75d767cccf-zwdlv\" (UID: \"7714225b-6ad4-44f8-a646-847d4b67d604\") " pod="kuadrant-system/authorino-75d767cccf-zwdlv"
Jul 21 01:32:23.296423 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:23.296395    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs897\" (UniqueName: \"kubernetes.io/projected/7714225b-6ad4-44f8-a646-847d4b67d604-kube-api-access-xs897\") pod \"authorino-75d767cccf-zwdlv\" (UID: \"7714225b-6ad4-44f8-a646-847d4b67d604\") " pod="kuadrant-system/authorino-75d767cccf-zwdlv"
Jul 21 01:32:24.289032 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:32:24.289000    2586 secret.go:189] Couldn't get secret kuadrant-system/authorino-server-cert: failed to sync secret cache: timed out waiting for the condition
Jul 21 01:32:24.289408 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:32:24.289079    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7714225b-6ad4-44f8-a646-847d4b67d604-tls-cert podName:7714225b-6ad4-44f8-a646-847d4b67d604 nodeName:}" failed. No retries permitted until 2026-07-21 01:32:24.789063993 +0000 UTC m=+603.977103361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-cert" (UniqueName: "kubernetes.io/secret/7714225b-6ad4-44f8-a646-847d4b67d604-tls-cert") pod "authorino-75d767cccf-zwdlv" (UID: "7714225b-6ad4-44f8-a646-847d4b67d604") : failed to sync secret cache: timed out waiting for the condition
Jul 21 01:32:24.331326 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:24.331296    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 21 01:32:24.801138 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:24.801095    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7714225b-6ad4-44f8-a646-847d4b67d604-tls-cert\") pod \"authorino-75d767cccf-zwdlv\" (UID: \"7714225b-6ad4-44f8-a646-847d4b67d604\") " pod="kuadrant-system/authorino-75d767cccf-zwdlv"
Jul 21 01:32:24.803774 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:24.803752    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7714225b-6ad4-44f8-a646-847d4b67d604-tls-cert\") pod \"authorino-75d767cccf-zwdlv\" (UID: \"7714225b-6ad4-44f8-a646-847d4b67d604\") " pod="kuadrant-system/authorino-75d767cccf-zwdlv"
Jul 21 01:32:24.946097 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:24.946064    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d767cccf-zwdlv"
Jul 21 01:32:25.087517 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:25.087430    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d767cccf-zwdlv"]
Jul 21 01:32:25.090434 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:32:25.090393    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7714225b_6ad4_44f8_a646_847d4b67d604.slice/crio-e92d12c8138cb7a9f0d716c38ff0be4a4aa1fd8b1d0477366d50353aecd8ba1b WatchSource:0}: Error finding container e92d12c8138cb7a9f0d716c38ff0be4a4aa1fd8b1d0477366d50353aecd8ba1b: Status 404 returned error can't find the container with id e92d12c8138cb7a9f0d716c38ff0be4a4aa1fd8b1d0477366d50353aecd8ba1b
Jul 21 01:32:25.240627 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:25.240592    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d767cccf-zwdlv" event={"ID":"7714225b-6ad4-44f8-a646-847d4b67d604","Type":"ContainerStarted","Data":"e92d12c8138cb7a9f0d716c38ff0be4a4aa1fd8b1d0477366d50353aecd8ba1b"}
Jul 21 01:32:26.247078 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:26.247039    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d767cccf-zwdlv" event={"ID":"7714225b-6ad4-44f8-a646-847d4b67d604","Type":"ContainerStarted","Data":"76a5586a4458115b430b4d93b473bdda4bd415aa3ce2ee03b65f3e3e3a00f774"}
Jul 21 01:32:26.262209 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:26.262153    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d767cccf-zwdlv" podStartSLOduration=2.926220581 podStartE2EDuration="3.262136483s" totalImagesPullingTime="335.915902ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:32:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:32:26.260663839 +0000 UTC m=+605.448703231" watchObservedRunningTime="2026-07-21 01:32:26.262136483 +0000 UTC m=+605.450175873"
Jul 21 01:32:26.284573 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:26.284542    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bfk9j"]
Jul 21 01:32:26.284742 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:26.284718    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-bfk9j" podUID="9e192620-da10-4b1d-9411-4ecf5221acf5" containerName="authorino" containerID="cri-o://41d4a9fecea059385c8887347930d54b85506eee095aea7929782923abcfb64d" gracePeriod=30
Jul 21 01:32:26.537583 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:26.537556    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bfk9j"
Jul 21 01:32:26.617366 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:26.617320    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxjcc\" (UniqueName: \"kubernetes.io/projected/9e192620-da10-4b1d-9411-4ecf5221acf5-kube-api-access-wxjcc\") pod \"9e192620-da10-4b1d-9411-4ecf5221acf5\" (UID: \"9e192620-da10-4b1d-9411-4ecf5221acf5\") "
Jul 21 01:32:26.619742 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:26.619710    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e192620-da10-4b1d-9411-4ecf5221acf5-kube-api-access-wxjcc" (OuterVolumeSpecName: "kube-api-access-wxjcc") pod "9e192620-da10-4b1d-9411-4ecf5221acf5" (UID: "9e192620-da10-4b1d-9411-4ecf5221acf5"). InnerVolumeSpecName "kube-api-access-wxjcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:32:26.718896 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:26.718850    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxjcc\" (UniqueName: \"kubernetes.io/projected/9e192620-da10-4b1d-9411-4ecf5221acf5-kube-api-access-wxjcc\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:32:27.253290 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:27.253253    2586 generic.go:356] "Generic (PLEG): container finished" podID="9e192620-da10-4b1d-9411-4ecf5221acf5" containerID="41d4a9fecea059385c8887347930d54b85506eee095aea7929782923abcfb64d" exitCode=0
Jul 21 01:32:27.253772 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:27.253298    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bfk9j"
Jul 21 01:32:27.253772 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:27.253345    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bfk9j" event={"ID":"9e192620-da10-4b1d-9411-4ecf5221acf5","Type":"ContainerDied","Data":"41d4a9fecea059385c8887347930d54b85506eee095aea7929782923abcfb64d"}
Jul 21 01:32:27.253772 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:27.253396    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bfk9j" event={"ID":"9e192620-da10-4b1d-9411-4ecf5221acf5","Type":"ContainerDied","Data":"5256ab9c0c2079c46f4bcb63b4979b7038dc99aee3aaca60987bfd6a4bb70449"}
Jul 21 01:32:27.253772 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:27.253422    2586 scope.go:117] "RemoveContainer" containerID="41d4a9fecea059385c8887347930d54b85506eee095aea7929782923abcfb64d"
Jul 21 01:32:27.262305 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:27.262288    2586 scope.go:117] "RemoveContainer" containerID="41d4a9fecea059385c8887347930d54b85506eee095aea7929782923abcfb64d"
Jul 21 01:32:27.262586 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:32:27.262569    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41d4a9fecea059385c8887347930d54b85506eee095aea7929782923abcfb64d\": container with ID starting with 41d4a9fecea059385c8887347930d54b85506eee095aea7929782923abcfb64d not found: ID does not exist" containerID="41d4a9fecea059385c8887347930d54b85506eee095aea7929782923abcfb64d"
Jul 21 01:32:27.262656 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:27.262595    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41d4a9fecea059385c8887347930d54b85506eee095aea7929782923abcfb64d"} err="failed to get container status \"41d4a9fecea059385c8887347930d54b85506eee095aea7929782923abcfb64d\": rpc error: code = NotFound desc = could not find container \"41d4a9fecea059385c8887347930d54b85506eee095aea7929782923abcfb64d\": container with ID starting with 41d4a9fecea059385c8887347930d54b85506eee095aea7929782923abcfb64d not found: ID does not exist"
Jul 21 01:32:27.272871 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:27.272840    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bfk9j"]
Jul 21 01:32:27.277784 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:27.277760    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bfk9j"]
Jul 21 01:32:27.308775 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:32:27.308730    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e192620-da10-4b1d-9411-4ecf5221acf5" path="/var/lib/kubelet/pods/9e192620-da10-4b1d-9411-4ecf5221acf5/volumes"
Jul 21 01:33:07.107794 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:07.107756    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:33:28.003736 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:28.003691    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:33:33.316863 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:33.316827    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:33:42.395555 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:42.395513    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:33:49.804843 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:49.804805    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:33:58.608805 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.608764    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"]
Jul 21 01:33:58.609237 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.609183    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e192620-da10-4b1d-9411-4ecf5221acf5" containerName="authorino"
Jul 21 01:33:58.609237 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.609195    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e192620-da10-4b1d-9411-4ecf5221acf5" containerName="authorino"
Jul 21 01:33:58.609314 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.609256    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e192620-da10-4b1d-9411-4ecf5221acf5" containerName="authorino"
Jul 21 01:33:58.612525 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.612505    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"
Jul 21 01:33:58.614948 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.614904    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 21 01:33:58.615095 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.614910    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 01:33:58.615095 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.614919    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 01:33:58.615095 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.614954    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hv87n\""
Jul 21 01:33:58.621214 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.621178    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"]
Jul 21 01:33:58.660262 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.660224    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f588489a-a936-4d15-b3a5-769c4a2c917e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xnqlj\" (UID: \"f588489a-a936-4d15-b3a5-769c4a2c917e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"
Jul 21 01:33:58.660262 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.660266    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f588489a-a936-4d15-b3a5-769c4a2c917e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xnqlj\" (UID: \"f588489a-a936-4d15-b3a5-769c4a2c917e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"
Jul 21 01:33:58.660525 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.660297    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shv7s\" (UniqueName: \"kubernetes.io/projected/f588489a-a936-4d15-b3a5-769c4a2c917e-kube-api-access-shv7s\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xnqlj\" (UID: \"f588489a-a936-4d15-b3a5-769c4a2c917e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"
Jul 21 01:33:58.660525 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.660351    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f588489a-a936-4d15-b3a5-769c4a2c917e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xnqlj\" (UID: \"f588489a-a936-4d15-b3a5-769c4a2c917e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"
Jul 21 01:33:58.660525 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.660381    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f588489a-a936-4d15-b3a5-769c4a2c917e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xnqlj\" (UID: \"f588489a-a936-4d15-b3a5-769c4a2c917e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"
Jul 21 01:33:58.660525 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.660504    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f588489a-a936-4d15-b3a5-769c4a2c917e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xnqlj\" (UID: \"f588489a-a936-4d15-b3a5-769c4a2c917e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"
Jul 21 01:33:58.762061 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.762021    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f588489a-a936-4d15-b3a5-769c4a2c917e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xnqlj\" (UID: \"f588489a-a936-4d15-b3a5-769c4a2c917e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"
Jul 21 01:33:58.762061 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.762067    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f588489a-a936-4d15-b3a5-769c4a2c917e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xnqlj\" (UID: \"f588489a-a936-4d15-b3a5-769c4a2c917e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"
Jul 21 01:33:58.762288 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.762109    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shv7s\" (UniqueName: \"kubernetes.io/projected/f588489a-a936-4d15-b3a5-769c4a2c917e-kube-api-access-shv7s\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xnqlj\" (UID: \"f588489a-a936-4d15-b3a5-769c4a2c917e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"
Jul 21 01:33:58.762288 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.762143    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f588489a-a936-4d15-b3a5-769c4a2c917e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xnqlj\" (UID: \"f588489a-a936-4d15-b3a5-769c4a2c917e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"
Jul 21 01:33:58.762397 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.762277    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f588489a-a936-4d15-b3a5-769c4a2c917e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xnqlj\" (UID: \"f588489a-a936-4d15-b3a5-769c4a2c917e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"
Jul 21 01:33:58.762397 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.762373    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f588489a-a936-4d15-b3a5-769c4a2c917e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xnqlj\" (UID: \"f588489a-a936-4d15-b3a5-769c4a2c917e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"
Jul 21 01:33:58.762501 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.762469    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f588489a-a936-4d15-b3a5-769c4a2c917e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xnqlj\" (UID: \"f588489a-a936-4d15-b3a5-769c4a2c917e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"
Jul 21 01:33:58.762570 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.762549    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f588489a-a936-4d15-b3a5-769c4a2c917e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xnqlj\" (UID: \"f588489a-a936-4d15-b3a5-769c4a2c917e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"
Jul 21 01:33:58.762713 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.762699    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f588489a-a936-4d15-b3a5-769c4a2c917e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xnqlj\" (UID: \"f588489a-a936-4d15-b3a5-769c4a2c917e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"
Jul 21 01:33:58.764615 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.764583    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f588489a-a936-4d15-b3a5-769c4a2c917e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xnqlj\" (UID: \"f588489a-a936-4d15-b3a5-769c4a2c917e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"
Jul 21 01:33:58.764808 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.764787    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f588489a-a936-4d15-b3a5-769c4a2c917e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xnqlj\" (UID: \"f588489a-a936-4d15-b3a5-769c4a2c917e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"
Jul 21 01:33:58.774449 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.774415    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shv7s\" (UniqueName: \"kubernetes.io/projected/f588489a-a936-4d15-b3a5-769c4a2c917e-kube-api-access-shv7s\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xnqlj\" (UID: \"f588489a-a936-4d15-b3a5-769c4a2c917e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"
Jul 21 01:33:58.924301 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:58.924205    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"
Jul 21 01:33:59.066297 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:59.066271    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"]
Jul 21 01:33:59.068952 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:33:59.068905    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf588489a_a936_4d15_b3a5_769c4a2c917e.slice/crio-ac642f6114feb1ff28815df83e6131437e0791305e03c84d2545c4fff85f9e80 WatchSource:0}: Error finding container ac642f6114feb1ff28815df83e6131437e0791305e03c84d2545c4fff85f9e80: Status 404 returned error can't find the container with id ac642f6114feb1ff28815df83e6131437e0791305e03c84d2545c4fff85f9e80
Jul 21 01:33:59.070282 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:59.070265    2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 01:33:59.697407 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:33:59.697370    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj" event={"ID":"f588489a-a936-4d15-b3a5-769c4a2c917e","Type":"ContainerStarted","Data":"ac642f6114feb1ff28815df83e6131437e0791305e03c84d2545c4fff85f9e80"}
Jul 21 01:34:00.704308 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:00.704274    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj" event={"ID":"f588489a-a936-4d15-b3a5-769c4a2c917e","Type":"ContainerStarted","Data":"bc64469333a8ea9529bde50200cc0e0615afe5fdc71e24343e2385a86ce0e070"}
Jul 21 01:34:00.722643 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:00.722585    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj" podStartSLOduration=1.722063389 podStartE2EDuration="2.722565683s" totalImagesPullingTime="1.000502294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:33:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:34:00.720788841 +0000 UTC m=+699.908828231" watchObservedRunningTime="2026-07-21 01:34:00.722565683 +0000 UTC m=+699.910605072"
Jul 21 01:34:01.603865 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:01.603818    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:34:08.924329 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:08.924291    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"
Jul 21 01:34:08.924997 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:08.924372    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"
Jul 21 01:34:08.937073 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:08.937044    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"
Jul 21 01:34:09.760463 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:09.760436    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xnqlj"
Jul 21 01:34:10.401277 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:10.401246    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"]
Jul 21 01:34:10.405168 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:10.405144    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"
Jul 21 01:34:10.407095 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:10.407064    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 21 01:34:10.414079 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:10.414052    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"]
Jul 21 01:34:10.472672 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:10.472635    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90c80363-e790-4b74-a345-1a896bdce61f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5dksg\" (UID: \"90c80363-e790-4b74-a345-1a896bdce61f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"
Jul 21 01:34:10.472868 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:10.472686    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xnx8\" (UniqueName: \"kubernetes.io/projected/90c80363-e790-4b74-a345-1a896bdce61f-kube-api-access-2xnx8\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5dksg\" (UID: \"90c80363-e790-4b74-a345-1a896bdce61f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"
Jul 21 01:34:10.472868 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:10.472734    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90c80363-e790-4b74-a345-1a896bdce61f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5dksg\" (UID: \"90c80363-e790-4b74-a345-1a896bdce61f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"
Jul 21 01:34:10.472868 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:10.472806    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90c80363-e790-4b74-a345-1a896bdce61f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5dksg\" (UID: \"90c80363-e790-4b74-a345-1a896bdce61f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"
Jul 21 01:34:10.472868 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:10.472859    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90c80363-e790-4b74-a345-1a896bdce61f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5dksg\" (UID: \"90c80363-e790-4b74-a345-1a896bdce61f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"
Jul 21 01:34:10.473110 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:10.472884    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90c80363-e790-4b74-a345-1a896bdce61f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5dksg\" (UID: \"90c80363-e790-4b74-a345-1a896bdce61f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"
Jul 21 01:34:10.573862 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:10.573827    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90c80363-e790-4b74-a345-1a896bdce61f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5dksg\" (UID: \"90c80363-e790-4b74-a345-1a896bdce61f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"
Jul 21 01:34:10.574057 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:10.573899    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90c80363-e790-4b74-a345-1a896bdce61f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5dksg\" (UID: \"90c80363-e790-4b74-a345-1a896bdce61f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"
Jul 21 01:34:10.574057 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:10.573929    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90c80363-e790-4b74-a345-1a896bdce61f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5dksg\" (UID: \"90c80363-e790-4b74-a345-1a896bdce61f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"
Jul 21 01:34:10.574057 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:10.573981    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90c80363-e790-4b74-a345-1a896bdce61f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5dksg\" (UID: \"90c80363-e790-4b74-a345-1a896bdce61f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"
Jul 21 01:34:10.574057 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:10.574019    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90c80363-e790-4b74-a345-1a896bdce61f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5dksg\" (UID: \"90c80363-e790-4b74-a345-1a896bdce61f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"
Jul 21 01:34:10.574057 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:10.574046    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xnx8\" (UniqueName: \"kubernetes.io/projected/90c80363-e790-4b74-a345-1a896bdce61f-kube-api-access-2xnx8\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5dksg\" (UID: \"90c80363-e790-4b74-a345-1a896bdce61f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"
Jul 21 01:34:10.574360 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:10.574333    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90c80363-e790-4b74-a345-1a896bdce61f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5dksg\" (UID: \"90c80363-e790-4b74-a345-1a896bdce61f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"
Jul 21 01:34:10.574448 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:10.574401    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90c80363-e790-4b74-a345-1a896bdce61f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5dksg\" (UID: \"90c80363-e790-4b74-a345-1a896bdce61f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"
Jul 21 01:34:10.574507 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:10.574484    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90c80363-e790-4b74-a345-1a896bdce61f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5dksg\" (UID: \"90c80363-e790-4b74-a345-1a896bdce61f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"
Jul 21 01:34:10.576264 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:10.576242    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90c80363-e790-4b74-a345-1a896bdce61f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5dksg\" (UID: \"90c80363-e790-4b74-a345-1a896bdce61f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"
Jul 21 01:34:10.576498 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:10.576483    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90c80363-e790-4b74-a345-1a896bdce61f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5dksg\" (UID: \"90c80363-e790-4b74-a345-1a896bdce61f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"
Jul 21 01:34:10.581572 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:10.581537    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xnx8\" (UniqueName: \"kubernetes.io/projected/90c80363-e790-4b74-a345-1a896bdce61f-kube-api-access-2xnx8\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5dksg\" (UID: \"90c80363-e790-4b74-a345-1a896bdce61f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"
Jul 21 01:34:10.716406 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:10.716309    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"
Jul 21 01:34:10.857684 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:10.857649    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"]
Jul 21 01:34:10.861442 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:34:10.861412    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90c80363_e790_4b74_a345_1a896bdce61f.slice/crio-5280bd5ede655e64caaee5d97c015bcaf1599a6bb4ec79684b77ba063e64c949 WatchSource:0}: Error finding container 5280bd5ede655e64caaee5d97c015bcaf1599a6bb4ec79684b77ba063e64c949: Status 404 returned error can't find the container with id 5280bd5ede655e64caaee5d97c015bcaf1599a6bb4ec79684b77ba063e64c949
Jul 21 01:34:11.764374 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:11.764328    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg" event={"ID":"90c80363-e790-4b74-a345-1a896bdce61f","Type":"ContainerStarted","Data":"49f3ea40bb2935dd0890dce5adc104b19f28836969f491049e628ff492d1b1b3"}
Jul 21 01:34:11.764374 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:11.764374    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg" event={"ID":"90c80363-e790-4b74-a345-1a896bdce61f","Type":"ContainerStarted","Data":"5280bd5ede655e64caaee5d97c015bcaf1599a6bb4ec79684b77ba063e64c949"}
Jul 21 01:34:11.781897 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:11.781838    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg" podStartSLOduration=1.5828287319999998 podStartE2EDuration="1.781819882s" totalImagesPullingTime="198.99115ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:34:11.780880716 +0000 UTC m=+710.968920107" watchObservedRunningTime="2026-07-21 01:34:11.781819882 +0000 UTC m=+710.969859272"
Jul 21 01:34:13.295614 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:13.295576    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:34:20.717229 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:20.717188    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"
Jul 21 01:34:20.717701 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:20.717536    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"
Jul 21 01:34:20.730434 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:20.730398    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"
Jul 21 01:34:20.820773 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:34:20.820742    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5dksg"
Jul 21 01:35:55.254241 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:35:55.254161    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d767cccf-zwdlv"]
Jul 21 01:35:55.254764 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:35:55.254357    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d767cccf-zwdlv" podUID="7714225b-6ad4-44f8-a646-847d4b67d604" containerName="authorino" containerID="cri-o://76a5586a4458115b430b4d93b473bdda4bd415aa3ce2ee03b65f3e3e3a00f774" gracePeriod=30
Jul 21 01:35:55.503301 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:35:55.503274    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d767cccf-zwdlv"
Jul 21 01:35:55.560423 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:35:55.560325    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7714225b-6ad4-44f8-a646-847d4b67d604-tls-cert\") pod \"7714225b-6ad4-44f8-a646-847d4b67d604\" (UID: \"7714225b-6ad4-44f8-a646-847d4b67d604\") "
Jul 21 01:35:55.560578 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:35:55.560501    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xs897\" (UniqueName: \"kubernetes.io/projected/7714225b-6ad4-44f8-a646-847d4b67d604-kube-api-access-xs897\") pod \"7714225b-6ad4-44f8-a646-847d4b67d604\" (UID: \"7714225b-6ad4-44f8-a646-847d4b67d604\") "
Jul 21 01:35:55.562615 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:35:55.562588    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7714225b-6ad4-44f8-a646-847d4b67d604-kube-api-access-xs897" (OuterVolumeSpecName: "kube-api-access-xs897") pod "7714225b-6ad4-44f8-a646-847d4b67d604" (UID: "7714225b-6ad4-44f8-a646-847d4b67d604"). InnerVolumeSpecName "kube-api-access-xs897". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:35:55.571734 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:35:55.571699    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7714225b-6ad4-44f8-a646-847d4b67d604-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7714225b-6ad4-44f8-a646-847d4b67d604" (UID: "7714225b-6ad4-44f8-a646-847d4b67d604"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:35:55.661720 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:35:55.661684    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xs897\" (UniqueName: \"kubernetes.io/projected/7714225b-6ad4-44f8-a646-847d4b67d604-kube-api-access-xs897\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:35:55.661720 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:35:55.661715    2586 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7714225b-6ad4-44f8-a646-847d4b67d604-tls-cert\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:35:56.268813 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:35:56.268776    2586 generic.go:356] "Generic (PLEG): container finished" podID="7714225b-6ad4-44f8-a646-847d4b67d604" containerID="76a5586a4458115b430b4d93b473bdda4bd415aa3ce2ee03b65f3e3e3a00f774" exitCode=0
Jul 21 01:35:56.269293 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:35:56.268823    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d767cccf-zwdlv"
Jul 21 01:35:56.269293 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:35:56.268861    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d767cccf-zwdlv" event={"ID":"7714225b-6ad4-44f8-a646-847d4b67d604","Type":"ContainerDied","Data":"76a5586a4458115b430b4d93b473bdda4bd415aa3ce2ee03b65f3e3e3a00f774"}
Jul 21 01:35:56.269293 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:35:56.268900    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d767cccf-zwdlv" event={"ID":"7714225b-6ad4-44f8-a646-847d4b67d604","Type":"ContainerDied","Data":"e92d12c8138cb7a9f0d716c38ff0be4a4aa1fd8b1d0477366d50353aecd8ba1b"}
Jul 21 01:35:56.269293 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:35:56.268917    2586 scope.go:117] "RemoveContainer" containerID="76a5586a4458115b430b4d93b473bdda4bd415aa3ce2ee03b65f3e3e3a00f774"
Jul 21 01:35:56.278673 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:35:56.278651    2586 scope.go:117] "RemoveContainer" containerID="76a5586a4458115b430b4d93b473bdda4bd415aa3ce2ee03b65f3e3e3a00f774"
Jul 21 01:35:56.279004 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:35:56.278979    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76a5586a4458115b430b4d93b473bdda4bd415aa3ce2ee03b65f3e3e3a00f774\": container with ID starting with 76a5586a4458115b430b4d93b473bdda4bd415aa3ce2ee03b65f3e3e3a00f774 not found: ID does not exist" containerID="76a5586a4458115b430b4d93b473bdda4bd415aa3ce2ee03b65f3e3e3a00f774"
Jul 21 01:35:56.279101 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:35:56.279011    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76a5586a4458115b430b4d93b473bdda4bd415aa3ce2ee03b65f3e3e3a00f774"} err="failed to get container status \"76a5586a4458115b430b4d93b473bdda4bd415aa3ce2ee03b65f3e3e3a00f774\": rpc error: code = NotFound desc = could not find container \"76a5586a4458115b430b4d93b473bdda4bd415aa3ce2ee03b65f3e3e3a00f774\": container with ID starting with 76a5586a4458115b430b4d93b473bdda4bd415aa3ce2ee03b65f3e3e3a00f774 not found: ID does not exist"
Jul 21 01:35:56.292337 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:35:56.292311    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d767cccf-zwdlv"]
Jul 21 01:35:56.295903 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:35:56.295878    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d767cccf-zwdlv"]
Jul 21 01:35:57.309265 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:35:57.309230    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7714225b-6ad4-44f8-a646-847d4b67d604" path="/var/lib/kubelet/pods/7714225b-6ad4-44f8-a646-847d4b67d604/volumes"
Jul 21 01:36:25.330216 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:36:25.330173    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:36:37.597330 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:36:37.597294    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:36:46.898209 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:36:46.898170    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:38:05.082526 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:38:05.082496    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bb6957b54-jdw8d"]
Jul 21 01:38:05.082970 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:38:05.082929    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7714225b-6ad4-44f8-a646-847d4b67d604" containerName="authorino"
Jul 21 01:38:05.083043 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:38:05.082977    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="7714225b-6ad4-44f8-a646-847d4b67d604" containerName="authorino"
Jul 21 01:38:05.083123 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:38:05.083104    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="7714225b-6ad4-44f8-a646-847d4b67d604" containerName="authorino"
Jul 21 01:38:05.086542 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:38:05.086522    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb6957b54-jdw8d"
Jul 21 01:38:05.089112 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:38:05.089087    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 01:38:05.089252 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:38:05.089087    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 01:38:05.089252 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:38:05.089174    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wj5n8\""
Jul 21 01:38:05.096117 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:38:05.096041    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bb6957b54-jdw8d"]
Jul 21 01:38:05.167828 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:38:05.167785    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvfl7\" (UniqueName: \"kubernetes.io/projected/1d6513b7-8300-43f7-81f7-c0af9becb0a9-kube-api-access-tvfl7\") pod \"maas-controller-6bb6957b54-jdw8d\" (UID: \"1d6513b7-8300-43f7-81f7-c0af9becb0a9\") " pod="opendatahub/maas-controller-6bb6957b54-jdw8d"
Jul 21 01:38:05.168038 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:38:05.167871    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d6513b7-8300-43f7-81f7-c0af9becb0a9-webhook-cert\") pod \"maas-controller-6bb6957b54-jdw8d\" (UID: \"1d6513b7-8300-43f7-81f7-c0af9becb0a9\") " pod="opendatahub/maas-controller-6bb6957b54-jdw8d"
Jul 21 01:38:05.268674 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:38:05.268624    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d6513b7-8300-43f7-81f7-c0af9becb0a9-webhook-cert\") pod \"maas-controller-6bb6957b54-jdw8d\" (UID: \"1d6513b7-8300-43f7-81f7-c0af9becb0a9\") " pod="opendatahub/maas-controller-6bb6957b54-jdw8d"
Jul 21 01:38:05.268849 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:38:05.268761    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvfl7\" (UniqueName: \"kubernetes.io/projected/1d6513b7-8300-43f7-81f7-c0af9becb0a9-kube-api-access-tvfl7\") pod \"maas-controller-6bb6957b54-jdw8d\" (UID: \"1d6513b7-8300-43f7-81f7-c0af9becb0a9\") " pod="opendatahub/maas-controller-6bb6957b54-jdw8d"
Jul 21 01:38:05.271494 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:38:05.271470    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d6513b7-8300-43f7-81f7-c0af9becb0a9-webhook-cert\") pod \"maas-controller-6bb6957b54-jdw8d\" (UID: \"1d6513b7-8300-43f7-81f7-c0af9becb0a9\") " pod="opendatahub/maas-controller-6bb6957b54-jdw8d"
Jul 21 01:38:05.276356 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:38:05.276330    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvfl7\" (UniqueName: \"kubernetes.io/projected/1d6513b7-8300-43f7-81f7-c0af9becb0a9-kube-api-access-tvfl7\") pod \"maas-controller-6bb6957b54-jdw8d\" (UID: \"1d6513b7-8300-43f7-81f7-c0af9becb0a9\") " pod="opendatahub/maas-controller-6bb6957b54-jdw8d"
Jul 21 01:38:05.400491 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:38:05.400452    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb6957b54-jdw8d"
Jul 21 01:38:05.545611 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:38:05.545582    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bb6957b54-jdw8d"]
Jul 21 01:38:05.547461 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:38:05.547422    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d6513b7_8300_43f7_81f7_c0af9becb0a9.slice/crio-4fefc133940c0f065dbd9b5c3ae3950633505143e72b6388ec9c0a0efd94b9a3 WatchSource:0}: Error finding container 4fefc133940c0f065dbd9b5c3ae3950633505143e72b6388ec9c0a0efd94b9a3: Status 404 returned error can't find the container with id 4fefc133940c0f065dbd9b5c3ae3950633505143e72b6388ec9c0a0efd94b9a3
Jul 21 01:38:05.893699 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:38:05.893662    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb6957b54-jdw8d" event={"ID":"1d6513b7-8300-43f7-81f7-c0af9becb0a9","Type":"ContainerStarted","Data":"4fefc133940c0f065dbd9b5c3ae3950633505143e72b6388ec9c0a0efd94b9a3"}
Jul 21 01:38:07.906676 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:38:07.906628    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb6957b54-jdw8d" event={"ID":"1d6513b7-8300-43f7-81f7-c0af9becb0a9","Type":"ContainerStarted","Data":"a72c2694784f4ad7619224b7c09f9c26691826345054afae6d729efdfa923eda"}
Jul 21 01:38:07.907216 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:38:07.906751    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bb6957b54-jdw8d"
Jul 21 01:38:07.922473 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:38:07.922419    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bb6957b54-jdw8d" podStartSLOduration=0.680967398 podStartE2EDuration="2.922404427s" totalImagesPullingTime="2.241437029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:38:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:38:07.92139846 +0000 UTC m=+947.109437863" watchObservedRunningTime="2026-07-21 01:38:07.922404427 +0000 UTC m=+947.110443854"
Jul 21 01:38:18.915266 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:38:18.915236    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bb6957b54-jdw8d"
Jul 21 01:38:33.100008 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:38:33.099969    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:38:41.594443 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:38:41.594355    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:39:13.907876 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:39:13.907834    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:39:23.595637 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:39:23.595596    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:39:33.898406 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:39:33.898367    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:39:39.705867 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:39:39.705829    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:39:50.199096 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:39:50.199043    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:40:00.406739 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:40:00.406695    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:40:11.200500 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:40:11.200460    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:40:21.295517 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:40:21.295465    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:40:43.309511 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:40:43.309481    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:40:54.206628 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:40:54.206592    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:41:17.703193 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:41:17.703149    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:41:30.839726 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:41:30.839682    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:41:47.005885 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:41:47.005792    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:41:56.914535 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:41:56.914497    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:42:07.010158 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:42:07.010118    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:42:17.313655 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:42:17.313615    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:42:27.121371 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:42:27.121334    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:44:14.999612 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:44:14.999571    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:44:26.595818 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:44:26.595773    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:44:46.205253 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:44:46.205172    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:44:56.488680 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:44:56.488644    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:45:07.794703 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:45:07.794656    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:45:15.696509 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:45:15.696465    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:45:27.192361 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:45:27.192315    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:45:38.589818 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:45:38.589784    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:45:46.888441 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:45:46.888403    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:45:58.099996 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:45:58.099963    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:46:19.198614 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:19.198531    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:46:29.105557 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:29.105517    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:46:34.904496 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:34.904466    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"]
Jul 21 01:46:34.908107 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:34.908088    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"
Jul 21 01:46:34.910155 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:34.910129    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-914199c4-kserve-self-signed-certs\""
Jul 21 01:46:34.919532 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:34.919505    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"]
Jul 21 01:46:34.983465 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:34.983427    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v525\" (UniqueName: \"kubernetes.io/projected/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-kube-api-access-9v525\") pod \"e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt\" (UID: \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\") " pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"
Jul 21 01:46:34.983675 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:34.983489    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-home\") pod \"e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt\" (UID: \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\") " pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"
Jul 21 01:46:34.983675 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:34.983593    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-dshm\") pod \"e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt\" (UID: \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\") " pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"
Jul 21 01:46:34.983675 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:34.983629    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-model-cache\") pod \"e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt\" (UID: \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\") " pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"
Jul 21 01:46:34.983675 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:34.983676    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-tmp-dir\") pod \"e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt\" (UID: \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\") " pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"
Jul 21 01:46:34.983830 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:34.983700    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-tls-certs\") pod \"e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt\" (UID: \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\") " pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"
Jul 21 01:46:35.085231 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:35.085196    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-home\") pod \"e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt\" (UID: \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\") " pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"
Jul 21 01:46:35.085397 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:35.085262    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-dshm\") pod \"e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt\" (UID: \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\") " pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"
Jul 21 01:46:35.085397 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:35.085284    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-model-cache\") pod \"e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt\" (UID: \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\") " pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"
Jul 21 01:46:35.085397 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:35.085323    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-tmp-dir\") pod \"e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt\" (UID: \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\") " pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"
Jul 21 01:46:35.085397 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:35.085355    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-tls-certs\") pod \"e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt\" (UID: \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\") " pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"
Jul 21 01:46:35.085579 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:35.085400    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v525\" (UniqueName: \"kubernetes.io/projected/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-kube-api-access-9v525\") pod \"e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt\" (UID: \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\") " pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"
Jul 21 01:46:35.085789 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:35.085764    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-model-cache\") pod \"e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt\" (UID: \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\") " pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"
Jul 21 01:46:35.086018 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:35.085820    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-home\") pod \"e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt\" (UID: \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\") " pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"
Jul 21 01:46:35.086018 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:35.085864    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-tmp-dir\") pod \"e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt\" (UID: \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\") " pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"
Jul 21 01:46:35.087721 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:35.087692    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-dshm\") pod \"e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt\" (UID: \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\") " pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"
Jul 21 01:46:35.087886 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:35.087865    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-tls-certs\") pod \"e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt\" (UID: \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\") " pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"
Jul 21 01:46:35.093150 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:35.093123    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v525\" (UniqueName: \"kubernetes.io/projected/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-kube-api-access-9v525\") pod \"e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt\" (UID: \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\") " pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"
Jul 21 01:46:35.220859 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:35.220716    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"
Jul 21 01:46:35.360739 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:35.360707    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"]
Jul 21 01:46:35.363513 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:46:35.363484    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6db9b1b8_4ccb_4a05_a7b4_7d332492cabd.slice/crio-5e5c2013a9ca59fb095932c109616a6aeb1942d17416abbaa75e3c0b50e60ca5 WatchSource:0}: Error finding container 5e5c2013a9ca59fb095932c109616a6aeb1942d17416abbaa75e3c0b50e60ca5: Status 404 returned error can't find the container with id 5e5c2013a9ca59fb095932c109616a6aeb1942d17416abbaa75e3c0b50e60ca5
Jul 21 01:46:35.415347 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:35.415318    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt" event={"ID":"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd","Type":"ContainerStarted","Data":"5e5c2013a9ca59fb095932c109616a6aeb1942d17416abbaa75e3c0b50e60ca5"}
Jul 21 01:46:36.421314 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:36.421278    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt" event={"ID":"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd","Type":"ContainerStarted","Data":"247fd4b31c3c76768a1eaab0dbc914c85db93478f4d5ea218ae443ead72a53d7"}
Jul 21 01:46:36.437959 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:36.437873    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt" podStartSLOduration=2.437851293 podStartE2EDuration="2.437851293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:46:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:46:36.435057715 +0000 UTC m=+1455.623097107" watchObservedRunningTime="2026-07-21 01:46:36.437851293 +0000 UTC m=+1455.625890684"
Jul 21 01:46:45.221241 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:45.221148    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"
Jul 21 01:46:45.221241 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:45.221209    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"
Jul 21 01:46:45.233664 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:45.233629    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"
Jul 21 01:46:45.477125 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:45.477047    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"
Jul 21 01:46:45.901714 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:46:45.901673    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:47:09.889183 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:09.889145    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"]
Jul 21 01:47:13.403959 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:13.403905    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:47:24.910665 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:24.910596    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt" podUID="6db9b1b8-4ccb-4a05-a7b4-7d332492cabd" containerName="main" containerID="cri-o://247fd4b31c3c76768a1eaab0dbc914c85db93478f4d5ea218ae443ead72a53d7" gracePeriod=45
Jul 21 01:47:25.165642 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.165566    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"
Jul 21 01:47:25.257072 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.257035    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-tls-certs\") pod \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\" (UID: \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\") "
Jul 21 01:47:25.257281 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.257109    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-model-cache\") pod \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\" (UID: \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\") "
Jul 21 01:47:25.257281 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.257130    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9v525\" (UniqueName: \"kubernetes.io/projected/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-kube-api-access-9v525\") pod \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\" (UID: \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\") "
Jul 21 01:47:25.257281 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.257147    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-tmp-dir\") pod \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\" (UID: \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\") "
Jul 21 01:47:25.257281 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.257181    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-home\") pod \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\" (UID: \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\") "
Jul 21 01:47:25.257281 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.257250    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-dshm\") pod \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\" (UID: \"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd\") "
Jul 21 01:47:25.257533 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.257456    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-model-cache" (OuterVolumeSpecName: "model-cache") pod "6db9b1b8-4ccb-4a05-a7b4-7d332492cabd" (UID: "6db9b1b8-4ccb-4a05-a7b4-7d332492cabd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:47:25.257533 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.257451    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6db9b1b8-4ccb-4a05-a7b4-7d332492cabd" (UID: "6db9b1b8-4ccb-4a05-a7b4-7d332492cabd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:47:25.257533 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.257501    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-home" (OuterVolumeSpecName: "home") pod "6db9b1b8-4ccb-4a05-a7b4-7d332492cabd" (UID: "6db9b1b8-4ccb-4a05-a7b4-7d332492cabd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:47:25.259533 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.259505    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6db9b1b8-4ccb-4a05-a7b4-7d332492cabd" (UID: "6db9b1b8-4ccb-4a05-a7b4-7d332492cabd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:47:25.259650 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.259562    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-kube-api-access-9v525" (OuterVolumeSpecName: "kube-api-access-9v525") pod "6db9b1b8-4ccb-4a05-a7b4-7d332492cabd" (UID: "6db9b1b8-4ccb-4a05-a7b4-7d332492cabd"). InnerVolumeSpecName "kube-api-access-9v525". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:47:25.259650 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.259581    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-dshm" (OuterVolumeSpecName: "dshm") pod "6db9b1b8-4ccb-4a05-a7b4-7d332492cabd" (UID: "6db9b1b8-4ccb-4a05-a7b4-7d332492cabd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:47:25.357978 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.357922    2586 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-model-cache\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:47:25.357978 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.357979    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9v525\" (UniqueName: \"kubernetes.io/projected/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-kube-api-access-9v525\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:47:25.358200 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.357993    2586 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-tmp-dir\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:47:25.358200 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.358007    2586 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-home\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:47:25.358200 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.358019    2586 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-dshm\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:47:25.358200 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.358039    2586 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd-tls-certs\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:47:25.671511 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.671475    2586 generic.go:356] "Generic (PLEG): container finished" podID="6db9b1b8-4ccb-4a05-a7b4-7d332492cabd" containerID="247fd4b31c3c76768a1eaab0dbc914c85db93478f4d5ea218ae443ead72a53d7" exitCode=0
Jul 21 01:47:25.671511 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.671517    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"
Jul 21 01:47:25.671765 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.671559    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt" event={"ID":"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd","Type":"ContainerDied","Data":"247fd4b31c3c76768a1eaab0dbc914c85db93478f4d5ea218ae443ead72a53d7"}
Jul 21 01:47:25.671765 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.671605    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt" event={"ID":"6db9b1b8-4ccb-4a05-a7b4-7d332492cabd","Type":"ContainerDied","Data":"5e5c2013a9ca59fb095932c109616a6aeb1942d17416abbaa75e3c0b50e60ca5"}
Jul 21 01:47:25.671765 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.671622    2586 scope.go:117] "RemoveContainer" containerID="247fd4b31c3c76768a1eaab0dbc914c85db93478f4d5ea218ae443ead72a53d7"
Jul 21 01:47:25.680826 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.680808    2586 scope.go:117] "RemoveContainer" containerID="247fd4b31c3c76768a1eaab0dbc914c85db93478f4d5ea218ae443ead72a53d7"
Jul 21 01:47:25.681175 ip-10-0-131-213 kubenswrapper[2586]: E0721 01:47:25.681150    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"247fd4b31c3c76768a1eaab0dbc914c85db93478f4d5ea218ae443ead72a53d7\": container with ID starting with 247fd4b31c3c76768a1eaab0dbc914c85db93478f4d5ea218ae443ead72a53d7 not found: ID does not exist" containerID="247fd4b31c3c76768a1eaab0dbc914c85db93478f4d5ea218ae443ead72a53d7"
Jul 21 01:47:25.681231 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.681188    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"247fd4b31c3c76768a1eaab0dbc914c85db93478f4d5ea218ae443ead72a53d7"} err="failed to get container status \"247fd4b31c3c76768a1eaab0dbc914c85db93478f4d5ea218ae443ead72a53d7\": rpc error: code = NotFound desc = could not find container \"247fd4b31c3c76768a1eaab0dbc914c85db93478f4d5ea218ae443ead72a53d7\": container with ID starting with 247fd4b31c3c76768a1eaab0dbc914c85db93478f4d5ea218ae443ead72a53d7 not found: ID does not exist"
Jul 21 01:47:25.685950 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.685904    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"]
Jul 21 01:47:25.689860 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:25.689831    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-914199c4-kserve-66987f6c5-rnbmt"]
Jul 21 01:47:27.309417 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:27.309382    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6db9b1b8-4ccb-4a05-a7b4-7d332492cabd" path="/var/lib/kubelet/pods/6db9b1b8-4ccb-4a05-a7b4-7d332492cabd/volumes"
Jul 21 01:47:27.510010 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:27.509977    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:47:34.622206 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:34.622174    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:47:51.100239 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:47:51.100197    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:48:00.596046 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:48:00.596007    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:48:10.097056 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:48:10.097018    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:48:20.799273 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:48:20.799229    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:48:30.596989 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:48:30.596954    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:48:40.196625 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:48:40.196579    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:48:51.397490 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:48:51.397450    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:49:08.598694 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:49:08.598653    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:49:18.801054 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:49:18.801015    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:49:25.598646 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:49:25.598601    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:49:35.496969 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:49:35.496923    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:49:42.392726 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:49:42.392682    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:49:57.998555 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:49:57.998511    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:50:10.299353 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:50:10.299312    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:50:23.792733 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:50:23.792693    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:50:37.399692 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:50:37.399653    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:50:46.095075 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:50:46.094980    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:50:56.499490 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:50:56.499452    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:51:09.892853 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:09.892816    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:51:24.507450 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:24.507406    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-11e2e27d-fs5g2"]
Jul 21 01:51:24.507860 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:24.507846    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6db9b1b8-4ccb-4a05-a7b4-7d332492cabd" containerName="main"
Jul 21 01:51:24.507902 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:24.507862    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="6db9b1b8-4ccb-4a05-a7b4-7d332492cabd" containerName="main"
Jul 21 01:51:24.507978 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:24.507965    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="6db9b1b8-4ccb-4a05-a7b4-7d332492cabd" containerName="main"
Jul 21 01:51:24.511083 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:24.511068    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-11e2e27d-fs5g2"
Jul 21 01:51:24.513090 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:24.513070    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 01:51:24.513202 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:24.513175    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8wthr\""
Jul 21 01:51:24.516705 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:24.516682    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-11e2e27d-fs5g2"]
Jul 21 01:51:24.636102 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:24.636066    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7eb7521c-81a1-45e7-828f-af0e651c538f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-11e2e27d-fs5g2\" (UID: \"7eb7521c-81a1-45e7-828f-af0e651c538f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-11e2e27d-fs5g2"
Jul 21 01:51:24.736719 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:24.736686    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7eb7521c-81a1-45e7-828f-af0e651c538f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-11e2e27d-fs5g2\" (UID: \"7eb7521c-81a1-45e7-828f-af0e651c538f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-11e2e27d-fs5g2"
Jul 21 01:51:24.737385 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:24.737365    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7eb7521c-81a1-45e7-828f-af0e651c538f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-11e2e27d-fs5g2\" (UID: \"7eb7521c-81a1-45e7-828f-af0e651c538f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-11e2e27d-fs5g2"
Jul 21 01:51:24.824378 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:24.824298    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-11e2e27d-fs5g2"
Jul 21 01:51:24.960957 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:24.960903    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-11e2e27d-fs5g2"]
Jul 21 01:51:24.964089 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:51:24.964065    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eb7521c_81a1_45e7_828f_af0e651c538f.slice/crio-2cb342b8902b9f797eada557778e2135c8ff3b19e19e6db064a27a00b1b4a5fe WatchSource:0}: Error finding container 2cb342b8902b9f797eada557778e2135c8ff3b19e19e6db064a27a00b1b4a5fe: Status 404 returned error can't find the container with id 2cb342b8902b9f797eada557778e2135c8ff3b19e19e6db064a27a00b1b4a5fe
Jul 21 01:51:24.966070 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:24.966050    2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 01:51:25.860031 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:25.859989    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-11e2e27d-fs5g2" event={"ID":"7eb7521c-81a1-45e7-828f-af0e651c538f","Type":"ContainerStarted","Data":"2cb342b8902b9f797eada557778e2135c8ff3b19e19e6db064a27a00b1b4a5fe"}
Jul 21 01:51:27.872919 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:27.872881    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-11e2e27d-fs5g2" event={"ID":"7eb7521c-81a1-45e7-828f-af0e651c538f","Type":"ContainerStarted","Data":"9ce25e96f790e41677664388f75b9934fbbe7d070d866fd542d2c047a0cec7bc"}
Jul 21 01:51:27.888473 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:27.888418    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-11e2e27d-fs5g2" podStartSLOduration=1.697148444 podStartE2EDuration="3.888401801s" totalImagesPullingTime="2.191253357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:51:27.886649492 +0000 UTC m=+1747.074688883" watchObservedRunningTime="2026-07-21 01:51:27.888401801 +0000 UTC m=+1747.076441191"
Jul 21 01:51:28.878566 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:28.878530    2586 generic.go:356] "Generic (PLEG): container finished" podID="7eb7521c-81a1-45e7-828f-af0e651c538f" containerID="9ce25e96f790e41677664388f75b9934fbbe7d070d866fd542d2c047a0cec7bc" exitCode=0
Jul 21 01:51:28.878983 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:28.878615    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-11e2e27d-fs5g2" event={"ID":"7eb7521c-81a1-45e7-828f-af0e651c538f","Type":"ContainerDied","Data":"9ce25e96f790e41677664388f75b9934fbbe7d070d866fd542d2c047a0cec7bc"}
Jul 21 01:51:30.020394 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:30.020368    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-11e2e27d-fs5g2"
Jul 21 01:51:30.084484 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:30.084446    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7eb7521c-81a1-45e7-828f-af0e651c538f-maas-api-service-ca\") pod \"7eb7521c-81a1-45e7-828f-af0e651c538f\" (UID: \"7eb7521c-81a1-45e7-828f-af0e651c538f\") "
Jul 21 01:51:30.084817 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:30.084795    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7eb7521c-81a1-45e7-828f-af0e651c538f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7eb7521c-81a1-45e7-828f-af0e651c538f" (UID: "7eb7521c-81a1-45e7-828f-af0e651c538f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:51:30.185405 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:30.185315    2586 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7eb7521c-81a1-45e7-828f-af0e651c538f-maas-api-service-ca\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:51:30.889602 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:30.889570    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-11e2e27d-fs5g2"
Jul 21 01:51:30.889786 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:30.889569    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-11e2e27d-fs5g2" event={"ID":"7eb7521c-81a1-45e7-828f-af0e651c538f","Type":"ContainerDied","Data":"2cb342b8902b9f797eada557778e2135c8ff3b19e19e6db064a27a00b1b4a5fe"}
Jul 21 01:51:30.889786 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:30.889699    2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2cb342b8902b9f797eada557778e2135c8ff3b19e19e6db064a27a00b1b4a5fe"
Jul 21 01:51:37.887155 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:37.887119    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:51:39.581875 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:39.581830    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-11e2e27d-fs5g2"]
Jul 21 01:51:39.583577 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:39.583553    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-11e2e27d-fs5g2"]
Jul 21 01:51:41.309146 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:41.309100    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7eb7521c-81a1-45e7-828f-af0e651c538f" path="/var/lib/kubelet/pods/7eb7521c-81a1-45e7-828f-af0e651c538f/volumes"
Jul 21 01:51:49.092346 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:51:49.092309    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:52:08.307265 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:08.307226    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18d78b1a-qd58p"]
Jul 21 01:52:08.307677 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:08.307659    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7eb7521c-81a1-45e7-828f-af0e651c538f" containerName="revoke-keys"
Jul 21 01:52:08.307677 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:08.307670    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="7eb7521c-81a1-45e7-828f-af0e651c538f" containerName="revoke-keys"
Jul 21 01:52:08.307760 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:08.307728    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="7eb7521c-81a1-45e7-828f-af0e651c538f" containerName="revoke-keys"
Jul 21 01:52:08.310799 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:08.310782    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18d78b1a-qd58p"
Jul 21 01:52:08.312619 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:08.312595    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8wthr\""
Jul 21 01:52:08.312751 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:08.312644    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 01:52:08.317023 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:08.316997    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18d78b1a-qd58p"]
Jul 21 01:52:08.437769 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:08.437728    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ea70574-1b25-449d-824c-2f222463e442-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-18d78b1a-qd58p\" (UID: \"1ea70574-1b25-449d-824c-2f222463e442\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18d78b1a-qd58p"
Jul 21 01:52:08.538691 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:08.538655    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ea70574-1b25-449d-824c-2f222463e442-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-18d78b1a-qd58p\" (UID: \"1ea70574-1b25-449d-824c-2f222463e442\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18d78b1a-qd58p"
Jul 21 01:52:08.539334 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:08.539315    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ea70574-1b25-449d-824c-2f222463e442-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-18d78b1a-qd58p\" (UID: \"1ea70574-1b25-449d-824c-2f222463e442\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18d78b1a-qd58p"
Jul 21 01:52:08.623059 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:08.623028    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18d78b1a-qd58p"
Jul 21 01:52:08.761216 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:08.761166    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18d78b1a-qd58p"]
Jul 21 01:52:08.764283 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:52:08.764253    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea70574_1b25_449d_824c_2f222463e442.slice/crio-66da5c8ba2e06e2037912c6a44d1dac9543fc9b39b17dbd4152ea89ebd689950 WatchSource:0}: Error finding container 66da5c8ba2e06e2037912c6a44d1dac9543fc9b39b17dbd4152ea89ebd689950: Status 404 returned error can't find the container with id 66da5c8ba2e06e2037912c6a44d1dac9543fc9b39b17dbd4152ea89ebd689950
Jul 21 01:52:09.083469 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:09.083435    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18d78b1a-qd58p" event={"ID":"1ea70574-1b25-449d-824c-2f222463e442","Type":"ContainerStarted","Data":"66da5c8ba2e06e2037912c6a44d1dac9543fc9b39b17dbd4152ea89ebd689950"}
Jul 21 01:52:10.090422 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:10.090382    2586 generic.go:356] "Generic (PLEG): container finished" podID="1ea70574-1b25-449d-824c-2f222463e442" containerID="c14a2495e69fed9adfe2f712894d15ee2fde0674eb05220172878eaa00b40ffc" exitCode=0
Jul 21 01:52:10.090823 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:10.090467    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18d78b1a-qd58p" event={"ID":"1ea70574-1b25-449d-824c-2f222463e442","Type":"ContainerDied","Data":"c14a2495e69fed9adfe2f712894d15ee2fde0674eb05220172878eaa00b40ffc"}
Jul 21 01:52:11.230216 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:11.230187    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18d78b1a-qd58p"
Jul 21 01:52:11.366888 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:11.366761    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ea70574-1b25-449d-824c-2f222463e442-maas-api-service-ca\") pod \"1ea70574-1b25-449d-824c-2f222463e442\" (UID: \"1ea70574-1b25-449d-824c-2f222463e442\") "
Jul 21 01:52:11.367155 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:11.367131    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ea70574-1b25-449d-824c-2f222463e442-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1ea70574-1b25-449d-824c-2f222463e442" (UID: "1ea70574-1b25-449d-824c-2f222463e442"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:52:11.468364 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:11.468308    2586 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ea70574-1b25-449d-824c-2f222463e442-maas-api-service-ca\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:52:12.100949 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:12.100895    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18d78b1a-qd58p" event={"ID":"1ea70574-1b25-449d-824c-2f222463e442","Type":"ContainerDied","Data":"66da5c8ba2e06e2037912c6a44d1dac9543fc9b39b17dbd4152ea89ebd689950"}
Jul 21 01:52:12.100949 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:12.100921    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18d78b1a-qd58p"
Jul 21 01:52:12.101161 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:12.100982    2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66da5c8ba2e06e2037912c6a44d1dac9543fc9b39b17dbd4152ea89ebd689950"
Jul 21 01:52:21.799285 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:21.799246    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:52:23.383693 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:23.383661    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18d78b1a-qd58p"]
Jul 21 01:52:23.389249 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:23.389214    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-18d78b1a-qd58p"]
Jul 21 01:52:25.313066 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:25.313029    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ea70574-1b25-449d-824c-2f222463e442" path="/var/lib/kubelet/pods/1ea70574-1b25-449d-824c-2f222463e442/volumes"
Jul 21 01:52:33.098738 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:33.098702    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:52:52.324043 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:52.324003    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c01c70b7-d9dh8"]
Jul 21 01:52:52.324664 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:52.324411    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ea70574-1b25-449d-824c-2f222463e442" containerName="revoke-keys"
Jul 21 01:52:52.324664 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:52.324423    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ea70574-1b25-449d-824c-2f222463e442" containerName="revoke-keys"
Jul 21 01:52:52.324664 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:52.324491    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ea70574-1b25-449d-824c-2f222463e442" containerName="revoke-keys"
Jul 21 01:52:52.327782 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:52.327764    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c01c70b7-d9dh8"
Jul 21 01:52:52.329651 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:52.329623    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8wthr\""
Jul 21 01:52:52.329777 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:52.329704    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 01:52:52.333549 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:52.333520    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c01c70b7-d9dh8"]
Jul 21 01:52:52.465761 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:52.465720    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85c1b2e4-a3ec-430c-9d57-1684c0ab22b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c01c70b7-d9dh8\" (UID: \"85c1b2e4-a3ec-430c-9d57-1684c0ab22b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c01c70b7-d9dh8"
Jul 21 01:52:52.566783 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:52.566753    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85c1b2e4-a3ec-430c-9d57-1684c0ab22b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c01c70b7-d9dh8\" (UID: \"85c1b2e4-a3ec-430c-9d57-1684c0ab22b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c01c70b7-d9dh8"
Jul 21 01:52:52.567394 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:52.567374    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85c1b2e4-a3ec-430c-9d57-1684c0ab22b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c01c70b7-d9dh8\" (UID: \"85c1b2e4-a3ec-430c-9d57-1684c0ab22b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c01c70b7-d9dh8"
Jul 21 01:52:52.641290 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:52.641250    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c01c70b7-d9dh8"
Jul 21 01:52:52.783655 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:52.783618    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c01c70b7-d9dh8"]
Jul 21 01:52:52.786780 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:52:52.786752    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85c1b2e4_a3ec_430c_9d57_1684c0ab22b1.slice/crio-8afea38ae62342d3281d76892533d5c535e2da63b1e003cf398739f9a5c0bebc WatchSource:0}: Error finding container 8afea38ae62342d3281d76892533d5c535e2da63b1e003cf398739f9a5c0bebc: Status 404 returned error can't find the container with id 8afea38ae62342d3281d76892533d5c535e2da63b1e003cf398739f9a5c0bebc
Jul 21 01:52:53.314545 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:53.314457    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c01c70b7-d9dh8" event={"ID":"85c1b2e4-a3ec-430c-9d57-1684c0ab22b1","Type":"ContainerStarted","Data":"35f7c4efbf4354d7227228fbb4cbced3fb81bcd9dcff0c29401ac251fbf51210"}
Jul 21 01:52:53.314545 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:53.314508    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c01c70b7-d9dh8" event={"ID":"85c1b2e4-a3ec-430c-9d57-1684c0ab22b1","Type":"ContainerStarted","Data":"8afea38ae62342d3281d76892533d5c535e2da63b1e003cf398739f9a5c0bebc"}
Jul 21 01:52:53.330302 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:53.330243    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c01c70b7-d9dh8" podStartSLOduration=1.330225853 podStartE2EDuration="1.330225853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:52:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:52:53.328601302 +0000 UTC m=+1832.516640693" watchObservedRunningTime="2026-07-21 01:52:53.330225853 +0000 UTC m=+1832.518265243"
Jul 21 01:52:54.320673 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:54.320636    2586 generic.go:356] "Generic (PLEG): container finished" podID="85c1b2e4-a3ec-430c-9d57-1684c0ab22b1" containerID="35f7c4efbf4354d7227228fbb4cbced3fb81bcd9dcff0c29401ac251fbf51210" exitCode=0
Jul 21 01:52:54.320859 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:54.320689    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c01c70b7-d9dh8" event={"ID":"85c1b2e4-a3ec-430c-9d57-1684c0ab22b1","Type":"ContainerDied","Data":"35f7c4efbf4354d7227228fbb4cbced3fb81bcd9dcff0c29401ac251fbf51210"}
Jul 21 01:52:55.459050 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:55.459022    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c01c70b7-d9dh8"
Jul 21 01:52:55.493492 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:55.493457    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85c1b2e4-a3ec-430c-9d57-1684c0ab22b1-maas-api-service-ca\") pod \"85c1b2e4-a3ec-430c-9d57-1684c0ab22b1\" (UID: \"85c1b2e4-a3ec-430c-9d57-1684c0ab22b1\") "
Jul 21 01:52:55.493774 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:55.493751    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85c1b2e4-a3ec-430c-9d57-1684c0ab22b1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "85c1b2e4-a3ec-430c-9d57-1684c0ab22b1" (UID: "85c1b2e4-a3ec-430c-9d57-1684c0ab22b1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:52:55.594761 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:55.594730    2586 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85c1b2e4-a3ec-430c-9d57-1684c0ab22b1-maas-api-service-ca\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:52:56.332593 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:56.332563    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c01c70b7-d9dh8"
Jul 21 01:52:56.332805 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:56.332594    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c01c70b7-d9dh8" event={"ID":"85c1b2e4-a3ec-430c-9d57-1684c0ab22b1","Type":"ContainerDied","Data":"8afea38ae62342d3281d76892533d5c535e2da63b1e003cf398739f9a5c0bebc"}
Jul 21 01:52:56.332805 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:52:56.332644    2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8afea38ae62342d3281d76892533d5c535e2da63b1e003cf398739f9a5c0bebc"
Jul 21 01:53:05.598309 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:05.598268    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:53:07.395793 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:07.395755    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c01c70b7-d9dh8"]
Jul 21 01:53:07.400019 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:07.399994    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c01c70b7-d9dh8"]
Jul 21 01:53:09.309338 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:09.309301    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85c1b2e4-a3ec-430c-9d57-1684c0ab22b1" path="/var/lib/kubelet/pods/85c1b2e4-a3ec-430c-9d57-1684c0ab22b1/volumes"
Jul 21 01:53:15.094421 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:15.094379    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:53:36.720770 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:36.720733    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e1f6418d-d49gq"]
Jul 21 01:53:36.721340 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:36.721173    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85c1b2e4-a3ec-430c-9d57-1684c0ab22b1" containerName="revoke-keys"
Jul 21 01:53:36.721340 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:36.721184    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="85c1b2e4-a3ec-430c-9d57-1684c0ab22b1" containerName="revoke-keys"
Jul 21 01:53:36.721340 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:36.721241    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="85c1b2e4-a3ec-430c-9d57-1684c0ab22b1" containerName="revoke-keys"
Jul 21 01:53:36.724556 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:36.724534    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e1f6418d-d49gq"
Jul 21 01:53:36.726408 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:36.726389    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 01:53:36.726503 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:36.726464    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8wthr\""
Jul 21 01:53:36.730208 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:36.730180    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e1f6418d-d49gq"]
Jul 21 01:53:36.895893 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:36.895840    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/070730e7-d53b-4316-9796-2333b002d26c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-e1f6418d-d49gq\" (UID: \"070730e7-d53b-4316-9796-2333b002d26c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e1f6418d-d49gq"
Jul 21 01:53:36.996592 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:36.996497    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/070730e7-d53b-4316-9796-2333b002d26c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-e1f6418d-d49gq\" (UID: \"070730e7-d53b-4316-9796-2333b002d26c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e1f6418d-d49gq"
Jul 21 01:53:36.997163 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:36.997143    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/070730e7-d53b-4316-9796-2333b002d26c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-e1f6418d-d49gq\" (UID: \"070730e7-d53b-4316-9796-2333b002d26c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e1f6418d-d49gq"
Jul 21 01:53:37.036520 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:37.036484    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e1f6418d-d49gq"
Jul 21 01:53:37.178097 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:37.178077    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e1f6418d-d49gq"]
Jul 21 01:53:37.180621 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:53:37.180592    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod070730e7_d53b_4316_9796_2333b002d26c.slice/crio-650aab96e207b4e108d8d876e6fe5452f5eb937cab8b333603b0ea6a89a4a13b WatchSource:0}: Error finding container 650aab96e207b4e108d8d876e6fe5452f5eb937cab8b333603b0ea6a89a4a13b: Status 404 returned error can't find the container with id 650aab96e207b4e108d8d876e6fe5452f5eb937cab8b333603b0ea6a89a4a13b
Jul 21 01:53:37.543277 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:37.543238    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e1f6418d-d49gq" event={"ID":"070730e7-d53b-4316-9796-2333b002d26c","Type":"ContainerStarted","Data":"dd810903f606c3e524459d31b57c2cf38167ff3f449d2448e5cc3508304e0347"}
Jul 21 01:53:37.543466 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:37.543306    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e1f6418d-d49gq" event={"ID":"070730e7-d53b-4316-9796-2333b002d26c","Type":"ContainerStarted","Data":"650aab96e207b4e108d8d876e6fe5452f5eb937cab8b333603b0ea6a89a4a13b"}
Jul 21 01:53:37.556990 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:37.556907    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e1f6418d-d49gq" podStartSLOduration=1.5568874990000001 podStartE2EDuration="1.556887499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:53:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:53:37.556378697 +0000 UTC m=+1876.744418087" watchObservedRunningTime="2026-07-21 01:53:37.556887499 +0000 UTC m=+1876.744926893"
Jul 21 01:53:38.550279 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:38.550242    2586 generic.go:356] "Generic (PLEG): container finished" podID="070730e7-d53b-4316-9796-2333b002d26c" containerID="dd810903f606c3e524459d31b57c2cf38167ff3f449d2448e5cc3508304e0347" exitCode=0
Jul 21 01:53:38.550690 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:38.550312    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e1f6418d-d49gq" event={"ID":"070730e7-d53b-4316-9796-2333b002d26c","Type":"ContainerDied","Data":"dd810903f606c3e524459d31b57c2cf38167ff3f449d2448e5cc3508304e0347"}
Jul 21 01:53:39.692242 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:39.692213    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e1f6418d-d49gq"
Jul 21 01:53:39.718623 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:39.718592    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/070730e7-d53b-4316-9796-2333b002d26c-maas-api-service-ca\") pod \"070730e7-d53b-4316-9796-2333b002d26c\" (UID: \"070730e7-d53b-4316-9796-2333b002d26c\") "
Jul 21 01:53:39.719026 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:39.718999    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/070730e7-d53b-4316-9796-2333b002d26c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "070730e7-d53b-4316-9796-2333b002d26c" (UID: "070730e7-d53b-4316-9796-2333b002d26c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:53:39.819331 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:39.819237    2586 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/070730e7-d53b-4316-9796-2333b002d26c-maas-api-service-ca\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:53:40.561663 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:40.561636    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e1f6418d-d49gq"
Jul 21 01:53:40.561663 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:40.561653    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e1f6418d-d49gq" event={"ID":"070730e7-d53b-4316-9796-2333b002d26c","Type":"ContainerDied","Data":"650aab96e207b4e108d8d876e6fe5452f5eb937cab8b333603b0ea6a89a4a13b"}
Jul 21 01:53:40.561960 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:40.561704    2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="650aab96e207b4e108d8d876e6fe5452f5eb937cab8b333603b0ea6a89a4a13b"
Jul 21 01:53:50.195166 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:50.195080    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:53:51.797083 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:51.797046    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e1f6418d-d49gq"]
Jul 21 01:53:51.799580 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:51.799556    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e1f6418d-d49gq"]
Jul 21 01:53:53.310592 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:53:53.310557    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="070730e7-d53b-4316-9796-2333b002d26c" path="/var/lib/kubelet/pods/070730e7-d53b-4316-9796-2333b002d26c/volumes"
Jul 21 01:55:16.793245 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:16.793159    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:55:25.295022 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:25.294983    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:55:36.592624 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:36.592585    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:55:49.002831 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:49.002792    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:55:49.080040 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:49.079970    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a83ed288-5bhv7"]
Jul 21 01:55:49.080481 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:49.080467    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="070730e7-d53b-4316-9796-2333b002d26c" containerName="revoke-keys"
Jul 21 01:55:49.080549 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:49.080484    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="070730e7-d53b-4316-9796-2333b002d26c" containerName="revoke-keys"
Jul 21 01:55:49.080591 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:49.080566    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="070730e7-d53b-4316-9796-2333b002d26c" containerName="revoke-keys"
Jul 21 01:55:49.083717 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:49.083698    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a83ed288-5bhv7"
Jul 21 01:55:49.085721 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:49.085697    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8wthr\""
Jul 21 01:55:49.085845 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:49.085697    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 01:55:49.090211 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:49.090181    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a83ed288-5bhv7"]
Jul 21 01:55:49.137261 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:49.137221    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98661a71-0c9f-4bbd-ab18-0b01b81f2b8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a83ed288-5bhv7\" (UID: \"98661a71-0c9f-4bbd-ab18-0b01b81f2b8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a83ed288-5bhv7"
Jul 21 01:55:49.237785 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:49.237745    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98661a71-0c9f-4bbd-ab18-0b01b81f2b8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a83ed288-5bhv7\" (UID: \"98661a71-0c9f-4bbd-ab18-0b01b81f2b8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a83ed288-5bhv7"
Jul 21 01:55:49.238470 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:49.238450    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98661a71-0c9f-4bbd-ab18-0b01b81f2b8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a83ed288-5bhv7\" (UID: \"98661a71-0c9f-4bbd-ab18-0b01b81f2b8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a83ed288-5bhv7"
Jul 21 01:55:49.396057 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:49.396022    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a83ed288-5bhv7"
Jul 21 01:55:49.552129 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:49.549155    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a83ed288-5bhv7"]
Jul 21 01:55:49.552674 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:55:49.552644    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98661a71_0c9f_4bbd_ab18_0b01b81f2b8e.slice/crio-e146803f968160c05582008e5fbb8d98a832aa95b3462d97a42c40041f2918a0 WatchSource:0}: Error finding container e146803f968160c05582008e5fbb8d98a832aa95b3462d97a42c40041f2918a0: Status 404 returned error can't find the container with id e146803f968160c05582008e5fbb8d98a832aa95b3462d97a42c40041f2918a0
Jul 21 01:55:50.232532 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:50.232489    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a83ed288-5bhv7" event={"ID":"98661a71-0c9f-4bbd-ab18-0b01b81f2b8e","Type":"ContainerStarted","Data":"30006a3f7e85f313d9afd34b888a40050018e6dda6458494123d7c744a1936f3"}
Jul 21 01:55:50.232909 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:50.232555    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a83ed288-5bhv7" event={"ID":"98661a71-0c9f-4bbd-ab18-0b01b81f2b8e","Type":"ContainerStarted","Data":"e146803f968160c05582008e5fbb8d98a832aa95b3462d97a42c40041f2918a0"}
Jul 21 01:55:50.245912 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:50.245849    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a83ed288-5bhv7" podStartSLOduration=1.245828483 podStartE2EDuration="1.245828483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:55:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:55:50.245098671 +0000 UTC m=+2009.433138062" watchObservedRunningTime="2026-07-21 01:55:50.245828483 +0000 UTC m=+2009.433867875"
Jul 21 01:55:51.239823 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:51.239786    2586 generic.go:356] "Generic (PLEG): container finished" podID="98661a71-0c9f-4bbd-ab18-0b01b81f2b8e" containerID="30006a3f7e85f313d9afd34b888a40050018e6dda6458494123d7c744a1936f3" exitCode=0
Jul 21 01:55:51.240246 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:51.239842    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a83ed288-5bhv7" event={"ID":"98661a71-0c9f-4bbd-ab18-0b01b81f2b8e","Type":"ContainerDied","Data":"30006a3f7e85f313d9afd34b888a40050018e6dda6458494123d7c744a1936f3"}
Jul 21 01:55:52.383478 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:52.383446    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a83ed288-5bhv7"
Jul 21 01:55:52.469334 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:52.469298    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98661a71-0c9f-4bbd-ab18-0b01b81f2b8e-maas-api-service-ca\") pod \"98661a71-0c9f-4bbd-ab18-0b01b81f2b8e\" (UID: \"98661a71-0c9f-4bbd-ab18-0b01b81f2b8e\") "
Jul 21 01:55:52.469729 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:52.469688    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98661a71-0c9f-4bbd-ab18-0b01b81f2b8e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "98661a71-0c9f-4bbd-ab18-0b01b81f2b8e" (UID: "98661a71-0c9f-4bbd-ab18-0b01b81f2b8e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:55:52.570095 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:52.570009    2586 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98661a71-0c9f-4bbd-ab18-0b01b81f2b8e-maas-api-service-ca\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:55:53.252268 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:53.252239    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a83ed288-5bhv7"
Jul 21 01:55:53.252445 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:53.252282    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a83ed288-5bhv7" event={"ID":"98661a71-0c9f-4bbd-ab18-0b01b81f2b8e","Type":"ContainerDied","Data":"e146803f968160c05582008e5fbb8d98a832aa95b3462d97a42c40041f2918a0"}
Jul 21 01:55:53.252445 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:55:53.252328    2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e146803f968160c05582008e5fbb8d98a832aa95b3462d97a42c40041f2918a0"
Jul 21 01:56:02.397430 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:02.397391    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:56:04.152306 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:04.152268    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a83ed288-5bhv7"]
Jul 21 01:56:04.155025 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:04.154997    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a83ed288-5bhv7"]
Jul 21 01:56:05.314956 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:05.314903    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98661a71-0c9f-4bbd-ab18-0b01b81f2b8e" path="/var/lib/kubelet/pods/98661a71-0c9f-4bbd-ab18-0b01b81f2b8e/volumes"
Jul 21 01:56:38.098250 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:38.098208    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:56:47.398429 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.398393    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"]
Jul 21 01:56:47.398870 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.398796    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98661a71-0c9f-4bbd-ab18-0b01b81f2b8e" containerName="revoke-keys"
Jul 21 01:56:47.398870 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.398808    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="98661a71-0c9f-4bbd-ab18-0b01b81f2b8e" containerName="revoke-keys"
Jul 21 01:56:47.398962 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.398877    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="98661a71-0c9f-4bbd-ab18-0b01b81f2b8e" containerName="revoke-keys"
Jul 21 01:56:47.402011 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.401993    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"
Jul 21 01:56:47.404306 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.404284    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-12818e85\"/\"default-dockercfg-277vf\""
Jul 21 01:56:47.404438 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.404287    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-12818e85\"/\"kube-root-ca.crt\""
Jul 21 01:56:47.404438 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.404289    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-12818e85\"/\"e2e-lifecycle-model-12818e85-kserve-self-signed-certs\""
Jul 21 01:56:47.404438 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.404340    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-12818e85\"/\"openshift-service-ca.crt\""
Jul 21 01:56:47.411615 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.411586    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"]
Jul 21 01:56:47.496150 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.496102    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-tmp-dir\") pod \"e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x\" (UID: \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\") " pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"
Jul 21 01:56:47.496340 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.496191    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c927d\" (UniqueName: \"kubernetes.io/projected/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-kube-api-access-c927d\") pod \"e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x\" (UID: \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\") " pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"
Jul 21 01:56:47.496340 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.496310    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-tls-certs\") pod \"e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x\" (UID: \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\") " pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"
Jul 21 01:56:47.496429 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.496347    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-home\") pod \"e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x\" (UID: \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\") " pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"
Jul 21 01:56:47.496429 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.496386    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-model-cache\") pod \"e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x\" (UID: \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\") " pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"
Jul 21 01:56:47.496429 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.496420    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-dshm\") pod \"e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x\" (UID: \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\") " pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"
Jul 21 01:56:47.597949 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.597911    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-tmp-dir\") pod \"e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x\" (UID: \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\") " pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"
Jul 21 01:56:47.598177 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.598028    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c927d\" (UniqueName: \"kubernetes.io/projected/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-kube-api-access-c927d\") pod \"e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x\" (UID: \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\") " pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"
Jul 21 01:56:47.598177 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.598094    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-tls-certs\") pod \"e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x\" (UID: \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\") " pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"
Jul 21 01:56:47.598177 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.598121    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-home\") pod \"e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x\" (UID: \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\") " pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"
Jul 21 01:56:47.598177 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.598154    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-model-cache\") pod \"e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x\" (UID: \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\") " pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"
Jul 21 01:56:47.598408 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.598190    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-dshm\") pod \"e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x\" (UID: \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\") " pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"
Jul 21 01:56:47.598464 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.598431    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-tmp-dir\") pod \"e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x\" (UID: \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\") " pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"
Jul 21 01:56:47.598464 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.598451    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-home\") pod \"e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x\" (UID: \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\") " pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"
Jul 21 01:56:47.598580 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.598554    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-model-cache\") pod \"e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x\" (UID: \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\") " pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"
Jul 21 01:56:47.600650 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.600618    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-dshm\") pod \"e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x\" (UID: \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\") " pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"
Jul 21 01:56:47.600893 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.600874    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-tls-certs\") pod \"e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x\" (UID: \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\") " pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"
Jul 21 01:56:47.605498 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.605481    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c927d\" (UniqueName: \"kubernetes.io/projected/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-kube-api-access-c927d\") pod \"e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x\" (UID: \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\") " pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"
Jul 21 01:56:47.712848 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.712747    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"
Jul 21 01:56:47.859913 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:47.859868    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"]
Jul 21 01:56:47.862389 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:56:47.862363    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73b6b56a_c2b3_4f7d_a46e_691a8ddd04f3.slice/crio-8504ef3614dad2d86f0e3e0fdea71555b99d6f4ba7434b060d8211dbe229456b WatchSource:0}: Error finding container 8504ef3614dad2d86f0e3e0fdea71555b99d6f4ba7434b060d8211dbe229456b: Status 404 returned error can't find the container with id 8504ef3614dad2d86f0e3e0fdea71555b99d6f4ba7434b060d8211dbe229456b
Jul 21 01:56:48.539843 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:48.539797    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x" event={"ID":"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3","Type":"ContainerStarted","Data":"b45aa8a52ccd16e4aa7ace6b5455f93021d1036f603e953f4e8bfcd224b47d2a"}
Jul 21 01:56:48.540252 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:48.539848    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x" event={"ID":"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3","Type":"ContainerStarted","Data":"8504ef3614dad2d86f0e3e0fdea71555b99d6f4ba7434b060d8211dbe229456b"}
Jul 21 01:56:48.556055 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:48.555993    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x" podStartSLOduration=1.555969087 podStartE2EDuration="1.555969087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:56:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:56:48.55438734 +0000 UTC m=+2067.742426729" watchObservedRunningTime="2026-07-21 01:56:48.555969087 +0000 UTC m=+2067.744008479"
Jul 21 01:56:52.748442 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:52.748409    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:56:57.713844 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:57.713805    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"
Jul 21 01:56:57.714292 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:57.713858    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"
Jul 21 01:56:57.726410 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:57.726380    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"
Jul 21 01:56:58.603688 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:56:58.603656    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"
Jul 21 01:57:07.394038 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:07.394000    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:57:24.591393 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:24.591353    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:57:35.396549 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:35.396505    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:57:37.727486 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:37.727444    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"]
Jul 21 01:57:52.748860 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:52.748788    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x" podUID="73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3" containerName="main" containerID="cri-o://b45aa8a52ccd16e4aa7ace6b5455f93021d1036f603e953f4e8bfcd224b47d2a" gracePeriod=45
Jul 21 01:57:52.873668 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:52.873638    2586 generic.go:356] "Generic (PLEG): container finished" podID="73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3" containerID="b45aa8a52ccd16e4aa7ace6b5455f93021d1036f603e953f4e8bfcd224b47d2a" exitCode=0
Jul 21 01:57:52.873826 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:52.873713    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x" event={"ID":"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3","Type":"ContainerDied","Data":"b45aa8a52ccd16e4aa7ace6b5455f93021d1036f603e953f4e8bfcd224b47d2a"}
Jul 21 01:57:53.013075 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:53.013004    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"
Jul 21 01:57:53.121240 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:53.121198    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-tls-certs\") pod \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\" (UID: \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\") "
Jul 21 01:57:53.121240 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:53.121244    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-model-cache\") pod \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\" (UID: \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\") "
Jul 21 01:57:53.121485 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:53.121262    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-tmp-dir\") pod \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\" (UID: \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\") "
Jul 21 01:57:53.121485 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:53.121287    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c927d\" (UniqueName: \"kubernetes.io/projected/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-kube-api-access-c927d\") pod \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\" (UID: \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\") "
Jul 21 01:57:53.121485 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:53.121417    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-dshm\") pod \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\" (UID: \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\") "
Jul 21 01:57:53.121485 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:53.121465    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-home\") pod \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\" (UID: \"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3\") "
Jul 21 01:57:53.121696 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:53.121574    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3" (UID: "73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:57:53.121696 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:53.121587    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-model-cache" (OuterVolumeSpecName: "model-cache") pod "73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3" (UID: "73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:57:53.121804 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:53.121757    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-home" (OuterVolumeSpecName: "home") pod "73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3" (UID: "73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:57:53.121850 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:53.121827    2586 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-home\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:57:53.121884 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:53.121847    2586 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-model-cache\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:57:53.121884 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:53.121864    2586 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-tmp-dir\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:57:53.123745 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:53.123724    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-dshm" (OuterVolumeSpecName: "dshm") pod "73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3" (UID: "73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:57:53.123745 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:53.123731    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3" (UID: "73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:57:53.123860 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:53.123761    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-kube-api-access-c927d" (OuterVolumeSpecName: "kube-api-access-c927d") pod "73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3" (UID: "73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3"). InnerVolumeSpecName "kube-api-access-c927d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:57:53.222790 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:53.222753    2586 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-tls-certs\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:57:53.222790 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:53.222784    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c927d\" (UniqueName: \"kubernetes.io/projected/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-kube-api-access-c927d\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:57:53.222790 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:53.222793    2586 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3-dshm\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 01:57:53.880980 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:53.880928    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"
Jul 21 01:57:53.880980 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:53.880923    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x" event={"ID":"73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3","Type":"ContainerDied","Data":"8504ef3614dad2d86f0e3e0fdea71555b99d6f4ba7434b060d8211dbe229456b"}
Jul 21 01:57:53.881445 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:53.881009    2586 scope.go:117] "RemoveContainer" containerID="b45aa8a52ccd16e4aa7ace6b5455f93021d1036f603e953f4e8bfcd224b47d2a"
Jul 21 01:57:53.898729 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:53.898696    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"]
Jul 21 01:57:53.901406 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:53.901382    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-12818e85/e2e-lifecycle-model-12818e85-kserve-6586c5479f-znd5x"]
Jul 21 01:57:55.308705 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:57:55.308670    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3" path="/var/lib/kubelet/pods/73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3/volumes"
Jul 21 01:58:21.407545 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:58:21.407463    2586 scope.go:117] "RemoveContainer" containerID="9ce25e96f790e41677664388f75b9934fbbe7d070d866fd542d2c047a0cec7bc"
Jul 21 01:58:21.416464 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:58:21.416442    2586 scope.go:117] "RemoveContainer" containerID="c14a2495e69fed9adfe2f712894d15ee2fde0674eb05220172878eaa00b40ffc"
Jul 21 01:58:30.203184 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:58:30.203143    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:58:40.106651 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:58:40.106614    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:59:21.444420 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:21.444384    2586 scope.go:117] "RemoveContainer" containerID="35f7c4efbf4354d7227228fbb4cbced3fb81bcd9dcff0c29401ac251fbf51210"
Jul 21 01:59:31.107925 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:31.107889    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:59:47.315409 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:47.315370    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 01:59:57.082956 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.082908    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"]
Jul 21 01:59:57.083437 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.083330    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3" containerName="main"
Jul 21 01:59:57.083437 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.083341    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3" containerName="main"
Jul 21 01:59:57.083437 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.083401    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="73b6b56a-c2b3-4f7d-a46e-691a8ddd04f3" containerName="main"
Jul 21 01:59:57.086346 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.086328    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"
Jul 21 01:59:57.089261 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.089234    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-811ee7\"/\"kube-root-ca.crt\""
Jul 21 01:59:57.089261 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.089248    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-811ee7\"/\"openshift-service-ca.crt\""
Jul 21 01:59:57.089452 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.089234    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-811ee7\"/\"test-model-811ee7-kserve-self-signed-certs\""
Jul 21 01:59:57.089452 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.089242    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-811ee7\"/\"default-dockercfg-khrx2\""
Jul 21 01:59:57.098211 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.098187    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"]
Jul 21 01:59:57.105683 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.105651    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0921d0c8-b291-4c3a-8514-ef02432fda42-dshm\") pod \"test-model-811ee7-kserve-5568988475-8mkpt\" (UID: \"0921d0c8-b291-4c3a-8514-ef02432fda42\") " pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"
Jul 21 01:59:57.105833 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.105709    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0921d0c8-b291-4c3a-8514-ef02432fda42-model-cache\") pod \"test-model-811ee7-kserve-5568988475-8mkpt\" (UID: \"0921d0c8-b291-4c3a-8514-ef02432fda42\") " pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"
Jul 21 01:59:57.105833 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.105768    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0921d0c8-b291-4c3a-8514-ef02432fda42-tmp-dir\") pod \"test-model-811ee7-kserve-5568988475-8mkpt\" (UID: \"0921d0c8-b291-4c3a-8514-ef02432fda42\") " pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"
Jul 21 01:59:57.105833 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.105828    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0921d0c8-b291-4c3a-8514-ef02432fda42-tls-certs\") pod \"test-model-811ee7-kserve-5568988475-8mkpt\" (UID: \"0921d0c8-b291-4c3a-8514-ef02432fda42\") " pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"
Jul 21 01:59:57.105968 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.105906    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0921d0c8-b291-4c3a-8514-ef02432fda42-home\") pod \"test-model-811ee7-kserve-5568988475-8mkpt\" (UID: \"0921d0c8-b291-4c3a-8514-ef02432fda42\") " pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"
Jul 21 01:59:57.106013 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.106000    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lht8r\" (UniqueName: \"kubernetes.io/projected/0921d0c8-b291-4c3a-8514-ef02432fda42-kube-api-access-lht8r\") pod \"test-model-811ee7-kserve-5568988475-8mkpt\" (UID: \"0921d0c8-b291-4c3a-8514-ef02432fda42\") " pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"
Jul 21 01:59:57.207253 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.207219    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0921d0c8-b291-4c3a-8514-ef02432fda42-home\") pod \"test-model-811ee7-kserve-5568988475-8mkpt\" (UID: \"0921d0c8-b291-4c3a-8514-ef02432fda42\") " pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"
Jul 21 01:59:57.207453 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.207268    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lht8r\" (UniqueName: \"kubernetes.io/projected/0921d0c8-b291-4c3a-8514-ef02432fda42-kube-api-access-lht8r\") pod \"test-model-811ee7-kserve-5568988475-8mkpt\" (UID: \"0921d0c8-b291-4c3a-8514-ef02432fda42\") " pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"
Jul 21 01:59:57.207453 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.207309    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0921d0c8-b291-4c3a-8514-ef02432fda42-dshm\") pod \"test-model-811ee7-kserve-5568988475-8mkpt\" (UID: \"0921d0c8-b291-4c3a-8514-ef02432fda42\") " pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"
Jul 21 01:59:57.207453 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.207330    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0921d0c8-b291-4c3a-8514-ef02432fda42-model-cache\") pod \"test-model-811ee7-kserve-5568988475-8mkpt\" (UID: \"0921d0c8-b291-4c3a-8514-ef02432fda42\") " pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"
Jul 21 01:59:57.207453 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.207350    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0921d0c8-b291-4c3a-8514-ef02432fda42-tmp-dir\") pod \"test-model-811ee7-kserve-5568988475-8mkpt\" (UID: \"0921d0c8-b291-4c3a-8514-ef02432fda42\") " pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"
Jul 21 01:59:57.207453 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.207383    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0921d0c8-b291-4c3a-8514-ef02432fda42-tls-certs\") pod \"test-model-811ee7-kserve-5568988475-8mkpt\" (UID: \"0921d0c8-b291-4c3a-8514-ef02432fda42\") " pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"
Jul 21 01:59:57.207737 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.207681    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0921d0c8-b291-4c3a-8514-ef02432fda42-home\") pod \"test-model-811ee7-kserve-5568988475-8mkpt\" (UID: \"0921d0c8-b291-4c3a-8514-ef02432fda42\") " pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"
Jul 21 01:59:57.207737 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.207690    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0921d0c8-b291-4c3a-8514-ef02432fda42-model-cache\") pod \"test-model-811ee7-kserve-5568988475-8mkpt\" (UID: \"0921d0c8-b291-4c3a-8514-ef02432fda42\") " pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"
Jul 21 01:59:57.207812 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.207775    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0921d0c8-b291-4c3a-8514-ef02432fda42-tmp-dir\") pod \"test-model-811ee7-kserve-5568988475-8mkpt\" (UID: \"0921d0c8-b291-4c3a-8514-ef02432fda42\") " pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"
Jul 21 01:59:57.209774 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.209744    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0921d0c8-b291-4c3a-8514-ef02432fda42-dshm\") pod \"test-model-811ee7-kserve-5568988475-8mkpt\" (UID: \"0921d0c8-b291-4c3a-8514-ef02432fda42\") " pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"
Jul 21 01:59:57.210040 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.210025    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0921d0c8-b291-4c3a-8514-ef02432fda42-tls-certs\") pod \"test-model-811ee7-kserve-5568988475-8mkpt\" (UID: \"0921d0c8-b291-4c3a-8514-ef02432fda42\") " pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"
Jul 21 01:59:57.214838 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.214814    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lht8r\" (UniqueName: \"kubernetes.io/projected/0921d0c8-b291-4c3a-8514-ef02432fda42-kube-api-access-lht8r\") pod \"test-model-811ee7-kserve-5568988475-8mkpt\" (UID: \"0921d0c8-b291-4c3a-8514-ef02432fda42\") " pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"
Jul 21 01:59:57.395860 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.395824    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"
Jul 21 01:59:57.538777 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:57.538752    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"]
Jul 21 01:59:57.541401 ip-10-0-131-213 kubenswrapper[2586]: W0721 01:59:57.541368    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0921d0c8_b291_4c3a_8514_ef02432fda42.slice/crio-b9f22c4bfe4a639ec6937a61c0a89310c0937a8638cf786805da62c814ffdaa6 WatchSource:0}: Error finding container b9f22c4bfe4a639ec6937a61c0a89310c0937a8638cf786805da62c814ffdaa6: Status 404 returned error can't find the container with id b9f22c4bfe4a639ec6937a61c0a89310c0937a8638cf786805da62c814ffdaa6
Jul 21 01:59:58.504070 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:58.504030    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt" event={"ID":"0921d0c8-b291-4c3a-8514-ef02432fda42","Type":"ContainerStarted","Data":"11f74d10cb6fac4ccaa4aab095c662359ce32a5830ad6660e7e96a651d1f37c2"}
Jul 21 01:59:58.504070 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:58.504076    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt" event={"ID":"0921d0c8-b291-4c3a-8514-ef02432fda42","Type":"ContainerStarted","Data":"b9f22c4bfe4a639ec6937a61c0a89310c0937a8638cf786805da62c814ffdaa6"}
Jul 21 01:59:58.519869 ip-10-0-131-213 kubenswrapper[2586]: I0721 01:59:58.519808    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt" podStartSLOduration=1.519786528 podStartE2EDuration="1.519786528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:59:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:59:58.519405341 +0000 UTC m=+2257.707444737" watchObservedRunningTime="2026-07-21 01:59:58.519786528 +0000 UTC m=+2257.707825923"
Jul 21 02:00:00.399377 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:00.399337    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:00:07.396508 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:07.396469    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"
Jul 21 02:00:07.397052 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:07.396541    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"
Jul 21 02:00:07.409127 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:07.409100    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"
Jul 21 02:00:07.562101 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:07.562071    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"
Jul 21 02:00:12.801417 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:12.801378    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:00:21.466652 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:21.466619    2586 scope.go:117] "RemoveContainer" containerID="dd810903f606c3e524459d31b57c2cf38167ff3f449d2448e5cc3508304e0347"
Jul 21 02:00:25.316980 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.316927    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"]
Jul 21 02:00:25.320622 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.320595    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"]
Jul 21 02:00:25.320777 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.320696    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"
Jul 21 02:00:25.322864 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.322823    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-f35db9\"/\"default-dockercfg-9txm2\""
Jul 21 02:00:25.323069 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.323056    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-f35db9\"/\"openshift-service-ca.crt\""
Jul 21 02:00:25.323357 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.323338    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-f35db9\"/\"kube-root-ca.crt\""
Jul 21 02:00:25.323498 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.323480    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-f35db9\"/\"test-model-f35db9-kserve-self-signed-certs\""
Jul 21 02:00:25.486209 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.486171    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5ed43ff-9328-44d9-89f7-06f1427a6d19-home\") pod \"test-model-f35db9-kserve-5f4cd86d99-bcdj7\" (UID: \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\") " pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"
Jul 21 02:00:25.486429 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.486245    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5ed43ff-9328-44d9-89f7-06f1427a6d19-tls-certs\") pod \"test-model-f35db9-kserve-5f4cd86d99-bcdj7\" (UID: \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\") " pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"
Jul 21 02:00:25.486429 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.486286    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5ed43ff-9328-44d9-89f7-06f1427a6d19-tmp-dir\") pod \"test-model-f35db9-kserve-5f4cd86d99-bcdj7\" (UID: \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\") " pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"
Jul 21 02:00:25.486429 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.486326    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87h8s\" (UniqueName: \"kubernetes.io/projected/a5ed43ff-9328-44d9-89f7-06f1427a6d19-kube-api-access-87h8s\") pod \"test-model-f35db9-kserve-5f4cd86d99-bcdj7\" (UID: \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\") " pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"
Jul 21 02:00:25.486566 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.486442    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5ed43ff-9328-44d9-89f7-06f1427a6d19-dshm\") pod \"test-model-f35db9-kserve-5f4cd86d99-bcdj7\" (UID: \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\") " pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"
Jul 21 02:00:25.486566 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.486485    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5ed43ff-9328-44d9-89f7-06f1427a6d19-model-cache\") pod \"test-model-f35db9-kserve-5f4cd86d99-bcdj7\" (UID: \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\") " pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"
Jul 21 02:00:25.587203 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.587111    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5ed43ff-9328-44d9-89f7-06f1427a6d19-dshm\") pod \"test-model-f35db9-kserve-5f4cd86d99-bcdj7\" (UID: \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\") " pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"
Jul 21 02:00:25.587203 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.587164    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5ed43ff-9328-44d9-89f7-06f1427a6d19-model-cache\") pod \"test-model-f35db9-kserve-5f4cd86d99-bcdj7\" (UID: \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\") " pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"
Jul 21 02:00:25.587433 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.587226    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5ed43ff-9328-44d9-89f7-06f1427a6d19-home\") pod \"test-model-f35db9-kserve-5f4cd86d99-bcdj7\" (UID: \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\") " pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"
Jul 21 02:00:25.587433 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.587271    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5ed43ff-9328-44d9-89f7-06f1427a6d19-tls-certs\") pod \"test-model-f35db9-kserve-5f4cd86d99-bcdj7\" (UID: \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\") " pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"
Jul 21 02:00:25.587433 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.587312    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5ed43ff-9328-44d9-89f7-06f1427a6d19-tmp-dir\") pod \"test-model-f35db9-kserve-5f4cd86d99-bcdj7\" (UID: \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\") " pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"
Jul 21 02:00:25.587433 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.587353    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87h8s\" (UniqueName: \"kubernetes.io/projected/a5ed43ff-9328-44d9-89f7-06f1427a6d19-kube-api-access-87h8s\") pod \"test-model-f35db9-kserve-5f4cd86d99-bcdj7\" (UID: \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\") " pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"
Jul 21 02:00:25.587687 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.587660    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5ed43ff-9328-44d9-89f7-06f1427a6d19-model-cache\") pod \"test-model-f35db9-kserve-5f4cd86d99-bcdj7\" (UID: \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\") " pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"
Jul 21 02:00:25.587756 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.587698    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5ed43ff-9328-44d9-89f7-06f1427a6d19-tmp-dir\") pod \"test-model-f35db9-kserve-5f4cd86d99-bcdj7\" (UID: \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\") " pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"
Jul 21 02:00:25.587756 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.587727    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5ed43ff-9328-44d9-89f7-06f1427a6d19-home\") pod \"test-model-f35db9-kserve-5f4cd86d99-bcdj7\" (UID: \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\") " pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"
Jul 21 02:00:25.589542 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.589524    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5ed43ff-9328-44d9-89f7-06f1427a6d19-dshm\") pod \"test-model-f35db9-kserve-5f4cd86d99-bcdj7\" (UID: \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\") " pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"
Jul 21 02:00:25.589891 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.589874    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5ed43ff-9328-44d9-89f7-06f1427a6d19-tls-certs\") pod \"test-model-f35db9-kserve-5f4cd86d99-bcdj7\" (UID: \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\") " pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"
Jul 21 02:00:25.595110 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.595089    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87h8s\" (UniqueName: \"kubernetes.io/projected/a5ed43ff-9328-44d9-89f7-06f1427a6d19-kube-api-access-87h8s\") pod \"test-model-f35db9-kserve-5f4cd86d99-bcdj7\" (UID: \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\") " pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"
Jul 21 02:00:25.631141 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.631107    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"
Jul 21 02:00:25.775051 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:25.774849    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"]
Jul 21 02:00:25.777889 ip-10-0-131-213 kubenswrapper[2586]: W0721 02:00:25.777865    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5ed43ff_9328_44d9_89f7_06f1427a6d19.slice/crio-fd81468bdbf236dfa41b749640652e4f5ba7a4bb2b6b6c1598de336c40b0fdfd WatchSource:0}: Error finding container fd81468bdbf236dfa41b749640652e4f5ba7a4bb2b6b6c1598de336c40b0fdfd: Status 404 returned error can't find the container with id fd81468bdbf236dfa41b749640652e4f5ba7a4bb2b6b6c1598de336c40b0fdfd
Jul 21 02:00:26.648897 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:26.648860    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7" event={"ID":"a5ed43ff-9328-44d9-89f7-06f1427a6d19","Type":"ContainerStarted","Data":"aa177260df231ecb7037fb382a8227c5a29a8e6bd85a0725eab6cec9970e98be"}
Jul 21 02:00:26.649347 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:26.648906    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7" event={"ID":"a5ed43ff-9328-44d9-89f7-06f1427a6d19","Type":"ContainerStarted","Data":"fd81468bdbf236dfa41b749640652e4f5ba7a4bb2b6b6c1598de336c40b0fdfd"}
Jul 21 02:00:26.670251 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:26.670197    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7" podStartSLOduration=1.670178105 podStartE2EDuration="1.670178105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:00:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:00:26.666634416 +0000 UTC m=+2285.854673806" watchObservedRunningTime="2026-07-21 02:00:26.670178105 +0000 UTC m=+2285.858217495"
Jul 21 02:00:30.593582 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:30.593540    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:00:35.632049 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:35.632004    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"
Jul 21 02:00:35.632481 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:35.632100    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"
Jul 21 02:00:35.644769 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:35.644735    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"
Jul 21 02:00:35.705857 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:00:35.705831    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"
Jul 21 02:01:08.744154 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:08.744113    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"]
Jul 21 02:01:09.646464 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:09.646429    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"]
Jul 21 02:01:13.399984 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:13.399883    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:01:23.765737 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:23.765668    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt" podUID="0921d0c8-b291-4c3a-8514-ef02432fda42" containerName="main" containerID="cri-o://11f74d10cb6fac4ccaa4aab095c662359ce32a5830ad6660e7e96a651d1f37c2" gracePeriod=45
Jul 21 02:01:23.940684 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:23.940649    2586 generic.go:356] "Generic (PLEG): container finished" podID="0921d0c8-b291-4c3a-8514-ef02432fda42" containerID="11f74d10cb6fac4ccaa4aab095c662359ce32a5830ad6660e7e96a651d1f37c2" exitCode=0
Jul 21 02:01:23.940823 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:23.940727    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt" event={"ID":"0921d0c8-b291-4c3a-8514-ef02432fda42","Type":"ContainerDied","Data":"11f74d10cb6fac4ccaa4aab095c662359ce32a5830ad6660e7e96a651d1f37c2"}
Jul 21 02:01:24.025340 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.025270    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"
Jul 21 02:01:24.063502 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.063467    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0921d0c8-b291-4c3a-8514-ef02432fda42-tmp-dir\") pod \"0921d0c8-b291-4c3a-8514-ef02432fda42\" (UID: \"0921d0c8-b291-4c3a-8514-ef02432fda42\") "
Jul 21 02:01:24.063728 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.063564    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0921d0c8-b291-4c3a-8514-ef02432fda42-dshm\") pod \"0921d0c8-b291-4c3a-8514-ef02432fda42\" (UID: \"0921d0c8-b291-4c3a-8514-ef02432fda42\") "
Jul 21 02:01:24.063728 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.063618    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0921d0c8-b291-4c3a-8514-ef02432fda42-model-cache\") pod \"0921d0c8-b291-4c3a-8514-ef02432fda42\" (UID: \"0921d0c8-b291-4c3a-8514-ef02432fda42\") "
Jul 21 02:01:24.063728 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.063656    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0921d0c8-b291-4c3a-8514-ef02432fda42-home\") pod \"0921d0c8-b291-4c3a-8514-ef02432fda42\" (UID: \"0921d0c8-b291-4c3a-8514-ef02432fda42\") "
Jul 21 02:01:24.063728 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.063689    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lht8r\" (UniqueName: \"kubernetes.io/projected/0921d0c8-b291-4c3a-8514-ef02432fda42-kube-api-access-lht8r\") pod \"0921d0c8-b291-4c3a-8514-ef02432fda42\" (UID: \"0921d0c8-b291-4c3a-8514-ef02432fda42\") "
Jul 21 02:01:24.063728 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.063720    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0921d0c8-b291-4c3a-8514-ef02432fda42-tls-certs\") pod \"0921d0c8-b291-4c3a-8514-ef02432fda42\" (UID: \"0921d0c8-b291-4c3a-8514-ef02432fda42\") "
Jul 21 02:01:24.064022 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.063742    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0921d0c8-b291-4c3a-8514-ef02432fda42-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0921d0c8-b291-4c3a-8514-ef02432fda42" (UID: "0921d0c8-b291-4c3a-8514-ef02432fda42"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:01:24.064022 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.063894    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0921d0c8-b291-4c3a-8514-ef02432fda42-model-cache" (OuterVolumeSpecName: "model-cache") pod "0921d0c8-b291-4c3a-8514-ef02432fda42" (UID: "0921d0c8-b291-4c3a-8514-ef02432fda42"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:01:24.064022 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.063904    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0921d0c8-b291-4c3a-8514-ef02432fda42-home" (OuterVolumeSpecName: "home") pod "0921d0c8-b291-4c3a-8514-ef02432fda42" (UID: "0921d0c8-b291-4c3a-8514-ef02432fda42"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:01:24.064149 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.064080    2586 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0921d0c8-b291-4c3a-8514-ef02432fda42-model-cache\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:01:24.064149 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.064093    2586 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0921d0c8-b291-4c3a-8514-ef02432fda42-home\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:01:24.064149 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.064102    2586 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0921d0c8-b291-4c3a-8514-ef02432fda42-tmp-dir\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:01:24.066019 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.065989    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0921d0c8-b291-4c3a-8514-ef02432fda42-dshm" (OuterVolumeSpecName: "dshm") pod "0921d0c8-b291-4c3a-8514-ef02432fda42" (UID: "0921d0c8-b291-4c3a-8514-ef02432fda42"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:01:24.066144 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.066072    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0921d0c8-b291-4c3a-8514-ef02432fda42-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0921d0c8-b291-4c3a-8514-ef02432fda42" (UID: "0921d0c8-b291-4c3a-8514-ef02432fda42"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:01:24.066216 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.066198    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0921d0c8-b291-4c3a-8514-ef02432fda42-kube-api-access-lht8r" (OuterVolumeSpecName: "kube-api-access-lht8r") pod "0921d0c8-b291-4c3a-8514-ef02432fda42" (UID: "0921d0c8-b291-4c3a-8514-ef02432fda42"). InnerVolumeSpecName "kube-api-access-lht8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:01:24.165516 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.165475    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lht8r\" (UniqueName: \"kubernetes.io/projected/0921d0c8-b291-4c3a-8514-ef02432fda42-kube-api-access-lht8r\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:01:24.165516 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.165511    2586 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0921d0c8-b291-4c3a-8514-ef02432fda42-tls-certs\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:01:24.165516 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.165522    2586 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0921d0c8-b291-4c3a-8514-ef02432fda42-dshm\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:01:24.668302 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.668262    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7" podUID="a5ed43ff-9328-44d9-89f7-06f1427a6d19" containerName="main" containerID="cri-o://aa177260df231ecb7037fb382a8227c5a29a8e6bd85a0725eab6cec9970e98be" gracePeriod=45
Jul 21 02:01:24.926656 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.926592    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"
Jul 21 02:01:24.948655 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.948628    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"
Jul 21 02:01:24.948850 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.948662    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt" event={"ID":"0921d0c8-b291-4c3a-8514-ef02432fda42","Type":"ContainerDied","Data":"b9f22c4bfe4a639ec6937a61c0a89310c0937a8638cf786805da62c814ffdaa6"}
Jul 21 02:01:24.948850 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.948711    2586 scope.go:117] "RemoveContainer" containerID="11f74d10cb6fac4ccaa4aab095c662359ce32a5830ad6660e7e96a651d1f37c2"
Jul 21 02:01:24.950797 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.950768    2586 generic.go:356] "Generic (PLEG): container finished" podID="a5ed43ff-9328-44d9-89f7-06f1427a6d19" containerID="aa177260df231ecb7037fb382a8227c5a29a8e6bd85a0725eab6cec9970e98be" exitCode=0
Jul 21 02:01:24.950967 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.950820    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"
Jul 21 02:01:24.950967 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.950829    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7" event={"ID":"a5ed43ff-9328-44d9-89f7-06f1427a6d19","Type":"ContainerDied","Data":"aa177260df231ecb7037fb382a8227c5a29a8e6bd85a0725eab6cec9970e98be"}
Jul 21 02:01:24.950967 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.950863    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7" event={"ID":"a5ed43ff-9328-44d9-89f7-06f1427a6d19","Type":"ContainerDied","Data":"fd81468bdbf236dfa41b749640652e4f5ba7a4bb2b6b6c1598de336c40b0fdfd"}
Jul 21 02:01:24.959998 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.959977    2586 scope.go:117] "RemoveContainer" containerID="aa177260df231ecb7037fb382a8227c5a29a8e6bd85a0725eab6cec9970e98be"
Jul 21 02:01:24.970037 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.969919    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"]
Jul 21 02:01:24.970110 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.970090    2586 scope.go:117] "RemoveContainer" containerID="aa177260df231ecb7037fb382a8227c5a29a8e6bd85a0725eab6cec9970e98be"
Jul 21 02:01:24.970472 ip-10-0-131-213 kubenswrapper[2586]: E0721 02:01:24.970452    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa177260df231ecb7037fb382a8227c5a29a8e6bd85a0725eab6cec9970e98be\": container with ID starting with aa177260df231ecb7037fb382a8227c5a29a8e6bd85a0725eab6cec9970e98be not found: ID does not exist" containerID="aa177260df231ecb7037fb382a8227c5a29a8e6bd85a0725eab6cec9970e98be"
Jul 21 02:01:24.970536 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.970488    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa177260df231ecb7037fb382a8227c5a29a8e6bd85a0725eab6cec9970e98be"} err="failed to get container status \"aa177260df231ecb7037fb382a8227c5a29a8e6bd85a0725eab6cec9970e98be\": rpc error: code = NotFound desc = could not find container \"aa177260df231ecb7037fb382a8227c5a29a8e6bd85a0725eab6cec9970e98be\": container with ID starting with aa177260df231ecb7037fb382a8227c5a29a8e6bd85a0725eab6cec9970e98be not found: ID does not exist"
Jul 21 02:01:24.975084 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.975060    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5ed43ff-9328-44d9-89f7-06f1427a6d19-home\") pod \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\" (UID: \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\") "
Jul 21 02:01:24.975237 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.975100    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5ed43ff-9328-44d9-89f7-06f1427a6d19-dshm\") pod \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\" (UID: \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\") "
Jul 21 02:01:24.975237 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.975128    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5ed43ff-9328-44d9-89f7-06f1427a6d19-model-cache\") pod \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\" (UID: \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\") "
Jul 21 02:01:24.975237 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.975171    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87h8s\" (UniqueName: \"kubernetes.io/projected/a5ed43ff-9328-44d9-89f7-06f1427a6d19-kube-api-access-87h8s\") pod \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\" (UID: \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\") "
Jul 21 02:01:24.975237 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.975214    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5ed43ff-9328-44d9-89f7-06f1427a6d19-tmp-dir\") pod \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\" (UID: \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\") "
Jul 21 02:01:24.975447 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.975325    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5ed43ff-9328-44d9-89f7-06f1427a6d19-tls-certs\") pod \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\" (UID: \"a5ed43ff-9328-44d9-89f7-06f1427a6d19\") "
Jul 21 02:01:24.975447 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.975364    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5ed43ff-9328-44d9-89f7-06f1427a6d19-home" (OuterVolumeSpecName: "home") pod "a5ed43ff-9328-44d9-89f7-06f1427a6d19" (UID: "a5ed43ff-9328-44d9-89f7-06f1427a6d19"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:01:24.975541 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.975452    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5ed43ff-9328-44d9-89f7-06f1427a6d19-model-cache" (OuterVolumeSpecName: "model-cache") pod "a5ed43ff-9328-44d9-89f7-06f1427a6d19" (UID: "a5ed43ff-9328-44d9-89f7-06f1427a6d19"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:01:24.975541 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.975517    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5ed43ff-9328-44d9-89f7-06f1427a6d19-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a5ed43ff-9328-44d9-89f7-06f1427a6d19" (UID: "a5ed43ff-9328-44d9-89f7-06f1427a6d19"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:01:24.975706 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.975689    2586 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5ed43ff-9328-44d9-89f7-06f1427a6d19-home\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:01:24.975772 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.975712    2586 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5ed43ff-9328-44d9-89f7-06f1427a6d19-model-cache\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:01:24.975772 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.975728    2586 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5ed43ff-9328-44d9-89f7-06f1427a6d19-tmp-dir\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:01:24.976261 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.976239    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-811ee7/test-model-811ee7-kserve-5568988475-8mkpt"]
Jul 21 02:01:24.977543 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.977518    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5ed43ff-9328-44d9-89f7-06f1427a6d19-kube-api-access-87h8s" (OuterVolumeSpecName: "kube-api-access-87h8s") pod "a5ed43ff-9328-44d9-89f7-06f1427a6d19" (UID: "a5ed43ff-9328-44d9-89f7-06f1427a6d19"). InnerVolumeSpecName "kube-api-access-87h8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:01:24.977543 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.977528    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5ed43ff-9328-44d9-89f7-06f1427a6d19-dshm" (OuterVolumeSpecName: "dshm") pod "a5ed43ff-9328-44d9-89f7-06f1427a6d19" (UID: "a5ed43ff-9328-44d9-89f7-06f1427a6d19"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:01:24.977679 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:24.977615    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5ed43ff-9328-44d9-89f7-06f1427a6d19-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a5ed43ff-9328-44d9-89f7-06f1427a6d19" (UID: "a5ed43ff-9328-44d9-89f7-06f1427a6d19"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:01:25.076569 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:25.076540    2586 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5ed43ff-9328-44d9-89f7-06f1427a6d19-tls-certs\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:01:25.076569 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:25.076564    2586 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5ed43ff-9328-44d9-89f7-06f1427a6d19-dshm\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:01:25.076569 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:25.076573    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87h8s\" (UniqueName: \"kubernetes.io/projected/a5ed43ff-9328-44d9-89f7-06f1427a6d19-kube-api-access-87h8s\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:01:25.276343 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:25.276303    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"]
Jul 21 02:01:25.281764 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:25.281726    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-f35db9/test-model-f35db9-kserve-5f4cd86d99-bcdj7"]
Jul 21 02:01:25.309072 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:25.309025    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0921d0c8-b291-4c3a-8514-ef02432fda42" path="/var/lib/kubelet/pods/0921d0c8-b291-4c3a-8514-ef02432fda42/volumes"
Jul 21 02:01:25.309524 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:25.309504    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5ed43ff-9328-44d9-89f7-06f1427a6d19" path="/var/lib/kubelet/pods/a5ed43ff-9328-44d9-89f7-06f1427a6d19/volumes"
Jul 21 02:01:25.904717 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:25.904683    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:01:31.838487 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:31.838453    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f35db9-2k6cl"]
Jul 21 02:01:31.838969 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:31.838840    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0921d0c8-b291-4c3a-8514-ef02432fda42" containerName="main"
Jul 21 02:01:31.838969 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:31.838852    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="0921d0c8-b291-4c3a-8514-ef02432fda42" containerName="main"
Jul 21 02:01:31.838969 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:31.838872    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5ed43ff-9328-44d9-89f7-06f1427a6d19" containerName="main"
Jul 21 02:01:31.838969 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:31.838877    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5ed43ff-9328-44d9-89f7-06f1427a6d19" containerName="main"
Jul 21 02:01:31.838969 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:31.838962    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5ed43ff-9328-44d9-89f7-06f1427a6d19" containerName="main"
Jul 21 02:01:31.838969 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:31.838971    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="0921d0c8-b291-4c3a-8514-ef02432fda42" containerName="main"
Jul 21 02:01:31.844204 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:31.844187    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f35db9-2k6cl"
Jul 21 02:01:31.852681 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:31.852658    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 02:01:31.853905 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:31.853889    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8wthr\""
Jul 21 02:01:31.869734 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:31.869706    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f35db9-2k6cl"]
Jul 21 02:01:31.942713 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:31.942676    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f39eb70c-b0ec-4018-a051-112792eba8f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-f35db9-2k6cl\" (UID: \"f39eb70c-b0ec-4018-a051-112792eba8f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f35db9-2k6cl"
Jul 21 02:01:32.043535 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:32.043497    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f39eb70c-b0ec-4018-a051-112792eba8f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-f35db9-2k6cl\" (UID: \"f39eb70c-b0ec-4018-a051-112792eba8f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f35db9-2k6cl"
Jul 21 02:01:32.044196 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:32.044175    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f39eb70c-b0ec-4018-a051-112792eba8f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-f35db9-2k6cl\" (UID: \"f39eb70c-b0ec-4018-a051-112792eba8f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f35db9-2k6cl"
Jul 21 02:01:32.153954 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:32.153904    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f35db9-2k6cl"
Jul 21 02:01:32.296661 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:32.296632    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f35db9-2k6cl"]
Jul 21 02:01:32.302156 ip-10-0-131-213 kubenswrapper[2586]: W0721 02:01:32.300232    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf39eb70c_b0ec_4018_a051_112792eba8f5.slice/crio-8ca7ee67c862fac9af9e7b0d72460d054dc8a3c33e24dab0bfca9a9155aee286 WatchSource:0}: Error finding container 8ca7ee67c862fac9af9e7b0d72460d054dc8a3c33e24dab0bfca9a9155aee286: Status 404 returned error can't find the container with id 8ca7ee67c862fac9af9e7b0d72460d054dc8a3c33e24dab0bfca9a9155aee286
Jul 21 02:01:32.993027 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:32.992993    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f35db9-2k6cl" event={"ID":"f39eb70c-b0ec-4018-a051-112792eba8f5","Type":"ContainerStarted","Data":"dfa401ea1f1600cfae66e2dcdc73d1b9dc2c498b1b60e655c7bebdb5c9967e01"}
Jul 21 02:01:32.993406 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:32.993059    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f35db9-2k6cl" event={"ID":"f39eb70c-b0ec-4018-a051-112792eba8f5","Type":"ContainerStarted","Data":"8ca7ee67c862fac9af9e7b0d72460d054dc8a3c33e24dab0bfca9a9155aee286"}
Jul 21 02:01:33.008706 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:33.008637    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f35db9-2k6cl" podStartSLOduration=2.008616851 podStartE2EDuration="2.008616851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:01:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:01:33.007399303 +0000 UTC m=+2352.195438695" watchObservedRunningTime="2026-07-21 02:01:33.008616851 +0000 UTC m=+2352.196656240"
Jul 21 02:01:33.999530 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:33.999488    2586 generic.go:356] "Generic (PLEG): container finished" podID="f39eb70c-b0ec-4018-a051-112792eba8f5" containerID="dfa401ea1f1600cfae66e2dcdc73d1b9dc2c498b1b60e655c7bebdb5c9967e01" exitCode=0
Jul 21 02:01:34.000005 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:33.999574    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f35db9-2k6cl" event={"ID":"f39eb70c-b0ec-4018-a051-112792eba8f5","Type":"ContainerDied","Data":"dfa401ea1f1600cfae66e2dcdc73d1b9dc2c498b1b60e655c7bebdb5c9967e01"}
Jul 21 02:01:35.147748 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:35.147720    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f35db9-2k6cl"
Jul 21 02:01:35.275625 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:35.275532    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f39eb70c-b0ec-4018-a051-112792eba8f5-maas-api-service-ca\") pod \"f39eb70c-b0ec-4018-a051-112792eba8f5\" (UID: \"f39eb70c-b0ec-4018-a051-112792eba8f5\") "
Jul 21 02:01:35.275905 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:35.275883    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f39eb70c-b0ec-4018-a051-112792eba8f5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f39eb70c-b0ec-4018-a051-112792eba8f5" (UID: "f39eb70c-b0ec-4018-a051-112792eba8f5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:01:35.377007 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:35.376965    2586 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f39eb70c-b0ec-4018-a051-112792eba8f5-maas-api-service-ca\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:01:36.010833 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:36.010801    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f35db9-2k6cl"
Jul 21 02:01:36.010833 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:36.010822    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f35db9-2k6cl" event={"ID":"f39eb70c-b0ec-4018-a051-112792eba8f5","Type":"ContainerDied","Data":"8ca7ee67c862fac9af9e7b0d72460d054dc8a3c33e24dab0bfca9a9155aee286"}
Jul 21 02:01:36.011070 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:36.010865    2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ca7ee67c862fac9af9e7b0d72460d054dc8a3c33e24dab0bfca9a9155aee286"
Jul 21 02:01:45.700448 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:45.700410    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:01:46.955506 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:46.955456    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f35db9-2k6cl"]
Jul 21 02:01:46.958223 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:46.958182    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f35db9-2k6cl"]
Jul 21 02:01:47.310710 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:01:47.310617    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f39eb70c-b0ec-4018-a051-112792eba8f5" path="/var/lib/kubelet/pods/f39eb70c-b0ec-4018-a051-112792eba8f5/volumes"
Jul 21 02:02:00.816781 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:00.816744    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:02:14.324365 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:14.324322    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:02:18.617737 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:18.617697    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-450472-g5jk7"]
Jul 21 02:02:18.618252 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:18.618127    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f39eb70c-b0ec-4018-a051-112792eba8f5" containerName="revoke-keys"
Jul 21 02:02:18.618252 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:18.618142    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="f39eb70c-b0ec-4018-a051-112792eba8f5" containerName="revoke-keys"
Jul 21 02:02:18.618252 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:18.618208    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="f39eb70c-b0ec-4018-a051-112792eba8f5" containerName="revoke-keys"
Jul 21 02:02:18.621572 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:18.621554    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-450472-g5jk7"
Jul 21 02:02:18.623797 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:18.623775    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8wthr\""
Jul 21 02:02:18.624301 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:18.624281    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 02:02:18.635791 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:18.635762    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-450472-g5jk7"]
Jul 21 02:02:18.798644 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:18.798603    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdbfd83c-9cf3-4a71-af1a-8af4d7df2203-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-450472-g5jk7\" (UID: \"cdbfd83c-9cf3-4a71-af1a-8af4d7df2203\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-450472-g5jk7"
Jul 21 02:02:18.899704 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:18.899597    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdbfd83c-9cf3-4a71-af1a-8af4d7df2203-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-450472-g5jk7\" (UID: \"cdbfd83c-9cf3-4a71-af1a-8af4d7df2203\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-450472-g5jk7"
Jul 21 02:02:18.900368 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:18.900344    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdbfd83c-9cf3-4a71-af1a-8af4d7df2203-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-450472-g5jk7\" (UID: \"cdbfd83c-9cf3-4a71-af1a-8af4d7df2203\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-450472-g5jk7"
Jul 21 02:02:18.933248 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:18.933207    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-450472-g5jk7"
Jul 21 02:02:19.086867 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:19.086833    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-450472-g5jk7"]
Jul 21 02:02:19.090497 ip-10-0-131-213 kubenswrapper[2586]: W0721 02:02:19.090454    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdbfd83c_9cf3_4a71_af1a_8af4d7df2203.slice/crio-0dcff90491e73bd88ca7de3ca9435a3b6f180bfa7e81bad85485c3a4481b789c WatchSource:0}: Error finding container 0dcff90491e73bd88ca7de3ca9435a3b6f180bfa7e81bad85485c3a4481b789c: Status 404 returned error can't find the container with id 0dcff90491e73bd88ca7de3ca9435a3b6f180bfa7e81bad85485c3a4481b789c
Jul 21 02:02:19.241400 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:19.241302    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-450472-g5jk7" event={"ID":"cdbfd83c-9cf3-4a71-af1a-8af4d7df2203","Type":"ContainerStarted","Data":"0dcff90491e73bd88ca7de3ca9435a3b6f180bfa7e81bad85485c3a4481b789c"}
Jul 21 02:02:20.251220 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:20.251183    2586 generic.go:356] "Generic (PLEG): container finished" podID="cdbfd83c-9cf3-4a71-af1a-8af4d7df2203" containerID="3e13594c8cfe550c18fe60d0a245949b8f767429bfaf42cbab8c1ae8821e50d2" exitCode=0
Jul 21 02:02:20.251648 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:20.251281    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-450472-g5jk7" event={"ID":"cdbfd83c-9cf3-4a71-af1a-8af4d7df2203","Type":"ContainerDied","Data":"3e13594c8cfe550c18fe60d0a245949b8f767429bfaf42cbab8c1ae8821e50d2"}
Jul 21 02:02:21.396668 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:21.396638    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-450472-g5jk7"
Jul 21 02:02:21.425544 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:21.425502    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdbfd83c-9cf3-4a71-af1a-8af4d7df2203-maas-api-service-ca\") pod \"cdbfd83c-9cf3-4a71-af1a-8af4d7df2203\" (UID: \"cdbfd83c-9cf3-4a71-af1a-8af4d7df2203\") "
Jul 21 02:02:21.425886 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:21.425862    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdbfd83c-9cf3-4a71-af1a-8af4d7df2203-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cdbfd83c-9cf3-4a71-af1a-8af4d7df2203" (UID: "cdbfd83c-9cf3-4a71-af1a-8af4d7df2203"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:02:21.495785 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:21.495750    2586 scope.go:117] "RemoveContainer" containerID="30006a3f7e85f313d9afd34b888a40050018e6dda6458494123d7c744a1936f3"
Jul 21 02:02:21.526387 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:21.526354    2586 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdbfd83c-9cf3-4a71-af1a-8af4d7df2203-maas-api-service-ca\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:02:22.262238 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:22.262210    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-450472-g5jk7"
Jul 21 02:02:22.262238 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:22.262234    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-450472-g5jk7" event={"ID":"cdbfd83c-9cf3-4a71-af1a-8af4d7df2203","Type":"ContainerDied","Data":"0dcff90491e73bd88ca7de3ca9435a3b6f180bfa7e81bad85485c3a4481b789c"}
Jul 21 02:02:22.262464 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:22.262279    2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0dcff90491e73bd88ca7de3ca9435a3b6f180bfa7e81bad85485c3a4481b789c"
Jul 21 02:02:38.133042 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:38.133007    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:02:38.766960 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:38.766905    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-450472-g5jk7"]
Jul 21 02:02:38.776563 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:38.776527    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-450472-g5jk7"]
Jul 21 02:02:39.308962 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:39.308903    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdbfd83c-9cf3-4a71-af1a-8af4d7df2203" path="/var/lib/kubelet/pods/cdbfd83c-9cf3-4a71-af1a-8af4d7df2203/volumes"
Jul 21 02:02:46.708241 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:46.708201    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-50f51c-zbh57"]
Jul 21 02:02:46.708670 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:46.708606    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdbfd83c-9cf3-4a71-af1a-8af4d7df2203" containerName="revoke-keys"
Jul 21 02:02:46.708670 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:46.708618    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdbfd83c-9cf3-4a71-af1a-8af4d7df2203" containerName="revoke-keys"
Jul 21 02:02:46.708761 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:46.708678    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdbfd83c-9cf3-4a71-af1a-8af4d7df2203" containerName="revoke-keys"
Jul 21 02:02:46.711857 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:46.711836    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-50f51c-zbh57"
Jul 21 02:02:46.714173 ip-10-0-131-213 kubenswrapper[2586]: E0721 02:02:46.714139    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-revoke-keys-e2e-api-b-50f51c-zbh57\" is forbidden: User \"system:node:ip-10-0-131-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-131-213.ec2.internal' and this object" podUID="0733c9f9-db31-42ec-b143-d11c5d5270b0" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-50f51c-zbh57"
Jul 21 02:02:46.714304 ip-10-0-131-213 kubenswrapper[2586]: E0721 02:02:46.714205    2586 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"maas-api-cleanup-dockercfg-8wthr\" is forbidden: User \"system:node:ip-10-0-131-213.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-131-213.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8wthr\"" type="*v1.Secret"
Jul 21 02:02:46.714452 ip-10-0-131-213 kubenswrapper[2586]: E0721 02:02:46.714431    2586 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-131-213.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-131-213.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 21 02:02:46.728419 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:46.728382    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-50f51c-zbh57"]
Jul 21 02:02:46.871986 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:46.871909    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0733c9f9-db31-42ec-b143-d11c5d5270b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-50f51c-zbh57\" (UID: \"0733c9f9-db31-42ec-b143-d11c5d5270b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-50f51c-zbh57"
Jul 21 02:02:46.973212 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:46.973109    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0733c9f9-db31-42ec-b143-d11c5d5270b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-50f51c-zbh57\" (UID: \"0733c9f9-db31-42ec-b143-d11c5d5270b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-50f51c-zbh57"
Jul 21 02:02:47.543186 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:47.543156    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8wthr\""
Jul 21 02:02:47.974177 ip-10-0-131-213 kubenswrapper[2586]: E0721 02:02:47.974140    2586 configmap.go:193] Couldn't get configMap odh-ai-gateway-infra/openshift-service-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Jul 21 02:02:47.974575 ip-10-0-131-213 kubenswrapper[2586]: E0721 02:02:47.974261    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0733c9f9-db31-42ec-b143-d11c5d5270b0-maas-api-service-ca podName:0733c9f9-db31-42ec-b143-d11c5d5270b0 nodeName:}" failed. No retries permitted until 2026-07-21 02:02:48.474243798 +0000 UTC m=+2427.662283165 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-service-ca" (UniqueName: "kubernetes.io/configmap/0733c9f9-db31-42ec-b143-d11c5d5270b0-maas-api-service-ca") pod "maas-api-revoke-keys-e2e-api-b-50f51c-zbh57" (UID: "0733c9f9-db31-42ec-b143-d11c5d5270b0") : failed to sync configmap cache: timed out waiting for the condition
Jul 21 02:02:47.986369 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:47.986343    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 02:02:48.487891 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:48.487850    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0733c9f9-db31-42ec-b143-d11c5d5270b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-50f51c-zbh57\" (UID: \"0733c9f9-db31-42ec-b143-d11c5d5270b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-50f51c-zbh57"
Jul 21 02:02:48.488512 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:48.488489    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0733c9f9-db31-42ec-b143-d11c5d5270b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-50f51c-zbh57\" (UID: \"0733c9f9-db31-42ec-b143-d11c5d5270b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-50f51c-zbh57"
Jul 21 02:02:48.521894 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:48.521844    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-50f51c-zbh57"
Jul 21 02:02:48.676890 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:48.676863    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-50f51c-zbh57"]
Jul 21 02:02:48.679722 ip-10-0-131-213 kubenswrapper[2586]: W0721 02:02:48.679695    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0733c9f9_db31_42ec_b143_d11c5d5270b0.slice/crio-59f25a1b6fa9100e39d106d5cad2484b1834b14fe12121c1164e312eda32de95 WatchSource:0}: Error finding container 59f25a1b6fa9100e39d106d5cad2484b1834b14fe12121c1164e312eda32de95: Status 404 returned error can't find the container with id 59f25a1b6fa9100e39d106d5cad2484b1834b14fe12121c1164e312eda32de95
Jul 21 02:02:49.396451 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:49.396413    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-50f51c-zbh57" event={"ID":"0733c9f9-db31-42ec-b143-d11c5d5270b0","Type":"ContainerStarted","Data":"9f7bcdf169184b7446384321b5203182ce8ecdfee6dbf33c917a6d8594aac594"}
Jul 21 02:02:49.396929 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:49.396476    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-50f51c-zbh57" event={"ID":"0733c9f9-db31-42ec-b143-d11c5d5270b0","Type":"ContainerStarted","Data":"59f25a1b6fa9100e39d106d5cad2484b1834b14fe12121c1164e312eda32de95"}
Jul 21 02:02:49.420539 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:49.420482    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-50f51c-zbh57" podStartSLOduration=3.42046329 podStartE2EDuration="3.42046329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:02:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:02:49.418883416 +0000 UTC m=+2428.606922808" watchObservedRunningTime="2026-07-21 02:02:49.42046329 +0000 UTC m=+2428.608502680"
Jul 21 02:02:50.402567 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:50.402528    2586 generic.go:356] "Generic (PLEG): container finished" podID="0733c9f9-db31-42ec-b143-d11c5d5270b0" containerID="9f7bcdf169184b7446384321b5203182ce8ecdfee6dbf33c917a6d8594aac594" exitCode=0
Jul 21 02:02:50.402981 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:50.402576    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-50f51c-zbh57" event={"ID":"0733c9f9-db31-42ec-b143-d11c5d5270b0","Type":"ContainerDied","Data":"9f7bcdf169184b7446384321b5203182ce8ecdfee6dbf33c917a6d8594aac594"}
Jul 21 02:02:51.544806 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:51.544779    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-50f51c-zbh57"
Jul 21 02:02:51.717008 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:51.716879    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0733c9f9-db31-42ec-b143-d11c5d5270b0-maas-api-service-ca\") pod \"0733c9f9-db31-42ec-b143-d11c5d5270b0\" (UID: \"0733c9f9-db31-42ec-b143-d11c5d5270b0\") "
Jul 21 02:02:51.717276 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:51.717252    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0733c9f9-db31-42ec-b143-d11c5d5270b0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0733c9f9-db31-42ec-b143-d11c5d5270b0" (UID: "0733c9f9-db31-42ec-b143-d11c5d5270b0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:02:51.817812 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:51.817777    2586 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0733c9f9-db31-42ec-b143-d11c5d5270b0-maas-api-service-ca\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:02:52.412819 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:52.412785    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-50f51c-zbh57"
Jul 21 02:02:52.413032 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:52.412813    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-50f51c-zbh57" event={"ID":"0733c9f9-db31-42ec-b143-d11c5d5270b0","Type":"ContainerDied","Data":"59f25a1b6fa9100e39d106d5cad2484b1834b14fe12121c1164e312eda32de95"}
Jul 21 02:02:52.413032 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:02:52.412874    2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59f25a1b6fa9100e39d106d5cad2484b1834b14fe12121c1164e312eda32de95"
Jul 21 02:03:06.203355 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:06.203316    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:03:06.787640 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:06.787600    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-50f51c-zbh57"]
Jul 21 02:03:06.790340 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:06.790311    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-50f51c-zbh57"]
Jul 21 02:03:07.308758 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:07.308721    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0733c9f9-db31-42ec-b143-d11c5d5270b0" path="/var/lib/kubelet/pods/0733c9f9-db31-42ec-b143-d11c5d5270b0/volumes"
Jul 21 02:03:24.407821 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:24.407787    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:03:40.534050 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:40.534011    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:03:45.698815 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.698771    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"]
Jul 21 02:03:45.699650 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.699237    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0733c9f9-db31-42ec-b143-d11c5d5270b0" containerName="revoke-keys"
Jul 21 02:03:45.699650 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.699251    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="0733c9f9-db31-42ec-b143-d11c5d5270b0" containerName="revoke-keys"
Jul 21 02:03:45.699650 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.699379    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="0733c9f9-db31-42ec-b143-d11c5d5270b0" containerName="revoke-keys"
Jul 21 02:03:45.702676 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.702658    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"
Jul 21 02:03:45.705423 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.705400    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0dfbd0\"/\"auth-test-model-0dfbd0-kserve-self-signed-certs\""
Jul 21 02:03:45.705543 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.705400    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0dfbd0\"/\"kube-root-ca.crt\""
Jul 21 02:03:45.705543 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.705452    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0dfbd0\"/\"default-dockercfg-cmzrz\""
Jul 21 02:03:45.705651 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.705551    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0dfbd0\"/\"openshift-service-ca.crt\""
Jul 21 02:03:45.716300 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.716270    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"]
Jul 21 02:03:45.727546 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.727507    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5d562a6-cc9e-422d-939c-eb0df0287084-model-cache\") pod \"auth-test-model-0dfbd0-kserve-f8d4c79f-892x7\" (UID: \"a5d562a6-cc9e-422d-939c-eb0df0287084\") " pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"
Jul 21 02:03:45.727718 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.727557    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpf88\" (UniqueName: \"kubernetes.io/projected/a5d562a6-cc9e-422d-939c-eb0df0287084-kube-api-access-lpf88\") pod \"auth-test-model-0dfbd0-kserve-f8d4c79f-892x7\" (UID: \"a5d562a6-cc9e-422d-939c-eb0df0287084\") " pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"
Jul 21 02:03:45.727718 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.727671    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5d562a6-cc9e-422d-939c-eb0df0287084-tls-certs\") pod \"auth-test-model-0dfbd0-kserve-f8d4c79f-892x7\" (UID: \"a5d562a6-cc9e-422d-939c-eb0df0287084\") " pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"
Jul 21 02:03:45.727718 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.727704    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5d562a6-cc9e-422d-939c-eb0df0287084-home\") pod \"auth-test-model-0dfbd0-kserve-f8d4c79f-892x7\" (UID: \"a5d562a6-cc9e-422d-939c-eb0df0287084\") " pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"
Jul 21 02:03:45.727825 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.727807    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5d562a6-cc9e-422d-939c-eb0df0287084-dshm\") pod \"auth-test-model-0dfbd0-kserve-f8d4c79f-892x7\" (UID: \"a5d562a6-cc9e-422d-939c-eb0df0287084\") " pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"
Jul 21 02:03:45.727866 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.727848    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5d562a6-cc9e-422d-939c-eb0df0287084-tmp-dir\") pod \"auth-test-model-0dfbd0-kserve-f8d4c79f-892x7\" (UID: \"a5d562a6-cc9e-422d-939c-eb0df0287084\") " pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"
Jul 21 02:03:45.829310 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.829270    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5d562a6-cc9e-422d-939c-eb0df0287084-tmp-dir\") pod \"auth-test-model-0dfbd0-kserve-f8d4c79f-892x7\" (UID: \"a5d562a6-cc9e-422d-939c-eb0df0287084\") " pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"
Jul 21 02:03:45.829516 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.829323    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5d562a6-cc9e-422d-939c-eb0df0287084-model-cache\") pod \"auth-test-model-0dfbd0-kserve-f8d4c79f-892x7\" (UID: \"a5d562a6-cc9e-422d-939c-eb0df0287084\") " pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"
Jul 21 02:03:45.829516 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.829340    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpf88\" (UniqueName: \"kubernetes.io/projected/a5d562a6-cc9e-422d-939c-eb0df0287084-kube-api-access-lpf88\") pod \"auth-test-model-0dfbd0-kserve-f8d4c79f-892x7\" (UID: \"a5d562a6-cc9e-422d-939c-eb0df0287084\") " pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"
Jul 21 02:03:45.829516 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.829380    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5d562a6-cc9e-422d-939c-eb0df0287084-tls-certs\") pod \"auth-test-model-0dfbd0-kserve-f8d4c79f-892x7\" (UID: \"a5d562a6-cc9e-422d-939c-eb0df0287084\") " pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"
Jul 21 02:03:45.829516 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.829399    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5d562a6-cc9e-422d-939c-eb0df0287084-home\") pod \"auth-test-model-0dfbd0-kserve-f8d4c79f-892x7\" (UID: \"a5d562a6-cc9e-422d-939c-eb0df0287084\") " pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"
Jul 21 02:03:45.829516 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.829434    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5d562a6-cc9e-422d-939c-eb0df0287084-dshm\") pod \"auth-test-model-0dfbd0-kserve-f8d4c79f-892x7\" (UID: \"a5d562a6-cc9e-422d-939c-eb0df0287084\") " pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"
Jul 21 02:03:45.829791 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.829721    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5d562a6-cc9e-422d-939c-eb0df0287084-model-cache\") pod \"auth-test-model-0dfbd0-kserve-f8d4c79f-892x7\" (UID: \"a5d562a6-cc9e-422d-939c-eb0df0287084\") " pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"
Jul 21 02:03:45.829791 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.829780    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5d562a6-cc9e-422d-939c-eb0df0287084-tmp-dir\") pod \"auth-test-model-0dfbd0-kserve-f8d4c79f-892x7\" (UID: \"a5d562a6-cc9e-422d-939c-eb0df0287084\") " pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"
Jul 21 02:03:45.829875 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.829801    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5d562a6-cc9e-422d-939c-eb0df0287084-home\") pod \"auth-test-model-0dfbd0-kserve-f8d4c79f-892x7\" (UID: \"a5d562a6-cc9e-422d-939c-eb0df0287084\") " pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"
Jul 21 02:03:45.831838 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.831820    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5d562a6-cc9e-422d-939c-eb0df0287084-dshm\") pod \"auth-test-model-0dfbd0-kserve-f8d4c79f-892x7\" (UID: \"a5d562a6-cc9e-422d-939c-eb0df0287084\") " pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"
Jul 21 02:03:45.832128 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.832112    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5d562a6-cc9e-422d-939c-eb0df0287084-tls-certs\") pod \"auth-test-model-0dfbd0-kserve-f8d4c79f-892x7\" (UID: \"a5d562a6-cc9e-422d-939c-eb0df0287084\") " pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"
Jul 21 02:03:45.841784 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:45.841755    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpf88\" (UniqueName: \"kubernetes.io/projected/a5d562a6-cc9e-422d-939c-eb0df0287084-kube-api-access-lpf88\") pod \"auth-test-model-0dfbd0-kserve-f8d4c79f-892x7\" (UID: \"a5d562a6-cc9e-422d-939c-eb0df0287084\") " pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"
Jul 21 02:03:46.011818 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:46.011727    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"
Jul 21 02:03:46.160668 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:46.160638    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"]
Jul 21 02:03:46.162893 ip-10-0-131-213 kubenswrapper[2586]: W0721 02:03:46.162867    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5d562a6_cc9e_422d_939c_eb0df0287084.slice/crio-ac28513f7316e559002bfd116a9e6ed2027a59b8329fae5e1724579e1288c5b4 WatchSource:0}: Error finding container ac28513f7316e559002bfd116a9e6ed2027a59b8329fae5e1724579e1288c5b4: Status 404 returned error can't find the container with id ac28513f7316e559002bfd116a9e6ed2027a59b8329fae5e1724579e1288c5b4
Jul 21 02:03:46.689843 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:46.689805    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7" event={"ID":"a5d562a6-cc9e-422d-939c-eb0df0287084","Type":"ContainerStarted","Data":"d292a620cf99290ae41091bc4289c877c124059882a91ddbfe5e716db60e31e4"}
Jul 21 02:03:46.689843 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:46.689849    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7" event={"ID":"a5d562a6-cc9e-422d-939c-eb0df0287084","Type":"ContainerStarted","Data":"ac28513f7316e559002bfd116a9e6ed2027a59b8329fae5e1724579e1288c5b4"}
Jul 21 02:03:46.706910 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:46.706853    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7" podStartSLOduration=1.706829394 podStartE2EDuration="1.706829394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:03:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:03:46.705812367 +0000 UTC m=+2485.893851758" watchObservedRunningTime="2026-07-21 02:03:46.706829394 +0000 UTC m=+2485.894868776"
Jul 21 02:03:50.400011 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:50.399968    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:03:56.012730 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:56.012669    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"
Jul 21 02:03:56.012730 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:56.012745    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"
Jul 21 02:03:56.025181 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:56.025154    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"
Jul 21 02:03:56.750502 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:03:56.750472    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"
Jul 21 02:04:10.310257 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.310222    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"]
Jul 21 02:04:10.313989 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.313967    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"
Jul 21 02:04:10.322540 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.322512    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a256ec\"/\"default-dockercfg-dgtp4\""
Jul 21 02:04:10.322683 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.322562    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a256ec\"/\"kube-root-ca.crt\""
Jul 21 02:04:10.322683 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.322563    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a256ec\"/\"auth-test-model-a256ec-kserve-self-signed-certs\""
Jul 21 02:04:10.323954 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.323916    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a256ec\"/\"openshift-service-ca.crt\""
Jul 21 02:04:10.335733 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.335695    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"]
Jul 21 02:04:10.380544 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.380511    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05718c94-ce86-4e3b-a490-c01ba27b4c2f-dshm\") pod \"auth-test-model-a256ec-kserve-df9dc9767-86nxw\" (UID: \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\") " pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"
Jul 21 02:04:10.380730 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.380566    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05718c94-ce86-4e3b-a490-c01ba27b4c2f-tls-certs\") pod \"auth-test-model-a256ec-kserve-df9dc9767-86nxw\" (UID: \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\") " pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"
Jul 21 02:04:10.380730 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.380594    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05718c94-ce86-4e3b-a490-c01ba27b4c2f-model-cache\") pod \"auth-test-model-a256ec-kserve-df9dc9767-86nxw\" (UID: \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\") " pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"
Jul 21 02:04:10.380730 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.380657    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05718c94-ce86-4e3b-a490-c01ba27b4c2f-home\") pod \"auth-test-model-a256ec-kserve-df9dc9767-86nxw\" (UID: \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\") " pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"
Jul 21 02:04:10.380730 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.380708    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6dfk\" (UniqueName: \"kubernetes.io/projected/05718c94-ce86-4e3b-a490-c01ba27b4c2f-kube-api-access-c6dfk\") pod \"auth-test-model-a256ec-kserve-df9dc9767-86nxw\" (UID: \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\") " pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"
Jul 21 02:04:10.380917 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.380794    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05718c94-ce86-4e3b-a490-c01ba27b4c2f-tmp-dir\") pod \"auth-test-model-a256ec-kserve-df9dc9767-86nxw\" (UID: \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\") " pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"
Jul 21 02:04:10.481208 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.481175    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05718c94-ce86-4e3b-a490-c01ba27b4c2f-home\") pod \"auth-test-model-a256ec-kserve-df9dc9767-86nxw\" (UID: \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\") " pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"
Jul 21 02:04:10.481404 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.481229    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6dfk\" (UniqueName: \"kubernetes.io/projected/05718c94-ce86-4e3b-a490-c01ba27b4c2f-kube-api-access-c6dfk\") pod \"auth-test-model-a256ec-kserve-df9dc9767-86nxw\" (UID: \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\") " pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"
Jul 21 02:04:10.481404 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.481301    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05718c94-ce86-4e3b-a490-c01ba27b4c2f-tmp-dir\") pod \"auth-test-model-a256ec-kserve-df9dc9767-86nxw\" (UID: \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\") " pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"
Jul 21 02:04:10.481404 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.481333    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05718c94-ce86-4e3b-a490-c01ba27b4c2f-dshm\") pod \"auth-test-model-a256ec-kserve-df9dc9767-86nxw\" (UID: \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\") " pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"
Jul 21 02:04:10.481404 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.481370    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05718c94-ce86-4e3b-a490-c01ba27b4c2f-tls-certs\") pod \"auth-test-model-a256ec-kserve-df9dc9767-86nxw\" (UID: \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\") " pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"
Jul 21 02:04:10.481404 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.481393    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05718c94-ce86-4e3b-a490-c01ba27b4c2f-model-cache\") pod \"auth-test-model-a256ec-kserve-df9dc9767-86nxw\" (UID: \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\") " pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"
Jul 21 02:04:10.481634 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.481611    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05718c94-ce86-4e3b-a490-c01ba27b4c2f-home\") pod \"auth-test-model-a256ec-kserve-df9dc9767-86nxw\" (UID: \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\") " pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"
Jul 21 02:04:10.481715 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.481690    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05718c94-ce86-4e3b-a490-c01ba27b4c2f-tmp-dir\") pod \"auth-test-model-a256ec-kserve-df9dc9767-86nxw\" (UID: \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\") " pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"
Jul 21 02:04:10.481829 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.481791    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05718c94-ce86-4e3b-a490-c01ba27b4c2f-model-cache\") pod \"auth-test-model-a256ec-kserve-df9dc9767-86nxw\" (UID: \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\") " pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"
Jul 21 02:04:10.483743 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.483722    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05718c94-ce86-4e3b-a490-c01ba27b4c2f-dshm\") pod \"auth-test-model-a256ec-kserve-df9dc9767-86nxw\" (UID: \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\") " pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"
Jul 21 02:04:10.484051 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.484029    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05718c94-ce86-4e3b-a490-c01ba27b4c2f-tls-certs\") pod \"auth-test-model-a256ec-kserve-df9dc9767-86nxw\" (UID: \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\") " pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"
Jul 21 02:04:10.488988 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.488961    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6dfk\" (UniqueName: \"kubernetes.io/projected/05718c94-ce86-4e3b-a490-c01ba27b4c2f-kube-api-access-c6dfk\") pod \"auth-test-model-a256ec-kserve-df9dc9767-86nxw\" (UID: \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\") " pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"
Jul 21 02:04:10.624035 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.623996    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"
Jul 21 02:04:10.771163 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.771135    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"]
Jul 21 02:04:10.774242 ip-10-0-131-213 kubenswrapper[2586]: W0721 02:04:10.774215    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05718c94_ce86_4e3b_a490_c01ba27b4c2f.slice/crio-bbb3b08b399634592bccfeee261344a9467210a776b7e8e5abc3dbe03beca53e WatchSource:0}: Error finding container bbb3b08b399634592bccfeee261344a9467210a776b7e8e5abc3dbe03beca53e: Status 404 returned error can't find the container with id bbb3b08b399634592bccfeee261344a9467210a776b7e8e5abc3dbe03beca53e
Jul 21 02:04:10.817737 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:10.817708    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw" event={"ID":"05718c94-ce86-4e3b-a490-c01ba27b4c2f","Type":"ContainerStarted","Data":"bbb3b08b399634592bccfeee261344a9467210a776b7e8e5abc3dbe03beca53e"}
Jul 21 02:04:11.824274 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:11.824189    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw" event={"ID":"05718c94-ce86-4e3b-a490-c01ba27b4c2f","Type":"ContainerStarted","Data":"e8415e2971de754c0a58d3a8cd678dd113cc16aeb7396b9f37416b3ac25c1ec0"}
Jul 21 02:04:11.849301 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:11.849234    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw" podStartSLOduration=1.849217163 podStartE2EDuration="1.849217163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:04:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:04:11.847483812 +0000 UTC m=+2511.035523203" watchObservedRunningTime="2026-07-21 02:04:11.849217163 +0000 UTC m=+2511.037256555"
Jul 21 02:04:14.376889 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:14.376849    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:04:20.625161 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:20.625112    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"
Jul 21 02:04:20.625576 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:20.625189    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"
Jul 21 02:04:20.638216 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:20.638181    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"
Jul 21 02:04:20.880723 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:20.880630    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"
Jul 21 02:04:53.404163 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:04:53.404121    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:05:12.099887 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:05:12.099849    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:05:31.803357 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:05:31.803315    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:05:46.894487 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:05:46.894392    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:06:06.209991 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:06.209953    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:06:23.112810 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:23.112772    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:06:37.001385 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:37.001339    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:06:42.347464 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:42.347422    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"]
Jul 21 02:06:43.286979 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:43.283660    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"]
Jul 21 02:06:53.323398 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:53.323360    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:06:57.368314 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.368278    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7" podUID="a5d562a6-cc9e-422d-939c-eb0df0287084" containerName="main" containerID="cri-o://d292a620cf99290ae41091bc4289c877c124059882a91ddbfe5e716db60e31e4" gracePeriod=45
Jul 21 02:06:57.626358 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.626295    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"
Jul 21 02:06:57.669536 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.669499    2586 generic.go:356] "Generic (PLEG): container finished" podID="a5d562a6-cc9e-422d-939c-eb0df0287084" containerID="d292a620cf99290ae41091bc4289c877c124059882a91ddbfe5e716db60e31e4" exitCode=0
Jul 21 02:06:57.669730 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.669549    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"
Jul 21 02:06:57.669730 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.669562    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7" event={"ID":"a5d562a6-cc9e-422d-939c-eb0df0287084","Type":"ContainerDied","Data":"d292a620cf99290ae41091bc4289c877c124059882a91ddbfe5e716db60e31e4"}
Jul 21 02:06:57.669730 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.669603    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7" event={"ID":"a5d562a6-cc9e-422d-939c-eb0df0287084","Type":"ContainerDied","Data":"ac28513f7316e559002bfd116a9e6ed2027a59b8329fae5e1724579e1288c5b4"}
Jul 21 02:06:57.669730 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.669627    2586 scope.go:117] "RemoveContainer" containerID="d292a620cf99290ae41091bc4289c877c124059882a91ddbfe5e716db60e31e4"
Jul 21 02:06:57.679274 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.679253    2586 scope.go:117] "RemoveContainer" containerID="d292a620cf99290ae41091bc4289c877c124059882a91ddbfe5e716db60e31e4"
Jul 21 02:06:57.679626 ip-10-0-131-213 kubenswrapper[2586]: E0721 02:06:57.679599    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d292a620cf99290ae41091bc4289c877c124059882a91ddbfe5e716db60e31e4\": container with ID starting with d292a620cf99290ae41091bc4289c877c124059882a91ddbfe5e716db60e31e4 not found: ID does not exist" containerID="d292a620cf99290ae41091bc4289c877c124059882a91ddbfe5e716db60e31e4"
Jul 21 02:06:57.679737 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.679634    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d292a620cf99290ae41091bc4289c877c124059882a91ddbfe5e716db60e31e4"} err="failed to get container status \"d292a620cf99290ae41091bc4289c877c124059882a91ddbfe5e716db60e31e4\": rpc error: code = NotFound desc = could not find container \"d292a620cf99290ae41091bc4289c877c124059882a91ddbfe5e716db60e31e4\": container with ID starting with d292a620cf99290ae41091bc4289c877c124059882a91ddbfe5e716db60e31e4 not found: ID does not exist"
Jul 21 02:06:57.724827 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.724787    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5d562a6-cc9e-422d-939c-eb0df0287084-home\") pod \"a5d562a6-cc9e-422d-939c-eb0df0287084\" (UID: \"a5d562a6-cc9e-422d-939c-eb0df0287084\") "
Jul 21 02:06:57.725054 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.724879    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5d562a6-cc9e-422d-939c-eb0df0287084-tls-certs\") pod \"a5d562a6-cc9e-422d-939c-eb0df0287084\" (UID: \"a5d562a6-cc9e-422d-939c-eb0df0287084\") "
Jul 21 02:06:57.725054 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.724960    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5d562a6-cc9e-422d-939c-eb0df0287084-dshm\") pod \"a5d562a6-cc9e-422d-939c-eb0df0287084\" (UID: \"a5d562a6-cc9e-422d-939c-eb0df0287084\") "
Jul 21 02:06:57.725054 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.725022    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpf88\" (UniqueName: \"kubernetes.io/projected/a5d562a6-cc9e-422d-939c-eb0df0287084-kube-api-access-lpf88\") pod \"a5d562a6-cc9e-422d-939c-eb0df0287084\" (UID: \"a5d562a6-cc9e-422d-939c-eb0df0287084\") "
Jul 21 02:06:57.725219 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.725054    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5d562a6-cc9e-422d-939c-eb0df0287084-model-cache\") pod \"a5d562a6-cc9e-422d-939c-eb0df0287084\" (UID: \"a5d562a6-cc9e-422d-939c-eb0df0287084\") "
Jul 21 02:06:57.725219 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.725087    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5d562a6-cc9e-422d-939c-eb0df0287084-tmp-dir\") pod \"a5d562a6-cc9e-422d-939c-eb0df0287084\" (UID: \"a5d562a6-cc9e-422d-939c-eb0df0287084\") "
Jul 21 02:06:57.725219 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.725141    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5d562a6-cc9e-422d-939c-eb0df0287084-home" (OuterVolumeSpecName: "home") pod "a5d562a6-cc9e-422d-939c-eb0df0287084" (UID: "a5d562a6-cc9e-422d-939c-eb0df0287084"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:06:57.725363 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.725335    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5d562a6-cc9e-422d-939c-eb0df0287084-model-cache" (OuterVolumeSpecName: "model-cache") pod "a5d562a6-cc9e-422d-939c-eb0df0287084" (UID: "a5d562a6-cc9e-422d-939c-eb0df0287084"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:06:57.725406 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.725381    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5d562a6-cc9e-422d-939c-eb0df0287084-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a5d562a6-cc9e-422d-939c-eb0df0287084" (UID: "a5d562a6-cc9e-422d-939c-eb0df0287084"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:06:57.725463 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.725443    2586 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5d562a6-cc9e-422d-939c-eb0df0287084-model-cache\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:06:57.725514 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.725461    2586 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5d562a6-cc9e-422d-939c-eb0df0287084-home\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:06:57.727380 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.727356    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5d562a6-cc9e-422d-939c-eb0df0287084-dshm" (OuterVolumeSpecName: "dshm") pod "a5d562a6-cc9e-422d-939c-eb0df0287084" (UID: "a5d562a6-cc9e-422d-939c-eb0df0287084"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:06:57.727511 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.727488    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5d562a6-cc9e-422d-939c-eb0df0287084-kube-api-access-lpf88" (OuterVolumeSpecName: "kube-api-access-lpf88") pod "a5d562a6-cc9e-422d-939c-eb0df0287084" (UID: "a5d562a6-cc9e-422d-939c-eb0df0287084"). InnerVolumeSpecName "kube-api-access-lpf88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:06:57.727606 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.727528    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5d562a6-cc9e-422d-939c-eb0df0287084-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a5d562a6-cc9e-422d-939c-eb0df0287084" (UID: "a5d562a6-cc9e-422d-939c-eb0df0287084"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:06:57.826648 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.826611    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpf88\" (UniqueName: \"kubernetes.io/projected/a5d562a6-cc9e-422d-939c-eb0df0287084-kube-api-access-lpf88\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:06:57.826648 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.826644    2586 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5d562a6-cc9e-422d-939c-eb0df0287084-tmp-dir\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:06:57.826648 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.826654    2586 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5d562a6-cc9e-422d-939c-eb0df0287084-tls-certs\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:06:57.826887 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.826661    2586 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5d562a6-cc9e-422d-939c-eb0df0287084-dshm\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:06:57.992731 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.992699    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"]
Jul 21 02:06:57.997218 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:57.997191    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0dfbd0/auth-test-model-0dfbd0-kserve-f8d4c79f-892x7"]
Jul 21 02:06:58.315468 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.315346    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw" podUID="05718c94-ce86-4e3b-a490-c01ba27b4c2f" containerName="main" containerID="cri-o://e8415e2971de754c0a58d3a8cd678dd113cc16aeb7396b9f37416b3ac25c1ec0" gracePeriod=45
Jul 21 02:06:58.575008 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.574920    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"
Jul 21 02:06:58.634427 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.634387    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05718c94-ce86-4e3b-a490-c01ba27b4c2f-model-cache\") pod \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\" (UID: \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\") "
Jul 21 02:06:58.634614 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.634457    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05718c94-ce86-4e3b-a490-c01ba27b4c2f-tls-certs\") pod \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\" (UID: \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\") "
Jul 21 02:06:58.634614 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.634482    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05718c94-ce86-4e3b-a490-c01ba27b4c2f-tmp-dir\") pod \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\" (UID: \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\") "
Jul 21 02:06:58.634614 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.634511    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05718c94-ce86-4e3b-a490-c01ba27b4c2f-dshm\") pod \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\" (UID: \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\") "
Jul 21 02:06:58.634614 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.634549    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6dfk\" (UniqueName: \"kubernetes.io/projected/05718c94-ce86-4e3b-a490-c01ba27b4c2f-kube-api-access-c6dfk\") pod \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\" (UID: \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\") "
Jul 21 02:06:58.634614 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.634611    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05718c94-ce86-4e3b-a490-c01ba27b4c2f-home\") pod \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\" (UID: \"05718c94-ce86-4e3b-a490-c01ba27b4c2f\") "
Jul 21 02:06:58.634875 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.634697    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05718c94-ce86-4e3b-a490-c01ba27b4c2f-model-cache" (OuterVolumeSpecName: "model-cache") pod "05718c94-ce86-4e3b-a490-c01ba27b4c2f" (UID: "05718c94-ce86-4e3b-a490-c01ba27b4c2f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:06:58.634875 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.634781    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05718c94-ce86-4e3b-a490-c01ba27b4c2f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "05718c94-ce86-4e3b-a490-c01ba27b4c2f" (UID: "05718c94-ce86-4e3b-a490-c01ba27b4c2f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:06:58.635025 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.634976    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05718c94-ce86-4e3b-a490-c01ba27b4c2f-home" (OuterVolumeSpecName: "home") pod "05718c94-ce86-4e3b-a490-c01ba27b4c2f" (UID: "05718c94-ce86-4e3b-a490-c01ba27b4c2f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:06:58.635075 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.635060    2586 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05718c94-ce86-4e3b-a490-c01ba27b4c2f-tmp-dir\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:06:58.635121 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.635081    2586 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05718c94-ce86-4e3b-a490-c01ba27b4c2f-model-cache\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:06:58.636997 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.636972    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05718c94-ce86-4e3b-a490-c01ba27b4c2f-dshm" (OuterVolumeSpecName: "dshm") pod "05718c94-ce86-4e3b-a490-c01ba27b4c2f" (UID: "05718c94-ce86-4e3b-a490-c01ba27b4c2f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:06:58.637120 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.637047    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05718c94-ce86-4e3b-a490-c01ba27b4c2f-kube-api-access-c6dfk" (OuterVolumeSpecName: "kube-api-access-c6dfk") pod "05718c94-ce86-4e3b-a490-c01ba27b4c2f" (UID: "05718c94-ce86-4e3b-a490-c01ba27b4c2f"). InnerVolumeSpecName "kube-api-access-c6dfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:06:58.637163 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.637131    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05718c94-ce86-4e3b-a490-c01ba27b4c2f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "05718c94-ce86-4e3b-a490-c01ba27b4c2f" (UID: "05718c94-ce86-4e3b-a490-c01ba27b4c2f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:06:58.676134 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.676096    2586 generic.go:356] "Generic (PLEG): container finished" podID="05718c94-ce86-4e3b-a490-c01ba27b4c2f" containerID="e8415e2971de754c0a58d3a8cd678dd113cc16aeb7396b9f37416b3ac25c1ec0" exitCode=0
Jul 21 02:06:58.676323 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.676149    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"
Jul 21 02:06:58.676323 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.676157    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw" event={"ID":"05718c94-ce86-4e3b-a490-c01ba27b4c2f","Type":"ContainerDied","Data":"e8415e2971de754c0a58d3a8cd678dd113cc16aeb7396b9f37416b3ac25c1ec0"}
Jul 21 02:06:58.676323 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.676204    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw" event={"ID":"05718c94-ce86-4e3b-a490-c01ba27b4c2f","Type":"ContainerDied","Data":"bbb3b08b399634592bccfeee261344a9467210a776b7e8e5abc3dbe03beca53e"}
Jul 21 02:06:58.676323 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.676223    2586 scope.go:117] "RemoveContainer" containerID="e8415e2971de754c0a58d3a8cd678dd113cc16aeb7396b9f37416b3ac25c1ec0"
Jul 21 02:06:58.686058 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.686036    2586 scope.go:117] "RemoveContainer" containerID="e8415e2971de754c0a58d3a8cd678dd113cc16aeb7396b9f37416b3ac25c1ec0"
Jul 21 02:06:58.686357 ip-10-0-131-213 kubenswrapper[2586]: E0721 02:06:58.686334    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8415e2971de754c0a58d3a8cd678dd113cc16aeb7396b9f37416b3ac25c1ec0\": container with ID starting with e8415e2971de754c0a58d3a8cd678dd113cc16aeb7396b9f37416b3ac25c1ec0 not found: ID does not exist" containerID="e8415e2971de754c0a58d3a8cd678dd113cc16aeb7396b9f37416b3ac25c1ec0"
Jul 21 02:06:58.686420 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.686367    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8415e2971de754c0a58d3a8cd678dd113cc16aeb7396b9f37416b3ac25c1ec0"} err="failed to get container status \"e8415e2971de754c0a58d3a8cd678dd113cc16aeb7396b9f37416b3ac25c1ec0\": rpc error: code = NotFound desc = could not find container \"e8415e2971de754c0a58d3a8cd678dd113cc16aeb7396b9f37416b3ac25c1ec0\": container with ID starting with e8415e2971de754c0a58d3a8cd678dd113cc16aeb7396b9f37416b3ac25c1ec0 not found: ID does not exist"
Jul 21 02:06:58.698295 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.698268    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"]
Jul 21 02:06:58.701966 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.701921    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a256ec/auth-test-model-a256ec-kserve-df9dc9767-86nxw"]
Jul 21 02:06:58.736019 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.735986    2586 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05718c94-ce86-4e3b-a490-c01ba27b4c2f-dshm\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:06:58.736019 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.736019    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6dfk\" (UniqueName: \"kubernetes.io/projected/05718c94-ce86-4e3b-a490-c01ba27b4c2f-kube-api-access-c6dfk\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:06:58.736222 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.736031    2586 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05718c94-ce86-4e3b-a490-c01ba27b4c2f-home\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:06:58.736222 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:58.736041    2586 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05718c94-ce86-4e3b-a490-c01ba27b4c2f-tls-certs\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:06:59.309457 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:59.309423    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05718c94-ce86-4e3b-a490-c01ba27b4c2f" path="/var/lib/kubelet/pods/05718c94-ce86-4e3b-a490-c01ba27b4c2f/volumes"
Jul 21 02:06:59.309831 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:06:59.309817    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5d562a6-cc9e-422d-939c-eb0df0287084" path="/var/lib/kubelet/pods/a5d562a6-cc9e-422d-939c-eb0df0287084/volumes"
Jul 21 02:07:00.898197 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:00.898162    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"]
Jul 21 02:07:00.898648 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:00.898548    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5d562a6-cc9e-422d-939c-eb0df0287084" containerName="main"
Jul 21 02:07:00.898648 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:00.898558    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5d562a6-cc9e-422d-939c-eb0df0287084" containerName="main"
Jul 21 02:07:00.898648 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:00.898566    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05718c94-ce86-4e3b-a490-c01ba27b4c2f" containerName="main"
Jul 21 02:07:00.898648 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:00.898572    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="05718c94-ce86-4e3b-a490-c01ba27b4c2f" containerName="main"
Jul 21 02:07:00.898648 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:00.898643    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="05718c94-ce86-4e3b-a490-c01ba27b4c2f" containerName="main"
Jul 21 02:07:00.898648 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:00.898651    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5d562a6-cc9e-422d-939c-eb0df0287084" containerName="main"
Jul 21 02:07:00.903117 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:00.903098    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"
Jul 21 02:07:00.905685 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:00.905622    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0dfbd0\"/\"default-dockercfg-cmzrz\""
Jul 21 02:07:00.905685 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:00.905652    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0dfbd0\"/\"kube-root-ca.crt\""
Jul 21 02:07:00.905858 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:00.905698    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0dfbd0\"/\"openshift-service-ca.crt\""
Jul 21 02:07:00.905858 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:00.905622    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0dfbd0\"/\"sub-test-model-0dfbd0-kserve-self-signed-certs\""
Jul 21 02:07:00.910837 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:00.910811    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"]
Jul 21 02:07:01.058501 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:01.058460    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr2th\" (UniqueName: \"kubernetes.io/projected/ebd49318-73d5-41e4-a6da-89dff86518f8-kube-api-access-tr2th\") pod \"sub-test-model-0dfbd0-kserve-67854f999-m7w52\" (UID: \"ebd49318-73d5-41e4-a6da-89dff86518f8\") " pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"
Jul 21 02:07:01.058685 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:01.058536    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebd49318-73d5-41e4-a6da-89dff86518f8-tls-certs\") pod \"sub-test-model-0dfbd0-kserve-67854f999-m7w52\" (UID: \"ebd49318-73d5-41e4-a6da-89dff86518f8\") " pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"
Jul 21 02:07:01.058685 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:01.058579    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebd49318-73d5-41e4-a6da-89dff86518f8-model-cache\") pod \"sub-test-model-0dfbd0-kserve-67854f999-m7w52\" (UID: \"ebd49318-73d5-41e4-a6da-89dff86518f8\") " pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"
Jul 21 02:07:01.058685 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:01.058616    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebd49318-73d5-41e4-a6da-89dff86518f8-dshm\") pod \"sub-test-model-0dfbd0-kserve-67854f999-m7w52\" (UID: \"ebd49318-73d5-41e4-a6da-89dff86518f8\") " pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"
Jul 21 02:07:01.058685 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:01.058645    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebd49318-73d5-41e4-a6da-89dff86518f8-tmp-dir\") pod \"sub-test-model-0dfbd0-kserve-67854f999-m7w52\" (UID: \"ebd49318-73d5-41e4-a6da-89dff86518f8\") " pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"
Jul 21 02:07:01.058685 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:01.058670    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebd49318-73d5-41e4-a6da-89dff86518f8-home\") pod \"sub-test-model-0dfbd0-kserve-67854f999-m7w52\" (UID: \"ebd49318-73d5-41e4-a6da-89dff86518f8\") " pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"
Jul 21 02:07:01.159372 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:01.159280    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebd49318-73d5-41e4-a6da-89dff86518f8-tmp-dir\") pod \"sub-test-model-0dfbd0-kserve-67854f999-m7w52\" (UID: \"ebd49318-73d5-41e4-a6da-89dff86518f8\") " pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"
Jul 21 02:07:01.159372 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:01.159324    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebd49318-73d5-41e4-a6da-89dff86518f8-home\") pod \"sub-test-model-0dfbd0-kserve-67854f999-m7w52\" (UID: \"ebd49318-73d5-41e4-a6da-89dff86518f8\") " pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"
Jul 21 02:07:01.159538 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:01.159375    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr2th\" (UniqueName: \"kubernetes.io/projected/ebd49318-73d5-41e4-a6da-89dff86518f8-kube-api-access-tr2th\") pod \"sub-test-model-0dfbd0-kserve-67854f999-m7w52\" (UID: \"ebd49318-73d5-41e4-a6da-89dff86518f8\") " pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"
Jul 21 02:07:01.159538 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:01.159427    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebd49318-73d5-41e4-a6da-89dff86518f8-tls-certs\") pod \"sub-test-model-0dfbd0-kserve-67854f999-m7w52\" (UID: \"ebd49318-73d5-41e4-a6da-89dff86518f8\") " pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"
Jul 21 02:07:01.159538 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:01.159469    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebd49318-73d5-41e4-a6da-89dff86518f8-model-cache\") pod \"sub-test-model-0dfbd0-kserve-67854f999-m7w52\" (UID: \"ebd49318-73d5-41e4-a6da-89dff86518f8\") " pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"
Jul 21 02:07:01.159659 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:01.159579    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebd49318-73d5-41e4-a6da-89dff86518f8-dshm\") pod \"sub-test-model-0dfbd0-kserve-67854f999-m7w52\" (UID: \"ebd49318-73d5-41e4-a6da-89dff86518f8\") " pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"
Jul 21 02:07:01.159791 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:01.159771    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebd49318-73d5-41e4-a6da-89dff86518f8-tmp-dir\") pod \"sub-test-model-0dfbd0-kserve-67854f999-m7w52\" (UID: \"ebd49318-73d5-41e4-a6da-89dff86518f8\") " pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"
Jul 21 02:07:01.159864 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:01.159798    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebd49318-73d5-41e4-a6da-89dff86518f8-home\") pod \"sub-test-model-0dfbd0-kserve-67854f999-m7w52\" (UID: \"ebd49318-73d5-41e4-a6da-89dff86518f8\") " pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"
Jul 21 02:07:01.159864 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:01.159842    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebd49318-73d5-41e4-a6da-89dff86518f8-model-cache\") pod \"sub-test-model-0dfbd0-kserve-67854f999-m7w52\" (UID: \"ebd49318-73d5-41e4-a6da-89dff86518f8\") " pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"
Jul 21 02:07:01.161967 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:01.161917    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebd49318-73d5-41e4-a6da-89dff86518f8-dshm\") pod \"sub-test-model-0dfbd0-kserve-67854f999-m7w52\" (UID: \"ebd49318-73d5-41e4-a6da-89dff86518f8\") " pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"
Jul 21 02:07:01.162109 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:01.162089    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebd49318-73d5-41e4-a6da-89dff86518f8-tls-certs\") pod \"sub-test-model-0dfbd0-kserve-67854f999-m7w52\" (UID: \"ebd49318-73d5-41e4-a6da-89dff86518f8\") " pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"
Jul 21 02:07:01.167321 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:01.167302    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr2th\" (UniqueName: \"kubernetes.io/projected/ebd49318-73d5-41e4-a6da-89dff86518f8-kube-api-access-tr2th\") pod \"sub-test-model-0dfbd0-kserve-67854f999-m7w52\" (UID: \"ebd49318-73d5-41e4-a6da-89dff86518f8\") " pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"
Jul 21 02:07:01.213905 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:01.213864    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"
Jul 21 02:07:01.360612 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:01.360585    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"]
Jul 21 02:07:01.363143 ip-10-0-131-213 kubenswrapper[2586]: W0721 02:07:01.363114    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podebd49318_73d5_41e4_a6da_89dff86518f8.slice/crio-2c4ff967da1f6c6d3bae4bc6499c706f4844e9d47d60aa4e607451a0ca047633 WatchSource:0}: Error finding container 2c4ff967da1f6c6d3bae4bc6499c706f4844e9d47d60aa4e607451a0ca047633: Status 404 returned error can't find the container with id 2c4ff967da1f6c6d3bae4bc6499c706f4844e9d47d60aa4e607451a0ca047633
Jul 21 02:07:01.696146 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:01.696033    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52" event={"ID":"ebd49318-73d5-41e4-a6da-89dff86518f8","Type":"ContainerStarted","Data":"df6fe242436983742e8acb554314d999176fe88fbc81e7fa1e50a3b7e68422b1"}
Jul 21 02:07:01.696146 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:01.696077    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52" event={"ID":"ebd49318-73d5-41e4-a6da-89dff86518f8","Type":"ContainerStarted","Data":"2c4ff967da1f6c6d3bae4bc6499c706f4844e9d47d60aa4e607451a0ca047633"}
Jul 21 02:07:01.713142 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:01.713089    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52" podStartSLOduration=1.71307088 podStartE2EDuration="1.71307088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:07:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:07:01.711208535 +0000 UTC m=+2680.899247924" watchObservedRunningTime="2026-07-21 02:07:01.71307088 +0000 UTC m=+2680.901110311"
Jul 21 02:07:04.500564 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:04.500523    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:07:11.214191 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:11.214150    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"
Jul 21 02:07:11.214599 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:11.214211    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"
Jul 21 02:07:11.226996 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:11.226972    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"
Jul 21 02:07:11.758592 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:11.758566    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"
Jul 21 02:07:28.005826 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.005786    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"]
Jul 21 02:07:28.009693 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.009666    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"
Jul 21 02:07:28.012395 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.012367    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a256ec\"/\"default-dockercfg-dgtp4\""
Jul 21 02:07:28.012395 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.012394    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a256ec\"/\"sub-test-model-a256ec-kserve-self-signed-certs\""
Jul 21 02:07:28.012580 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.012367    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a256ec\"/\"openshift-service-ca.crt\""
Jul 21 02:07:28.012580 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.012455    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a256ec\"/\"kube-root-ca.crt\""
Jul 21 02:07:28.020124 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.020094    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"]
Jul 21 02:07:28.109591 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.109553    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-home\") pod \"sub-test-model-a256ec-kserve-66569c55ff-7p4z6\" (UID: \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\") " pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"
Jul 21 02:07:28.109591 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.109591    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-tmp-dir\") pod \"sub-test-model-a256ec-kserve-66569c55ff-7p4z6\" (UID: \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\") " pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"
Jul 21 02:07:28.109854 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.109613    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-model-cache\") pod \"sub-test-model-a256ec-kserve-66569c55ff-7p4z6\" (UID: \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\") " pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"
Jul 21 02:07:28.109854 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.109638    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-tls-certs\") pod \"sub-test-model-a256ec-kserve-66569c55ff-7p4z6\" (UID: \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\") " pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"
Jul 21 02:07:28.109854 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.109747    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgx74\" (UniqueName: \"kubernetes.io/projected/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-kube-api-access-cgx74\") pod \"sub-test-model-a256ec-kserve-66569c55ff-7p4z6\" (UID: \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\") " pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"
Jul 21 02:07:28.109854 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.109797    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-dshm\") pod \"sub-test-model-a256ec-kserve-66569c55ff-7p4z6\" (UID: \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\") " pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"
Jul 21 02:07:28.210366 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.210327    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-dshm\") pod \"sub-test-model-a256ec-kserve-66569c55ff-7p4z6\" (UID: \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\") " pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"
Jul 21 02:07:28.210586 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.210421    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-home\") pod \"sub-test-model-a256ec-kserve-66569c55ff-7p4z6\" (UID: \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\") " pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"
Jul 21 02:07:28.210586 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.210446    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-tmp-dir\") pod \"sub-test-model-a256ec-kserve-66569c55ff-7p4z6\" (UID: \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\") " pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"
Jul 21 02:07:28.210586 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.210467    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-model-cache\") pod \"sub-test-model-a256ec-kserve-66569c55ff-7p4z6\" (UID: \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\") " pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"
Jul 21 02:07:28.210586 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.210496    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-tls-certs\") pod \"sub-test-model-a256ec-kserve-66569c55ff-7p4z6\" (UID: \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\") " pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"
Jul 21 02:07:28.210586 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.210532    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgx74\" (UniqueName: \"kubernetes.io/projected/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-kube-api-access-cgx74\") pod \"sub-test-model-a256ec-kserve-66569c55ff-7p4z6\" (UID: \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\") " pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"
Jul 21 02:07:28.210896 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.210873    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-model-cache\") pod \"sub-test-model-a256ec-kserve-66569c55ff-7p4z6\" (UID: \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\") " pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"
Jul 21 02:07:28.210977 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.210958    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-home\") pod \"sub-test-model-a256ec-kserve-66569c55ff-7p4z6\" (UID: \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\") " pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"
Jul 21 02:07:28.211033 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.210960    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-tmp-dir\") pod \"sub-test-model-a256ec-kserve-66569c55ff-7p4z6\" (UID: \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\") " pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"
Jul 21 02:07:28.213069 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.213040    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-dshm\") pod \"sub-test-model-a256ec-kserve-66569c55ff-7p4z6\" (UID: \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\") " pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"
Jul 21 02:07:28.213218 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.213200    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-tls-certs\") pod \"sub-test-model-a256ec-kserve-66569c55ff-7p4z6\" (UID: \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\") " pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"
Jul 21 02:07:28.219370 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.219340    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgx74\" (UniqueName: \"kubernetes.io/projected/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-kube-api-access-cgx74\") pod \"sub-test-model-a256ec-kserve-66569c55ff-7p4z6\" (UID: \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\") " pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"
Jul 21 02:07:28.319606 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.319479    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"
Jul 21 02:07:28.465307 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.465281    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"]
Jul 21 02:07:28.468249 ip-10-0-131-213 kubenswrapper[2586]: W0721 02:07:28.468217    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3595c1c4_67c0_46fd_af02_7dbd07dd88ac.slice/crio-ff84a38cdf325ea89d2b507d3118960f269b22e543318d3fdf15bcd2a2c4da95 WatchSource:0}: Error finding container ff84a38cdf325ea89d2b507d3118960f269b22e543318d3fdf15bcd2a2c4da95: Status 404 returned error can't find the container with id ff84a38cdf325ea89d2b507d3118960f269b22e543318d3fdf15bcd2a2c4da95
Jul 21 02:07:28.836220 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.836179    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6" event={"ID":"3595c1c4-67c0-46fd-af02-7dbd07dd88ac","Type":"ContainerStarted","Data":"ac26d19534cfe8a11f2eead8b5b20944cacc97b8358d315e1008a95030ef8fcf"}
Jul 21 02:07:28.836220 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.836219    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6" event={"ID":"3595c1c4-67c0-46fd-af02-7dbd07dd88ac","Type":"ContainerStarted","Data":"ff84a38cdf325ea89d2b507d3118960f269b22e543318d3fdf15bcd2a2c4da95"}
Jul 21 02:07:28.853369 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:28.853304    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6" podStartSLOduration=1.853282377 podStartE2EDuration="1.853282377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:07:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:07:28.851566081 +0000 UTC m=+2708.039605471" watchObservedRunningTime="2026-07-21 02:07:28.853282377 +0000 UTC m=+2708.041321770"
Jul 21 02:07:31.300467 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:31.300427    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:07:38.320427 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:38.320391    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"
Jul 21 02:07:38.320889 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:38.320669    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"
Jul 21 02:07:38.333163 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:38.333134    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"
Jul 21 02:07:38.898649 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:38.898620    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"
Jul 21 02:07:46.097767 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:07:46.097726    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:08:01.932950 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:01.932904    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"]
Jul 21 02:08:02.806727 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:02.806691    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"]
Jul 21 02:08:07.508814 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:07.508776    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:08:16.954337 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:16.954266    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52" podUID="ebd49318-73d5-41e4-a6da-89dff86518f8" containerName="main" containerID="cri-o://df6fe242436983742e8acb554314d999176fe88fbc81e7fa1e50a3b7e68422b1" gracePeriod=45
Jul 21 02:08:17.097748 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:17.097711    2586 generic.go:356] "Generic (PLEG): container finished" podID="ebd49318-73d5-41e4-a6da-89dff86518f8" containerID="df6fe242436983742e8acb554314d999176fe88fbc81e7fa1e50a3b7e68422b1" exitCode=0
Jul 21 02:08:17.097912 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:17.097765    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52" event={"ID":"ebd49318-73d5-41e4-a6da-89dff86518f8","Type":"ContainerDied","Data":"df6fe242436983742e8acb554314d999176fe88fbc81e7fa1e50a3b7e68422b1"}
Jul 21 02:08:17.219306 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:17.219235    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"
Jul 21 02:08:17.303480 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:17.303437    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tr2th\" (UniqueName: \"kubernetes.io/projected/ebd49318-73d5-41e4-a6da-89dff86518f8-kube-api-access-tr2th\") pod \"ebd49318-73d5-41e4-a6da-89dff86518f8\" (UID: \"ebd49318-73d5-41e4-a6da-89dff86518f8\") "
Jul 21 02:08:17.303680 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:17.303534    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebd49318-73d5-41e4-a6da-89dff86518f8-tls-certs\") pod \"ebd49318-73d5-41e4-a6da-89dff86518f8\" (UID: \"ebd49318-73d5-41e4-a6da-89dff86518f8\") "
Jul 21 02:08:17.303823 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:17.303714    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebd49318-73d5-41e4-a6da-89dff86518f8-model-cache\") pod \"ebd49318-73d5-41e4-a6da-89dff86518f8\" (UID: \"ebd49318-73d5-41e4-a6da-89dff86518f8\") "
Jul 21 02:08:17.303823 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:17.303747    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebd49318-73d5-41e4-a6da-89dff86518f8-home\") pod \"ebd49318-73d5-41e4-a6da-89dff86518f8\" (UID: \"ebd49318-73d5-41e4-a6da-89dff86518f8\") "
Jul 21 02:08:17.303984 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:17.303828    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebd49318-73d5-41e4-a6da-89dff86518f8-tmp-dir\") pod \"ebd49318-73d5-41e4-a6da-89dff86518f8\" (UID: \"ebd49318-73d5-41e4-a6da-89dff86518f8\") "
Jul 21 02:08:17.303984 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:17.303874    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebd49318-73d5-41e4-a6da-89dff86518f8-dshm\") pod \"ebd49318-73d5-41e4-a6da-89dff86518f8\" (UID: \"ebd49318-73d5-41e4-a6da-89dff86518f8\") "
Jul 21 02:08:17.304101 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:17.304034    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebd49318-73d5-41e4-a6da-89dff86518f8-model-cache" (OuterVolumeSpecName: "model-cache") pod "ebd49318-73d5-41e4-a6da-89dff86518f8" (UID: "ebd49318-73d5-41e4-a6da-89dff86518f8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:08:17.304243 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:17.304223    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebd49318-73d5-41e4-a6da-89dff86518f8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ebd49318-73d5-41e4-a6da-89dff86518f8" (UID: "ebd49318-73d5-41e4-a6da-89dff86518f8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:08:17.304309 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:17.304240    2586 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebd49318-73d5-41e4-a6da-89dff86518f8-model-cache\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:08:17.304442 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:17.304316    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebd49318-73d5-41e4-a6da-89dff86518f8-home" (OuterVolumeSpecName: "home") pod "ebd49318-73d5-41e4-a6da-89dff86518f8" (UID: "ebd49318-73d5-41e4-a6da-89dff86518f8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:08:17.305871 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:17.305841    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebd49318-73d5-41e4-a6da-89dff86518f8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ebd49318-73d5-41e4-a6da-89dff86518f8" (UID: "ebd49318-73d5-41e4-a6da-89dff86518f8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:08:17.305871 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:17.305853    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebd49318-73d5-41e4-a6da-89dff86518f8-kube-api-access-tr2th" (OuterVolumeSpecName: "kube-api-access-tr2th") pod "ebd49318-73d5-41e4-a6da-89dff86518f8" (UID: "ebd49318-73d5-41e4-a6da-89dff86518f8"). InnerVolumeSpecName "kube-api-access-tr2th". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:08:17.306259 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:17.306233    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebd49318-73d5-41e4-a6da-89dff86518f8-dshm" (OuterVolumeSpecName: "dshm") pod "ebd49318-73d5-41e4-a6da-89dff86518f8" (UID: "ebd49318-73d5-41e4-a6da-89dff86518f8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:08:17.405246 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:17.405201    2586 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebd49318-73d5-41e4-a6da-89dff86518f8-tmp-dir\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:08:17.405246 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:17.405236    2586 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebd49318-73d5-41e4-a6da-89dff86518f8-dshm\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:08:17.405246 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:17.405245    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tr2th\" (UniqueName: \"kubernetes.io/projected/ebd49318-73d5-41e4-a6da-89dff86518f8-kube-api-access-tr2th\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:08:17.405246 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:17.405259    2586 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebd49318-73d5-41e4-a6da-89dff86518f8-tls-certs\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:08:17.405597 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:17.405273    2586 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebd49318-73d5-41e4-a6da-89dff86518f8-home\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:08:17.830214 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:17.830165    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6" podUID="3595c1c4-67c0-46fd-af02-7dbd07dd88ac" containerName="main" containerID="cri-o://ac26d19534cfe8a11f2eead8b5b20944cacc97b8358d315e1008a95030ef8fcf" gracePeriod=45
Jul 21 02:08:18.002181 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.002149    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"]
Jul 21 02:08:18.002783 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.002753    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebd49318-73d5-41e4-a6da-89dff86518f8" containerName="main"
Jul 21 02:08:18.002783 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.002776    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebd49318-73d5-41e4-a6da-89dff86518f8" containerName="main"
Jul 21 02:08:18.002929 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.002910    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebd49318-73d5-41e4-a6da-89dff86518f8" containerName="main"
Jul 21 02:08:18.006094 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.006072    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"
Jul 21 02:08:18.008187 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.008152    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0dfbd0\"/\"rate-test-model-0dfbd0-kserve-self-signed-certs\""
Jul 21 02:08:18.020050 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.020025    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"]
Jul 21 02:08:18.093588 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.093568    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"
Jul 21 02:08:18.103365 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.103337    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"
Jul 21 02:08:18.103365 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.103348    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52" event={"ID":"ebd49318-73d5-41e4-a6da-89dff86518f8","Type":"ContainerDied","Data":"2c4ff967da1f6c6d3bae4bc6499c706f4844e9d47d60aa4e607451a0ca047633"}
Jul 21 02:08:18.103592 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.103399    2586 scope.go:117] "RemoveContainer" containerID="df6fe242436983742e8acb554314d999176fe88fbc81e7fa1e50a3b7e68422b1"
Jul 21 02:08:18.104669 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.104644    2586 generic.go:356] "Generic (PLEG): container finished" podID="3595c1c4-67c0-46fd-af02-7dbd07dd88ac" containerID="ac26d19534cfe8a11f2eead8b5b20944cacc97b8358d315e1008a95030ef8fcf" exitCode=0
Jul 21 02:08:18.104771 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.104754    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"
Jul 21 02:08:18.104848 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.104759    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6" event={"ID":"3595c1c4-67c0-46fd-af02-7dbd07dd88ac","Type":"ContainerDied","Data":"ac26d19534cfe8a11f2eead8b5b20944cacc97b8358d315e1008a95030ef8fcf"}
Jul 21 02:08:18.104893 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.104864    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6" event={"ID":"3595c1c4-67c0-46fd-af02-7dbd07dd88ac","Type":"ContainerDied","Data":"ff84a38cdf325ea89d2b507d3118960f269b22e543318d3fdf15bcd2a2c4da95"}
Jul 21 02:08:18.113309 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.113268    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/380c067a-317e-4c03-9ab7-073e1fb658e7-dshm\") pod \"rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5\" (UID: \"380c067a-317e-4c03-9ab7-073e1fb658e7\") " pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"
Jul 21 02:08:18.113458 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.113312    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvsp5\" (UniqueName: \"kubernetes.io/projected/380c067a-317e-4c03-9ab7-073e1fb658e7-kube-api-access-pvsp5\") pod \"rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5\" (UID: \"380c067a-317e-4c03-9ab7-073e1fb658e7\") " pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"
Jul 21 02:08:18.113458 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.113377    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/380c067a-317e-4c03-9ab7-073e1fb658e7-tls-certs\") pod \"rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5\" (UID: \"380c067a-317e-4c03-9ab7-073e1fb658e7\") " pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"
Jul 21 02:08:18.113653 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.113456    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/380c067a-317e-4c03-9ab7-073e1fb658e7-tmp-dir\") pod \"rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5\" (UID: \"380c067a-317e-4c03-9ab7-073e1fb658e7\") " pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"
Jul 21 02:08:18.113653 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.113505    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/380c067a-317e-4c03-9ab7-073e1fb658e7-model-cache\") pod \"rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5\" (UID: \"380c067a-317e-4c03-9ab7-073e1fb658e7\") " pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"
Jul 21 02:08:18.113653 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.113543    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/380c067a-317e-4c03-9ab7-073e1fb658e7-home\") pod \"rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5\" (UID: \"380c067a-317e-4c03-9ab7-073e1fb658e7\") " pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"
Jul 21 02:08:18.113653 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.113555    2586 scope.go:117] "RemoveContainer" containerID="ac26d19534cfe8a11f2eead8b5b20944cacc97b8358d315e1008a95030ef8fcf"
Jul 21 02:08:18.125340 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.125317    2586 scope.go:117] "RemoveContainer" containerID="ac26d19534cfe8a11f2eead8b5b20944cacc97b8358d315e1008a95030ef8fcf"
Jul 21 02:08:18.125681 ip-10-0-131-213 kubenswrapper[2586]: E0721 02:08:18.125661    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac26d19534cfe8a11f2eead8b5b20944cacc97b8358d315e1008a95030ef8fcf\": container with ID starting with ac26d19534cfe8a11f2eead8b5b20944cacc97b8358d315e1008a95030ef8fcf not found: ID does not exist" containerID="ac26d19534cfe8a11f2eead8b5b20944cacc97b8358d315e1008a95030ef8fcf"
Jul 21 02:08:18.125754 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.125696    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac26d19534cfe8a11f2eead8b5b20944cacc97b8358d315e1008a95030ef8fcf"} err="failed to get container status \"ac26d19534cfe8a11f2eead8b5b20944cacc97b8358d315e1008a95030ef8fcf\": rpc error: code = NotFound desc = could not find container \"ac26d19534cfe8a11f2eead8b5b20944cacc97b8358d315e1008a95030ef8fcf\": container with ID starting with ac26d19534cfe8a11f2eead8b5b20944cacc97b8358d315e1008a95030ef8fcf not found: ID does not exist"
Jul 21 02:08:18.125999 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.125980    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"]
Jul 21 02:08:18.131531 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.131499    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0dfbd0/sub-test-model-0dfbd0-kserve-67854f999-m7w52"]
Jul 21 02:08:18.214994 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.214952    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-tmp-dir\") pod \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\" (UID: \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\") "
Jul 21 02:08:18.215194 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.215012    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-model-cache\") pod \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\" (UID: \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\") "
Jul 21 02:08:18.215194 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.215040    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-dshm\") pod \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\" (UID: \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\") "
Jul 21 02:08:18.215316 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.215193    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-home\") pod \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\" (UID: \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\") "
Jul 21 02:08:18.215316 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.215249    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-tls-certs\") pod \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\" (UID: \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\") "
Jul 21 02:08:18.215316 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.215295    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgx74\" (UniqueName: \"kubernetes.io/projected/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-kube-api-access-cgx74\") pod \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\" (UID: \"3595c1c4-67c0-46fd-af02-7dbd07dd88ac\") "
Jul 21 02:08:18.215470 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.215199    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3595c1c4-67c0-46fd-af02-7dbd07dd88ac" (UID: "3595c1c4-67c0-46fd-af02-7dbd07dd88ac"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:08:18.215470 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.215295    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-model-cache" (OuterVolumeSpecName: "model-cache") pod "3595c1c4-67c0-46fd-af02-7dbd07dd88ac" (UID: "3595c1c4-67c0-46fd-af02-7dbd07dd88ac"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:08:18.215470 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.215357    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-home" (OuterVolumeSpecName: "home") pod "3595c1c4-67c0-46fd-af02-7dbd07dd88ac" (UID: "3595c1c4-67c0-46fd-af02-7dbd07dd88ac"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:08:18.215571 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.215521    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/380c067a-317e-4c03-9ab7-073e1fb658e7-dshm\") pod \"rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5\" (UID: \"380c067a-317e-4c03-9ab7-073e1fb658e7\") " pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"
Jul 21 02:08:18.215571 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.215545    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvsp5\" (UniqueName: \"kubernetes.io/projected/380c067a-317e-4c03-9ab7-073e1fb658e7-kube-api-access-pvsp5\") pod \"rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5\" (UID: \"380c067a-317e-4c03-9ab7-073e1fb658e7\") " pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"
Jul 21 02:08:18.215690 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.215583    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/380c067a-317e-4c03-9ab7-073e1fb658e7-tls-certs\") pod \"rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5\" (UID: \"380c067a-317e-4c03-9ab7-073e1fb658e7\") " pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"
Jul 21 02:08:18.215690 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.215638    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/380c067a-317e-4c03-9ab7-073e1fb658e7-tmp-dir\") pod \"rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5\" (UID: \"380c067a-317e-4c03-9ab7-073e1fb658e7\") " pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"
Jul 21 02:08:18.215690 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.215682    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/380c067a-317e-4c03-9ab7-073e1fb658e7-model-cache\") pod \"rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5\" (UID: \"380c067a-317e-4c03-9ab7-073e1fb658e7\") " pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"
Jul 21 02:08:18.215957 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.215722    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/380c067a-317e-4c03-9ab7-073e1fb658e7-home\") pod \"rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5\" (UID: \"380c067a-317e-4c03-9ab7-073e1fb658e7\") " pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"
Jul 21 02:08:18.215957 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.215794    2586 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-tmp-dir\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:08:18.215957 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.215812    2586 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-model-cache\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:08:18.215957 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.215826    2586 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-home\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:08:18.216263 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.216181    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/380c067a-317e-4c03-9ab7-073e1fb658e7-home\") pod \"rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5\" (UID: \"380c067a-317e-4c03-9ab7-073e1fb658e7\") " pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"
Jul 21 02:08:18.216263 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.216224    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/380c067a-317e-4c03-9ab7-073e1fb658e7-tmp-dir\") pod \"rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5\" (UID: \"380c067a-317e-4c03-9ab7-073e1fb658e7\") " pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"
Jul 21 02:08:18.216505 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.216476    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/380c067a-317e-4c03-9ab7-073e1fb658e7-model-cache\") pod \"rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5\" (UID: \"380c067a-317e-4c03-9ab7-073e1fb658e7\") " pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"
Jul 21 02:08:18.217637 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.217613    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3595c1c4-67c0-46fd-af02-7dbd07dd88ac" (UID: "3595c1c4-67c0-46fd-af02-7dbd07dd88ac"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:08:18.217755 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.217639    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-kube-api-access-cgx74" (OuterVolumeSpecName: "kube-api-access-cgx74") pod "3595c1c4-67c0-46fd-af02-7dbd07dd88ac" (UID: "3595c1c4-67c0-46fd-af02-7dbd07dd88ac"). InnerVolumeSpecName "kube-api-access-cgx74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:08:18.217952 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.217919    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/380c067a-317e-4c03-9ab7-073e1fb658e7-dshm\") pod \"rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5\" (UID: \"380c067a-317e-4c03-9ab7-073e1fb658e7\") " pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"
Jul 21 02:08:18.218027 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.217993    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-dshm" (OuterVolumeSpecName: "dshm") pod "3595c1c4-67c0-46fd-af02-7dbd07dd88ac" (UID: "3595c1c4-67c0-46fd-af02-7dbd07dd88ac"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:08:18.218824 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.218807    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/380c067a-317e-4c03-9ab7-073e1fb658e7-tls-certs\") pod \"rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5\" (UID: \"380c067a-317e-4c03-9ab7-073e1fb658e7\") " pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"
Jul 21 02:08:18.224160 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.224137    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvsp5\" (UniqueName: \"kubernetes.io/projected/380c067a-317e-4c03-9ab7-073e1fb658e7-kube-api-access-pvsp5\") pod \"rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5\" (UID: \"380c067a-317e-4c03-9ab7-073e1fb658e7\") " pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"
Jul 21 02:08:18.316607 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.316564    2586 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-dshm\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:08:18.316607 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.316609    2586 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-tls-certs\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:08:18.316607 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.316626    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgx74\" (UniqueName: \"kubernetes.io/projected/3595c1c4-67c0-46fd-af02-7dbd07dd88ac-kube-api-access-cgx74\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:08:18.318323 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.318289    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"
Jul 21 02:08:18.430215 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.430179    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"]
Jul 21 02:08:18.435371 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.435337    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a256ec/sub-test-model-a256ec-kserve-66569c55ff-7p4z6"]
Jul 21 02:08:18.463309 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:18.463288    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"]
Jul 21 02:08:18.465879 ip-10-0-131-213 kubenswrapper[2586]: W0721 02:08:18.465842    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod380c067a_317e_4c03_9ab7_073e1fb658e7.slice/crio-9d75b5eeb72ed42a161716c38e7525483d5fa80c884f94ea8780306832afae9c WatchSource:0}: Error finding container 9d75b5eeb72ed42a161716c38e7525483d5fa80c884f94ea8780306832afae9c: Status 404 returned error can't find the container with id 9d75b5eeb72ed42a161716c38e7525483d5fa80c884f94ea8780306832afae9c
Jul 21 02:08:19.112825 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:19.112784    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5" event={"ID":"380c067a-317e-4c03-9ab7-073e1fb658e7","Type":"ContainerStarted","Data":"036f2236288fcbc94339cdaac7abe3425d3474915785c486671fcd56da065524"}
Jul 21 02:08:19.113243 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:19.112833    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5" event={"ID":"380c067a-317e-4c03-9ab7-073e1fb658e7","Type":"ContainerStarted","Data":"9d75b5eeb72ed42a161716c38e7525483d5fa80c884f94ea8780306832afae9c"}
Jul 21 02:08:19.131756 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:19.131700    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5" podStartSLOduration=2.131682283 podStartE2EDuration="2.131682283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:08:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:08:19.12960622 +0000 UTC m=+2758.317645610" watchObservedRunningTime="2026-07-21 02:08:19.131682283 +0000 UTC m=+2758.319721672"
Jul 21 02:08:19.308915 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:19.308876    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3595c1c4-67c0-46fd-af02-7dbd07dd88ac" path="/var/lib/kubelet/pods/3595c1c4-67c0-46fd-af02-7dbd07dd88ac/volumes"
Jul 21 02:08:19.309536 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:19.309511    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebd49318-73d5-41e4-a6da-89dff86518f8" path="/var/lib/kubelet/pods/ebd49318-73d5-41e4-a6da-89dff86518f8/volumes"
Jul 21 02:08:21.194286 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:21.194253    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:08:21.576167 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:21.576076    2586 scope.go:117] "RemoveContainer" containerID="dfa401ea1f1600cfae66e2dcdc73d1b9dc2c498b1b60e655c7bebdb5c9967e01"
Jul 21 02:08:21.584918 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:21.584898    2586 scope.go:117] "RemoveContainer" containerID="3e13594c8cfe550c18fe60d0a245949b8f767429bfaf42cbab8c1ae8821e50d2"
Jul 21 02:08:28.319511 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:28.319467    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"
Jul 21 02:08:28.319511 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:28.319518    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"
Jul 21 02:08:28.332410 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:28.332377    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"
Jul 21 02:08:29.175464 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:29.175432    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"
Jul 21 02:08:41.208516 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.208481    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"]
Jul 21 02:08:41.208994 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.208912    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3595c1c4-67c0-46fd-af02-7dbd07dd88ac" containerName="main"
Jul 21 02:08:41.208994 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.208925    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="3595c1c4-67c0-46fd-af02-7dbd07dd88ac" containerName="main"
Jul 21 02:08:41.209072 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.209013    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="3595c1c4-67c0-46fd-af02-7dbd07dd88ac" containerName="main"
Jul 21 02:08:41.212379 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.212358    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"
Jul 21 02:08:41.214655 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.214635    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a256ec\"/\"kube-root-ca.crt\""
Jul 21 02:08:41.215208 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.215171    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a256ec\"/\"openshift-service-ca.crt\""
Jul 21 02:08:41.215284 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.215258    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a256ec\"/\"default-dockercfg-dgtp4\""
Jul 21 02:08:41.215336 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.215294    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a256ec\"/\"rate-test-model-a256ec-kserve-self-signed-certs\""
Jul 21 02:08:41.221561 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.221533    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"]
Jul 21 02:08:41.237927 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.237895    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b4e1932-4a05-4c55-8454-e615a5910341-model-cache\") pod \"rate-test-model-a256ec-kserve-689cdb5995-vmmc9\" (UID: \"5b4e1932-4a05-4c55-8454-e615a5910341\") " pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"
Jul 21 02:08:41.238138 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.237957    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b4e1932-4a05-4c55-8454-e615a5910341-dshm\") pod \"rate-test-model-a256ec-kserve-689cdb5995-vmmc9\" (UID: \"5b4e1932-4a05-4c55-8454-e615a5910341\") " pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"
Jul 21 02:08:41.238138 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.238011    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b4e1932-4a05-4c55-8454-e615a5910341-tmp-dir\") pod \"rate-test-model-a256ec-kserve-689cdb5995-vmmc9\" (UID: \"5b4e1932-4a05-4c55-8454-e615a5910341\") " pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"
Jul 21 02:08:41.238138 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.238043    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsmzw\" (UniqueName: \"kubernetes.io/projected/5b4e1932-4a05-4c55-8454-e615a5910341-kube-api-access-hsmzw\") pod \"rate-test-model-a256ec-kserve-689cdb5995-vmmc9\" (UID: \"5b4e1932-4a05-4c55-8454-e615a5910341\") " pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"
Jul 21 02:08:41.238138 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.238082    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b4e1932-4a05-4c55-8454-e615a5910341-home\") pod \"rate-test-model-a256ec-kserve-689cdb5995-vmmc9\" (UID: \"5b4e1932-4a05-4c55-8454-e615a5910341\") " pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"
Jul 21 02:08:41.238138 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.238116    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b4e1932-4a05-4c55-8454-e615a5910341-tls-certs\") pod \"rate-test-model-a256ec-kserve-689cdb5995-vmmc9\" (UID: \"5b4e1932-4a05-4c55-8454-e615a5910341\") " pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"
Jul 21 02:08:41.339691 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.339597    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b4e1932-4a05-4c55-8454-e615a5910341-tls-certs\") pod \"rate-test-model-a256ec-kserve-689cdb5995-vmmc9\" (UID: \"5b4e1932-4a05-4c55-8454-e615a5910341\") " pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"
Jul 21 02:08:41.339691 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.339675    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b4e1932-4a05-4c55-8454-e615a5910341-model-cache\") pod \"rate-test-model-a256ec-kserve-689cdb5995-vmmc9\" (UID: \"5b4e1932-4a05-4c55-8454-e615a5910341\") " pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"
Jul 21 02:08:41.339973 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.339724    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b4e1932-4a05-4c55-8454-e615a5910341-dshm\") pod \"rate-test-model-a256ec-kserve-689cdb5995-vmmc9\" (UID: \"5b4e1932-4a05-4c55-8454-e615a5910341\") " pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"
Jul 21 02:08:41.339973 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.339753    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b4e1932-4a05-4c55-8454-e615a5910341-tmp-dir\") pod \"rate-test-model-a256ec-kserve-689cdb5995-vmmc9\" (UID: \"5b4e1932-4a05-4c55-8454-e615a5910341\") " pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"
Jul 21 02:08:41.339973 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.339782    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsmzw\" (UniqueName: \"kubernetes.io/projected/5b4e1932-4a05-4c55-8454-e615a5910341-kube-api-access-hsmzw\") pod \"rate-test-model-a256ec-kserve-689cdb5995-vmmc9\" (UID: \"5b4e1932-4a05-4c55-8454-e615a5910341\") " pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"
Jul 21 02:08:41.339973 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.339858    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b4e1932-4a05-4c55-8454-e615a5910341-home\") pod \"rate-test-model-a256ec-kserve-689cdb5995-vmmc9\" (UID: \"5b4e1932-4a05-4c55-8454-e615a5910341\") " pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"
Jul 21 02:08:41.340245 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.340221    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b4e1932-4a05-4c55-8454-e615a5910341-tmp-dir\") pod \"rate-test-model-a256ec-kserve-689cdb5995-vmmc9\" (UID: \"5b4e1932-4a05-4c55-8454-e615a5910341\") " pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"
Jul 21 02:08:41.340306 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.340267    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b4e1932-4a05-4c55-8454-e615a5910341-model-cache\") pod \"rate-test-model-a256ec-kserve-689cdb5995-vmmc9\" (UID: \"5b4e1932-4a05-4c55-8454-e615a5910341\") " pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"
Jul 21 02:08:41.340365 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.340320    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b4e1932-4a05-4c55-8454-e615a5910341-home\") pod \"rate-test-model-a256ec-kserve-689cdb5995-vmmc9\" (UID: \"5b4e1932-4a05-4c55-8454-e615a5910341\") " pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"
Jul 21 02:08:41.342241 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.342216    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b4e1932-4a05-4c55-8454-e615a5910341-dshm\") pod \"rate-test-model-a256ec-kserve-689cdb5995-vmmc9\" (UID: \"5b4e1932-4a05-4c55-8454-e615a5910341\") " pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"
Jul 21 02:08:41.342559 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.342542    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b4e1932-4a05-4c55-8454-e615a5910341-tls-certs\") pod \"rate-test-model-a256ec-kserve-689cdb5995-vmmc9\" (UID: \"5b4e1932-4a05-4c55-8454-e615a5910341\") " pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"
Jul 21 02:08:41.349556 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.349525    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsmzw\" (UniqueName: \"kubernetes.io/projected/5b4e1932-4a05-4c55-8454-e615a5910341-kube-api-access-hsmzw\") pod \"rate-test-model-a256ec-kserve-689cdb5995-vmmc9\" (UID: \"5b4e1932-4a05-4c55-8454-e615a5910341\") " pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"
Jul 21 02:08:41.524692 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.524590    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"
Jul 21 02:08:41.677625 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:41.677598    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"]
Jul 21 02:08:41.680463 ip-10-0-131-213 kubenswrapper[2586]: W0721 02:08:41.680420    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b4e1932_4a05_4c55_8454_e615a5910341.slice/crio-94eca4ea4132364701026c922dd54297076b86742da6ca30e3f7470d8c8bde57 WatchSource:0}: Error finding container 94eca4ea4132364701026c922dd54297076b86742da6ca30e3f7470d8c8bde57: Status 404 returned error can't find the container with id 94eca4ea4132364701026c922dd54297076b86742da6ca30e3f7470d8c8bde57
Jul 21 02:08:42.229434 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:42.229395    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9" event={"ID":"5b4e1932-4a05-4c55-8454-e615a5910341","Type":"ContainerStarted","Data":"fc2d6a58f9b4c13d69cba041119264568f55acaa1c2ddc6e13bf745bb2e2ba9f"}
Jul 21 02:08:42.229858 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:42.229444    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9" event={"ID":"5b4e1932-4a05-4c55-8454-e615a5910341","Type":"ContainerStarted","Data":"94eca4ea4132364701026c922dd54297076b86742da6ca30e3f7470d8c8bde57"}
Jul 21 02:08:42.248133 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:42.248080    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9" podStartSLOduration=1.248063495 podStartE2EDuration="1.248063495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:08:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:08:42.246041683 +0000 UTC m=+2781.434081083" watchObservedRunningTime="2026-07-21 02:08:42.248063495 +0000 UTC m=+2781.436102884"
Jul 21 02:08:45.108638 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:45.108599    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:08:51.525023 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:51.524979    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"
Jul 21 02:08:51.525539 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:51.525039    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"
Jul 21 02:08:51.537850 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:51.537821    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"
Jul 21 02:08:52.300505 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:08:52.300475    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"
Jul 21 02:09:08.693738 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:08.693697    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:09:21.617770 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:21.617736    2586 scope.go:117] "RemoveContainer" containerID="9f7bcdf169184b7446384321b5203182ce8ecdfee6dbf33c917a6d8594aac594"
Jul 21 02:09:25.105268 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:25.105232    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:09:31.484410 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:31.484370    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"]
Jul 21 02:09:32.390761 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:32.390719    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"]
Jul 21 02:09:33.346293 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:33.346259    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7538-140632279530800"]
Jul 21 02:09:33.349690 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:33.349671    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7538-140632279530800"
Jul 21 02:09:33.351920 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:33.351900    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wjdmg\""
Jul 21 02:09:33.358357 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:33.358330    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7538-140632279530800"]
Jul 21 02:09:33.465410 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:33.465363    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-977rh\" (UniqueName: \"kubernetes.io/projected/97da8bf4-9104-4de0-9fb8-86d184e1f692-kube-api-access-977rh\") pod \"test-curl-7538-140632279530800\" (UID: \"97da8bf4-9104-4de0-9fb8-86d184e1f692\") " pod="opendatahub/test-curl-7538-140632279530800"
Jul 21 02:09:33.567000 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:33.566928    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-977rh\" (UniqueName: \"kubernetes.io/projected/97da8bf4-9104-4de0-9fb8-86d184e1f692-kube-api-access-977rh\") pod \"test-curl-7538-140632279530800\" (UID: \"97da8bf4-9104-4de0-9fb8-86d184e1f692\") " pod="opendatahub/test-curl-7538-140632279530800"
Jul 21 02:09:33.576134 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:33.576100    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-977rh\" (UniqueName: \"kubernetes.io/projected/97da8bf4-9104-4de0-9fb8-86d184e1f692-kube-api-access-977rh\") pod \"test-curl-7538-140632279530800\" (UID: \"97da8bf4-9104-4de0-9fb8-86d184e1f692\") " pod="opendatahub/test-curl-7538-140632279530800"
Jul 21 02:09:33.660315 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:33.660223    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7538-140632279530800"
Jul 21 02:09:33.819320 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:33.819295    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7538-140632279530800"]
Jul 21 02:09:33.821782 ip-10-0-131-213 kubenswrapper[2586]: W0721 02:09:33.821755    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97da8bf4_9104_4de0_9fb8_86d184e1f692.slice/crio-b11fa0cdfd756262ac037f8c8a309910ac36e5c4a5657bd794bc896828fd58f3 WatchSource:0}: Error finding container b11fa0cdfd756262ac037f8c8a309910ac36e5c4a5657bd794bc896828fd58f3: Status 404 returned error can't find the container with id b11fa0cdfd756262ac037f8c8a309910ac36e5c4a5657bd794bc896828fd58f3
Jul 21 02:09:33.824999 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:33.824978    2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 02:09:34.501262 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:34.501232    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7538-140632279530800" event={"ID":"97da8bf4-9104-4de0-9fb8-86d184e1f692","Type":"ContainerStarted","Data":"b11fa0cdfd756262ac037f8c8a309910ac36e5c4a5657bd794bc896828fd58f3"}
Jul 21 02:09:35.508749 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:35.508714    2586 generic.go:356] "Generic (PLEG): container finished" podID="97da8bf4-9104-4de0-9fb8-86d184e1f692" containerID="f8f8b7ac4bdea5ff631c6fee8740d5598e28507126e14c7183242d6fa0b9f449" exitCode=0
Jul 21 02:09:35.509169 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:35.508796    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7538-140632279530800" event={"ID":"97da8bf4-9104-4de0-9fb8-86d184e1f692","Type":"ContainerDied","Data":"f8f8b7ac4bdea5ff631c6fee8740d5598e28507126e14c7183242d6fa0b9f449"}
Jul 21 02:09:36.653176 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:36.653150    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7538-140632279530800"
Jul 21 02:09:36.690162 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:36.690132    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7538-140632279530800_97da8bf4-9104-4de0-9fb8-86d184e1f692/test-curl-7538-140632279530800/0.log"
Jul 21 02:09:36.713107 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:36.713051    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7538-140632279530800"]
Jul 21 02:09:36.716491 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:36.716465    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7538-140632279530800"]
Jul 21 02:09:36.796174 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:36.796079    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-977rh\" (UniqueName: \"kubernetes.io/projected/97da8bf4-9104-4de0-9fb8-86d184e1f692-kube-api-access-977rh\") pod \"97da8bf4-9104-4de0-9fb8-86d184e1f692\" (UID: \"97da8bf4-9104-4de0-9fb8-86d184e1f692\") "
Jul 21 02:09:36.798513 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:36.798487    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97da8bf4-9104-4de0-9fb8-86d184e1f692-kube-api-access-977rh" (OuterVolumeSpecName: "kube-api-access-977rh") pod "97da8bf4-9104-4de0-9fb8-86d184e1f692" (UID: "97da8bf4-9104-4de0-9fb8-86d184e1f692"). InnerVolumeSpecName "kube-api-access-977rh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:09:36.897237 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:36.897200    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-977rh\" (UniqueName: \"kubernetes.io/projected/97da8bf4-9104-4de0-9fb8-86d184e1f692-kube-api-access-977rh\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:09:37.309024 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:37.308992    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97da8bf4-9104-4de0-9fb8-86d184e1f692" path="/var/lib/kubelet/pods/97da8bf4-9104-4de0-9fb8-86d184e1f692/volumes"
Jul 21 02:09:37.518911 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:37.518881    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7538-140632279530800"
Jul 21 02:09:37.519111 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:37.518890    2586 scope.go:117] "RemoveContainer" containerID="f8f8b7ac4bdea5ff631c6fee8740d5598e28507126e14c7183242d6fa0b9f449"
Jul 21 02:09:42.857477 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:42.857444    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7538-140632279507136"]
Jul 21 02:09:42.857871 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:42.857859    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97da8bf4-9104-4de0-9fb8-86d184e1f692" containerName="test-curl-7538-140632279530800"
Jul 21 02:09:42.857871 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:42.857871    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="97da8bf4-9104-4de0-9fb8-86d184e1f692" containerName="test-curl-7538-140632279530800"
Jul 21 02:09:42.857979 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:42.857953    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="97da8bf4-9104-4de0-9fb8-86d184e1f692" containerName="test-curl-7538-140632279530800"
Jul 21 02:09:42.862650 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:42.862624    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7538-140632279507136"
Jul 21 02:09:42.865264 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:42.865237    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wjdmg\""
Jul 21 02:09:42.867421 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:42.867390    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7538-140632279507136"]
Jul 21 02:09:42.960025 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:42.959978    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcvvn\" (UniqueName: \"kubernetes.io/projected/cc61cf9c-eb89-48a1-ad1f-67dc02f59088-kube-api-access-xcvvn\") pod \"test-curl-7538-140632279507136\" (UID: \"cc61cf9c-eb89-48a1-ad1f-67dc02f59088\") " pod="opendatahub/test-curl-7538-140632279507136"
Jul 21 02:09:43.060684 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:43.060640    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcvvn\" (UniqueName: \"kubernetes.io/projected/cc61cf9c-eb89-48a1-ad1f-67dc02f59088-kube-api-access-xcvvn\") pod \"test-curl-7538-140632279507136\" (UID: \"cc61cf9c-eb89-48a1-ad1f-67dc02f59088\") " pod="opendatahub/test-curl-7538-140632279507136"
Jul 21 02:09:43.070697 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:43.070667    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcvvn\" (UniqueName: \"kubernetes.io/projected/cc61cf9c-eb89-48a1-ad1f-67dc02f59088-kube-api-access-xcvvn\") pod \"test-curl-7538-140632279507136\" (UID: \"cc61cf9c-eb89-48a1-ad1f-67dc02f59088\") " pod="opendatahub/test-curl-7538-140632279507136"
Jul 21 02:09:43.172779 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:43.172666    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7538-140632279507136"
Jul 21 02:09:43.314057 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:43.314035    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7538-140632279507136"]
Jul 21 02:09:43.316253 ip-10-0-131-213 kubenswrapper[2586]: W0721 02:09:43.316227    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc61cf9c_eb89_48a1_ad1f_67dc02f59088.slice/crio-c4bfdc7c4fd2b8950c31cadce1990c78b06eee1126de667568d3812ace949489 WatchSource:0}: Error finding container c4bfdc7c4fd2b8950c31cadce1990c78b06eee1126de667568d3812ace949489: Status 404 returned error can't find the container with id c4bfdc7c4fd2b8950c31cadce1990c78b06eee1126de667568d3812ace949489
Jul 21 02:09:43.549661 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:43.549571    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7538-140632279507136" event={"ID":"cc61cf9c-eb89-48a1-ad1f-67dc02f59088","Type":"ContainerStarted","Data":"c4bfdc7c4fd2b8950c31cadce1990c78b06eee1126de667568d3812ace949489"}
Jul 21 02:09:44.203141 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:44.203105    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:09:44.555453 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:44.555422    2586 generic.go:356] "Generic (PLEG): container finished" podID="cc61cf9c-eb89-48a1-ad1f-67dc02f59088" containerID="7db943dc9427f259bc5a8291b19e5b36deb4dc8bafa2b3ac6a873be18fcd7d93" exitCode=0
Jul 21 02:09:44.555640 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:44.555509    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7538-140632279507136" event={"ID":"cc61cf9c-eb89-48a1-ad1f-67dc02f59088","Type":"ContainerDied","Data":"7db943dc9427f259bc5a8291b19e5b36deb4dc8bafa2b3ac6a873be18fcd7d93"}
Jul 21 02:09:45.698907 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:45.698879    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7538-140632279507136"
Jul 21 02:09:45.717535 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:45.717503    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7538-140632279507136_cc61cf9c-eb89-48a1-ad1f-67dc02f59088/test-curl-7538-140632279507136/0.log"
Jul 21 02:09:45.740481 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:45.740448    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7538-140632279507136"]
Jul 21 02:09:45.745886 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:45.745857    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7538-140632279507136"]
Jul 21 02:09:45.888915 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:45.888874    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcvvn\" (UniqueName: \"kubernetes.io/projected/cc61cf9c-eb89-48a1-ad1f-67dc02f59088-kube-api-access-xcvvn\") pod \"cc61cf9c-eb89-48a1-ad1f-67dc02f59088\" (UID: \"cc61cf9c-eb89-48a1-ad1f-67dc02f59088\") "
Jul 21 02:09:45.891415 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:45.891381    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc61cf9c-eb89-48a1-ad1f-67dc02f59088-kube-api-access-xcvvn" (OuterVolumeSpecName: "kube-api-access-xcvvn") pod "cc61cf9c-eb89-48a1-ad1f-67dc02f59088" (UID: "cc61cf9c-eb89-48a1-ad1f-67dc02f59088"). InnerVolumeSpecName "kube-api-access-xcvvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:09:45.990430 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:45.990373    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcvvn\" (UniqueName: \"kubernetes.io/projected/cc61cf9c-eb89-48a1-ad1f-67dc02f59088-kube-api-access-xcvvn\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:09:46.506017 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:46.505965    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5" podUID="380c067a-317e-4c03-9ab7-073e1fb658e7" containerName="main" containerID="cri-o://036f2236288fcbc94339cdaac7abe3425d3474915785c486671fcd56da065524" gracePeriod=45
Jul 21 02:09:46.566083 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:46.566055    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7538-140632279507136"
Jul 21 02:09:46.566267 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:46.566089    2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4bfdc7c4fd2b8950c31cadce1990c78b06eee1126de667568d3812ace949489"
Jul 21 02:09:46.575816 ip-10-0-131-213 kubenswrapper[2586]: E0721 02:09:46.575785    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7538-140632279507136\" is forbidden: User \"system:node:ip-10-0-131-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-213.ec2.internal' and this object" podUID="cc61cf9c-eb89-48a1-ad1f-67dc02f59088" pod="opendatahub/test-curl-7538-140632279507136"
Jul 21 02:09:46.766963 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:46.766871    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"
Jul 21 02:09:46.768730 ip-10-0-131-213 kubenswrapper[2586]: E0721 02:09:46.768703    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7538-140632279507136\" is forbidden: User \"system:node:ip-10-0-131-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-213.ec2.internal' and this object" podUID="cc61cf9c-eb89-48a1-ad1f-67dc02f59088" pod="opendatahub/test-curl-7538-140632279507136"
Jul 21 02:09:46.900011 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:46.899972    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/380c067a-317e-4c03-9ab7-073e1fb658e7-dshm\") pod \"380c067a-317e-4c03-9ab7-073e1fb658e7\" (UID: \"380c067a-317e-4c03-9ab7-073e1fb658e7\") "
Jul 21 02:09:46.900190 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:46.900026    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvsp5\" (UniqueName: \"kubernetes.io/projected/380c067a-317e-4c03-9ab7-073e1fb658e7-kube-api-access-pvsp5\") pod \"380c067a-317e-4c03-9ab7-073e1fb658e7\" (UID: \"380c067a-317e-4c03-9ab7-073e1fb658e7\") "
Jul 21 02:09:46.900190 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:46.900063    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/380c067a-317e-4c03-9ab7-073e1fb658e7-model-cache\") pod \"380c067a-317e-4c03-9ab7-073e1fb658e7\" (UID: \"380c067a-317e-4c03-9ab7-073e1fb658e7\") "
Jul 21 02:09:46.900190 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:46.900097    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/380c067a-317e-4c03-9ab7-073e1fb658e7-tmp-dir\") pod \"380c067a-317e-4c03-9ab7-073e1fb658e7\" (UID: \"380c067a-317e-4c03-9ab7-073e1fb658e7\") "
Jul 21 02:09:46.900190 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:46.900128    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/380c067a-317e-4c03-9ab7-073e1fb658e7-tls-certs\") pod \"380c067a-317e-4c03-9ab7-073e1fb658e7\" (UID: \"380c067a-317e-4c03-9ab7-073e1fb658e7\") "
Jul 21 02:09:46.900190 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:46.900169    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/380c067a-317e-4c03-9ab7-073e1fb658e7-home\") pod \"380c067a-317e-4c03-9ab7-073e1fb658e7\" (UID: \"380c067a-317e-4c03-9ab7-073e1fb658e7\") "
Jul 21 02:09:46.900456 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:46.900388    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/380c067a-317e-4c03-9ab7-073e1fb658e7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "380c067a-317e-4c03-9ab7-073e1fb658e7" (UID: "380c067a-317e-4c03-9ab7-073e1fb658e7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:09:46.900456 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:46.900397    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/380c067a-317e-4c03-9ab7-073e1fb658e7-model-cache" (OuterVolumeSpecName: "model-cache") pod "380c067a-317e-4c03-9ab7-073e1fb658e7" (UID: "380c067a-317e-4c03-9ab7-073e1fb658e7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:09:46.900561 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:46.900517    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/380c067a-317e-4c03-9ab7-073e1fb658e7-home" (OuterVolumeSpecName: "home") pod "380c067a-317e-4c03-9ab7-073e1fb658e7" (UID: "380c067a-317e-4c03-9ab7-073e1fb658e7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:09:46.900618 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:46.900590    2586 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/380c067a-317e-4c03-9ab7-073e1fb658e7-model-cache\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:09:46.900618 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:46.900609    2586 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/380c067a-317e-4c03-9ab7-073e1fb658e7-tmp-dir\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:09:46.900618 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:46.900617    2586 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/380c067a-317e-4c03-9ab7-073e1fb658e7-home\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:09:46.902398 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:46.902369    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/380c067a-317e-4c03-9ab7-073e1fb658e7-dshm" (OuterVolumeSpecName: "dshm") pod "380c067a-317e-4c03-9ab7-073e1fb658e7" (UID: "380c067a-317e-4c03-9ab7-073e1fb658e7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:09:46.902398 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:46.902384    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/380c067a-317e-4c03-9ab7-073e1fb658e7-kube-api-access-pvsp5" (OuterVolumeSpecName: "kube-api-access-pvsp5") pod "380c067a-317e-4c03-9ab7-073e1fb658e7" (UID: "380c067a-317e-4c03-9ab7-073e1fb658e7"). InnerVolumeSpecName "kube-api-access-pvsp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:09:46.902562 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:46.902414    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/380c067a-317e-4c03-9ab7-073e1fb658e7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "380c067a-317e-4c03-9ab7-073e1fb658e7" (UID: "380c067a-317e-4c03-9ab7-073e1fb658e7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:09:47.001976 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.001921    2586 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/380c067a-317e-4c03-9ab7-073e1fb658e7-dshm\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:09:47.001976 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.001972    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvsp5\" (UniqueName: \"kubernetes.io/projected/380c067a-317e-4c03-9ab7-073e1fb658e7-kube-api-access-pvsp5\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:09:47.001976 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.001984    2586 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/380c067a-317e-4c03-9ab7-073e1fb658e7-tls-certs\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:09:47.312830 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.312788    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc61cf9c-eb89-48a1-ad1f-67dc02f59088" path="/var/lib/kubelet/pods/cc61cf9c-eb89-48a1-ad1f-67dc02f59088/volumes"
Jul 21 02:09:47.412715 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.412643    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9" podUID="5b4e1932-4a05-4c55-8454-e615a5910341" containerName="main" containerID="cri-o://fc2d6a58f9b4c13d69cba041119264568f55acaa1c2ddc6e13bf745bb2e2ba9f" gracePeriod=45
Jul 21 02:09:47.574598 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.574510    2586 generic.go:356] "Generic (PLEG): container finished" podID="5b4e1932-4a05-4c55-8454-e615a5910341" containerID="fc2d6a58f9b4c13d69cba041119264568f55acaa1c2ddc6e13bf745bb2e2ba9f" exitCode=0
Jul 21 02:09:47.574761 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.574592    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9" event={"ID":"5b4e1932-4a05-4c55-8454-e615a5910341","Type":"ContainerDied","Data":"fc2d6a58f9b4c13d69cba041119264568f55acaa1c2ddc6e13bf745bb2e2ba9f"}
Jul 21 02:09:47.576007 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.575975    2586 generic.go:356] "Generic (PLEG): container finished" podID="380c067a-317e-4c03-9ab7-073e1fb658e7" containerID="036f2236288fcbc94339cdaac7abe3425d3474915785c486671fcd56da065524" exitCode=0
Jul 21 02:09:47.576161 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.576047    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"
Jul 21 02:09:47.576161 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.576056    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5" event={"ID":"380c067a-317e-4c03-9ab7-073e1fb658e7","Type":"ContainerDied","Data":"036f2236288fcbc94339cdaac7abe3425d3474915785c486671fcd56da065524"}
Jul 21 02:09:47.576161 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.576101    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5" event={"ID":"380c067a-317e-4c03-9ab7-073e1fb658e7","Type":"ContainerDied","Data":"9d75b5eeb72ed42a161716c38e7525483d5fa80c884f94ea8780306832afae9c"}
Jul 21 02:09:47.576161 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.576121    2586 scope.go:117] "RemoveContainer" containerID="036f2236288fcbc94339cdaac7abe3425d3474915785c486671fcd56da065524"
Jul 21 02:09:47.586145 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.586118    2586 scope.go:117] "RemoveContainer" containerID="036f2236288fcbc94339cdaac7abe3425d3474915785c486671fcd56da065524"
Jul 21 02:09:47.586492 ip-10-0-131-213 kubenswrapper[2586]: E0721 02:09:47.586466    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"036f2236288fcbc94339cdaac7abe3425d3474915785c486671fcd56da065524\": container with ID starting with 036f2236288fcbc94339cdaac7abe3425d3474915785c486671fcd56da065524 not found: ID does not exist" containerID="036f2236288fcbc94339cdaac7abe3425d3474915785c486671fcd56da065524"
Jul 21 02:09:47.586584 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.586501    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"036f2236288fcbc94339cdaac7abe3425d3474915785c486671fcd56da065524"} err="failed to get container status \"036f2236288fcbc94339cdaac7abe3425d3474915785c486671fcd56da065524\": rpc error: code = NotFound desc = could not find container \"036f2236288fcbc94339cdaac7abe3425d3474915785c486671fcd56da065524\": container with ID starting with 036f2236288fcbc94339cdaac7abe3425d3474915785c486671fcd56da065524 not found: ID does not exist"
Jul 21 02:09:47.595856 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.595829    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"]
Jul 21 02:09:47.598857 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.598828    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0dfbd0/rate-test-model-0dfbd0-kserve-bb7f444d7-xndt5"]
Jul 21 02:09:47.665861 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.665834    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"
Jul 21 02:09:47.708990 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.708959    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b4e1932-4a05-4c55-8454-e615a5910341-dshm\") pod \"5b4e1932-4a05-4c55-8454-e615a5910341\" (UID: \"5b4e1932-4a05-4c55-8454-e615a5910341\") "
Jul 21 02:09:47.709161 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.709001    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsmzw\" (UniqueName: \"kubernetes.io/projected/5b4e1932-4a05-4c55-8454-e615a5910341-kube-api-access-hsmzw\") pod \"5b4e1932-4a05-4c55-8454-e615a5910341\" (UID: \"5b4e1932-4a05-4c55-8454-e615a5910341\") "
Jul 21 02:09:47.709161 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.709032    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b4e1932-4a05-4c55-8454-e615a5910341-home\") pod \"5b4e1932-4a05-4c55-8454-e615a5910341\" (UID: \"5b4e1932-4a05-4c55-8454-e615a5910341\") "
Jul 21 02:09:47.709161 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.709079    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b4e1932-4a05-4c55-8454-e615a5910341-tls-certs\") pod \"5b4e1932-4a05-4c55-8454-e615a5910341\" (UID: \"5b4e1932-4a05-4c55-8454-e615a5910341\") "
Jul 21 02:09:47.709161 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.709115    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b4e1932-4a05-4c55-8454-e615a5910341-tmp-dir\") pod \"5b4e1932-4a05-4c55-8454-e615a5910341\" (UID: \"5b4e1932-4a05-4c55-8454-e615a5910341\") "
Jul 21 02:09:47.709161 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.709153    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b4e1932-4a05-4c55-8454-e615a5910341-model-cache\") pod \"5b4e1932-4a05-4c55-8454-e615a5910341\" (UID: \"5b4e1932-4a05-4c55-8454-e615a5910341\") "
Jul 21 02:09:47.709435 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.709327    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b4e1932-4a05-4c55-8454-e615a5910341-home" (OuterVolumeSpecName: "home") pod "5b4e1932-4a05-4c55-8454-e615a5910341" (UID: "5b4e1932-4a05-4c55-8454-e615a5910341"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:09:47.709435 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.709366    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b4e1932-4a05-4c55-8454-e615a5910341-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5b4e1932-4a05-4c55-8454-e615a5910341" (UID: "5b4e1932-4a05-4c55-8454-e615a5910341"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:09:47.709546 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.709508    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b4e1932-4a05-4c55-8454-e615a5910341-model-cache" (OuterVolumeSpecName: "model-cache") pod "5b4e1932-4a05-4c55-8454-e615a5910341" (UID: "5b4e1932-4a05-4c55-8454-e615a5910341"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:09:47.709617 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.709597    2586 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b4e1932-4a05-4c55-8454-e615a5910341-home\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:09:47.709674 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.709624    2586 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b4e1932-4a05-4c55-8454-e615a5910341-tmp-dir\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:09:47.709674 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.709644    2586 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b4e1932-4a05-4c55-8454-e615a5910341-model-cache\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:09:47.711239 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.711219    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b4e1932-4a05-4c55-8454-e615a5910341-dshm" (OuterVolumeSpecName: "dshm") pod "5b4e1932-4a05-4c55-8454-e615a5910341" (UID: "5b4e1932-4a05-4c55-8454-e615a5910341"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:09:47.711324 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.711310    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b4e1932-4a05-4c55-8454-e615a5910341-kube-api-access-hsmzw" (OuterVolumeSpecName: "kube-api-access-hsmzw") pod "5b4e1932-4a05-4c55-8454-e615a5910341" (UID: "5b4e1932-4a05-4c55-8454-e615a5910341"). InnerVolumeSpecName "kube-api-access-hsmzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:09:47.711382 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.711318    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b4e1932-4a05-4c55-8454-e615a5910341-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5b4e1932-4a05-4c55-8454-e615a5910341" (UID: "5b4e1932-4a05-4c55-8454-e615a5910341"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:09:47.810665 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.810626    2586 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b4e1932-4a05-4c55-8454-e615a5910341-dshm\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:09:47.810665 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.810662    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsmzw\" (UniqueName: \"kubernetes.io/projected/5b4e1932-4a05-4c55-8454-e615a5910341-kube-api-access-hsmzw\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:09:47.810665 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:47.810674    2586 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b4e1932-4a05-4c55-8454-e615a5910341-tls-certs\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:09:48.583621 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:48.583585    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9" event={"ID":"5b4e1932-4a05-4c55-8454-e615a5910341","Type":"ContainerDied","Data":"94eca4ea4132364701026c922dd54297076b86742da6ca30e3f7470d8c8bde57"}
Jul 21 02:09:48.583621 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:48.583619    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"
Jul 21 02:09:48.583922 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:48.583637    2586 scope.go:117] "RemoveContainer" containerID="fc2d6a58f9b4c13d69cba041119264568f55acaa1c2ddc6e13bf745bb2e2ba9f"
Jul 21 02:09:48.604081 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:48.604052    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"]
Jul 21 02:09:48.607830 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:48.607805    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a256ec/rate-test-model-a256ec-kserve-689cdb5995-vmmc9"]
Jul 21 02:09:48.910326 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:48.910288    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7538-140632277681184"]
Jul 21 02:09:48.910728 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:48.910715    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="380c067a-317e-4c03-9ab7-073e1fb658e7" containerName="main"
Jul 21 02:09:48.910780 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:48.910729    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="380c067a-317e-4c03-9ab7-073e1fb658e7" containerName="main"
Jul 21 02:09:48.910780 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:48.910768    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b4e1932-4a05-4c55-8454-e615a5910341" containerName="main"
Jul 21 02:09:48.910780 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:48.910774    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b4e1932-4a05-4c55-8454-e615a5910341" containerName="main"
Jul 21 02:09:48.910911 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:48.910782    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc61cf9c-eb89-48a1-ad1f-67dc02f59088" containerName="test-curl-7538-140632279507136"
Jul 21 02:09:48.910911 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:48.910789    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc61cf9c-eb89-48a1-ad1f-67dc02f59088" containerName="test-curl-7538-140632279507136"
Jul 21 02:09:48.910911 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:48.910843    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="380c067a-317e-4c03-9ab7-073e1fb658e7" containerName="main"
Jul 21 02:09:48.910911 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:48.910849    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b4e1932-4a05-4c55-8454-e615a5910341" containerName="main"
Jul 21 02:09:48.910911 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:48.910858    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc61cf9c-eb89-48a1-ad1f-67dc02f59088" containerName="test-curl-7538-140632279507136"
Jul 21 02:09:48.915534 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:48.915506    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7538-140632277681184"
Jul 21 02:09:48.917550 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:48.917523    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wjdmg\""
Jul 21 02:09:48.919133 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:48.919109    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl526\" (UniqueName: \"kubernetes.io/projected/43b3b4fb-5aa0-4ed3-8d02-be8ae4b1dc80-kube-api-access-dl526\") pod \"test-curl-7538-140632277681184\" (UID: \"43b3b4fb-5aa0-4ed3-8d02-be8ae4b1dc80\") " pod="opendatahub/test-curl-7538-140632277681184"
Jul 21 02:09:48.919367 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:48.919345    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7538-140632277681184"]
Jul 21 02:09:49.020437 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:49.020402    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl526\" (UniqueName: \"kubernetes.io/projected/43b3b4fb-5aa0-4ed3-8d02-be8ae4b1dc80-kube-api-access-dl526\") pod \"test-curl-7538-140632277681184\" (UID: \"43b3b4fb-5aa0-4ed3-8d02-be8ae4b1dc80\") " pod="opendatahub/test-curl-7538-140632277681184"
Jul 21 02:09:49.028338 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:49.028313    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl526\" (UniqueName: \"kubernetes.io/projected/43b3b4fb-5aa0-4ed3-8d02-be8ae4b1dc80-kube-api-access-dl526\") pod \"test-curl-7538-140632277681184\" (UID: \"43b3b4fb-5aa0-4ed3-8d02-be8ae4b1dc80\") " pod="opendatahub/test-curl-7538-140632277681184"
Jul 21 02:09:49.227129 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:49.227030    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7538-140632277681184"
Jul 21 02:09:49.311382 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:49.311344    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="380c067a-317e-4c03-9ab7-073e1fb658e7" path="/var/lib/kubelet/pods/380c067a-317e-4c03-9ab7-073e1fb658e7/volumes"
Jul 21 02:09:49.312018 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:49.311998    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b4e1932-4a05-4c55-8454-e615a5910341" path="/var/lib/kubelet/pods/5b4e1932-4a05-4c55-8454-e615a5910341/volumes"
Jul 21 02:09:49.369990 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:49.369953    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7538-140632277681184"]
Jul 21 02:09:49.373920 ip-10-0-131-213 kubenswrapper[2586]: W0721 02:09:49.373892    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43b3b4fb_5aa0_4ed3_8d02_be8ae4b1dc80.slice/crio-76ca70483380d33d46042e20382942b3f407cfd8495bdd9ab0f8ec4eec09535f WatchSource:0}: Error finding container 76ca70483380d33d46042e20382942b3f407cfd8495bdd9ab0f8ec4eec09535f: Status 404 returned error can't find the container with id 76ca70483380d33d46042e20382942b3f407cfd8495bdd9ab0f8ec4eec09535f
Jul 21 02:09:49.590765 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:49.590671    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7538-140632277681184" event={"ID":"43b3b4fb-5aa0-4ed3-8d02-be8ae4b1dc80","Type":"ContainerStarted","Data":"76ca70483380d33d46042e20382942b3f407cfd8495bdd9ab0f8ec4eec09535f"}
Jul 21 02:09:50.598805 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:50.598766    2586 generic.go:356] "Generic (PLEG): container finished" podID="43b3b4fb-5aa0-4ed3-8d02-be8ae4b1dc80" containerID="41366f0f8e57c215d73d63b1aaa006923eeef8b02146b86d2ba7bae7361d4ec2" exitCode=0
Jul 21 02:09:50.599201 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:50.598849    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7538-140632277681184" event={"ID":"43b3b4fb-5aa0-4ed3-8d02-be8ae4b1dc80","Type":"ContainerDied","Data":"41366f0f8e57c215d73d63b1aaa006923eeef8b02146b86d2ba7bae7361d4ec2"}
Jul 21 02:09:51.745094 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:51.745061    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7538-140632277681184"
Jul 21 02:09:51.767755 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:51.767723    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7538-140632277681184_43b3b4fb-5aa0-4ed3-8d02-be8ae4b1dc80/test-curl-7538-140632277681184/0.log"
Jul 21 02:09:51.794250 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:51.794216    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7538-140632277681184"]
Jul 21 02:09:51.799492 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:51.799465    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7538-140632277681184"]
Jul 21 02:09:51.847866 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:51.847831    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dl526\" (UniqueName: \"kubernetes.io/projected/43b3b4fb-5aa0-4ed3-8d02-be8ae4b1dc80-kube-api-access-dl526\") pod \"43b3b4fb-5aa0-4ed3-8d02-be8ae4b1dc80\" (UID: \"43b3b4fb-5aa0-4ed3-8d02-be8ae4b1dc80\") "
Jul 21 02:09:51.850150 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:51.850114    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43b3b4fb-5aa0-4ed3-8d02-be8ae4b1dc80-kube-api-access-dl526" (OuterVolumeSpecName: "kube-api-access-dl526") pod "43b3b4fb-5aa0-4ed3-8d02-be8ae4b1dc80" (UID: "43b3b4fb-5aa0-4ed3-8d02-be8ae4b1dc80"). InnerVolumeSpecName "kube-api-access-dl526". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:09:51.948841 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:51.948800    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dl526\" (UniqueName: \"kubernetes.io/projected/43b3b4fb-5aa0-4ed3-8d02-be8ae4b1dc80-kube-api-access-dl526\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:09:51.989695 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:51.989660    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0dfbd0-q7mrs"]
Jul 21 02:09:51.990105 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:51.990090    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43b3b4fb-5aa0-4ed3-8d02-be8ae4b1dc80" containerName="test-curl-7538-140632277681184"
Jul 21 02:09:51.990157 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:51.990107    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="43b3b4fb-5aa0-4ed3-8d02-be8ae4b1dc80" containerName="test-curl-7538-140632277681184"
Jul 21 02:09:51.990222 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:51.990212    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="43b3b4fb-5aa0-4ed3-8d02-be8ae4b1dc80" containerName="test-curl-7538-140632277681184"
Jul 21 02:09:51.993496 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:51.993475    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0dfbd0-q7mrs"
Jul 21 02:09:51.996183 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:51.996151    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 02:09:51.996312 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:51.996184    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8wthr\""
Jul 21 02:09:52.005568 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:52.005537    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0dfbd0-q7mrs"]
Jul 21 02:09:52.050281 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:52.050247    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee6dae1b-2b27-4e97-9ee7-3c4378400461-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-0dfbd0-q7mrs\" (UID: \"ee6dae1b-2b27-4e97-9ee7-3c4378400461\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0dfbd0-q7mrs"
Jul 21 02:09:52.151657 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:52.151570    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee6dae1b-2b27-4e97-9ee7-3c4378400461-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-0dfbd0-q7mrs\" (UID: \"ee6dae1b-2b27-4e97-9ee7-3c4378400461\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0dfbd0-q7mrs"
Jul 21 02:09:52.152237 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:52.152219    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee6dae1b-2b27-4e97-9ee7-3c4378400461-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-0dfbd0-q7mrs\" (UID: \"ee6dae1b-2b27-4e97-9ee7-3c4378400461\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0dfbd0-q7mrs"
Jul 21 02:09:52.305224 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:52.305185    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0dfbd0-q7mrs"
Jul 21 02:09:52.443974 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:52.443851    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0dfbd0-q7mrs"]
Jul 21 02:09:52.446852 ip-10-0-131-213 kubenswrapper[2586]: W0721 02:09:52.446826    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee6dae1b_2b27_4e97_9ee7_3c4378400461.slice/crio-9b145b891b11a7a122270536b8e3c955b4e75206fa98b97af19dea8bb0d6121e WatchSource:0}: Error finding container 9b145b891b11a7a122270536b8e3c955b4e75206fa98b97af19dea8bb0d6121e: Status 404 returned error can't find the container with id 9b145b891b11a7a122270536b8e3c955b4e75206fa98b97af19dea8bb0d6121e
Jul 21 02:09:52.611178 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:52.611149    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7538-140632277681184"
Jul 21 02:09:52.611393 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:52.611188    2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76ca70483380d33d46042e20382942b3f407cfd8495bdd9ab0f8ec4eec09535f"
Jul 21 02:09:52.612633 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:52.612603    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0dfbd0-q7mrs" event={"ID":"ee6dae1b-2b27-4e97-9ee7-3c4378400461","Type":"ContainerStarted","Data":"9b145b891b11a7a122270536b8e3c955b4e75206fa98b97af19dea8bb0d6121e"}
Jul 21 02:09:52.621128 ip-10-0-131-213 kubenswrapper[2586]: E0721 02:09:52.621096    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7538-140632277681184\" is forbidden: User \"system:node:ip-10-0-131-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-213.ec2.internal' and this object" podUID="43b3b4fb-5aa0-4ed3-8d02-be8ae4b1dc80" pod="opendatahub/test-curl-7538-140632277681184"
Jul 21 02:09:53.310090 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:53.310056    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43b3b4fb-5aa0-4ed3-8d02-be8ae4b1dc80" path="/var/lib/kubelet/pods/43b3b4fb-5aa0-4ed3-8d02-be8ae4b1dc80/volumes"
Jul 21 02:09:53.619537 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:53.619507    2586 generic.go:356] "Generic (PLEG): container finished" podID="ee6dae1b-2b27-4e97-9ee7-3c4378400461" containerID="8022b743fd2d392844e3d6caff12e54f02b8c094fe1830aa925330b76ad6dc45" exitCode=0
Jul 21 02:09:53.619709 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:53.619605    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0dfbd0-q7mrs" event={"ID":"ee6dae1b-2b27-4e97-9ee7-3c4378400461","Type":"ContainerDied","Data":"8022b743fd2d392844e3d6caff12e54f02b8c094fe1830aa925330b76ad6dc45"}
Jul 21 02:09:54.762494 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:54.762465    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0dfbd0-q7mrs"
Jul 21 02:09:54.876656 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:54.876563    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee6dae1b-2b27-4e97-9ee7-3c4378400461-maas-api-service-ca\") pod \"ee6dae1b-2b27-4e97-9ee7-3c4378400461\" (UID: \"ee6dae1b-2b27-4e97-9ee7-3c4378400461\") "
Jul 21 02:09:54.876970 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:54.876917    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee6dae1b-2b27-4e97-9ee7-3c4378400461-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ee6dae1b-2b27-4e97-9ee7-3c4378400461" (UID: "ee6dae1b-2b27-4e97-9ee7-3c4378400461"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:09:54.977985 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:54.977920    2586 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee6dae1b-2b27-4e97-9ee7-3c4378400461-maas-api-service-ca\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:09:55.631421 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:55.631388    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0dfbd0-q7mrs"
Jul 21 02:09:55.631627 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:55.631395    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0dfbd0-q7mrs" event={"ID":"ee6dae1b-2b27-4e97-9ee7-3c4378400461","Type":"ContainerDied","Data":"9b145b891b11a7a122270536b8e3c955b4e75206fa98b97af19dea8bb0d6121e"}
Jul 21 02:09:55.631627 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:09:55.631509    2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b145b891b11a7a122270536b8e3c955b4e75206fa98b97af19dea8bb0d6121e"
Jul 21 02:10:05.505720 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:05.505678    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:10:07.104549 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:07.104509    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0dfbd0-q7mrs"]
Jul 21 02:10:07.108064 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:07.108036    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0dfbd0-q7mrs"]
Jul 21 02:10:07.309067 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:07.309031    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee6dae1b-2b27-4e97-9ee7-3c4378400461" path="/var/lib/kubelet/pods/ee6dae1b-2b27-4e97-9ee7-3c4378400461/volumes"
Jul 21 02:10:14.108963 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:14.108876    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a256ec-p2hcw"]
Jul 21 02:10:14.109329 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:14.109288    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee6dae1b-2b27-4e97-9ee7-3c4378400461" containerName="revoke-keys"
Jul 21 02:10:14.109329 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:14.109300    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee6dae1b-2b27-4e97-9ee7-3c4378400461" containerName="revoke-keys"
Jul 21 02:10:14.109408 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:14.109362    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee6dae1b-2b27-4e97-9ee7-3c4378400461" containerName="revoke-keys"
Jul 21 02:10:14.114953 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:14.114918    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a256ec-p2hcw"
Jul 21 02:10:14.117921 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:14.117892    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 02:10:14.118105 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:14.117892    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8wthr\""
Jul 21 02:10:14.131396 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:14.131348    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a256ec-p2hcw"]
Jul 21 02:10:14.262212 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:14.262161    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc7a0a66-87c1-4b78-ad86-bbda0ef72797-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-a256ec-p2hcw\" (UID: \"cc7a0a66-87c1-4b78-ad86-bbda0ef72797\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a256ec-p2hcw"
Jul 21 02:10:14.363370 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:14.363278    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc7a0a66-87c1-4b78-ad86-bbda0ef72797-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-a256ec-p2hcw\" (UID: \"cc7a0a66-87c1-4b78-ad86-bbda0ef72797\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a256ec-p2hcw"
Jul 21 02:10:14.363965 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:14.363922    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc7a0a66-87c1-4b78-ad86-bbda0ef72797-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-a256ec-p2hcw\" (UID: \"cc7a0a66-87c1-4b78-ad86-bbda0ef72797\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a256ec-p2hcw"
Jul 21 02:10:14.426257 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:14.426213    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a256ec-p2hcw"
Jul 21 02:10:14.584873 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:14.584826    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a256ec-p2hcw"]
Jul 21 02:10:14.592517 ip-10-0-131-213 kubenswrapper[2586]: W0721 02:10:14.592479    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc7a0a66_87c1_4b78_ad86_bbda0ef72797.slice/crio-469ff54fb4152fe17074b64b674144ec1864da546d5f0e82d89f82f59ce52c2d WatchSource:0}: Error finding container 469ff54fb4152fe17074b64b674144ec1864da546d5f0e82d89f82f59ce52c2d: Status 404 returned error can't find the container with id 469ff54fb4152fe17074b64b674144ec1864da546d5f0e82d89f82f59ce52c2d
Jul 21 02:10:14.732052 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:14.732012    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a256ec-p2hcw" event={"ID":"cc7a0a66-87c1-4b78-ad86-bbda0ef72797","Type":"ContainerStarted","Data":"469ff54fb4152fe17074b64b674144ec1864da546d5f0e82d89f82f59ce52c2d"}
Jul 21 02:10:15.738722 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:15.738690    2586 generic.go:356] "Generic (PLEG): container finished" podID="cc7a0a66-87c1-4b78-ad86-bbda0ef72797" containerID="9951d4bd3f59f9004fdec087eb4364f755ba2b8613f5c892a534302619eba610" exitCode=0
Jul 21 02:10:15.739171 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:15.738783    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a256ec-p2hcw" event={"ID":"cc7a0a66-87c1-4b78-ad86-bbda0ef72797","Type":"ContainerDied","Data":"9951d4bd3f59f9004fdec087eb4364f755ba2b8613f5c892a534302619eba610"}
Jul 21 02:10:16.892337 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:16.892308    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a256ec-p2hcw"
Jul 21 02:10:16.987520 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:16.987474    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc7a0a66-87c1-4b78-ad86-bbda0ef72797-maas-api-service-ca\") pod \"cc7a0a66-87c1-4b78-ad86-bbda0ef72797\" (UID: \"cc7a0a66-87c1-4b78-ad86-bbda0ef72797\") "
Jul 21 02:10:16.987847 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:16.987825    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc7a0a66-87c1-4b78-ad86-bbda0ef72797-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cc7a0a66-87c1-4b78-ad86-bbda0ef72797" (UID: "cc7a0a66-87c1-4b78-ad86-bbda0ef72797"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:10:17.088325 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:17.088222    2586 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc7a0a66-87c1-4b78-ad86-bbda0ef72797-maas-api-service-ca\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 21 02:10:17.749968 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:17.749920    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a256ec-p2hcw"
Jul 21 02:10:17.749968 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:17.749960    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a256ec-p2hcw" event={"ID":"cc7a0a66-87c1-4b78-ad86-bbda0ef72797","Type":"ContainerDied","Data":"469ff54fb4152fe17074b64b674144ec1864da546d5f0e82d89f82f59ce52c2d"}
Jul 21 02:10:17.750209 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:17.750008    2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="469ff54fb4152fe17074b64b674144ec1864da546d5f0e82d89f82f59ce52c2d"
Jul 21 02:10:27.598549 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:27.598493    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w8v8m"]
Jul 21 02:10:29.184058 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:29.184023    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a256ec-p2hcw"]
Jul 21 02:10:29.187036 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:29.187004    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a256ec-p2hcw"]
Jul 21 02:10:29.308638 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:29.308600    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc7a0a66-87c1-4b78-ad86-bbda0ef72797" path="/var/lib/kubelet/pods/cc7a0a66-87c1-4b78-ad86-bbda0ef72797/volumes"
Jul 21 02:10:42.075598 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:42.075564    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6bb6957b54-jdw8d_1d6513b7-8300-43f7-81f7-c0af9becb0a9/manager/0.log"
Jul 21 02:10:42.565158 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:42.565125    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74c7b5f9f-8vbqd_f4e7245a-0cc0-4c37-ac08-c2175d421ee9/copy-manifests/0.log"
Jul 21 02:10:42.574692 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:42.574664    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74c7b5f9f-8vbqd_f4e7245a-0cc0-4c37-ac08-c2175d421ee9/manager/0.log"
Jul 21 02:10:45.087701 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:45.087674    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-zjg7s_32b56443-fe9e-43f3-965b-fc607578ac39/kuadrant-console-plugin/0.log"
Jul 21 02:10:45.464808 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:45.464781    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-w8v8m_31462a27-cc4f-42b7-8cf2-6462d4596e52/limitador/0.log"
Jul 21 02:10:46.173892 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:46.173858    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545dd4bbd9-4dg6d_7e7b6130-64d4-41a2-ba36-33fbac91d602/kube-auth-proxy/0.log"
Jul 21 02:10:47.615896 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:47.615861    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-xnqlj_f588489a-a936-4d15-b3a5-769c4a2c917e/main/0.log"
Jul 21 02:10:47.736843 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:47.736811    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-5dksg_90c80363-e790-4b74-a345-1a896bdce61f/main/0.log"
Jul 21 02:10:56.222890 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:56.222859    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hm4l8_e1ad4368-cb38-4500-9a3c-9d3101bb3e09/global-pull-secret-syncer/0.log"
Jul 21 02:10:56.344071 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:56.344037    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pwgsm_be9755bc-dbcf-4698-921c-88db5322a227/konnectivity-agent/0.log"
Jul 21 02:10:56.490185 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:10:56.490109    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-213.ec2.internal_a9e90f2c5cc33581ed2c58ee5030092f/haproxy/0.log"
Jul 21 02:11:01.523993 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:01.523962    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-zjg7s_32b56443-fe9e-43f3-965b-fc607578ac39/kuadrant-console-plugin/0.log"
Jul 21 02:11:01.797655 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:01.797566    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-w8v8m_31462a27-cc4f-42b7-8cf2-6462d4596e52/limitador/0.log"
Jul 21 02:11:03.661621 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:03.661593    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d51b72a6-91a3-43e5-8690-31855abe4967/alertmanager/0.log"
Jul 21 02:11:03.686997 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:03.686967    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d51b72a6-91a3-43e5-8690-31855abe4967/config-reloader/0.log"
Jul 21 02:11:03.718305 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:03.718273    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d51b72a6-91a3-43e5-8690-31855abe4967/kube-rbac-proxy-web/0.log"
Jul 21 02:11:03.754572 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:03.754490    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d51b72a6-91a3-43e5-8690-31855abe4967/kube-rbac-proxy/0.log"
Jul 21 02:11:03.776685 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:03.776657    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d51b72a6-91a3-43e5-8690-31855abe4967/kube-rbac-proxy-metric/0.log"
Jul 21 02:11:03.799867 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:03.799834    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d51b72a6-91a3-43e5-8690-31855abe4967/prom-label-proxy/0.log"
Jul 21 02:11:03.821910 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:03.821879    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d51b72a6-91a3-43e5-8690-31855abe4967/init-config-reloader/0.log"
Jul 21 02:11:03.892678 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:03.892644    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-r2jpf_cab82bae-b077-47fe-8725-04a2d39bea10/kube-state-metrics/0.log"
Jul 21 02:11:03.915605 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:03.915577    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-r2jpf_cab82bae-b077-47fe-8725-04a2d39bea10/kube-rbac-proxy-main/0.log"
Jul 21 02:11:03.950053 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:03.950012    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-r2jpf_cab82bae-b077-47fe-8725-04a2d39bea10/kube-rbac-proxy-self/0.log"
Jul 21 02:11:03.991708 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:03.991677    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7598f45dc6-9sh89_eb8bad2b-774d-4994-a91f-ce3e46533608/metrics-server/0.log"
Jul 21 02:11:04.029094 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:04.029022    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-cn4ts_746eabd4-7e64-4632-8ce8-f13dc1cd4549/monitoring-plugin/0.log"
Jul 21 02:11:04.125452 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:04.125426    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9x8ct_2b565020-4cb1-4d9b-8557-3a99d1c3ddb3/node-exporter/0.log"
Jul 21 02:11:04.147622 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:04.147592    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9x8ct_2b565020-4cb1-4d9b-8557-3a99d1c3ddb3/kube-rbac-proxy/0.log"
Jul 21 02:11:04.169449 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:04.169424    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9x8ct_2b565020-4cb1-4d9b-8557-3a99d1c3ddb3/init-textfile/0.log"
Jul 21 02:11:04.263641 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:04.263614    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-g4djk_a929fe7b-0020-4b58-bdde-4a15366bfec9/kube-rbac-proxy-main/0.log"
Jul 21 02:11:04.284815 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:04.284740    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-g4djk_a929fe7b-0020-4b58-bdde-4a15366bfec9/kube-rbac-proxy-self/0.log"
Jul 21 02:11:04.316431 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:04.316401    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-g4djk_a929fe7b-0020-4b58-bdde-4a15366bfec9/openshift-state-metrics/0.log"
Jul 21 02:11:04.349391 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:04.349357    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b0ce746d-5d3b-40dc-864d-c0799ac7dc66/prometheus/0.log"
Jul 21 02:11:04.375656 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:04.375634    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b0ce746d-5d3b-40dc-864d-c0799ac7dc66/config-reloader/0.log"
Jul 21 02:11:04.414033 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:04.413995    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b0ce746d-5d3b-40dc-864d-c0799ac7dc66/thanos-sidecar/0.log"
Jul 21 02:11:04.436125 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:04.436101    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b0ce746d-5d3b-40dc-864d-c0799ac7dc66/kube-rbac-proxy-web/0.log"
Jul 21 02:11:04.459441 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:04.459412    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b0ce746d-5d3b-40dc-864d-c0799ac7dc66/kube-rbac-proxy/0.log"
Jul 21 02:11:04.483758 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:04.483733    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b0ce746d-5d3b-40dc-864d-c0799ac7dc66/kube-rbac-proxy-thanos/0.log"
Jul 21 02:11:04.504192 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:04.504167    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b0ce746d-5d3b-40dc-864d-c0799ac7dc66/init-config-reloader/0.log"
Jul 21 02:11:04.530824 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:04.530789    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-tfzfd_30c3c093-0067-43df-abc1-491950269dc0/prometheus-operator/0.log"
Jul 21 02:11:04.549713 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:04.549646    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-tfzfd_30c3c093-0067-43df-abc1-491950269dc0/kube-rbac-proxy/0.log"
Jul 21 02:11:04.573770 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:04.573741    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-pqctg_d33b4cd3-495d-4f1a-8041-a074d098526b/prometheus-operator-admission-webhook/0.log"
Jul 21 02:11:04.612378 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:04.612351    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-546b48bcfd-s56gb_1637fafd-f6b0-4869-827e-07ba5263c89e/telemeter-client/0.log"
Jul 21 02:11:04.633907 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:04.633879    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-546b48bcfd-s56gb_1637fafd-f6b0-4869-827e-07ba5263c89e/reload/0.log"
Jul 21 02:11:04.664771 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:04.664742    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-546b48bcfd-s56gb_1637fafd-f6b0-4869-827e-07ba5263c89e/kube-rbac-proxy/0.log"
Jul 21 02:11:04.697587 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:04.697559    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bdb586f8b-8ssc6_209b6aee-e2c6-43dc-8eef-bf23f5c31103/thanos-query/0.log"
Jul 21 02:11:04.722124 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:04.722097    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bdb586f8b-8ssc6_209b6aee-e2c6-43dc-8eef-bf23f5c31103/kube-rbac-proxy-web/0.log"
Jul 21 02:11:04.749862 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:04.749837    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bdb586f8b-8ssc6_209b6aee-e2c6-43dc-8eef-bf23f5c31103/kube-rbac-proxy/0.log"
Jul 21 02:11:04.770993 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:04.770967    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bdb586f8b-8ssc6_209b6aee-e2c6-43dc-8eef-bf23f5c31103/prom-label-proxy/0.log"
Jul 21 02:11:04.791834 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:04.791811    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bdb586f8b-8ssc6_209b6aee-e2c6-43dc-8eef-bf23f5c31103/kube-rbac-proxy-rules/0.log"
Jul 21 02:11:04.815244 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:04.815177    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bdb586f8b-8ssc6_209b6aee-e2c6-43dc-8eef-bf23f5c31103/kube-rbac-proxy-metrics/0.log"
Jul 21 02:11:06.644199 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:06.644163    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-whjhw/perf-node-gather-daemonset-98j6h"]
Jul 21 02:11:06.644584 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:06.644571    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc7a0a66-87c1-4b78-ad86-bbda0ef72797" containerName="revoke-keys"
Jul 21 02:11:06.644625 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:06.644587    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc7a0a66-87c1-4b78-ad86-bbda0ef72797" containerName="revoke-keys"
Jul 21 02:11:06.644689 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:06.644678    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc7a0a66-87c1-4b78-ad86-bbda0ef72797" containerName="revoke-keys"
Jul 21 02:11:06.647778 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:06.647760    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-98j6h"
Jul 21 02:11:06.649761 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:06.649741    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-whjhw\"/\"kube-root-ca.crt\""
Jul 21 02:11:06.649861 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:06.649795    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-whjhw\"/\"openshift-service-ca.crt\""
Jul 21 02:11:06.650270 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:06.650254    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-whjhw\"/\"default-dockercfg-vdthq\""
Jul 21 02:11:06.655298 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:06.655262    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-whjhw/perf-node-gather-daemonset-98j6h"]
Jul 21 02:11:06.770906 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:06.770858    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b602c1a6-980e-481e-a836-98f478b88997-lib-modules\") pod \"perf-node-gather-daemonset-98j6h\" (UID: \"b602c1a6-980e-481e-a836-98f478b88997\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-98j6h"
Jul 21 02:11:06.770906 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:06.770905    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b602c1a6-980e-481e-a836-98f478b88997-podres\") pod \"perf-node-gather-daemonset-98j6h\" (UID: \"b602c1a6-980e-481e-a836-98f478b88997\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-98j6h"
Jul 21 02:11:06.771182 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:06.771064    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b602c1a6-980e-481e-a836-98f478b88997-sys\") pod \"perf-node-gather-daemonset-98j6h\" (UID: \"b602c1a6-980e-481e-a836-98f478b88997\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-98j6h"
Jul 21 02:11:06.771182 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:06.771104    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rq6s\" (UniqueName: \"kubernetes.io/projected/b602c1a6-980e-481e-a836-98f478b88997-kube-api-access-9rq6s\") pod \"perf-node-gather-daemonset-98j6h\" (UID: \"b602c1a6-980e-481e-a836-98f478b88997\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-98j6h"
Jul 21 02:11:06.771182 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:06.771173    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b602c1a6-980e-481e-a836-98f478b88997-proc\") pod \"perf-node-gather-daemonset-98j6h\" (UID: \"b602c1a6-980e-481e-a836-98f478b88997\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-98j6h"
Jul 21 02:11:06.872093 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:06.872049    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b602c1a6-980e-481e-a836-98f478b88997-sys\") pod \"perf-node-gather-daemonset-98j6h\" (UID: \"b602c1a6-980e-481e-a836-98f478b88997\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-98j6h"
Jul 21 02:11:06.872278 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:06.872104    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rq6s\" (UniqueName: \"kubernetes.io/projected/b602c1a6-980e-481e-a836-98f478b88997-kube-api-access-9rq6s\") pod \"perf-node-gather-daemonset-98j6h\" (UID: \"b602c1a6-980e-481e-a836-98f478b88997\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-98j6h"
Jul 21 02:11:06.872278 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:06.872160    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b602c1a6-980e-481e-a836-98f478b88997-proc\") pod \"perf-node-gather-daemonset-98j6h\" (UID: \"b602c1a6-980e-481e-a836-98f478b88997\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-98j6h"
Jul 21 02:11:06.872278 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:06.872193    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b602c1a6-980e-481e-a836-98f478b88997-sys\") pod \"perf-node-gather-daemonset-98j6h\" (UID: \"b602c1a6-980e-481e-a836-98f478b88997\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-98j6h"
Jul 21 02:11:06.872278 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:06.872214    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b602c1a6-980e-481e-a836-98f478b88997-lib-modules\") pod \"perf-node-gather-daemonset-98j6h\" (UID: \"b602c1a6-980e-481e-a836-98f478b88997\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-98j6h"
Jul 21 02:11:06.872278 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:06.872250    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b602c1a6-980e-481e-a836-98f478b88997-podres\") pod \"perf-node-gather-daemonset-98j6h\" (UID: \"b602c1a6-980e-481e-a836-98f478b88997\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-98j6h"
Jul 21 02:11:06.872278 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:06.872259    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b602c1a6-980e-481e-a836-98f478b88997-proc\") pod \"perf-node-gather-daemonset-98j6h\" (UID: \"b602c1a6-980e-481e-a836-98f478b88997\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-98j6h"
Jul 21 02:11:06.872530 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:06.872363    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b602c1a6-980e-481e-a836-98f478b88997-podres\") pod \"perf-node-gather-daemonset-98j6h\" (UID: \"b602c1a6-980e-481e-a836-98f478b88997\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-98j6h"
Jul 21 02:11:06.872530 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:06.872400    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b602c1a6-980e-481e-a836-98f478b88997-lib-modules\") pod \"perf-node-gather-daemonset-98j6h\" (UID: \"b602c1a6-980e-481e-a836-98f478b88997\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-98j6h"
Jul 21 02:11:06.881256 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:06.881227    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rq6s\" (UniqueName: \"kubernetes.io/projected/b602c1a6-980e-481e-a836-98f478b88997-kube-api-access-9rq6s\") pod \"perf-node-gather-daemonset-98j6h\" (UID: \"b602c1a6-980e-481e-a836-98f478b88997\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-98j6h"
Jul 21 02:11:06.958538 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:06.958428    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-98j6h"
Jul 21 02:11:07.105175 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:07.105140    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-whjhw/perf-node-gather-daemonset-98j6h"]
Jul 21 02:11:07.108342 ip-10-0-131-213 kubenswrapper[2586]: W0721 02:11:07.108315    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb602c1a6_980e_481e_a836_98f478b88997.slice/crio-4c5b81ee0e8d30ba15b12d9fcc8db27576036b027d4e8ff0215152e66a22d6ca WatchSource:0}: Error finding container 4c5b81ee0e8d30ba15b12d9fcc8db27576036b027d4e8ff0215152e66a22d6ca: Status 404 returned error can't find the container with id 4c5b81ee0e8d30ba15b12d9fcc8db27576036b027d4e8ff0215152e66a22d6ca
Jul 21 02:11:07.407460 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:07.407415    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-fjv8z_c096a789-958f-4e95-900f-5737ba498889/download-server/0.log"
Jul 21 02:11:08.007327 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:08.007284    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-98j6h" event={"ID":"b602c1a6-980e-481e-a836-98f478b88997","Type":"ContainerStarted","Data":"99a41231016a164ee2d2ef34e7a23cee85f900de102d6f38f45243a59579114e"}
Jul 21 02:11:08.007738 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:08.007386    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-98j6h" event={"ID":"b602c1a6-980e-481e-a836-98f478b88997","Type":"ContainerStarted","Data":"4c5b81ee0e8d30ba15b12d9fcc8db27576036b027d4e8ff0215152e66a22d6ca"}
Jul 21 02:11:08.007738 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:08.007417    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-98j6h"
Jul 21 02:11:08.028105 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:08.028047    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-98j6h" podStartSLOduration=2.028030148 podStartE2EDuration="2.028030148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 02:11:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:11:08.026790619 +0000 UTC m=+2927.214830010" watchObservedRunningTime="2026-07-21 02:11:08.028030148 +0000 UTC m=+2927.216069537"
Jul 21 02:11:09.066349 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:09.066304    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-svwc8_46b75d82-7430-4a0c-aaba-10b7e2458f74/dns/0.log"
Jul 21 02:11:09.087347 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:09.087319    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-svwc8_46b75d82-7430-4a0c-aaba-10b7e2458f74/kube-rbac-proxy/0.log"
Jul 21 02:11:09.197724 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:09.197685    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-slkgx_4dc33e59-dee4-4993-aee2-95bf4940a36c/dns-node-resolver/0.log"
Jul 21 02:11:09.722686 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:09.722657    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-66295_58d7de41-3645-4c8a-9250-e174e268c8e9/node-ca/0.log"
Jul 21 02:11:10.830470 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:10.830445    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545dd4bbd9-4dg6d_7e7b6130-64d4-41a2-ba36-33fbac91d602/kube-auth-proxy/0.log"
Jul 21 02:11:11.730655 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:11.730624    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vwk5q_e54512b1-3bc4-4d65-abcb-0d95573cbc51/serve-healthcheck-canary/0.log"
Jul 21 02:11:12.320197 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:12.320163    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xhmg6_46007ddc-a719-426e-9aa0-04acd11a3bd6/kube-rbac-proxy/0.log"
Jul 21 02:11:12.342239 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:12.342209    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xhmg6_46007ddc-a719-426e-9aa0-04acd11a3bd6/exporter/0.log"
Jul 21 02:11:12.363691 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:12.363644    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xhmg6_46007ddc-a719-426e-9aa0-04acd11a3bd6/extractor/0.log"
Jul 21 02:11:14.023461 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:14.023434    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-98j6h"
Jul 21 02:11:14.835875 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:14.835841    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6bb6957b54-jdw8d_1d6513b7-8300-43f7-81f7-c0af9becb0a9/manager/0.log"
Jul 21 02:11:15.025652 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:15.025619    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74c7b5f9f-8vbqd_f4e7245a-0cc0-4c37-ac08-c2175d421ee9/manager/0.log"
Jul 21 02:11:15.050728 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:15.050701    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74c7b5f9f-8vbqd_f4e7245a-0cc0-4c37-ac08-c2175d421ee9/copy-manifests/0.log"
Jul 21 02:11:16.627802 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:16.627770    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c984b598c-8r4qk_7269df4b-2549-42a1-91d2-4dc525f92dda/manager/0.log"
Jul 21 02:11:17.517210 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:17.517182    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545dd4bbd9-4dg6d_7e7b6130-64d4-41a2-ba36-33fbac91d602/kube-auth-proxy/0.log"
Jul 21 02:11:19.019079 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:19.019049    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545dd4bbd9-4dg6d_7e7b6130-64d4-41a2-ba36-33fbac91d602/kube-auth-proxy/0.log"
Jul 21 02:11:23.284560 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:23.284532    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kxv64_e50007d2-ddf9-433f-b3ee-379c4a88b1b7/kube-multus-additional-cni-plugins/0.log"
Jul 21 02:11:23.306158 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:23.306124    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kxv64_e50007d2-ddf9-433f-b3ee-379c4a88b1b7/egress-router-binary-copy/0.log"
Jul 21 02:11:23.327392 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:23.327366    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kxv64_e50007d2-ddf9-433f-b3ee-379c4a88b1b7/cni-plugins/0.log"
Jul 21 02:11:23.348433 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:23.348405    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kxv64_e50007d2-ddf9-433f-b3ee-379c4a88b1b7/bond-cni-plugin/0.log"
Jul 21 02:11:23.369765 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:23.369739    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kxv64_e50007d2-ddf9-433f-b3ee-379c4a88b1b7/routeoverride-cni/0.log"
Jul 21 02:11:23.394049 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:23.394015    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kxv64_e50007d2-ddf9-433f-b3ee-379c4a88b1b7/whereabouts-cni-bincopy/0.log"
Jul 21 02:11:23.415081 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:23.415053    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kxv64_e50007d2-ddf9-433f-b3ee-379c4a88b1b7/whereabouts-cni/0.log"
Jul 21 02:11:23.495268 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:23.495235    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-s8jbs_b525b4f3-47fe-4d16-b2bc-d8ce41ea6c83/kube-multus/0.log"
Jul 21 02:11:23.557205 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:23.557115    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-p4bm8_4c40807d-20bc-4fa8-957f-ef7712b7d745/network-metrics-daemon/0.log"
Jul 21 02:11:23.575235 ip-10-0-131-213 kubenswrapper[2586]: I0721 02:11:23.575210    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-p4bm8_4c40807d-20bc-4fa8-957f-ef7712b7d745/kube-rbac-proxy/0.log"