Jul 21 00:39:04.760219 ip-10-0-133-75 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 21 00:39:04.760231 ip-10-0-133-75 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 21 00:39:04.760242 ip-10-0-133-75 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 21 00:39:04.760576 ip-10-0-133-75 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 21 00:39:14.892878 ip-10-0-133-75 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 21 00:39:14.892896 ip-10-0-133-75 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot deebdf4afd494f56a142f90bc96b7f9c --
Jul 21 00:41:09.576011 ip-10-0-133-75 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 00:41:10.089040 ip-10-0-133-75 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 00:41:10.089040 ip-10-0-133-75 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 00:41:10.089040 ip-10-0-133-75 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 00:41:10.089040 ip-10-0-133-75 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 00:41:10.089040 ip-10-0-133-75 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 00:41:10.089040 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.052627    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 00:41:10.089040 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059123    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 00:41:10.089040 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059143    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 00:41:10.089040 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059147    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 00:41:10.089040 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059151    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 00:41:10.089040 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059154    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 00:41:10.089040 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059157    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 00:41:10.089040 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059164    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 00:41:10.089040 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059168    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 00:41:10.090119 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059173    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 00:41:10.090119 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059176    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 00:41:10.090119 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059179    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 00:41:10.090119 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059183    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 00:41:10.090119 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059186    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 00:41:10.090119 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059190    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 00:41:10.090119 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059193    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 00:41:10.090119 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059196    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 00:41:10.090119 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059200    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 00:41:10.090119 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059203    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 00:41:10.090119 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059206    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 00:41:10.090119 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059209    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 00:41:10.090119 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059212    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 00:41:10.090119 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059215    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 00:41:10.090119 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059219    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 00:41:10.090119 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059222    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 00:41:10.090119 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059225    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 00:41:10.090119 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059228    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 00:41:10.090119 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059231    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 00:41:10.090119 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059236    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 00:41:10.090827 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059239    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 00:41:10.090827 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059242    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 00:41:10.090827 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059244    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 00:41:10.090827 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059247    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 00:41:10.090827 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059250    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 00:41:10.090827 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059252    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 00:41:10.090827 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059255    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 00:41:10.090827 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059258    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 00:41:10.090827 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059261    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 00:41:10.090827 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059263    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 00:41:10.090827 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059266    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 00:41:10.090827 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059269    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 00:41:10.090827 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059272    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 00:41:10.090827 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059274    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 00:41:10.090827 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059277    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 00:41:10.090827 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059280    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 00:41:10.090827 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059282    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 00:41:10.090827 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059286    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 00:41:10.090827 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059290    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 00:41:10.090827 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059294    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 00:41:10.091520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059298    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 00:41:10.091520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059301    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 00:41:10.091520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059305    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 00:41:10.091520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059308    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 00:41:10.091520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059311    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 00:41:10.091520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059313    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 00:41:10.091520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059317    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 00:41:10.091520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059320    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 00:41:10.091520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059323    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 00:41:10.091520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059328    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 00:41:10.091520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059331    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 00:41:10.091520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059336    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 00:41:10.091520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059339    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 00:41:10.091520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059342    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 00:41:10.091520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059345    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 00:41:10.091520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059348    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 00:41:10.091520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059351    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 00:41:10.091520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059356    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 00:41:10.091520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059359    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 00:41:10.091520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059362    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 00:41:10.092508 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059365    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 00:41:10.092508 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059367    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 00:41:10.092508 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059370    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 00:41:10.092508 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059374    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 00:41:10.092508 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059377    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 00:41:10.092508 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059382    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 00:41:10.092508 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059384    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 00:41:10.092508 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059387    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 00:41:10.092508 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059390    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 00:41:10.092508 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059393    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 00:41:10.092508 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059396    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 00:41:10.092508 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059399    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 00:41:10.092508 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059402    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 00:41:10.092508 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059405    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 00:41:10.092508 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059408    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 00:41:10.092508 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059410    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 00:41:10.092508 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059413    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 00:41:10.092508 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059416    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 00:41:10.092508 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059419    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 00:41:10.092508 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059422    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 00:41:10.093104 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059425    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 00:41:10.093104 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059428    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 00:41:10.093104 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059431    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 00:41:10.093104 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059434    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 00:41:10.093104 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059437    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 00:41:10.093104 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059440    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 00:41:10.093104 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059443    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 00:41:10.093104 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059446    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 00:41:10.093104 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059449    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 00:41:10.093104 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059452    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 00:41:10.093104 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.059455    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 00:41:10.093104 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060325    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 00:41:10.093104 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060333    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 00:41:10.093104 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060337    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 00:41:10.093104 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060339    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 00:41:10.093104 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060342    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 00:41:10.093104 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060345    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 00:41:10.093104 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060348    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 00:41:10.093104 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060351    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 00:41:10.094161 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060354    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 00:41:10.094161 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060357    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 00:41:10.094161 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060361    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 00:41:10.094161 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060364    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 00:41:10.094161 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060367    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 00:41:10.094161 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060370    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 00:41:10.094161 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060373    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 00:41:10.094161 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060376    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 00:41:10.094161 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060379    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 00:41:10.094161 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060382    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 00:41:10.094161 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060384    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 00:41:10.094161 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060387    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 00:41:10.094161 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060391    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 00:41:10.094161 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060394    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 00:41:10.094161 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060397    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 00:41:10.094161 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060400    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 00:41:10.094161 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060403    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 00:41:10.094161 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060406    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 00:41:10.094161 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060408    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 00:41:10.094814 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060411    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 00:41:10.094814 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060414    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 00:41:10.094814 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060417    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 00:41:10.094814 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060420    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 00:41:10.094814 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060422    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 00:41:10.094814 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060425    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 00:41:10.094814 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060427    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 00:41:10.094814 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060430    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 00:41:10.094814 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060433    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 00:41:10.094814 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060435    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 00:41:10.094814 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060438    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 00:41:10.094814 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060440    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 00:41:10.094814 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060443    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 00:41:10.094814 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060446    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 00:41:10.094814 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060449    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 00:41:10.094814 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060451    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 00:41:10.094814 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060455    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 00:41:10.094814 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060459    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 00:41:10.094814 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060462    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 00:41:10.094814 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060489    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 00:41:10.095470 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060494    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 00:41:10.095470 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060498    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 00:41:10.095470 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060502    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 00:41:10.095470 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060507    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 00:41:10.095470 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060511    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 00:41:10.095470 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060514    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 00:41:10.095470 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060517    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 00:41:10.095470 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060520    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 00:41:10.095470 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060523    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 00:41:10.095470 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060526    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 00:41:10.095470 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060529    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 00:41:10.095470 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060534    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 00:41:10.095470 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060537    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 00:41:10.095470 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060540    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 00:41:10.095470 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060545    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 00:41:10.095470 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060548    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 00:41:10.095470 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060552    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 00:41:10.095470 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060555    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 00:41:10.095470 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060558    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 00:41:10.096073 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060561    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 00:41:10.096073 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060563    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 00:41:10.096073 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060566    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 00:41:10.096073 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060569    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 00:41:10.096073 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060572    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 00:41:10.096073 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060574    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 00:41:10.096073 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060577    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 00:41:10.096073 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060580    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 00:41:10.096073 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060583    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 00:41:10.096073 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060586    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 00:41:10.096073 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060590    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 00:41:10.096073 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060593    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 00:41:10.096073 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060596    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 00:41:10.096073 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060599    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 00:41:10.096073 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060602    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 00:41:10.096073 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060605    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 00:41:10.096073 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060608    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 00:41:10.096073 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060610    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 00:41:10.096073 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060613    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 00:41:10.096073 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060616    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 00:41:10.096704 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060619    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 00:41:10.096704 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060621    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 00:41:10.096704 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060628    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 00:41:10.096704 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060631    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 00:41:10.096704 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060634    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 00:41:10.096704 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060637    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 00:41:10.096704 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060640    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 00:41:10.096704 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060643    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 00:41:10.096704 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060646    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 00:41:10.096704 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060649    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 00:41:10.096704 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060652    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 00:41:10.096704 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060655    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 00:41:10.096704 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.060657    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 00:41:10.096704 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061117    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 00:41:10.096704 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061123    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 00:41:10.096704 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061126    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 00:41:10.096704 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061130    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 00:41:10.096704 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061133    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 00:41:10.096704 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061136    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 00:41:10.096704 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061139    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 00:41:10.217033 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061142    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 00:41:10.217033 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061145    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 00:41:10.217033 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061147    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 00:41:10.217033 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061151    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 00:41:10.217033 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061154    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 00:41:10.217033 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061157    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 00:41:10.217033 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061159    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 00:41:10.217033 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061162    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 00:41:10.217033 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061165    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 00:41:10.217033 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061186    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 00:41:10.217033 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061191    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 00:41:10.217033 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061195    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 00:41:10.217033 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061198    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 00:41:10.217033 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061201    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 00:41:10.217033 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061207    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 00:41:10.217033 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061211    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 00:41:10.217033 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061214    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 00:41:10.217033 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061218    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 00:41:10.217033 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061221    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 00:41:10.145718 ip-10-0-133-75 systemd[1]: Started Kubernetes Kubelet.
Jul 21 00:41:10.217797 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061224    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 00:41:10.217797 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061227    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 00:41:10.217797 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061230    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 00:41:10.217797 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061232    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 00:41:10.217797 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061235    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 00:41:10.217797 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061238    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 00:41:10.217797 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061240    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 00:41:10.217797 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061243    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 00:41:10.217797 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061246    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 00:41:10.217797 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061248    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 00:41:10.217797 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061251    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 00:41:10.217797 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061255    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 00:41:10.217797 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061258    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 00:41:10.217797 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061261    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 00:41:10.217797 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061263    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 00:41:10.217797 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061266    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 00:41:10.217797 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061269    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 00:41:10.217797 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061280    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 00:41:10.217797 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061283    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 00:41:10.217797 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061286    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 00:41:10.218653 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061288    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 00:41:10.218653 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061291    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 00:41:10.218653 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061294    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 00:41:10.218653 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061296    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 00:41:10.218653 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061299    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 00:41:10.218653 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061302    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 00:41:10.218653 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061305    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 00:41:10.218653 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061310    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 00:41:10.218653 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061312    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 00:41:10.218653 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061315    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 00:41:10.218653 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061318    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 00:41:10.218653 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061321    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 00:41:10.218653 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061324    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 00:41:10.218653 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061326    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 00:41:10.218653 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061329    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 00:41:10.218653 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061332    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 00:41:10.218653 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061335    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 00:41:10.218653 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061337    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 00:41:10.218653 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061340    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 00:41:10.218653 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061343    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 00:41:10.220489 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061345    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 00:41:10.220489 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061348    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 00:41:10.220489 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061351    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 00:41:10.220489 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061355    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 00:41:10.220489 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061358    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 00:41:10.220489 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061363    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 00:41:10.220489 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061367    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 00:41:10.220489 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061370    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 00:41:10.220489 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061374    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 00:41:10.220489 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061377    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 00:41:10.220489 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061380    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 00:41:10.220489 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061383    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 00:41:10.220489 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061386    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 00:41:10.220489 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061389    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 00:41:10.220489 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061392    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 00:41:10.220489 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061395    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 00:41:10.220489 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061398    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 00:41:10.220489 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061400    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 00:41:10.220489 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061403    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 00:41:10.221287 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061409    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 00:41:10.221287 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061412    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 00:41:10.221287 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061422    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 00:41:10.221287 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061425    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 00:41:10.221287 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061428    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 00:41:10.221287 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061431    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 00:41:10.221287 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061436    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 00:41:10.221287 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061439    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 00:41:10.221287 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061442    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 00:41:10.221287 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061445    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 00:41:10.221287 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061448    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 00:41:10.221287 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061452    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 00:41:10.221287 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061455    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 00:41:10.221287 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.061458    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 00:41:10.221287 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061546    2582 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 00:41:10.221287 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061555    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 00:41:10.221287 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061567    2582 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 00:41:10.221287 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061572    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 00:41:10.221287 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061577    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 00:41:10.221287 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061581    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 00:41:10.221287 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061585    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 00:41:10.222263 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061589    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 00:41:10.222263 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061593    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 00:41:10.222263 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061597    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 00:41:10.222263 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061602    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 00:41:10.222263 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061606    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 00:41:10.222263 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061609    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 00:41:10.222263 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061613    2582 flags.go:64] FLAG: --cgroup-root=""
Jul 21 00:41:10.222263 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061616    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 00:41:10.222263 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061619    2582 flags.go:64] FLAG: --client-ca-file=""
Jul 21 00:41:10.222263 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061622    2582 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 00:41:10.222263 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061625    2582 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 00:41:10.222263 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061633    2582 flags.go:64] FLAG: --cluster-domain=""
Jul 21 00:41:10.222263 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061636    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 00:41:10.222263 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061639    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 00:41:10.222263 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061642    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 00:41:10.222263 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061646    2582 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 00:41:10.222263 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061650    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 00:41:10.222263 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061654    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 00:41:10.222263 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061657    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 00:41:10.222263 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061661    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 00:41:10.222263 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061664    2582 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 00:41:10.222263 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061667    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 00:41:10.222263 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061671    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 00:41:10.222263 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061674    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 00:41:10.223570 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061677    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 00:41:10.223570 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061686    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 00:41:10.223570 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061689    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 00:41:10.223570 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061694    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 00:41:10.223570 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061697    2582 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 00:41:10.223570 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061701    2582 flags.go:64] FLAG: --enable-server="true"
Jul 21 00:41:10.223570 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061704    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 00:41:10.223570 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061708    2582 flags.go:64] FLAG: --event-burst="100"
Jul 21 00:41:10.223570 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061712    2582 flags.go:64] FLAG: --event-qps="50"
Jul 21 00:41:10.223570 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061715    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 00:41:10.223570 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061718    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 00:41:10.223570 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061735    2582 flags.go:64] FLAG: --eviction-hard=""
Jul 21 00:41:10.223570 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061740    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 00:41:10.223570 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061743    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 00:41:10.223570 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061747    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 00:41:10.223570 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061750    2582 flags.go:64] FLAG: --eviction-soft=""
Jul 21 00:41:10.223570 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061754    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 00:41:10.223570 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061757    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 00:41:10.223570 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061760    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 00:41:10.223570 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061766    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 00:41:10.223570 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061769    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 00:41:10.223570 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061772    2582 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 00:41:10.223570 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061775    2582 flags.go:64] FLAG: --feature-gates=""
Jul 21 00:41:10.223570 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061779    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 00:41:10.223570 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061783    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 00:41:10.226371 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061786    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 00:41:10.226371 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061790    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 00:41:10.226371 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061793    2582 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 00:41:10.226371 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061796    2582 flags.go:64] FLAG: --help="false"
Jul 21 00:41:10.226371 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061799    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-133-75.ec2.internal"
Jul 21 00:41:10.226371 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061802    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 00:41:10.226371 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061805    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 00:41:10.226371 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061808    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 00:41:10.226371 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061812    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 00:41:10.226371 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061815    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 00:41:10.226371 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061820    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 00:41:10.226371 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061823    2582 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 00:41:10.226371 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061826    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 00:41:10.226371 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061830    2582 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 00:41:10.226371 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061833    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 00:41:10.226371 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061836    2582 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 00:41:10.226371 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061839    2582 flags.go:64] FLAG: --kube-reserved=""
Jul 21 00:41:10.226371 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061842    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 00:41:10.226371 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061845    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 00:41:10.226371 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061848    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 00:41:10.226371 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061852    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 00:41:10.226371 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061855    2582 flags.go:64] FLAG: --lock-file=""
Jul 21 00:41:10.226371 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061858    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 00:41:10.226371 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061861    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 00:41:10.228138 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061865    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 00:41:10.228138 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061871    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 00:41:10.228138 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061876    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 00:41:10.228138 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061879    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 00:41:10.228138 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061882    2582 flags.go:64] FLAG: --logging-format="text"
Jul 21 00:41:10.228138 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061885    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 00:41:10.228138 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061889    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 00:41:10.228138 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061892    2582 flags.go:64] FLAG: --manifest-url=""
Jul 21 00:41:10.228138 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061895    2582 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 00:41:10.228138 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061899    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 00:41:10.228138 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061903    2582 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 00:41:10.228138 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061908    2582 flags.go:64] FLAG: --max-pods="110"
Jul 21 00:41:10.228138 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061911    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 00:41:10.228138 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061914    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 00:41:10.228138 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061917    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 00:41:10.228138 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061921    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 00:41:10.228138 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061924    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 00:41:10.228138 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061927    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 00:41:10.228138 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061932    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 00:41:10.228138 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061940    2582 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 00:41:10.228138 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061943    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 00:41:10.228138 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061947    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 00:41:10.228138 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061950    2582 flags.go:64] FLAG: --pod-cidr=""
Jul 21 00:41:10.229030 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061954    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 00:41:10.229030 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061960    2582 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 00:41:10.229030 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061963    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 00:41:10.229030 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061967    2582 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 00:41:10.229030 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061970    2582 flags.go:64] FLAG: --port="10250"
Jul 21 00:41:10.229030 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061973    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 00:41:10.229030 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061977    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03cc1e417256af6a1"
Jul 21 00:41:10.229030 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061980    2582 flags.go:64] FLAG: --qos-reserved=""
Jul 21 00:41:10.229030 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061984    2582 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 00:41:10.229030 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061987    2582 flags.go:64] FLAG: --register-node="true"
Jul 21 00:41:10.229030 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061990    2582 flags.go:64] FLAG: --register-with-taints=""
Jul 21 00:41:10.229030 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061994    2582 flags.go:64] FLAG: --registry-burst="10"
Jul 21 00:41:10.229030 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.061998    2582 flags.go:64] FLAG: --registry-qps="5"
Jul 21 00:41:10.229030 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062001    2582 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 00:41:10.229030 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062004    2582 flags.go:64] FLAG: --reserved-memory=""
Jul 21 00:41:10.229030 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062008    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 00:41:10.229030 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062011    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 00:41:10.229030 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062014    2582 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 00:41:10.229030 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062017    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 00:41:10.229030 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062020    2582 flags.go:64] FLAG: --runonce="false"
Jul 21 00:41:10.229030 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062023    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 00:41:10.229030 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062026    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 00:41:10.229030 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062030    2582 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 00:41:10.229030 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062033    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 00:41:10.229030 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062037    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 00:41:10.229955 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062040    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 00:41:10.229955 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062043    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 00:41:10.229955 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062048    2582 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 00:41:10.229955 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062051    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 00:41:10.229955 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062054    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 00:41:10.229955 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062057    2582 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 00:41:10.229955 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062060    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 00:41:10.229955 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062064    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 00:41:10.229955 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062067    2582 flags.go:64] FLAG: --system-cgroups=""
Jul 21 00:41:10.229955 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062070    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 00:41:10.229955 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062076    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 00:41:10.229955 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062079    2582 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 00:41:10.229955 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062082    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 00:41:10.229955 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062087    2582 flags.go:64] FLAG: --tls-min-version=""
Jul 21 00:41:10.229955 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062091    2582 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 00:41:10.229955 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062094    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 00:41:10.229955 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062097    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 00:41:10.229955 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062100    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 00:41:10.229955 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062103    2582 flags.go:64] FLAG: --v="2"
Jul 21 00:41:10.229955 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062109    2582 flags.go:64] FLAG: --version="false"
Jul 21 00:41:10.229955 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062114    2582 flags.go:64] FLAG: --vmodule=""
Jul 21 00:41:10.229955 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062118    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 00:41:10.229955 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.062121    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 00:41:10.229955 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062266    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 00:41:10.230705 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062271    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 00:41:10.230705 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062276    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 00:41:10.230705 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062280    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 00:41:10.230705 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062283    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 00:41:10.230705 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062286    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 00:41:10.230705 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062289    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 00:41:10.230705 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062292    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 00:41:10.230705 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062295    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 00:41:10.230705 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062298    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 00:41:10.230705 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062301    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 00:41:10.230705 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062306    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 00:41:10.230705 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062308    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 00:41:10.230705 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062312    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 00:41:10.230705 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062314    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 00:41:10.230705 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062317    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 00:41:10.230705 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062320    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 00:41:10.230705 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062323    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 00:41:10.230705 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062325    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 00:41:10.230705 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062328    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 00:41:10.230705 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062331    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 00:41:10.231412 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062333    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 00:41:10.231412 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062337    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 00:41:10.231412 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062339    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 00:41:10.231412 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062343    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 00:41:10.231412 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062345    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 00:41:10.231412 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062348    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 00:41:10.231412 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062350    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 00:41:10.231412 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062354    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 00:41:10.231412 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062357    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 00:41:10.231412 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062360    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 00:41:10.231412 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062363    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 00:41:10.231412 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062365    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 00:41:10.231412 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062368    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 00:41:10.231412 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062371    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 00:41:10.231412 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062373    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 00:41:10.231412 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062376    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 00:41:10.231412 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062379    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 00:41:10.231412 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062381    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 00:41:10.231412 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062384    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 00:41:10.231412 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062387    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 00:41:10.232076 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062389    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 00:41:10.232076 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062392    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 00:41:10.232076 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062396    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 00:41:10.232076 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062399    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 00:41:10.232076 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062401    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 00:41:10.232076 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062404    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 00:41:10.232076 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062407    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 00:41:10.232076 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062409    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 00:41:10.232076 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062412    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 00:41:10.232076 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062415    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 00:41:10.232076 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062417    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 00:41:10.232076 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062420    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 00:41:10.232076 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062423    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 00:41:10.232076 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062426    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 00:41:10.232076 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062428    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 00:41:10.232076 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062431    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 00:41:10.232076 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062434    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 00:41:10.232076 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062437    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 00:41:10.232076 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062439    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 00:41:10.232076 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062443    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 00:41:10.232944 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062446    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 00:41:10.232944 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062450    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 00:41:10.232944 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062454    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 00:41:10.232944 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062457    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 00:41:10.232944 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062461    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 00:41:10.232944 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062464    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 00:41:10.232944 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062467    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 00:41:10.232944 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062471    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 00:41:10.232944 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062474    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 00:41:10.232944 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062477    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 00:41:10.232944 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062480    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 00:41:10.232944 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062483    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 00:41:10.232944 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062486    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 00:41:10.232944 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062489    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 00:41:10.232944 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062493    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 00:41:10.232944 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062496    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 00:41:10.232944 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062498    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 00:41:10.232944 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062501    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 00:41:10.232944 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062504    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 00:41:10.233866 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062506    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 00:41:10.233866 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062509    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 00:41:10.233866 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062512    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 00:41:10.233866 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062514    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 00:41:10.233866 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062517    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 00:41:10.233866 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062520    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 00:41:10.233866 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062523    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 00:41:10.233866 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062526    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 00:41:10.233866 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062528    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 00:41:10.233866 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062531    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 00:41:10.233866 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062534    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 00:41:10.233866 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062537    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 00:41:10.233866 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062541    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 00:41:10.233866 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062544    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 00:41:10.233866 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062546    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 00:41:10.233866 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062549    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 00:41:10.233866 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062552    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 00:41:10.233866 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062555    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 00:41:10.233866 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.062557    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 00:41:10.234558 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.063136    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 00:41:10.234558 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.072942    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 00:41:10.234558 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.072968    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 00:41:10.234558 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.073676    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 00:41:10.234558 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.073686    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 00:41:10.234558 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073759    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 00:41:10.234558 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073765    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 00:41:10.234558 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073768    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 00:41:10.234558 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073773    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 00:41:10.234558 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073776    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 00:41:10.234558 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073779    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 00:41:10.234558 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073782    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 00:41:10.234558 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073786    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 00:41:10.234558 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073789    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 00:41:10.234558 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073792    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 00:41:10.235163 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073795    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 00:41:10.235163 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073798    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 00:41:10.235163 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073801    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 00:41:10.235163 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073804    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 00:41:10.235163 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073807    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 00:41:10.235163 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073810    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 00:41:10.235163 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073813    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 00:41:10.235163 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073816    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 00:41:10.235163 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073818    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 00:41:10.235163 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073821    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 00:41:10.235163 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073824    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 00:41:10.235163 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073826    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 00:41:10.235163 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073830    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 00:41:10.235163 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073833    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 00:41:10.235163 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073836    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 00:41:10.235163 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073839    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 00:41:10.235163 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073842    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 00:41:10.235163 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073851    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 00:41:10.235163 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073854    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 00:41:10.235163 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073858    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 00:41:10.235749 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073861    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 00:41:10.235749 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073864    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 00:41:10.235749 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073866    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 00:41:10.235749 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073869    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 00:41:10.235749 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073872    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 00:41:10.235749 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073874    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 00:41:10.235749 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073877    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 00:41:10.235749 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073880    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 00:41:10.235749 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073882    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 00:41:10.235749 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073886    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 00:41:10.235749 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073888    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 00:41:10.235749 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073893    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 00:41:10.235749 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073898    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 00:41:10.235749 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073901    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 00:41:10.235749 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073903    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 00:41:10.235749 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073906    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 00:41:10.235749 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073909    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 00:41:10.235749 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073912    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 00:41:10.235749 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073914    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 00:41:10.236338 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073919    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 00:41:10.236338 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073923    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 00:41:10.236338 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073926    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 00:41:10.236338 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073929    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 00:41:10.236338 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073932    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 00:41:10.236338 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073935    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 00:41:10.236338 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073937    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 00:41:10.236338 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073940    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 00:41:10.236338 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073942    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 00:41:10.236338 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073945    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 00:41:10.236338 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073951    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 00:41:10.236338 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073954    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 00:41:10.236338 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073957    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 00:41:10.236338 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073960    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 00:41:10.236338 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073963    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 00:41:10.236338 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073965    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 00:41:10.236338 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073969    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 00:41:10.236338 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073973    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 00:41:10.236338 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073976    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 00:41:10.236910 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073979    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 00:41:10.236910 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073982    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 00:41:10.236910 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073985    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 00:41:10.236910 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073987    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 00:41:10.236910 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073990    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 00:41:10.236910 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073993    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 00:41:10.236910 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073995    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 00:41:10.236910 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.073998    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 00:41:10.236910 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074001    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 00:41:10.236910 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074004    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 00:41:10.236910 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074006    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 00:41:10.236910 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074009    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 00:41:10.236910 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074012    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 00:41:10.236910 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074015    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 00:41:10.236910 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074017    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 00:41:10.236910 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074020    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 00:41:10.236910 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074023    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 00:41:10.236910 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074025    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 00:41:10.236910 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074028    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 00:41:10.236910 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074031    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 00:41:10.237520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074034    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 00:41:10.237520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074036    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 00:41:10.237520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074039    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 00:41:10.237520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074046    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 00:41:10.237520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074049    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 00:41:10.237520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074052    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 00:41:10.237520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074055    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 00:41:10.237520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074058    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 00:41:10.237520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074061    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 00:41:10.237520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074064    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 00:41:10.237520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074067    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 00:41:10.237520 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.074072    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 00:41:10.237520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074204    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 00:41:10.237520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074211    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 00:41:10.237520 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074214    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 00:41:10.386772 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074218    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 00:41:10.386772 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074221    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 00:41:10.386772 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074224    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 00:41:10.386772 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074227    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 00:41:10.386772 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074230    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 00:41:10.386772 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074234    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 00:41:10.386772 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074238    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 00:41:10.386772 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074241    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 00:41:10.386772 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074244    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 00:41:10.386772 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074246    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 00:41:10.386772 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074249    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 00:41:10.386772 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074252    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 00:41:10.386772 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074254    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 00:41:10.386772 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074258    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 00:41:10.386772 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074260    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 00:41:10.386772 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074264    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 00:41:10.386772 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074268    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 00:41:10.386772 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074271    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 00:41:10.386772 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074274    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 00:41:10.412666 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074277    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 00:41:10.412666 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074282    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 00:41:10.412666 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074289    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 00:41:10.412666 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074292    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 00:41:10.412666 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074295    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 00:41:10.412666 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074298    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 00:41:10.412666 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074301    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 00:41:10.412666 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074304    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 00:41:10.412666 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074307    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 00:41:10.412666 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074309    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 00:41:10.412666 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074312    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 00:41:10.412666 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074315    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 00:41:10.412666 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074318    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 00:41:10.412666 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074321    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 00:41:10.412666 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074323    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 00:41:10.412666 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074326    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 00:41:10.412666 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074329    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 00:41:10.412666 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074332    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 00:41:10.412666 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074336    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 00:41:10.412666 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074339    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 00:41:10.415185 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074341    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 00:41:10.415185 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074344    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 00:41:10.415185 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074347    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 00:41:10.415185 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074350    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 00:41:10.415185 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074353    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 00:41:10.415185 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074355    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 00:41:10.415185 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074359    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 00:41:10.415185 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074361    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 00:41:10.415185 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074364    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 00:41:10.415185 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074367    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 00:41:10.415185 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074369    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 00:41:10.415185 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074371    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 00:41:10.415185 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074374    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 00:41:10.415185 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074379    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 00:41:10.415185 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074383    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 00:41:10.415185 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074386    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 00:41:10.415185 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074388    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 00:41:10.415185 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074391    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 00:41:10.415185 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074394    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 00:41:10.415185 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074398    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 00:41:10.416345 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074401    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 00:41:10.416345 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074403    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 00:41:10.416345 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074406    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 00:41:10.416345 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074409    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 00:41:10.416345 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074412    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 00:41:10.416345 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074414    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 00:41:10.416345 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074417    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 00:41:10.416345 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074421    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 00:41:10.416345 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074423    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 00:41:10.416345 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074426    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 00:41:10.416345 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074429    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 00:41:10.416345 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074431    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 00:41:10.416345 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074434    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 00:41:10.416345 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074437    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 00:41:10.416345 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074439    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 00:41:10.416345 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074442    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 00:41:10.416345 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074445    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 00:41:10.416345 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074448    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 00:41:10.416345 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074451    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 00:41:10.416345 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074453    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 00:41:10.417755 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074456    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 00:41:10.417755 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074458    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 00:41:10.417755 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074461    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 00:41:10.417755 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074464    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 00:41:10.417755 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074466    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 00:41:10.417755 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074471    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 00:41:10.417755 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074475    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 00:41:10.417755 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074478    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 00:41:10.417755 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074480    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 00:41:10.417755 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074483    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 00:41:10.417755 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074486    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 00:41:10.417755 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074489    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 00:41:10.417755 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074492    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 00:41:10.417755 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074495    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 00:41:10.417755 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074498    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 00:41:10.417755 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074500    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 00:41:10.417755 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:10.074503    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 00:41:10.418696 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.074509    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 00:41:10.418696 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.074665    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 00:41:10.418696 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.077595    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 00:41:10.418696 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.078841    2582 server.go:1019] "Starting client certificate rotation"
Jul 21 00:41:10.418696 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.078961    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 00:41:10.418696 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.079015    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 00:41:10.418696 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.081219    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 00:41:10.418696 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.086660    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 00:41:10.418696 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.099190    2582 log.go:25] "Validated CRI v1 runtime API"
Jul 21 00:41:10.418696 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.101584    2582 log.go:25] "Validated CRI v1 image API"
Jul 21 00:41:10.418696 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.102492    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 00:41:10.418696 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.107987    2582 fs.go:135] Filesystem UUIDs: map[534d15b1-1827-4126-905c-bccc95a444a9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c7a1cc6c-a8ba-4632-b4e5-f90f7384dcc5:/dev/nvme0n1p4]
Jul 21 00:41:10.419394 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.108007    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 00:41:10.419394 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.111507    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 00:41:10.420091 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.112693    2582 manager.go:216] Machine: {Timestamp:2026-07-21 00:41:10.112159299 +0000 UTC m=+0.411855714 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3184944 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2030d27791febff4d2019b4b5d82a6 SystemUUID:ec2030d2-7791-febf-f4d2-019b4b5d82a6 BootID:deebdf4a-fd49-4f56-a142-f90bc96b7f9c Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b7:ad:d3:1d:35 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b7:ad:d3:1d:35 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:66:cb:36:fb:7f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 00:41:10.420091 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.112827    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 00:41:10.420091 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.112968    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 00:41:10.420091 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.116139    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 00:41:10.420091 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.116179    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-75.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 00:41:10.420091 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.116895    2582 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 00:41:10.420091 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.116908    2582 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 00:41:10.420091 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.116917    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 00:41:10.420091 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.117603    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 00:41:10.420091 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.118781    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 00:41:10.420091 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.123007    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 00:41:10.420091 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.123173    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 00:41:10.420091 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.123202    2582 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 00:41:10.420091 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.123214    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 00:41:10.420091 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.123232    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 00:41:10.420091 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.123247    2582 kubelet.go:398] "Adding apiserver pod source"
Jul 21 00:41:10.420091 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.123258    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 00:41:10.420091 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.123678    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.123697    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.128476    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.130079    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.130110    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.130339    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bdjcm"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.131554    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.131574    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.131581    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.131587    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.131596    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.131602    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.131610    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.131616    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.131623    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.131629    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.131638    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.131644    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.132677    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.132693    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.136388    2582 server.go:1268] "Started kubelet"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.136532    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.144612    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bdjcm"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.142359    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.144754    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.145395    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-75.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:10.145747    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-75.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:10.145795    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.147819    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.148655    2582 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:10.148933    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:10.148419    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-75.ec2.internal.18c42737249a99f5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-75.ec2.internal,UID:ip-10-0-133-75.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-75.ec2.internal,},FirstTimestamp:2026-07-21 00:41:10.136355317 +0000 UTC m=+0.436051732,LastTimestamp:2026-07-21 00:41:10.136355317 +0000 UTC m=+0.436051732,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-75.ec2.internal,}"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.154935    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.154940    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:10.155015    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-75.ec2.internal\" not found"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.155753    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.155769    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.155769    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.155915    2582 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 00:41:10.421704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.155924    2582 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.156210    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.156224    2582 factory.go:55] Registering systemd factory
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.156230    2582 factory.go:223] Registration of the systemd container factory successfully
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.156440    2582 factory.go:153] Registering CRI-O factory
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.156454    2582 factory.go:223] Registration of the crio container factory successfully
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.156475    2582 factory.go:103] Registering Raw factory
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.156487    2582 manager.go:1196] Started watching for new ooms in manager
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.156851    2582 manager.go:349] Starting recovery of all containers
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.164560    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.168267    2582 manager.go:354] Recovery completed
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.169006    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:10.172794    2582 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-75.ec2.internal\" not found" node="ip-10-0-133-75.ec2.internal"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.174966    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.177170    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.177196    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.177208    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-75.ec2.internal" event="NodeHasSufficientPID"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.177917    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.177926    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.177944    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.180337    2582 policy_none.go:49] "None policy: Start"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.180352    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.180362    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.182019    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.182676    2582 policy_none.go:47] "Start"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.183041    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.183077    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.183093    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-75.ec2.internal" event="NodeHasSufficientPID"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.210523    2582 manager.go:337] "Starting Device Plugin manager"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:10.210576    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.210588    2582 server.go:87] "Starting device plugin registration server"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.210922    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.210935    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.211033    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.211154    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.211165    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:10.221115    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:10.221189    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-75.ec2.internal\" not found"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.312520    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.313614    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.313644    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.313656    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-75.ec2.internal" event="NodeHasSufficientPID"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.313685    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-75.ec2.internal"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.320596    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-75.ec2.internal"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:10.320624    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-75.ec2.internal\": node \"ip-10-0-133-75.ec2.internal\" not found"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:10.333354    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-75.ec2.internal\" not found"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.337715    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.337774    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.337799    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 00:41:10.423634 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:10.337840    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 00:41:10.426031 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.340089    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:10.438968    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-75.ec2.internal\" not found"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.439009    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-75.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-75.ec2.internal"]
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.439127    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.440279    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.440303    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.440313    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-75.ec2.internal" event="NodeHasSufficientPID"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.442842    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.442953    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-75.ec2.internal"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.442996    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.443683    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.443700    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.443720    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.443730    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.443744    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-75.ec2.internal" event="NodeHasSufficientPID"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.443733    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-75.ec2.internal" event="NodeHasSufficientPID"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.446189    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-75.ec2.internal"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.446213    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.446996    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.447023    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.447033    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-75.ec2.internal" event="NodeHasSufficientPID"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.458133    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/610d9e0ff95d95bca94ab45c88df2393-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-75.ec2.internal\" (UID: \"610d9e0ff95d95bca94ab45c88df2393\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-75.ec2.internal"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.458163    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/610d9e0ff95d95bca94ab45c88df2393-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-75.ec2.internal\" (UID: \"610d9e0ff95d95bca94ab45c88df2393\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-75.ec2.internal"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.458185    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8a511dbb64386472f7853b93500b3424-config\") pod \"kube-apiserver-proxy-ip-10-0-133-75.ec2.internal\" (UID: \"8a511dbb64386472f7853b93500b3424\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-75.ec2.internal"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:10.475202    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-75.ec2.internal\" not found" node="ip-10-0-133-75.ec2.internal"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:10.481018    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-75.ec2.internal\" not found" node="ip-10-0-133-75.ec2.internal"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:10.540171    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-75.ec2.internal\" not found"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.559031    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/610d9e0ff95d95bca94ab45c88df2393-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-75.ec2.internal\" (UID: \"610d9e0ff95d95bca94ab45c88df2393\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-75.ec2.internal"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.559069    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/610d9e0ff95d95bca94ab45c88df2393-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-75.ec2.internal\" (UID: \"610d9e0ff95d95bca94ab45c88df2393\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-75.ec2.internal"
Jul 21 00:41:10.596846 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.559087    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8a511dbb64386472f7853b93500b3424-config\") pod \"kube-apiserver-proxy-ip-10-0-133-75.ec2.internal\" (UID: \"8a511dbb64386472f7853b93500b3424\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-75.ec2.internal"
Jul 21 00:41:10.598690 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.559154    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/610d9e0ff95d95bca94ab45c88df2393-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-75.ec2.internal\" (UID: \"610d9e0ff95d95bca94ab45c88df2393\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-75.ec2.internal"
Jul 21 00:41:10.598690 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.559139    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8a511dbb64386472f7853b93500b3424-config\") pod \"kube-apiserver-proxy-ip-10-0-133-75.ec2.internal\" (UID: \"8a511dbb64386472f7853b93500b3424\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-75.ec2.internal"
Jul 21 00:41:10.598690 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.559174    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/610d9e0ff95d95bca94ab45c88df2393-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-75.ec2.internal\" (UID: \"610d9e0ff95d95bca94ab45c88df2393\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-75.ec2.internal"
Jul 21 00:41:10.724406 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:10.640430    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-75.ec2.internal\" not found"
Jul 21 00:41:10.814840 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:10.747044    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-75.ec2.internal\" not found"
Jul 21 00:41:10.814840 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.779095    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-75.ec2.internal"
Jul 21 00:41:10.814840 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:10.801468    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-75.ec2.internal"
Jul 21 00:41:10.898016 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:10.847783    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-75.ec2.internal\" not found"
Jul 21 00:41:10.975451 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:10.948637    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-75.ec2.internal\" not found"
Jul 21 00:41:11.081576 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:11.049192    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-75.ec2.internal\" not found"
Jul 21 00:41:11.081576 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:11.078877    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 00:41:11.081576 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:11.079087    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 00:41:11.081576 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:11.079087    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 00:41:11.215508 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:11.149360    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-75.ec2.internal\" not found"
Jul 21 00:41:11.215508 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:11.153257    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 00:36:11 +0000 UTC" deadline="2028-02-13 20:30:54.849089246 +0000 UTC"
Jul 21 00:41:11.215508 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:11.153283    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13747h49m43.695809232s"
Jul 21 00:41:11.250307 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:11.250221    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-75.ec2.internal\" not found"
Jul 21 00:41:11.351078 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:11.351046    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-75.ec2.internal\" not found"
Jul 21 00:41:11.444884 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:11.444833    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod610d9e0ff95d95bca94ab45c88df2393.slice/crio-ea0c24cbb2cee1c709189f774cd400d1b135a25ea86dcef6ffdac2b482e18602 WatchSource:0}: Error finding container ea0c24cbb2cee1c709189f774cd400d1b135a25ea86dcef6ffdac2b482e18602: Status 404 returned error can't find the container with id ea0c24cbb2cee1c709189f774cd400d1b135a25ea86dcef6ffdac2b482e18602
Jul 21 00:41:11.445100 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:11.445084    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a511dbb64386472f7853b93500b3424.slice/crio-5d5f5f9d1bc4c8476d9039f943c58f05eed479391c7b79ed949a4855b9c909a3 WatchSource:0}: Error finding container 5d5f5f9d1bc4c8476d9039f943c58f05eed479391c7b79ed949a4855b9c909a3: Status 404 returned error can't find the container with id 5d5f5f9d1bc4c8476d9039f943c58f05eed479391c7b79ed949a4855b9c909a3
Jul 21 00:41:11.450630 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:11.450611    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 00:41:11.451131 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:11.451103    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-75.ec2.internal\" not found"
Jul 21 00:41:11.467582 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:11.467456    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 00:41:11.536934 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:11.536897    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 00:41:11.555803 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:11.555772    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-75.ec2.internal"
Jul 21 00:41:11.566365 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:11.566334    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 00:41:11.567430 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:11.567412    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-75.ec2.internal"
Jul 21 00:41:11.576982 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:11.576958    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 00:41:12.069061 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.069027    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 00:41:12.129695 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.129641    2582 apiserver.go:52] "Watching apiserver"
Jul 21 00:41:12.136357 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.136180    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 00:41:12.137048 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.137023    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-wkprw","kube-system/kube-apiserver-proxy-ip-10-0-133-75.ec2.internal","openshift-cluster-node-tuning-operator/tuned-m7mj9","openshift-image-registry/node-ca-x9vfr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-75.ec2.internal","openshift-multus/multus-2n82r","openshift-network-operator/iptables-alerter-ptk9k","openshift-ovn-kubernetes/ovnkube-node-bf6gs","kube-system/global-pull-secret-syncer-88txv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb","openshift-dns/node-resolver-9tbvx","openshift-multus/multus-additional-cni-plugins-kfclp","openshift-multus/network-metrics-daemon-bhkcc","openshift-network-diagnostics/network-check-target-wlhjv"]
Jul 21 00:41:12.140834 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.140812    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ptk9k"
Jul 21 00:41:12.142600 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.142577    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 00:41:12.142708 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.142648    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 00:41:12.142708 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.142699    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hxcdg\""
Jul 21 00:41:12.142810 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.142743    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 00:41:12.143365 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.143348    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9tbvx"
Jul 21 00:41:12.144872 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.144849    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tzdgk\""
Jul 21 00:41:12.145008 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.144989    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 00:41:12.145177 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.145162    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 00:41:12.145509 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.145495    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.147153 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.147137    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 00:41:12.147226 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.147213    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 00:41:12.147306 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.147289    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r55jd\""
Jul 21 00:41:12.147656 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.147639    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x9vfr"
Jul 21 00:41:12.149159 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.149144    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 00:41:12.149311 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.149291    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 00:41:12.149358 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.149316    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 00:41:12.149358 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.149347    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b824b\""
Jul 21 00:41:12.150004 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.149988    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:12.150090 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:12.150066    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:41:12.152437 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.152415    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.153981 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.153922    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 00:41:12.154202 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.154161    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 00:41:12.154202 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.154195    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 00:41:12.154341 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.154291    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jbtdf\""
Jul 21 00:41:12.154410 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.154299    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 00:41:12.154864 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.154836    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:12.154968 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:12.154944    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:41:12.156113 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.156091    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 00:41:12.157057 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.157038    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:12.157152 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:12.157099    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:41:12.159374 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.159358    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.161617 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.161594    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 00:41:12.161617 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.161616    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 00:41:12.161911 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.161800    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 00:41:12.161911 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.161894    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-m5dbx\""
Jul 21 00:41:12.161911 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.161905    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb"
Jul 21 00:41:12.162048 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.161967    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 00:41:12.162048 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.162042    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 00:41:12.162437 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.162325    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 00:41:12.163629 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.163605    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 00:41:12.163894 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.163865    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 00:41:12.165405 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.164450    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 00:41:12.165405 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.164617    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cv2qw\""
Jul 21 00:41:12.165405 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.165082    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 00:41:12.167608 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.166200    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wkprw"
Jul 21 00:41:12.167608 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.167537    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d61aa2f7-0359-4f25-b575-dd995021228e-metrics-certs\") pod \"network-metrics-daemon-bhkcc\" (UID: \"d61aa2f7-0359-4f25-b575-dd995021228e\") " pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:12.167608 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.167560    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-system-cni-dir\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.167608 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.167607    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-multus-socket-dir-parent\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.167881 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.167629    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0da7e607-7001-47f1-a96d-1c366f2dd3ef-kubelet-config\") pod \"global-pull-secret-syncer-88txv\" (UID: \"0da7e607-7001-47f1-a96d-1c366f2dd3ef\") " pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:12.167881 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.167652    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0da7e607-7001-47f1-a96d-1c366f2dd3ef-original-pull-secret\") pod \"global-pull-secret-syncer-88txv\" (UID: \"0da7e607-7001-47f1-a96d-1c366f2dd3ef\") " pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:12.167881 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.167686    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k22ts\" (UniqueName: \"kubernetes.io/projected/d61aa2f7-0359-4f25-b575-dd995021228e-kube-api-access-k22ts\") pod \"network-metrics-daemon-bhkcc\" (UID: \"d61aa2f7-0359-4f25-b575-dd995021228e\") " pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:12.167881 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.167711    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-multus-cni-dir\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.167881 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.167750    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14433a10-65ef-416b-9284-e38ae76b9f6a-cni-binary-copy\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.168124 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.167942    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-host-run-k8s-cni-cncf-io\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.168124 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.167984    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 00:41:12.168124 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.168007    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-host-run-netns\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.168124 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.168040    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-multus-conf-dir\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.168392 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.168191    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-host-run-multus-certs\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.168392 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.168232    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-etc-modprobe-d\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.168392 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.168289    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-etc-kubernetes\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.168392 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.168247    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 00:41:12.168593 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.168359    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-var-lib-kubelet\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.168593 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.168444    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-os-release\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.168593 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.168474    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/14433a10-65ef-416b-9284-e38ae76b9f6a-multus-daemon-config\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.168593 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.168514    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-etc-kubernetes\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.168593 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.168545    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9b3be570-f529-482f-b550-7c9859afc85b-host-slash\") pod \"iptables-alerter-ptk9k\" (UID: \"9b3be570-f529-482f-b550-7c9859afc85b\") " pod="openshift-network-operator/iptables-alerter-ptk9k"
Jul 21 00:41:12.168593 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.168560    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kfclp"
Jul 21 00:41:12.168593 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.168576    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f94d1cc3-b8ae-45e5-a26e-e1207b41fab1-tmp-dir\") pod \"node-resolver-9tbvx\" (UID: \"f94d1cc3-b8ae-45e5-a26e-e1207b41fab1\") " pod="openshift-dns/node-resolver-9tbvx"
Jul 21 00:41:12.169001 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.168618    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-etc-sysctl-d\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.169001 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.168646    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-sys\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.169001 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.168793    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dc09f871-05eb-4b8d-8be0-d756b949cb52-etc-tuned\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.169001 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.168867    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg7gh\" (UniqueName: \"kubernetes.io/projected/9b3be570-f529-482f-b550-7c9859afc85b-kube-api-access-dg7gh\") pod \"iptables-alerter-ptk9k\" (UID: \"9b3be570-f529-482f-b550-7c9859afc85b\") " pod="openshift-network-operator/iptables-alerter-ptk9k"
Jul 21 00:41:12.169001 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.168927    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g88gz\" (UniqueName: \"kubernetes.io/projected/f94d1cc3-b8ae-45e5-a26e-e1207b41fab1-kube-api-access-g88gz\") pod \"node-resolver-9tbvx\" (UID: \"f94d1cc3-b8ae-45e5-a26e-e1207b41fab1\") " pod="openshift-dns/node-resolver-9tbvx"
Jul 21 00:41:12.169001 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.168985    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-lib-modules\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.169298 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.169016    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-host-var-lib-cni-bin\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.169298 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.169050    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0ba67891-af9c-4a91-a956-bff562695d4c-serviceca\") pod \"node-ca-x9vfr\" (UID: \"0ba67891-af9c-4a91-a956-bff562695d4c\") " pod="openshift-image-registry/node-ca-x9vfr"
Jul 21 00:41:12.169298 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.169120    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k97v\" (UniqueName: \"kubernetes.io/projected/0ba67891-af9c-4a91-a956-bff562695d4c-kube-api-access-8k97v\") pod \"node-ca-x9vfr\" (UID: \"0ba67891-af9c-4a91-a956-bff562695d4c\") " pod="openshift-image-registry/node-ca-x9vfr"
Jul 21 00:41:12.169298 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.169181    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-hostroot\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.169298 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.169213    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f94d1cc3-b8ae-45e5-a26e-e1207b41fab1-hosts-file\") pod \"node-resolver-9tbvx\" (UID: \"f94d1cc3-b8ae-45e5-a26e-e1207b41fab1\") " pod="openshift-dns/node-resolver-9tbvx"
Jul 21 00:41:12.169298 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.169248    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ba67891-af9c-4a91-a956-bff562695d4c-host\") pod \"node-ca-x9vfr\" (UID: \"0ba67891-af9c-4a91-a956-bff562695d4c\") " pod="openshift-image-registry/node-ca-x9vfr"
Jul 21 00:41:12.169686 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.169298    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-etc-sysctl-conf\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.169686 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.169374    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9l79b\""
Jul 21 00:41:12.169686 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.169422    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-etc-systemd\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.169686 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.169525    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-run\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.169686 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.169602    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxncz\" (UniqueName: \"kubernetes.io/projected/dc09f871-05eb-4b8d-8be0-d756b949cb52-kube-api-access-cxncz\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.169686 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.169659    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-host-var-lib-kubelet\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.170022 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.169745    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btw2h\" (UniqueName: \"kubernetes.io/projected/14433a10-65ef-416b-9284-e38ae76b9f6a-kube-api-access-btw2h\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.170022 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.169770    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9b3be570-f529-482f-b550-7c9859afc85b-iptables-alerter-script\") pod \"iptables-alerter-ptk9k\" (UID: \"9b3be570-f529-482f-b550-7c9859afc85b\") " pod="openshift-network-operator/iptables-alerter-ptk9k"
Jul 21 00:41:12.170022 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.169804    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-etc-sysconfig\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.170022 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.169875    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-host\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.170022 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.169903    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc09f871-05eb-4b8d-8be0-d756b949cb52-tmp\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.170285 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.170264    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-cnibin\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.170343 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.170301    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-host-var-lib-cni-multus\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.170343 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.170327    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0da7e607-7001-47f1-a96d-1c366f2dd3ef-dbus\") pod \"global-pull-secret-syncer-88txv\" (UID: \"0da7e607-7001-47f1-a96d-1c366f2dd3ef\") " pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:12.170449 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.170366    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lszrr\" (UniqueName: \"kubernetes.io/projected/a817dd2e-1a95-45d6-bbca-6af085ee85a5-kube-api-access-lszrr\") pod \"network-check-target-wlhjv\" (UID: \"a817dd2e-1a95-45d6-bbca-6af085ee85a5\") " pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:12.170499 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.170478    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 00:41:12.170544 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.170478    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gttlc\""
Jul 21 00:41:12.170606 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.170544    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 00:41:12.178070 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.177874    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 00:41:12.188821 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.188799    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-68ln7"
Jul 21 00:41:12.197223 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.197202    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-68ln7"
Jul 21 00:41:12.257143 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.257108    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 00:41:12.270792 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.270755    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-etc-systemd\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.270792 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.270797    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-run\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.271058 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.270824    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btw2h\" (UniqueName: \"kubernetes.io/projected/14433a10-65ef-416b-9284-e38ae76b9f6a-kube-api-access-btw2h\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.271058 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.270857    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a3d080ee-b504-431c-9f18-bec478eea517-device-dir\") pod \"aws-ebs-csi-driver-node-8zqgb\" (UID: \"a3d080ee-b504-431c-9f18-bec478eea517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb"
Jul 21 00:41:12.271058 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.270882    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-env-overrides\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.271058 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.270905    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-ovn-node-metrics-cert\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.271058 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.270911    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-etc-systemd\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.271058 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.270929    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9da83bc3-8b2d-4191-ad4f-3070cf84d2ac-system-cni-dir\") pod \"multus-additional-cni-plugins-kfclp\" (UID: \"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac\") " pod="openshift-multus/multus-additional-cni-plugins-kfclp"
Jul 21 00:41:12.271058 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.270980    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9da83bc3-8b2d-4191-ad4f-3070cf84d2ac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kfclp\" (UID: \"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac\") " pod="openshift-multus/multus-additional-cni-plugins-kfclp"
Jul 21 00:41:12.271058 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271008    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-run\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.271058 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271043    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-etc-sysconfig\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.271561 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271071    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-host\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.271561 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271100    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-cnibin\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.271561 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271121    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-etc-sysconfig\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.271561 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271130    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0da7e607-7001-47f1-a96d-1c366f2dd3ef-dbus\") pod \"global-pull-secret-syncer-88txv\" (UID: \"0da7e607-7001-47f1-a96d-1c366f2dd3ef\") " pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:12.271561 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271157    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lszrr\" (UniqueName: \"kubernetes.io/projected/a817dd2e-1a95-45d6-bbca-6af085ee85a5-kube-api-access-lszrr\") pod \"network-check-target-wlhjv\" (UID: \"a817dd2e-1a95-45d6-bbca-6af085ee85a5\") " pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:12.271561 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271172    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-host\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.271561 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271181    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/136a9e74-4da5-4788-a64b-0d9db3001160-konnectivity-ca\") pod \"konnectivity-agent-wkprw\" (UID: \"136a9e74-4da5-4788-a64b-0d9db3001160\") " pod="kube-system/konnectivity-agent-wkprw"
Jul 21 00:41:12.271561 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271188    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-cnibin\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.271561 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271224    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-host-run-netns\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.271561 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271257    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-etc-openvswitch\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.271561 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271287    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-multus-socket-dir-parent\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.271561 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271315    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0da7e607-7001-47f1-a96d-1c366f2dd3ef-kubelet-config\") pod \"global-pull-secret-syncer-88txv\" (UID: \"0da7e607-7001-47f1-a96d-1c366f2dd3ef\") " pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:12.271561 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271339    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0da7e607-7001-47f1-a96d-1c366f2dd3ef-dbus\") pod \"global-pull-secret-syncer-88txv\" (UID: \"0da7e607-7001-47f1-a96d-1c366f2dd3ef\") " pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:12.271561 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271345    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0da7e607-7001-47f1-a96d-1c366f2dd3ef-original-pull-secret\") pod \"global-pull-secret-syncer-88txv\" (UID: \"0da7e607-7001-47f1-a96d-1c366f2dd3ef\") " pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:12.271561 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271420    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a3d080ee-b504-431c-9f18-bec478eea517-registration-dir\") pod \"aws-ebs-csi-driver-node-8zqgb\" (UID: \"a3d080ee-b504-431c-9f18-bec478eea517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb"
Jul 21 00:41:12.271561 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271424    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0da7e607-7001-47f1-a96d-1c366f2dd3ef-kubelet-config\") pod \"global-pull-secret-syncer-88txv\" (UID: \"0da7e607-7001-47f1-a96d-1c366f2dd3ef\") " pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:12.271561 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271504    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-multus-socket-dir-parent\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.271561 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:12.271518    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 00:41:12.272474 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271573    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-run-ovn\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.272474 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:12.271640    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0da7e607-7001-47f1-a96d-1c366f2dd3ef-original-pull-secret podName:0da7e607-7001-47f1-a96d-1c366f2dd3ef nodeName:}" failed. No retries permitted until 2026-07-21 00:41:12.771593283 +0000 UTC m=+3.071289708 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0da7e607-7001-47f1-a96d-1c366f2dd3ef-original-pull-secret") pod "global-pull-secret-syncer-88txv" (UID: "0da7e607-7001-47f1-a96d-1c366f2dd3ef") : object "kube-system"/"original-pull-secret" not registered
Jul 21 00:41:12.272474 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271663    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-host-cni-netd\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.272474 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271717    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9da83bc3-8b2d-4191-ad4f-3070cf84d2ac-cnibin\") pod \"multus-additional-cni-plugins-kfclp\" (UID: \"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac\") " pod="openshift-multus/multus-additional-cni-plugins-kfclp"
Jul 21 00:41:12.272474 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271747    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9da83bc3-8b2d-4191-ad4f-3070cf84d2ac-cni-binary-copy\") pod \"multus-additional-cni-plugins-kfclp\" (UID: \"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac\") " pod="openshift-multus/multus-additional-cni-plugins-kfclp"
Jul 21 00:41:12.272474 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271777    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14433a10-65ef-416b-9284-e38ae76b9f6a-cni-binary-copy\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.272474 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271820    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.272474 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271853    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9da83bc3-8b2d-4191-ad4f-3070cf84d2ac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kfclp\" (UID: \"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac\") " pod="openshift-multus/multus-additional-cni-plugins-kfclp"
Jul 21 00:41:12.272474 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271938    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g88gz\" (UniqueName: \"kubernetes.io/projected/f94d1cc3-b8ae-45e5-a26e-e1207b41fab1-kube-api-access-g88gz\") pod \"node-resolver-9tbvx\" (UID: \"f94d1cc3-b8ae-45e5-a26e-e1207b41fab1\") " pod="openshift-dns/node-resolver-9tbvx"
Jul 21 00:41:12.272474 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271971    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-etc-modprobe-d\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.272474 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.271995    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-etc-kubernetes\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.272474 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272021    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-var-lib-kubelet\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.272474 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272050    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/14433a10-65ef-416b-9284-e38ae76b9f6a-multus-daemon-config\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.272474 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272076    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9b3be570-f529-482f-b550-7c9859afc85b-host-slash\") pod \"iptables-alerter-ptk9k\" (UID: \"9b3be570-f529-482f-b550-7c9859afc85b\") " pod="openshift-network-operator/iptables-alerter-ptk9k"
Jul 21 00:41:12.272474 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272103    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f94d1cc3-b8ae-45e5-a26e-e1207b41fab1-tmp-dir\") pod \"node-resolver-9tbvx\" (UID: \"f94d1cc3-b8ae-45e5-a26e-e1207b41fab1\") " pod="openshift-dns/node-resolver-9tbvx"
Jul 21 00:41:12.272474 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272129    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-etc-sysctl-d\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.273318 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272138    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-etc-modprobe-d\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.273318 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272154    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-sys\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.273318 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272179    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dc09f871-05eb-4b8d-8be0-d756b949cb52-etc-tuned\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.273318 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272205    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg7gh\" (UniqueName: \"kubernetes.io/projected/9b3be570-f529-482f-b550-7c9859afc85b-kube-api-access-dg7gh\") pod \"iptables-alerter-ptk9k\" (UID: \"9b3be570-f529-482f-b550-7c9859afc85b\") " pod="openshift-network-operator/iptables-alerter-ptk9k"
Jul 21 00:41:12.273318 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272234    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-run-openvswitch\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.273318 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272247    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-var-lib-kubelet\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.273318 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272268    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-log-socket\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.273318 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272293    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-ovnkube-config\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.273318 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272298    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-sys\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.273318 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272300    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9b3be570-f529-482f-b550-7c9859afc85b-host-slash\") pod \"iptables-alerter-ptk9k\" (UID: \"9b3be570-f529-482f-b550-7c9859afc85b\") " pod="openshift-network-operator/iptables-alerter-ptk9k"
Jul 21 00:41:12.273318 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272338    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-lib-modules\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.273318 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272366    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a3d080ee-b504-431c-9f18-bec478eea517-socket-dir\") pod \"aws-ebs-csi-driver-node-8zqgb\" (UID: \"a3d080ee-b504-431c-9f18-bec478eea517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb"
Jul 21 00:41:12.273318 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272390    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-run-systemd\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.273318 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272407    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-etc-sysctl-d\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.273318 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272421    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f94d1cc3-b8ae-45e5-a26e-e1207b41fab1-hosts-file\") pod \"node-resolver-9tbvx\" (UID: \"f94d1cc3-b8ae-45e5-a26e-e1207b41fab1\") " pod="openshift-dns/node-resolver-9tbvx"
Jul 21 00:41:12.273318 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272440    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14433a10-65ef-416b-9284-e38ae76b9f6a-cni-binary-copy\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.273318 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272446    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-etc-sysctl-conf\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.274172 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272206    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-etc-kubernetes\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.274172 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272558    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxncz\" (UniqueName: \"kubernetes.io/projected/dc09f871-05eb-4b8d-8be0-d756b949cb52-kube-api-access-cxncz\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.274172 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272587    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-host-var-lib-kubelet\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.274172 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272582    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f94d1cc3-b8ae-45e5-a26e-e1207b41fab1-hosts-file\") pod \"node-resolver-9tbvx\" (UID: \"f94d1cc3-b8ae-45e5-a26e-e1207b41fab1\") " pod="openshift-dns/node-resolver-9tbvx"
Jul 21 00:41:12.274172 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272586    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f94d1cc3-b8ae-45e5-a26e-e1207b41fab1-tmp-dir\") pod \"node-resolver-9tbvx\" (UID: \"f94d1cc3-b8ae-45e5-a26e-e1207b41fab1\") " pod="openshift-dns/node-resolver-9tbvx"
Jul 21 00:41:12.274172 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272638    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-lib-modules\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.274172 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272640    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9b3be570-f529-482f-b550-7c9859afc85b-iptables-alerter-script\") pod \"iptables-alerter-ptk9k\" (UID: \"9b3be570-f529-482f-b550-7c9859afc85b\") " pod="openshift-network-operator/iptables-alerter-ptk9k"
Jul 21 00:41:12.274172 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272607    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dc09f871-05eb-4b8d-8be0-d756b949cb52-etc-sysctl-conf\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.274172 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272741    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vggb2\" (UniqueName: \"kubernetes.io/projected/a3d080ee-b504-431c-9f18-bec478eea517-kube-api-access-vggb2\") pod \"aws-ebs-csi-driver-node-8zqgb\" (UID: \"a3d080ee-b504-431c-9f18-bec478eea517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb"
Jul 21 00:41:12.274172 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272748    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-host-var-lib-kubelet\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.274172 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272807    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-node-log\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.274172 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272837    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-host-cni-bin\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.274172 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272863    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9da83bc3-8b2d-4191-ad4f-3070cf84d2ac-os-release\") pod \"multus-additional-cni-plugins-kfclp\" (UID: \"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac\") " pod="openshift-multus/multus-additional-cni-plugins-kfclp"
Jul 21 00:41:12.274172 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272907    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc09f871-05eb-4b8d-8be0-d756b949cb52-tmp\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.274172 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.272986    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-host-var-lib-cni-multus\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.274172 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273024    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/136a9e74-4da5-4788-a64b-0d9db3001160-agent-certs\") pod \"konnectivity-agent-wkprw\" (UID: \"136a9e74-4da5-4788-a64b-0d9db3001160\") " pod="kube-system/konnectivity-agent-wkprw"
Jul 21 00:41:12.274172 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273051    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-host-kubelet\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.274172 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273063    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 00:41:12.275093 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273075    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/14433a10-65ef-416b-9284-e38ae76b9f6a-multus-daemon-config\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.275093 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273083    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-host-slash\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.275093 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273097    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-host-var-lib-cni-multus\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.275093 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273150    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d61aa2f7-0359-4f25-b575-dd995021228e-metrics-certs\") pod \"network-metrics-daemon-bhkcc\" (UID: \"d61aa2f7-0359-4f25-b575-dd995021228e\") " pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:12.275093 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273198    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-system-cni-dir\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.275093 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273237    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-system-cni-dir\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.275093 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:12.273287    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:41:12.275093 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273326    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k97v\" (UniqueName: \"kubernetes.io/projected/0ba67891-af9c-4a91-a956-bff562695d4c-kube-api-access-8k97v\") pod \"node-ca-x9vfr\" (UID: \"0ba67891-af9c-4a91-a956-bff562695d4c\") " pod="openshift-image-registry/node-ca-x9vfr"
Jul 21 00:41:12.275093 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273332    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9b3be570-f529-482f-b550-7c9859afc85b-iptables-alerter-script\") pod \"iptables-alerter-ptk9k\" (UID: \"9b3be570-f529-482f-b550-7c9859afc85b\") " pod="openshift-network-operator/iptables-alerter-ptk9k"
Jul 21 00:41:12.275093 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:12.273343    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d61aa2f7-0359-4f25-b575-dd995021228e-metrics-certs podName:d61aa2f7-0359-4f25-b575-dd995021228e nodeName:}" failed. No retries permitted until 2026-07-21 00:41:12.773325873 +0000 UTC m=+3.073022293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d61aa2f7-0359-4f25-b575-dd995021228e-metrics-certs") pod "network-metrics-daemon-bhkcc" (UID: "d61aa2f7-0359-4f25-b575-dd995021228e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:41:12.275093 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273454    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a3d080ee-b504-431c-9f18-bec478eea517-sys-fs\") pod \"aws-ebs-csi-driver-node-8zqgb\" (UID: \"a3d080ee-b504-431c-9f18-bec478eea517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb"
Jul 21 00:41:12.275093 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273497    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k22ts\" (UniqueName: \"kubernetes.io/projected/d61aa2f7-0359-4f25-b575-dd995021228e-kube-api-access-k22ts\") pod \"network-metrics-daemon-bhkcc\" (UID: \"d61aa2f7-0359-4f25-b575-dd995021228e\") " pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:12.275093 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273527    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-multus-cni-dir\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.275093 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273554    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-host-run-k8s-cni-cncf-io\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.275093 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273583    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-host-run-netns\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.275093 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273646    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-host-run-k8s-cni-cncf-io\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.275093 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273662    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-multus-cni-dir\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.275927 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273699    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-multus-conf-dir\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.275927 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273736    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-host-run-netns\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.275927 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273751    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a3d080ee-b504-431c-9f18-bec478eea517-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8zqgb\" (UID: \"a3d080ee-b504-431c-9f18-bec478eea517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb"
Jul 21 00:41:12.275927 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273780    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-host-run-multus-certs\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.275927 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273784    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-multus-conf-dir\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.275927 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273817    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-os-release\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.275927 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273829    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-host-run-multus-certs\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.275927 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273846    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-etc-kubernetes\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.275927 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273875    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-systemd-units\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.275927 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273908    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.275927 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273944    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6znn\" (UniqueName: \"kubernetes.io/projected/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-kube-api-access-g6znn\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.275927 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273948    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-etc-kubernetes\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.275927 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273978    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-ovnkube-script-lib\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.275927 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.274012    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-host-var-lib-cni-bin\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.275927 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.273999    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-os-release\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.275927 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.274040    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0ba67891-af9c-4a91-a956-bff562695d4c-serviceca\") pod \"node-ca-x9vfr\" (UID: \"0ba67891-af9c-4a91-a956-bff562695d4c\") " pod="openshift-image-registry/node-ca-x9vfr"
Jul 21 00:41:12.275927 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.274067    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a3d080ee-b504-431c-9f18-bec478eea517-etc-selinux\") pod \"aws-ebs-csi-driver-node-8zqgb\" (UID: \"a3d080ee-b504-431c-9f18-bec478eea517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb"
Jul 21 00:41:12.276833 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.274069    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-host-var-lib-cni-bin\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.276833 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.274104    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-var-lib-openvswitch\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.276833 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.274132    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9da83bc3-8b2d-4191-ad4f-3070cf84d2ac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kfclp\" (UID: \"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac\") " pod="openshift-multus/multus-additional-cni-plugins-kfclp"
Jul 21 00:41:12.276833 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.274159    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjng2\" (UniqueName: \"kubernetes.io/projected/9da83bc3-8b2d-4191-ad4f-3070cf84d2ac-kube-api-access-vjng2\") pod \"multus-additional-cni-plugins-kfclp\" (UID: \"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac\") " pod="openshift-multus/multus-additional-cni-plugins-kfclp"
Jul 21 00:41:12.276833 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.274204    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-hostroot\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.276833 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.274248    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ba67891-af9c-4a91-a956-bff562695d4c-host\") pod \"node-ca-x9vfr\" (UID: \"0ba67891-af9c-4a91-a956-bff562695d4c\") " pod="openshift-image-registry/node-ca-x9vfr"
Jul 21 00:41:12.276833 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.274347    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ba67891-af9c-4a91-a956-bff562695d4c-host\") pod \"node-ca-x9vfr\" (UID: \"0ba67891-af9c-4a91-a956-bff562695d4c\") " pod="openshift-image-registry/node-ca-x9vfr"
Jul 21 00:41:12.276833 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.274517    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14433a10-65ef-416b-9284-e38ae76b9f6a-hostroot\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.276833 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.274533    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0ba67891-af9c-4a91-a956-bff562695d4c-serviceca\") pod \"node-ca-x9vfr\" (UID: \"0ba67891-af9c-4a91-a956-bff562695d4c\") " pod="openshift-image-registry/node-ca-x9vfr"
Jul 21 00:41:12.277461 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.277438    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dc09f871-05eb-4b8d-8be0-d756b949cb52-etc-tuned\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.277638 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:12.277620    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 00:41:12.277707 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:12.277644    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 00:41:12.277707 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:12.277666    2582 projected.go:196] Error preparing data for projected volume kube-api-access-lszrr for pod openshift-network-diagnostics/network-check-target-wlhjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:41:12.277858 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:12.277752    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a817dd2e-1a95-45d6-bbca-6af085ee85a5-kube-api-access-lszrr podName:a817dd2e-1a95-45d6-bbca-6af085ee85a5 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:12.777712801 +0000 UTC m=+3.077409231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lszrr" (UniqueName: "kubernetes.io/projected/a817dd2e-1a95-45d6-bbca-6af085ee85a5-kube-api-access-lszrr") pod "network-check-target-wlhjv" (UID: "a817dd2e-1a95-45d6-bbca-6af085ee85a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:41:12.277983 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.277959    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc09f871-05eb-4b8d-8be0-d756b949cb52-tmp\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.281169 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.281099    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btw2h\" (UniqueName: \"kubernetes.io/projected/14433a10-65ef-416b-9284-e38ae76b9f6a-kube-api-access-btw2h\") pod \"multus-2n82r\" (UID: \"14433a10-65ef-416b-9284-e38ae76b9f6a\") " pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.282511 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.282450    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg7gh\" (UniqueName: \"kubernetes.io/projected/9b3be570-f529-482f-b550-7c9859afc85b-kube-api-access-dg7gh\") pod \"iptables-alerter-ptk9k\" (UID: \"9b3be570-f529-482f-b550-7c9859afc85b\") " pod="openshift-network-operator/iptables-alerter-ptk9k"
Jul 21 00:41:12.282511 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.282485    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g88gz\" (UniqueName: \"kubernetes.io/projected/f94d1cc3-b8ae-45e5-a26e-e1207b41fab1-kube-api-access-g88gz\") pod \"node-resolver-9tbvx\" (UID: \"f94d1cc3-b8ae-45e5-a26e-e1207b41fab1\") " pod="openshift-dns/node-resolver-9tbvx"
Jul 21 00:41:12.283006 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.282925    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k97v\" (UniqueName: \"kubernetes.io/projected/0ba67891-af9c-4a91-a956-bff562695d4c-kube-api-access-8k97v\") pod \"node-ca-x9vfr\" (UID: \"0ba67891-af9c-4a91-a956-bff562695d4c\") " pod="openshift-image-registry/node-ca-x9vfr"
Jul 21 00:41:12.284117 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.284094    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxncz\" (UniqueName: \"kubernetes.io/projected/dc09f871-05eb-4b8d-8be0-d756b949cb52-kube-api-access-cxncz\") pod \"tuned-m7mj9\" (UID: \"dc09f871-05eb-4b8d-8be0-d756b949cb52\") " pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.284235 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.284159    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k22ts\" (UniqueName: \"kubernetes.io/projected/d61aa2f7-0359-4f25-b575-dd995021228e-kube-api-access-k22ts\") pod \"network-metrics-daemon-bhkcc\" (UID: \"d61aa2f7-0359-4f25-b575-dd995021228e\") " pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:12.344253 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.344119    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-75.ec2.internal" event={"ID":"610d9e0ff95d95bca94ab45c88df2393","Type":"ContainerStarted","Data":"ea0c24cbb2cee1c709189f774cd400d1b135a25ea86dcef6ffdac2b482e18602"}
Jul 21 00:41:12.345999 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.345947    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-75.ec2.internal" event={"ID":"8a511dbb64386472f7853b93500b3424","Type":"ContainerStarted","Data":"5d5f5f9d1bc4c8476d9039f943c58f05eed479391c7b79ed949a4855b9c909a3"}
Jul 21 00:41:12.375522 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.375480    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-host-run-netns\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.375522 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.375529    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-etc-openvswitch\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.375830 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.375573    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a3d080ee-b504-431c-9f18-bec478eea517-registration-dir\") pod \"aws-ebs-csi-driver-node-8zqgb\" (UID: \"a3d080ee-b504-431c-9f18-bec478eea517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb"
Jul 21 00:41:12.375830 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.375594    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-run-ovn\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.375830 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.375615    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-host-cni-netd\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.375830 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.375639    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9da83bc3-8b2d-4191-ad4f-3070cf84d2ac-cnibin\") pod \"multus-additional-cni-plugins-kfclp\" (UID: \"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac\") " pod="openshift-multus/multus-additional-cni-plugins-kfclp"
Jul 21 00:41:12.375830 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.375662    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9da83bc3-8b2d-4191-ad4f-3070cf84d2ac-cni-binary-copy\") pod \"multus-additional-cni-plugins-kfclp\" (UID: \"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac\") " pod="openshift-multus/multus-additional-cni-plugins-kfclp"
Jul 21 00:41:12.375830 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.375705    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.375830 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.375728    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9da83bc3-8b2d-4191-ad4f-3070cf84d2ac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kfclp\" (UID: \"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac\") " pod="openshift-multus/multus-additional-cni-plugins-kfclp"
Jul 21 00:41:12.375830 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.375765    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-run-openvswitch\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.375830 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.375788    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-log-socket\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.375830 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.375813    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-ovnkube-config\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.376323 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.375837    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a3d080ee-b504-431c-9f18-bec478eea517-socket-dir\") pod \"aws-ebs-csi-driver-node-8zqgb\" (UID: \"a3d080ee-b504-431c-9f18-bec478eea517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb"
Jul 21 00:41:12.376323 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.375873    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-run-systemd\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.376323 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.375905    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vggb2\" (UniqueName: \"kubernetes.io/projected/a3d080ee-b504-431c-9f18-bec478eea517-kube-api-access-vggb2\") pod \"aws-ebs-csi-driver-node-8zqgb\" (UID: \"a3d080ee-b504-431c-9f18-bec478eea517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb"
Jul 21 00:41:12.376323 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.375932    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-node-log\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.376323 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.375956    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-host-cni-bin\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.376323 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.375982    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9da83bc3-8b2d-4191-ad4f-3070cf84d2ac-os-release\") pod \"multus-additional-cni-plugins-kfclp\" (UID: \"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac\") " pod="openshift-multus/multus-additional-cni-plugins-kfclp"
Jul 21 00:41:12.376323 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376010    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/136a9e74-4da5-4788-a64b-0d9db3001160-agent-certs\") pod \"konnectivity-agent-wkprw\" (UID: \"136a9e74-4da5-4788-a64b-0d9db3001160\") " pod="kube-system/konnectivity-agent-wkprw"
Jul 21 00:41:12.376323 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376038    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-host-kubelet\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.376323 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376062    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-host-slash\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.376323 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376103    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a3d080ee-b504-431c-9f18-bec478eea517-sys-fs\") pod \"aws-ebs-csi-driver-node-8zqgb\" (UID: \"a3d080ee-b504-431c-9f18-bec478eea517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb"
Jul 21 00:41:12.376323 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376139    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a3d080ee-b504-431c-9f18-bec478eea517-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8zqgb\" (UID: \"a3d080ee-b504-431c-9f18-bec478eea517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb"
Jul 21 00:41:12.376323 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376168    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-systemd-units\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.376323 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376194    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.376323 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376222    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6znn\" (UniqueName: \"kubernetes.io/projected/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-kube-api-access-g6znn\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.376323 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376249    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-ovnkube-script-lib\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.376323 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376277    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a3d080ee-b504-431c-9f18-bec478eea517-etc-selinux\") pod \"aws-ebs-csi-driver-node-8zqgb\" (UID: \"a3d080ee-b504-431c-9f18-bec478eea517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb"
Jul 21 00:41:12.376323 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376311    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-var-lib-openvswitch\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.378586 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376339    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9da83bc3-8b2d-4191-ad4f-3070cf84d2ac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kfclp\" (UID: \"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac\") " pod="openshift-multus/multus-additional-cni-plugins-kfclp"
Jul 21 00:41:12.378586 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376367    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjng2\" (UniqueName: \"kubernetes.io/projected/9da83bc3-8b2d-4191-ad4f-3070cf84d2ac-kube-api-access-vjng2\") pod \"multus-additional-cni-plugins-kfclp\" (UID: \"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac\") " pod="openshift-multus/multus-additional-cni-plugins-kfclp"
Jul 21 00:41:12.378586 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376404    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a3d080ee-b504-431c-9f18-bec478eea517-device-dir\") pod \"aws-ebs-csi-driver-node-8zqgb\" (UID: \"a3d080ee-b504-431c-9f18-bec478eea517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb"
Jul 21 00:41:12.378586 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376430    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-env-overrides\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.378586 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376457    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-ovn-node-metrics-cert\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.378586 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376486    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9da83bc3-8b2d-4191-ad4f-3070cf84d2ac-system-cni-dir\") pod \"multus-additional-cni-plugins-kfclp\" (UID: \"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac\") " pod="openshift-multus/multus-additional-cni-plugins-kfclp"
Jul 21 00:41:12.378586 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376515    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9da83bc3-8b2d-4191-ad4f-3070cf84d2ac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kfclp\" (UID: \"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac\") " pod="openshift-multus/multus-additional-cni-plugins-kfclp"
Jul 21 00:41:12.378586 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376598    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-host-cni-bin\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.378586 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376644    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9da83bc3-8b2d-4191-ad4f-3070cf84d2ac-os-release\") pod \"multus-additional-cni-plugins-kfclp\" (UID: \"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac\") " pod="openshift-multus/multus-additional-cni-plugins-kfclp"
Jul 21 00:41:12.378586 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376723    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-host-run-netns\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.378586 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376768    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-etc-openvswitch\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.378586 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376816    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-log-socket\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.378586 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376808    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-run-openvswitch\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.378586 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376852    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9da83bc3-8b2d-4191-ad4f-3070cf84d2ac-cnibin\") pod \"multus-additional-cni-plugins-kfclp\" (UID: \"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac\") " pod="openshift-multus/multus-additional-cni-plugins-kfclp"
Jul 21 00:41:12.378586 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376868    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a3d080ee-b504-431c-9f18-bec478eea517-registration-dir\") pod \"aws-ebs-csi-driver-node-8zqgb\" (UID: \"a3d080ee-b504-431c-9f18-bec478eea517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb"
Jul 21 00:41:12.378586 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376923    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-host-cni-netd\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.378586 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376954    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-run-ovn\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.379422 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.376996    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.379422 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.377245    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a3d080ee-b504-431c-9f18-bec478eea517-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8zqgb\" (UID: \"a3d080ee-b504-431c-9f18-bec478eea517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb"
Jul 21 00:41:12.379422 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.377276    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-host-slash\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.379422 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.377291    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-systemd-units\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.379422 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.377310    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a3d080ee-b504-431c-9f18-bec478eea517-sys-fs\") pod \"aws-ebs-csi-driver-node-8zqgb\" (UID: \"a3d080ee-b504-431c-9f18-bec478eea517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb"
Jul 21 00:41:12.379422 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.377357    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-host-kubelet\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.379422 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.377357    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.379422 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.377493    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9da83bc3-8b2d-4191-ad4f-3070cf84d2ac-cni-binary-copy\") pod \"multus-additional-cni-plugins-kfclp\" (UID: \"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac\") " pod="openshift-multus/multus-additional-cni-plugins-kfclp"
Jul 21 00:41:12.379422 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.377508    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9da83bc3-8b2d-4191-ad4f-3070cf84d2ac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kfclp\" (UID: \"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac\") " pod="openshift-multus/multus-additional-cni-plugins-kfclp"
Jul 21 00:41:12.379422 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.377552    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-ovnkube-config\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.379422 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.377597    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/136a9e74-4da5-4788-a64b-0d9db3001160-konnectivity-ca\") pod \"konnectivity-agent-wkprw\" (UID: \"136a9e74-4da5-4788-a64b-0d9db3001160\") " pod="kube-system/konnectivity-agent-wkprw"
Jul 21 00:41:12.379422 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.377614    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-run-systemd\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.379422 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.377643    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-node-log\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.379422 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.377739    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a3d080ee-b504-431c-9f18-bec478eea517-socket-dir\") pod \"aws-ebs-csi-driver-node-8zqgb\" (UID: \"a3d080ee-b504-431c-9f18-bec478eea517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb"
Jul 21 00:41:12.379422 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.377831    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-var-lib-openvswitch\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.379422 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.377858    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a3d080ee-b504-431c-9f18-bec478eea517-device-dir\") pod \"aws-ebs-csi-driver-node-8zqgb\" (UID: \"a3d080ee-b504-431c-9f18-bec478eea517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb"
Jul 21 00:41:12.379422 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.377939    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9da83bc3-8b2d-4191-ad4f-3070cf84d2ac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kfclp\" (UID: \"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac\") " pod="openshift-multus/multus-additional-cni-plugins-kfclp"
Jul 21 00:41:12.380070 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.377983    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9da83bc3-8b2d-4191-ad4f-3070cf84d2ac-system-cni-dir\") pod \"multus-additional-cni-plugins-kfclp\" (UID: \"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac\") " pod="openshift-multus/multus-additional-cni-plugins-kfclp"
Jul 21 00:41:12.380070 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.378029    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a3d080ee-b504-431c-9f18-bec478eea517-etc-selinux\") pod \"aws-ebs-csi-driver-node-8zqgb\" (UID: \"a3d080ee-b504-431c-9f18-bec478eea517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb"
Jul 21 00:41:12.380070 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.378032    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9da83bc3-8b2d-4191-ad4f-3070cf84d2ac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kfclp\" (UID: \"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac\") " pod="openshift-multus/multus-additional-cni-plugins-kfclp"
Jul 21 00:41:12.380070 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.378070    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-ovnkube-script-lib\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.380070 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.378115    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-env-overrides\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.380070 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.378236    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/136a9e74-4da5-4788-a64b-0d9db3001160-konnectivity-ca\") pod \"konnectivity-agent-wkprw\" (UID: \"136a9e74-4da5-4788-a64b-0d9db3001160\") " pod="kube-system/konnectivity-agent-wkprw"
Jul 21 00:41:12.380826 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.380800    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-ovn-node-metrics-cert\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.381345 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.381297    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/136a9e74-4da5-4788-a64b-0d9db3001160-agent-certs\") pod \"konnectivity-agent-wkprw\" (UID: \"136a9e74-4da5-4788-a64b-0d9db3001160\") " pod="kube-system/konnectivity-agent-wkprw"
Jul 21 00:41:12.388554 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.388522    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjng2\" (UniqueName: \"kubernetes.io/projected/9da83bc3-8b2d-4191-ad4f-3070cf84d2ac-kube-api-access-vjng2\") pod \"multus-additional-cni-plugins-kfclp\" (UID: \"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac\") " pod="openshift-multus/multus-additional-cni-plugins-kfclp"
Jul 21 00:41:12.389963 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.389909    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6znn\" (UniqueName: \"kubernetes.io/projected/6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8-kube-api-access-g6znn\") pod \"ovnkube-node-bf6gs\" (UID: \"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.391078 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.391048    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vggb2\" (UniqueName: \"kubernetes.io/projected/a3d080ee-b504-431c-9f18-bec478eea517-kube-api-access-vggb2\") pod \"aws-ebs-csi-driver-node-8zqgb\" (UID: \"a3d080ee-b504-431c-9f18-bec478eea517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb"
Jul 21 00:41:12.451833 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.451791    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ptk9k"
Jul 21 00:41:12.458747 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.458715    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9tbvx"
Jul 21 00:41:12.468755 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.468568    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m7mj9"
Jul 21 00:41:12.471398 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:12.471353    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b3be570_f529_482f_b550_7c9859afc85b.slice/crio-e4d82b1ec1c31a806c0ec212a74d044d57e721c66457277c9eeabd0506443c07 WatchSource:0}: Error finding container e4d82b1ec1c31a806c0ec212a74d044d57e721c66457277c9eeabd0506443c07: Status 404 returned error can't find the container with id e4d82b1ec1c31a806c0ec212a74d044d57e721c66457277c9eeabd0506443c07
Jul 21 00:41:12.474376 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.474349    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x9vfr"
Jul 21 00:41:12.474490 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:12.474470    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf94d1cc3_b8ae_45e5_a26e_e1207b41fab1.slice/crio-fb1450cffdfea21e0f704c35d2b20a0d9832c779f80ae9dbb5264a9834ef86cb WatchSource:0}: Error finding container fb1450cffdfea21e0f704c35d2b20a0d9832c779f80ae9dbb5264a9834ef86cb: Status 404 returned error can't find the container with id fb1450cffdfea21e0f704c35d2b20a0d9832c779f80ae9dbb5264a9834ef86cb
Jul 21 00:41:12.481609 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.481192    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2n82r"
Jul 21 00:41:12.487023 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.486831    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:12.491307 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:12.491213    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba67891_af9c_4a91_a956_bff562695d4c.slice/crio-2f6317a60d1809993c3365bd4e8319c0ee68c35511879bd85349035ed03974f9 WatchSource:0}: Error finding container 2f6317a60d1809993c3365bd4e8319c0ee68c35511879bd85349035ed03974f9: Status 404 returned error can't find the container with id 2f6317a60d1809993c3365bd4e8319c0ee68c35511879bd85349035ed03974f9
Jul 21 00:41:12.491986 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.491962    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb"
Jul 21 00:41:12.499905 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.499881    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wkprw"
Jul 21 00:41:12.500506 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:12.500478    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14433a10_65ef_416b_9284_e38ae76b9f6a.slice/crio-7ccb56136a9a6ff1868d74387f56d1aa0aeee7bfbba8d3ba669f61d4f1663db4 WatchSource:0}: Error finding container 7ccb56136a9a6ff1868d74387f56d1aa0aeee7bfbba8d3ba669f61d4f1663db4: Status 404 returned error can't find the container with id 7ccb56136a9a6ff1868d74387f56d1aa0aeee7bfbba8d3ba669f61d4f1663db4
Jul 21 00:41:12.502930 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.502906    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kfclp"
Jul 21 00:41:12.510044 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:12.510000    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cbc17f7_0fa9_4380_8f8c_6e3d1e26c5a8.slice/crio-9a91c8efed8fe1c2e20c3128e6b62e54c3d4d0493afc00f1a664fa0d2864f832 WatchSource:0}: Error finding container 9a91c8efed8fe1c2e20c3128e6b62e54c3d4d0493afc00f1a664fa0d2864f832: Status 404 returned error can't find the container with id 9a91c8efed8fe1c2e20c3128e6b62e54c3d4d0493afc00f1a664fa0d2864f832
Jul 21 00:41:12.518843 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:41:12.518804    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3d080ee_b504_431c_9f18_bec478eea517.slice/crio-a2dae332446d60ece56b39be438bd0d91c0840afd5f959db7eb9526584f7ba00 WatchSource:0}: Error finding container a2dae332446d60ece56b39be438bd0d91c0840afd5f959db7eb9526584f7ba00: Status 404 returned error can't find the container with id a2dae332446d60ece56b39be438bd0d91c0840afd5f959db7eb9526584f7ba00
Jul 21 00:41:12.782182 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.782142    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lszrr\" (UniqueName: \"kubernetes.io/projected/a817dd2e-1a95-45d6-bbca-6af085ee85a5-kube-api-access-lszrr\") pod \"network-check-target-wlhjv\" (UID: \"a817dd2e-1a95-45d6-bbca-6af085ee85a5\") " pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:12.782392 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.782198    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0da7e607-7001-47f1-a96d-1c366f2dd3ef-original-pull-secret\") pod \"global-pull-secret-syncer-88txv\" (UID: \"0da7e607-7001-47f1-a96d-1c366f2dd3ef\") " pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:12.782392 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:12.782251    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d61aa2f7-0359-4f25-b575-dd995021228e-metrics-certs\") pod \"network-metrics-daemon-bhkcc\" (UID: \"d61aa2f7-0359-4f25-b575-dd995021228e\") " pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:12.782392 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:12.782325    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 00:41:12.782392 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:12.782349    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 00:41:12.782392 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:12.782357    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:41:12.782392 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:12.782364    2582 projected.go:196] Error preparing data for projected volume kube-api-access-lszrr for pod openshift-network-diagnostics/network-check-target-wlhjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:41:12.782392 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:12.782381    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 00:41:12.782867 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:12.782427    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a817dd2e-1a95-45d6-bbca-6af085ee85a5-kube-api-access-lszrr podName:a817dd2e-1a95-45d6-bbca-6af085ee85a5 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:13.782405454 +0000 UTC m=+4.082101876 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lszrr" (UniqueName: "kubernetes.io/projected/a817dd2e-1a95-45d6-bbca-6af085ee85a5-kube-api-access-lszrr") pod "network-check-target-wlhjv" (UID: "a817dd2e-1a95-45d6-bbca-6af085ee85a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:41:12.782867 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:12.782445    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0da7e607-7001-47f1-a96d-1c366f2dd3ef-original-pull-secret podName:0da7e607-7001-47f1-a96d-1c366f2dd3ef nodeName:}" failed. No retries permitted until 2026-07-21 00:41:13.782436192 +0000 UTC m=+4.082132604 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0da7e607-7001-47f1-a96d-1c366f2dd3ef-original-pull-secret") pod "global-pull-secret-syncer-88txv" (UID: "0da7e607-7001-47f1-a96d-1c366f2dd3ef") : object "kube-system"/"original-pull-secret" not registered
Jul 21 00:41:12.782867 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:12.782460    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d61aa2f7-0359-4f25-b575-dd995021228e-metrics-certs podName:d61aa2f7-0359-4f25-b575-dd995021228e nodeName:}" failed. No retries permitted until 2026-07-21 00:41:13.782451679 +0000 UTC m=+4.082148091 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d61aa2f7-0359-4f25-b575-dd995021228e-metrics-certs") pod "network-metrics-daemon-bhkcc" (UID: "d61aa2f7-0359-4f25-b575-dd995021228e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:41:13.201154 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:13.201046    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 00:36:12 +0000 UTC" deadline="2027-12-23 16:46:39.111889117 +0000 UTC"
Jul 21 00:41:13.201154 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:13.201091    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12496h5m25.910803935s"
Jul 21 00:41:13.339123 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:13.339079    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:13.339872 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:13.339269    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:41:13.351200 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:13.351157    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb" event={"ID":"a3d080ee-b504-431c-9f18-bec478eea517","Type":"ContainerStarted","Data":"a2dae332446d60ece56b39be438bd0d91c0840afd5f959db7eb9526584f7ba00"}
Jul 21 00:41:13.353537 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:13.353454    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m7mj9" event={"ID":"dc09f871-05eb-4b8d-8be0-d756b949cb52","Type":"ContainerStarted","Data":"5d976d140f816434e2d25839a6e2ac2e59d30a9cac180647c4266ed5e4acd6f9"}
Jul 21 00:41:13.355288 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:13.355209    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kfclp" event={"ID":"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac","Type":"ContainerStarted","Data":"c251b07658117f2f3ea9164362ea13559bd3ec7ea1efd43b3590809edf3648a6"}
Jul 21 00:41:13.357627 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:13.357593    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs" event={"ID":"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8","Type":"ContainerStarted","Data":"9a91c8efed8fe1c2e20c3128e6b62e54c3d4d0493afc00f1a664fa0d2864f832"}
Jul 21 00:41:13.361866 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:13.361816    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2n82r" event={"ID":"14433a10-65ef-416b-9284-e38ae76b9f6a","Type":"ContainerStarted","Data":"7ccb56136a9a6ff1868d74387f56d1aa0aeee7bfbba8d3ba669f61d4f1663db4"}
Jul 21 00:41:13.365721 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:13.365624    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x9vfr" event={"ID":"0ba67891-af9c-4a91-a956-bff562695d4c","Type":"ContainerStarted","Data":"2f6317a60d1809993c3365bd4e8319c0ee68c35511879bd85349035ed03974f9"}
Jul 21 00:41:13.367851 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:13.367816    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9tbvx" event={"ID":"f94d1cc3-b8ae-45e5-a26e-e1207b41fab1","Type":"ContainerStarted","Data":"fb1450cffdfea21e0f704c35d2b20a0d9832c779f80ae9dbb5264a9834ef86cb"}
Jul 21 00:41:13.370077 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:13.370002    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ptk9k" event={"ID":"9b3be570-f529-482f-b550-7c9859afc85b","Type":"ContainerStarted","Data":"e4d82b1ec1c31a806c0ec212a74d044d57e721c66457277c9eeabd0506443c07"}
Jul 21 00:41:13.371495 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:13.371437    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wkprw" event={"ID":"136a9e74-4da5-4788-a64b-0d9db3001160","Type":"ContainerStarted","Data":"7a1c1157941e3faeca220264055942f17a58577d0247d58ed0210623c1b90662"}
Jul 21 00:41:13.790481 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:13.790436    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d61aa2f7-0359-4f25-b575-dd995021228e-metrics-certs\") pod \"network-metrics-daemon-bhkcc\" (UID: \"d61aa2f7-0359-4f25-b575-dd995021228e\") " pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:13.790678 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:13.790522    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lszrr\" (UniqueName: \"kubernetes.io/projected/a817dd2e-1a95-45d6-bbca-6af085ee85a5-kube-api-access-lszrr\") pod \"network-check-target-wlhjv\" (UID: \"a817dd2e-1a95-45d6-bbca-6af085ee85a5\") " pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:13.790678 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:13.790555    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0da7e607-7001-47f1-a96d-1c366f2dd3ef-original-pull-secret\") pod \"global-pull-secret-syncer-88txv\" (UID: \"0da7e607-7001-47f1-a96d-1c366f2dd3ef\") " pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:13.790851 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:13.790722    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 00:41:13.790851 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:13.790792    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0da7e607-7001-47f1-a96d-1c366f2dd3ef-original-pull-secret podName:0da7e607-7001-47f1-a96d-1c366f2dd3ef nodeName:}" failed. No retries permitted until 2026-07-21 00:41:15.790771868 +0000 UTC m=+6.090468273 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0da7e607-7001-47f1-a96d-1c366f2dd3ef-original-pull-secret") pod "global-pull-secret-syncer-88txv" (UID: "0da7e607-7001-47f1-a96d-1c366f2dd3ef") : object "kube-system"/"original-pull-secret" not registered
Jul 21 00:41:13.791526 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:13.791264    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:41:13.791526 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:13.791323    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d61aa2f7-0359-4f25-b575-dd995021228e-metrics-certs podName:d61aa2f7-0359-4f25-b575-dd995021228e nodeName:}" failed. No retries permitted until 2026-07-21 00:41:15.791307438 +0000 UTC m=+6.091003842 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d61aa2f7-0359-4f25-b575-dd995021228e-metrics-certs") pod "network-metrics-daemon-bhkcc" (UID: "d61aa2f7-0359-4f25-b575-dd995021228e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:41:13.791526 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:13.791414    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 00:41:13.791526 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:13.791433    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 00:41:13.791526 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:13.791446    2582 projected.go:196] Error preparing data for projected volume kube-api-access-lszrr for pod openshift-network-diagnostics/network-check-target-wlhjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:41:13.791526 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:13.791485    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a817dd2e-1a95-45d6-bbca-6af085ee85a5-kube-api-access-lszrr podName:a817dd2e-1a95-45d6-bbca-6af085ee85a5 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:15.791472686 +0000 UTC m=+6.091169090 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lszrr" (UniqueName: "kubernetes.io/projected/a817dd2e-1a95-45d6-bbca-6af085ee85a5-kube-api-access-lszrr") pod "network-check-target-wlhjv" (UID: "a817dd2e-1a95-45d6-bbca-6af085ee85a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:41:14.201967 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:14.201882    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 00:36:12 +0000 UTC" deadline="2028-01-10 23:23:13.901661309 +0000 UTC"
Jul 21 00:41:14.201967 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:14.201955    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12934h41m59.699711094s"
Jul 21 00:41:14.339121 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:14.339084    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:14.339319 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:14.339246    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:41:14.342431 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:14.342243    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:14.342431 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:14.342407    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:41:15.338807 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:15.338514    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:15.339003 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:15.338954    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:41:15.390425 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:15.390377    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-75.ec2.internal" event={"ID":"610d9e0ff95d95bca94ab45c88df2393","Type":"ContainerStarted","Data":"cbe3001343e412be380c8dfdb366560d4b881da39822a0c1550302bb61070a7a"}
Jul 21 00:41:15.396467 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:15.396430    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-75.ec2.internal" event={"ID":"8a511dbb64386472f7853b93500b3424","Type":"ContainerStarted","Data":"14b6025dc053044cb33ab2088242eed82b83dd6355eef4136db773fec4559110"}
Jul 21 00:41:15.808185 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:15.808143    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d61aa2f7-0359-4f25-b575-dd995021228e-metrics-certs\") pod \"network-metrics-daemon-bhkcc\" (UID: \"d61aa2f7-0359-4f25-b575-dd995021228e\") " pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:15.808412 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:15.808223    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lszrr\" (UniqueName: \"kubernetes.io/projected/a817dd2e-1a95-45d6-bbca-6af085ee85a5-kube-api-access-lszrr\") pod \"network-check-target-wlhjv\" (UID: \"a817dd2e-1a95-45d6-bbca-6af085ee85a5\") " pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:15.808412 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:15.808259    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0da7e607-7001-47f1-a96d-1c366f2dd3ef-original-pull-secret\") pod \"global-pull-secret-syncer-88txv\" (UID: \"0da7e607-7001-47f1-a96d-1c366f2dd3ef\") " pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:15.808412 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:15.808392    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 00:41:15.808584 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:15.808461    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0da7e607-7001-47f1-a96d-1c366f2dd3ef-original-pull-secret podName:0da7e607-7001-47f1-a96d-1c366f2dd3ef nodeName:}" failed. No retries permitted until 2026-07-21 00:41:19.808440306 +0000 UTC m=+10.108136711 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0da7e607-7001-47f1-a96d-1c366f2dd3ef-original-pull-secret") pod "global-pull-secret-syncer-88txv" (UID: "0da7e607-7001-47f1-a96d-1c366f2dd3ef") : object "kube-system"/"original-pull-secret" not registered
Jul 21 00:41:15.809045 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:15.808911    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:41:15.809045 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:15.809003    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d61aa2f7-0359-4f25-b575-dd995021228e-metrics-certs podName:d61aa2f7-0359-4f25-b575-dd995021228e nodeName:}" failed. No retries permitted until 2026-07-21 00:41:19.808984309 +0000 UTC m=+10.108680736 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d61aa2f7-0359-4f25-b575-dd995021228e-metrics-certs") pod "network-metrics-daemon-bhkcc" (UID: "d61aa2f7-0359-4f25-b575-dd995021228e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:41:15.809270 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:15.809062    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 00:41:15.809270 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:15.809087    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 00:41:15.809270 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:15.809101    2582 projected.go:196] Error preparing data for projected volume kube-api-access-lszrr for pod openshift-network-diagnostics/network-check-target-wlhjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:41:15.809270 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:15.809157    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a817dd2e-1a95-45d6-bbca-6af085ee85a5-kube-api-access-lszrr podName:a817dd2e-1a95-45d6-bbca-6af085ee85a5 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:19.809139337 +0000 UTC m=+10.108835742 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lszrr" (UniqueName: "kubernetes.io/projected/a817dd2e-1a95-45d6-bbca-6af085ee85a5-kube-api-access-lszrr") pod "network-check-target-wlhjv" (UID: "a817dd2e-1a95-45d6-bbca-6af085ee85a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:41:16.341493 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:16.340821    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:16.341493 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:16.340985    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:41:16.341493 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:16.341308    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:16.341493 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:16.341439    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:41:17.338257 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:17.338221    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:17.338873 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:17.338359    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:41:18.339474 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:18.338898    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:18.339474 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:18.339051    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:41:18.340449 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:18.340258    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:18.340449 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:18.340404    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:41:18.410226 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:18.410166    2582 generic.go:356] "Generic (PLEG): container finished" podID="610d9e0ff95d95bca94ab45c88df2393" containerID="cbe3001343e412be380c8dfdb366560d4b881da39822a0c1550302bb61070a7a" exitCode=0
Jul 21 00:41:18.410226 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:18.410219    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-75.ec2.internal" event={"ID":"610d9e0ff95d95bca94ab45c88df2393","Type":"ContainerDied","Data":"cbe3001343e412be380c8dfdb366560d4b881da39822a0c1550302bb61070a7a"}
Jul 21 00:41:18.425209 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:18.425141    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-75.ec2.internal" podStartSLOduration=6.425122121 podStartE2EDuration="6.425122121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:41:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:41:15.417515846 +0000 UTC m=+5.717212271" watchObservedRunningTime="2026-07-21 00:41:18.425122121 +0000 UTC m=+8.724818565"
Jul 21 00:41:19.339494 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:19.338939    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:19.339494 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:19.339089    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:41:19.847793 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:19.847751    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lszrr\" (UniqueName: \"kubernetes.io/projected/a817dd2e-1a95-45d6-bbca-6af085ee85a5-kube-api-access-lszrr\") pod \"network-check-target-wlhjv\" (UID: \"a817dd2e-1a95-45d6-bbca-6af085ee85a5\") " pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:19.848035 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:19.847817    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0da7e607-7001-47f1-a96d-1c366f2dd3ef-original-pull-secret\") pod \"global-pull-secret-syncer-88txv\" (UID: \"0da7e607-7001-47f1-a96d-1c366f2dd3ef\") " pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:19.848035 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:19.847874    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d61aa2f7-0359-4f25-b575-dd995021228e-metrics-certs\") pod \"network-metrics-daemon-bhkcc\" (UID: \"d61aa2f7-0359-4f25-b575-dd995021228e\") " pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:19.848035 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:19.847905    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 00:41:19.848035 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:19.847933    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 00:41:19.848035 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:19.847949    2582 projected.go:196] Error preparing data for projected volume kube-api-access-lszrr for pod openshift-network-diagnostics/network-check-target-wlhjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:41:19.848035 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:19.848011    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:41:19.848406 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:19.848012    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a817dd2e-1a95-45d6-bbca-6af085ee85a5-kube-api-access-lszrr podName:a817dd2e-1a95-45d6-bbca-6af085ee85a5 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:27.847991099 +0000 UTC m=+18.147687526 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lszrr" (UniqueName: "kubernetes.io/projected/a817dd2e-1a95-45d6-bbca-6af085ee85a5-kube-api-access-lszrr") pod "network-check-target-wlhjv" (UID: "a817dd2e-1a95-45d6-bbca-6af085ee85a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:41:19.848406 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:19.848096    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d61aa2f7-0359-4f25-b575-dd995021228e-metrics-certs podName:d61aa2f7-0359-4f25-b575-dd995021228e nodeName:}" failed. No retries permitted until 2026-07-21 00:41:27.848060933 +0000 UTC m=+18.147757351 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d61aa2f7-0359-4f25-b575-dd995021228e-metrics-certs") pod "network-metrics-daemon-bhkcc" (UID: "d61aa2f7-0359-4f25-b575-dd995021228e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:41:19.848406 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:19.848009    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 00:41:19.848406 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:19.848158    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0da7e607-7001-47f1-a96d-1c366f2dd3ef-original-pull-secret podName:0da7e607-7001-47f1-a96d-1c366f2dd3ef nodeName:}" failed. No retries permitted until 2026-07-21 00:41:27.848145753 +0000 UTC m=+18.147842156 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0da7e607-7001-47f1-a96d-1c366f2dd3ef-original-pull-secret") pod "global-pull-secret-syncer-88txv" (UID: "0da7e607-7001-47f1-a96d-1c366f2dd3ef") : object "kube-system"/"original-pull-secret" not registered
Jul 21 00:41:20.341083 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:20.341022    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:20.341628 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:20.341184    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:41:20.341628 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:20.341285    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:20.341628 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:20.341420    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:41:21.338970 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:21.338933    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:21.339193 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:21.339099    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:41:22.338910 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:22.338870    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:22.338910 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:22.338905    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:22.339449 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:22.339014    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:41:22.339449 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:22.339155    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:41:23.338282 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:23.338239    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:23.338490 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:23.338365    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:41:24.338995 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:24.338949    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:24.339733 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:24.339703    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:24.340073 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:24.339910    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:41:24.340387 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:24.340323    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:41:25.338006 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:25.337963    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:25.338190 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:25.338077    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:41:26.342139 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:26.342103    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:26.342623 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:26.342109    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:26.342623 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:26.342222    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:41:26.342623 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:26.342331    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:41:27.338463 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:27.338420    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:27.338721 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:27.338534    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:41:27.916641 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:27.916603    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d61aa2f7-0359-4f25-b575-dd995021228e-metrics-certs\") pod \"network-metrics-daemon-bhkcc\" (UID: \"d61aa2f7-0359-4f25-b575-dd995021228e\") " pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:27.917082 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:27.916684    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lszrr\" (UniqueName: \"kubernetes.io/projected/a817dd2e-1a95-45d6-bbca-6af085ee85a5-kube-api-access-lszrr\") pod \"network-check-target-wlhjv\" (UID: \"a817dd2e-1a95-45d6-bbca-6af085ee85a5\") " pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:27.917082 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:27.916712    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0da7e607-7001-47f1-a96d-1c366f2dd3ef-original-pull-secret\") pod \"global-pull-secret-syncer-88txv\" (UID: \"0da7e607-7001-47f1-a96d-1c366f2dd3ef\") " pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:27.917082 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:27.916763    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:41:27.917082 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:27.916784    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 00:41:27.917082 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:27.916834    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d61aa2f7-0359-4f25-b575-dd995021228e-metrics-certs podName:d61aa2f7-0359-4f25-b575-dd995021228e nodeName:}" failed. No retries permitted until 2026-07-21 00:41:43.916813952 +0000 UTC m=+34.216510365 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d61aa2f7-0359-4f25-b575-dd995021228e-metrics-certs") pod "network-metrics-daemon-bhkcc" (UID: "d61aa2f7-0359-4f25-b575-dd995021228e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:41:27.917082 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:27.916847    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0da7e607-7001-47f1-a96d-1c366f2dd3ef-original-pull-secret podName:0da7e607-7001-47f1-a96d-1c366f2dd3ef nodeName:}" failed. No retries permitted until 2026-07-21 00:41:43.916841253 +0000 UTC m=+34.216537653 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0da7e607-7001-47f1-a96d-1c366f2dd3ef-original-pull-secret") pod "global-pull-secret-syncer-88txv" (UID: "0da7e607-7001-47f1-a96d-1c366f2dd3ef") : object "kube-system"/"original-pull-secret" not registered
Jul 21 00:41:27.917082 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:27.916845    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 00:41:27.917082 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:27.916869    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 00:41:27.917082 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:27.916879    2582 projected.go:196] Error preparing data for projected volume kube-api-access-lszrr for pod openshift-network-diagnostics/network-check-target-wlhjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:41:27.917082 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:27.916921    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a817dd2e-1a95-45d6-bbca-6af085ee85a5-kube-api-access-lszrr podName:a817dd2e-1a95-45d6-bbca-6af085ee85a5 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:43.91690891 +0000 UTC m=+34.216605309 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lszrr" (UniqueName: "kubernetes.io/projected/a817dd2e-1a95-45d6-bbca-6af085ee85a5-kube-api-access-lszrr") pod "network-check-target-wlhjv" (UID: "a817dd2e-1a95-45d6-bbca-6af085ee85a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:41:28.338998 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:28.338963    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:28.339192 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:28.339008    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:28.339192 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:28.339124    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:41:28.339292 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:28.339248    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:41:29.339063 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:29.339020    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:29.339543 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:29.339161    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:41:30.339889 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:30.339853    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:30.340430 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:30.339988    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:41:30.340430 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:30.340051    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:30.340430 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:30.340152    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:41:31.338892 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:31.338853    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:31.339081 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:31.339004    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:41:32.340935 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:32.340902    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:32.341362 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:32.341053    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:41:32.348839 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:32.348810    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:32.348999 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:32.348976    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:41:32.459036 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:32.458113    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m7mj9" event={"ID":"dc09f871-05eb-4b8d-8be0-d756b949cb52","Type":"ContainerStarted","Data":"26d2bc062b5e39d3c59e16d9e895a326ebfb9ada5776e83721bdbfc0c0ad1e80"}
Jul 21 00:41:32.473600 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:32.473380    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m7mj9" podStartSLOduration=1.640123615 podStartE2EDuration="21.47335599s" totalImagesPullingTime="19.833232375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:41:32.472960316 +0000 UTC m=+22.772656737" watchObservedRunningTime="2026-07-21 00:41:32.47335599 +0000 UTC m=+22.773052412"
Jul 21 00:41:33.339029 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:33.338628    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:33.339232 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:33.339124    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:41:33.461829 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:33.461773    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wkprw" event={"ID":"136a9e74-4da5-4788-a64b-0d9db3001160","Type":"ContainerStarted","Data":"294ca239dbad191ac0cec435e071419a9f9e71d312178dda67989b3c086b9a1e"}
Jul 21 00:41:33.463361 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:33.463323    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb" event={"ID":"a3d080ee-b504-431c-9f18-bec478eea517","Type":"ContainerStarted","Data":"ae1b990cf1700f51ff67fa8aec78a6da361f07f07fa087da61715538d96fd595"}
Jul 21 00:41:33.465219 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:33.465197    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-75.ec2.internal" event={"ID":"610d9e0ff95d95bca94ab45c88df2393","Type":"ContainerStarted","Data":"62ef1f28466b8f2e10094a55a48969fd3adb8fceeabee4a487ff614b3e8449bb"}
Jul 21 00:41:33.466791 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:33.466766    2582 generic.go:356] "Generic (PLEG): container finished" podID="9da83bc3-8b2d-4191-ad4f-3070cf84d2ac" containerID="f4946bb2e1895c6e35b400901c15a82a3cb619bef4fc5234be1252a9b2b7e277" exitCode=0
Jul 21 00:41:33.466916 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:33.466847    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kfclp" event={"ID":"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac","Type":"ContainerDied","Data":"f4946bb2e1895c6e35b400901c15a82a3cb619bef4fc5234be1252a9b2b7e277"}
Jul 21 00:41:33.469966 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:33.469939    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs" event={"ID":"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8","Type":"ContainerStarted","Data":"d10f8b2d79ec38fc1c3f4749baabddcde337f9a348145735798e345aa95c7f66"}
Jul 21 00:41:33.470057 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:33.470021    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs" event={"ID":"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8","Type":"ContainerStarted","Data":"23cbec847bdc96586bcd1bc7f4a1372d4a380fb51ac738aa0db48bbffffff258"}
Jul 21 00:41:33.470108 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:33.470059    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs" event={"ID":"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8","Type":"ContainerStarted","Data":"64a6669017ed8e1232cf5a7c4ad68c31dbca7fede39805c9277c0a1d0e3dbf76"}
Jul 21 00:41:33.470108 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:33.470087    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs" event={"ID":"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8","Type":"ContainerStarted","Data":"7c1379f19d97c979a1005568a66bdee205141f35a528a20e2d93d075d58521af"}
Jul 21 00:41:33.470203 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:33.470121    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs" event={"ID":"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8","Type":"ContainerStarted","Data":"8e4d966c8247798f3b503c784e7a04ca8e4d80d246ba7a284b22f1fae920e7c3"}
Jul 21 00:41:33.470203 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:33.470166    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs" event={"ID":"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8","Type":"ContainerStarted","Data":"474e05b7c71dc9c25cc20569512de0e706e709d4b49ec0f1202530ab18f7fb89"}
Jul 21 00:41:33.471270 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:33.471248    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2n82r" event={"ID":"14433a10-65ef-416b-9284-e38ae76b9f6a","Type":"ContainerStarted","Data":"22e930bf024bb9c7d666ddfbecfade74130d5b1b4056e99911b5480f519bd262"}
Jul 21 00:41:33.472681 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:33.472642    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x9vfr" event={"ID":"0ba67891-af9c-4a91-a956-bff562695d4c","Type":"ContainerStarted","Data":"7b175c02102814d934162179374fd37d9d6877ae30f1ec150ed34e1803e52ff0"}
Jul 21 00:41:33.474019 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:33.473992    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9tbvx" event={"ID":"f94d1cc3-b8ae-45e5-a26e-e1207b41fab1","Type":"ContainerStarted","Data":"7243c5b3ad843ca7f61a58d0d39677d4f20657987ce866833dadc5d2cb6a7cca"}
Jul 21 00:41:33.474253 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:33.474109    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wkprw" podStartSLOduration=10.797029203 podStartE2EDuration="22.474098767s" totalImagesPullingTime="11.677069564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:41:33.474067477 +0000 UTC m=+23.773763901" watchObservedRunningTime="2026-07-21 00:41:33.474098767 +0000 UTC m=+23.773795188"
Jul 21 00:41:33.486727 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:33.486679    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-75.ec2.internal" podStartSLOduration=21.486661216999998 podStartE2EDuration="21.486661217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:41:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:41:33.486393782 +0000 UTC m=+23.786090202" watchObservedRunningTime="2026-07-21 00:41:33.486661217 +0000 UTC m=+23.786357629"
Jul 21 00:41:33.498406 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:33.498350    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-x9vfr" podStartSLOduration=2.697190412 podStartE2EDuration="22.498334978s" totalImagesPullingTime="19.801144566s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:41:33.49791513 +0000 UTC m=+23.797611563" watchObservedRunningTime="2026-07-21 00:41:33.498334978 +0000 UTC m=+23.798031457"
Jul 21 00:41:33.530580 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:33.530522    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2n82r" podStartSLOduration=2.675168243 podStartE2EDuration="22.530503627s" totalImagesPullingTime="19.855335384s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:41:33.530375276 +0000 UTC m=+23.830071702" watchObservedRunningTime="2026-07-21 00:41:33.530503627 +0000 UTC m=+23.830200047"
Jul 21 00:41:33.783392 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:33.783360    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 00:41:34.225326 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:34.225134    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T00:41:33.783385556Z","UUID":"6553fbcd-8d93-465e-9fa9-2b45b37ccaee","Handler":null,"Name":"","Endpoint":""}
Jul 21 00:41:34.227229 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:34.227207    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 00:41:34.227392 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:34.227254    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 00:41:34.343336 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:34.342833    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:34.343336 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:34.342852    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:34.343336 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:34.342971    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:41:34.343336 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:34.343087    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:41:34.477922 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:34.477839    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ptk9k" event={"ID":"9b3be570-f529-482f-b550-7c9859afc85b","Type":"ContainerStarted","Data":"3e6132586c6d18ab280a5245363cd6a432db051008af765735f7c35d04b19681"}
Jul 21 00:41:34.479675 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:34.479622    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb" event={"ID":"a3d080ee-b504-431c-9f18-bec478eea517","Type":"ContainerStarted","Data":"5a174fc8a805ed48920f59174b47d7ad1d9ee9114861fca63b2bbedce9a885d8"}
Jul 21 00:41:34.492901 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:34.492816    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9tbvx" podStartSLOduration=3.67343772 podStartE2EDuration="23.492796547s" totalImagesPullingTime="19.819358827s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:41:33.542545539 +0000 UTC m=+23.842241960" watchObservedRunningTime="2026-07-21 00:41:34.492796547 +0000 UTC m=+24.792492966"
Jul 21 00:41:34.493565 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:34.493529    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ptk9k" podStartSLOduration=3.675120214 podStartE2EDuration="23.493511028s" totalImagesPullingTime="19.818390814s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:41:34.49269134 +0000 UTC m=+24.792387760" watchObservedRunningTime="2026-07-21 00:41:34.493511028 +0000 UTC m=+24.793207448"
Jul 21 00:41:34.710556 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:34.710516    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wkprw"
Jul 21 00:41:34.711239 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:34.711209    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wkprw"
Jul 21 00:41:35.338701 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:35.338588    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:35.338885 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:35.338736    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:41:35.484280 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:35.484236    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb" event={"ID":"a3d080ee-b504-431c-9f18-bec478eea517","Type":"ContainerStarted","Data":"e416244d1f5178e33f48c34223762aeb5cdce1458f5f7c6bbc34a3dece6b3543"}
Jul 21 00:41:35.488048 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:35.488015    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs" event={"ID":"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8","Type":"ContainerStarted","Data":"766056e2cca0604b48f03a28d5eea1ffbedd87f4c1f73be1662c188602066f26"}
Jul 21 00:41:35.499855 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:35.499799    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zqgb" podStartSLOduration=6.868129056 podStartE2EDuration="24.49977596s" totalImagesPullingTime="17.631646904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:41:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:41:35.498713196 +0000 UTC m=+25.798409631" watchObservedRunningTime="2026-07-21 00:41:35.49977596 +0000 UTC m=+25.799472384"
Jul 21 00:41:35.584821 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:35.584786    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wkprw"
Jul 21 00:41:35.585401 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:35.585356    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wkprw"
Jul 21 00:41:36.341761 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:36.341731    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:36.341761 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:36.341765    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:36.342015 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:36.341851    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:41:36.342015 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:36.341946    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:41:37.339119 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:37.338903    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:37.339541 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:37.339218    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:41:38.341904 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:38.341825    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:38.342548 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:38.341825    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:38.342548 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:38.341927    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:41:38.342548 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:38.342004    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:41:38.496837 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:38.496801    2582 generic.go:356] "Generic (PLEG): container finished" podID="9da83bc3-8b2d-4191-ad4f-3070cf84d2ac" containerID="b772161fc911950605f4746d864850ffbd461aa9d4ba533b19d43cadbc11659f" exitCode=0
Jul 21 00:41:38.497005 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:38.496883    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kfclp" event={"ID":"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac","Type":"ContainerDied","Data":"b772161fc911950605f4746d864850ffbd461aa9d4ba533b19d43cadbc11659f"}
Jul 21 00:41:38.500624 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:38.500599    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs" event={"ID":"6cbc17f7-0fa9-4380-8f8c-6e3d1e26c5a8","Type":"ContainerStarted","Data":"a771ebc3478f6af3a9c023d040f3e9b75b79f6df45abfca3a887e87f08729039"}
Jul 21 00:41:38.501022 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:38.500993    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:38.501108 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:38.501047    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:38.501108 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:38.501095    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:38.517838 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:38.517640    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:38.517993 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:38.517926    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:41:38.535849 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:38.535798    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs" podStartSLOduration=7.668091948 podStartE2EDuration="27.535781476s" totalImagesPullingTime="19.867689528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:41:38.53516478 +0000 UTC m=+28.834861202" watchObservedRunningTime="2026-07-21 00:41:38.535781476 +0000 UTC m=+28.835477904"
Jul 21 00:41:39.338299 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:39.338261    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:39.338465 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:39.338372    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:41:39.941076 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:39.941039    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-88txv"]
Jul 21 00:41:39.941523 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:39.941189    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:39.941523 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:39.941303    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:41:39.947359 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:39.947328    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bhkcc"]
Jul 21 00:41:39.947506 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:39.947491    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:39.947680 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:39.947625    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:41:39.947881 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:39.947861    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wlhjv"]
Jul 21 00:41:39.947978 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:39.947940    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:39.948046 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:39.948024    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:41:40.507251 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:40.507217    2582 generic.go:356] "Generic (PLEG): container finished" podID="9da83bc3-8b2d-4191-ad4f-3070cf84d2ac" containerID="2710572fb3d877bbbd3afdcf0355d8879adb30426e4f3770af9482301c0d029f" exitCode=0
Jul 21 00:41:40.507449 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:40.507301    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kfclp" event={"ID":"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac","Type":"ContainerDied","Data":"2710572fb3d877bbbd3afdcf0355d8879adb30426e4f3770af9482301c0d029f"}
Jul 21 00:41:41.338099 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:41.338066    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:41.338099 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:41.338081    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:41.338099 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:41.338081    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:41.338608 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:41.338177    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:41:41.338608 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:41.338253    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:41:41.338608 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:41.338322    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:41:41.934246 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:41.934050    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9tbvx_f94d1cc3-b8ae-45e5-a26e-e1207b41fab1/dns-node-resolver/0.log"
Jul 21 00:41:42.514017 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:42.513978    2582 generic.go:356] "Generic (PLEG): container finished" podID="9da83bc3-8b2d-4191-ad4f-3070cf84d2ac" containerID="b538a578714de473bbc74523d6549135567f61339e8dc4b029274d41baf6fab4" exitCode=0
Jul 21 00:41:42.514388 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:42.514040    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kfclp" event={"ID":"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac","Type":"ContainerDied","Data":"b538a578714de473bbc74523d6549135567f61339e8dc4b029274d41baf6fab4"}
Jul 21 00:41:43.112960 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:43.112925    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x9vfr_0ba67891-af9c-4a91-a956-bff562695d4c/node-ca/0.log"
Jul 21 00:41:43.338138 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:43.338106    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:43.338138 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:43.338123    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:43.338380 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:43.338106    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:43.338380 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:43.338247    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:41:43.338380 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:43.338296    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:41:43.338380 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:43.338375    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:41:43.942682 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:43.942583    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d61aa2f7-0359-4f25-b575-dd995021228e-metrics-certs\") pod \"network-metrics-daemon-bhkcc\" (UID: \"d61aa2f7-0359-4f25-b575-dd995021228e\") " pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:43.942682 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:43.942629    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lszrr\" (UniqueName: \"kubernetes.io/projected/a817dd2e-1a95-45d6-bbca-6af085ee85a5-kube-api-access-lszrr\") pod \"network-check-target-wlhjv\" (UID: \"a817dd2e-1a95-45d6-bbca-6af085ee85a5\") " pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:43.942682 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:43.942665    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0da7e607-7001-47f1-a96d-1c366f2dd3ef-original-pull-secret\") pod \"global-pull-secret-syncer-88txv\" (UID: \"0da7e607-7001-47f1-a96d-1c366f2dd3ef\") " pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:43.943270 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:43.942768    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 00:41:43.943270 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:43.942771    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:41:43.943270 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:43.942782    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 00:41:43.943270 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:43.942822    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 00:41:43.943270 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:43.942835    2582 projected.go:196] Error preparing data for projected volume kube-api-access-lszrr for pod openshift-network-diagnostics/network-check-target-wlhjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:41:43.943270 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:43.942840    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0da7e607-7001-47f1-a96d-1c366f2dd3ef-original-pull-secret podName:0da7e607-7001-47f1-a96d-1c366f2dd3ef nodeName:}" failed. No retries permitted until 2026-07-21 00:42:15.942824017 +0000 UTC m=+66.242520417 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0da7e607-7001-47f1-a96d-1c366f2dd3ef-original-pull-secret") pod "global-pull-secret-syncer-88txv" (UID: "0da7e607-7001-47f1-a96d-1c366f2dd3ef") : object "kube-system"/"original-pull-secret" not registered
Jul 21 00:41:43.943270 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:43.942853    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d61aa2f7-0359-4f25-b575-dd995021228e-metrics-certs podName:d61aa2f7-0359-4f25-b575-dd995021228e nodeName:}" failed. No retries permitted until 2026-07-21 00:42:15.942846935 +0000 UTC m=+66.242543335 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d61aa2f7-0359-4f25-b575-dd995021228e-metrics-certs") pod "network-metrics-daemon-bhkcc" (UID: "d61aa2f7-0359-4f25-b575-dd995021228e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:41:43.943270 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:43.942868    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a817dd2e-1a95-45d6-bbca-6af085ee85a5-kube-api-access-lszrr podName:a817dd2e-1a95-45d6-bbca-6af085ee85a5 nodeName:}" failed. No retries permitted until 2026-07-21 00:42:15.942857184 +0000 UTC m=+66.242553588 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lszrr" (UniqueName: "kubernetes.io/projected/a817dd2e-1a95-45d6-bbca-6af085ee85a5-kube-api-access-lszrr") pod "network-check-target-wlhjv" (UID: "a817dd2e-1a95-45d6-bbca-6af085ee85a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:41:45.338357 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:45.338313    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:45.338822 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:45.338321    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:45.338822 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:45.338470    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:41:45.338822 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:45.338335    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:45.338822 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:45.338532    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:41:45.338822 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:45.338587    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:41:47.338025 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:47.337984    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:47.338025 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:47.338006    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:47.338025 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:47.338013    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:47.338594 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:47.338086    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:41:47.338594 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:47.338164    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:41:47.338594 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:47.338217    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:41:47.529724 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:47.529689    2582 generic.go:356] "Generic (PLEG): container finished" podID="9da83bc3-8b2d-4191-ad4f-3070cf84d2ac" containerID="8125e82abdb588c52c29f0c624241605b3e79a99b1c4aafe98023e6216d7d075" exitCode=0
Jul 21 00:41:47.529916 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:47.529755    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kfclp" event={"ID":"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac","Type":"ContainerDied","Data":"8125e82abdb588c52c29f0c624241605b3e79a99b1c4aafe98023e6216d7d075"}
Jul 21 00:41:48.535119 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:48.535083    2582 generic.go:356] "Generic (PLEG): container finished" podID="9da83bc3-8b2d-4191-ad4f-3070cf84d2ac" containerID="1bcccfa99a1a5481ed08e585ff6076458c7049e3aa38f86769e463d9ddb73d60" exitCode=0
Jul 21 00:41:48.535618 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:48.535137    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kfclp" event={"ID":"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac","Type":"ContainerDied","Data":"1bcccfa99a1a5481ed08e585ff6076458c7049e3aa38f86769e463d9ddb73d60"}
Jul 21 00:41:49.338366 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:49.338334    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:49.338577 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:49.338330    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:49.338577 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:49.338453    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:41:49.338577 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:49.338460    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:49.338577 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:49.338556    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:41:49.338841 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:49.338635    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:41:49.540920 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:49.540882    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kfclp" event={"ID":"9da83bc3-8b2d-4191-ad4f-3070cf84d2ac","Type":"ContainerStarted","Data":"e2e1371a5155b466f1b3945652b2a72e7630487003e13c4ffffe03b068fe0609"}
Jul 21 00:41:49.560219 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:49.560172    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kfclp" podStartSLOduration=8.102335282 podStartE2EDuration="38.560156004s" totalImagesPullingTime="30.457820722s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:41:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:41:49.55937761 +0000 UTC m=+39.859074032" watchObservedRunningTime="2026-07-21 00:41:49.560156004 +0000 UTC m=+39.859852455"
Jul 21 00:41:51.338341 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:51.338296    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:51.338341 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:51.338327    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:51.338923 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:51.338326    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:51.338923 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:51.338404    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:41:51.338923 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:51.338524    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:41:51.338923 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:51.338615    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:41:53.338250 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:53.338207    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:53.338675 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:53.338260    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:53.338675 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:53.338313    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:53.338675 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:53.338333    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:41:53.338675 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:53.338385    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:41:53.338675 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:53.338470    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:41:55.338896 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:55.338855    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:55.338896 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:55.338900    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:55.339369 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:55.338865    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:55.339369 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:55.339003    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:41:55.339369 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:55.339049    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:41:55.339369 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:55.339148    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:41:57.338754 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:57.338711    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:57.338754 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:57.338735    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:57.338754 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:57.338719    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:57.339425 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:57.338878    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:41:57.339425 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:57.338944    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:41:57.339425 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:57.339019    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:41:59.338393 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:59.338356    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:41:59.338904 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:59.338465    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:41:59.338904 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:59.338356    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:41:59.338904 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:41:59.338356    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:41:59.338904 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:59.338528    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:41:59.338904 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:41:59.338623    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:42:01.338541 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:01.338504    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:42:01.339001 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:01.338504    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:42:01.339001 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:42:01.338618    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:42:01.339001 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:42:01.338704    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:42:01.339001 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:01.338504    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:42:01.339001 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:42:01.338797    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:42:03.338636 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:03.338606    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:42:03.339172 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:03.338606    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:42:03.339172 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:42:03.338720    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhkcc" podUID="d61aa2f7-0359-4f25-b575-dd995021228e"
Jul 21 00:42:03.339172 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:03.338606    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:42:03.339172 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:42:03.338797    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88txv" podUID="0da7e607-7001-47f1-a96d-1c366f2dd3ef"
Jul 21 00:42:03.339172 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:42:03.338885    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wlhjv" podUID="a817dd2e-1a95-45d6-bbca-6af085ee85a5"
Jul 21 00:42:04.961317 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:04.961286    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-75.ec2.internal" event="NodeReady"
Jul 21 00:42:04.961691 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:04.961416    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 00:42:05.007548 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.007512    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mrz6p"]
Jul 21 00:42:05.023984 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.023946    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tfh26"]
Jul 21 00:42:05.024158 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.024044    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mrz6p"
Jul 21 00:42:05.026305 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.026267    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lf5vb\""
Jul 21 00:42:05.026478 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.026459    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 00:42:05.026577 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.026287    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 00:42:05.035953 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.035930    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mrz6p"]
Jul 21 00:42:05.036092 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.035971    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tfh26"]
Jul 21 00:42:05.036092 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.036047    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tfh26"
Jul 21 00:42:05.037959 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.037935    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 00:42:05.038096 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.038074    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 00:42:05.038096 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.038091    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 00:42:05.038212 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.038088    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 00:42:05.038212 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.038173    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fhmkx\""
Jul 21 00:42:05.092487 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.092369    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12a92fbc-402e-4a05-88ff-ab3b48da8fed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tfh26\" (UID: \"12a92fbc-402e-4a05-88ff-ab3b48da8fed\") " pod="openshift-insights/insights-runtime-extractor-tfh26"
Jul 21 00:42:05.094999 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.092747    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8410a2b-748e-4495-b67d-e7782149b0ad-tmp-dir\") pod \"dns-default-mrz6p\" (UID: \"f8410a2b-748e-4495-b67d-e7782149b0ad\") " pod="openshift-dns/dns-default-mrz6p"
Jul 21 00:42:05.094999 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.092805    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8410a2b-748e-4495-b67d-e7782149b0ad-metrics-tls\") pod \"dns-default-mrz6p\" (UID: \"f8410a2b-748e-4495-b67d-e7782149b0ad\") " pod="openshift-dns/dns-default-mrz6p"
Jul 21 00:42:05.094999 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.092840    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/12a92fbc-402e-4a05-88ff-ab3b48da8fed-crio-socket\") pod \"insights-runtime-extractor-tfh26\" (UID: \"12a92fbc-402e-4a05-88ff-ab3b48da8fed\") " pod="openshift-insights/insights-runtime-extractor-tfh26"
Jul 21 00:42:05.094999 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.092871    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdg55\" (UniqueName: \"kubernetes.io/projected/12a92fbc-402e-4a05-88ff-ab3b48da8fed-kube-api-access-rdg55\") pod \"insights-runtime-extractor-tfh26\" (UID: \"12a92fbc-402e-4a05-88ff-ab3b48da8fed\") " pod="openshift-insights/insights-runtime-extractor-tfh26"
Jul 21 00:42:05.094999 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.092898    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn48b\" (UniqueName: \"kubernetes.io/projected/f8410a2b-748e-4495-b67d-e7782149b0ad-kube-api-access-hn48b\") pod \"dns-default-mrz6p\" (UID: \"f8410a2b-748e-4495-b67d-e7782149b0ad\") " pod="openshift-dns/dns-default-mrz6p"
Jul 21 00:42:05.094999 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.092938    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/12a92fbc-402e-4a05-88ff-ab3b48da8fed-data-volume\") pod \"insights-runtime-extractor-tfh26\" (UID: \"12a92fbc-402e-4a05-88ff-ab3b48da8fed\") " pod="openshift-insights/insights-runtime-extractor-tfh26"
Jul 21 00:42:05.094999 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.092980    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/12a92fbc-402e-4a05-88ff-ab3b48da8fed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tfh26\" (UID: \"12a92fbc-402e-4a05-88ff-ab3b48da8fed\") " pod="openshift-insights/insights-runtime-extractor-tfh26"
Jul 21 00:42:05.094999 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.093012    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f8410a2b-748e-4495-b67d-e7782149b0ad-config-volume\") pod \"dns-default-mrz6p\" (UID: \"f8410a2b-748e-4495-b67d-e7782149b0ad\") " pod="openshift-dns/dns-default-mrz6p"
Jul 21 00:42:05.110860 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.110826    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sznsc"]
Jul 21 00:42:05.132878 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.132839    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sznsc"]
Jul 21 00:42:05.133060 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.132979    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sznsc"
Jul 21 00:42:05.134729 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.134705    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ql26v\""
Jul 21 00:42:05.134899 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.134872    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 00:42:05.134982 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.134879    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 00:42:05.135039 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.135016    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 00:42:05.193632 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.193596    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12a92fbc-402e-4a05-88ff-ab3b48da8fed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tfh26\" (UID: \"12a92fbc-402e-4a05-88ff-ab3b48da8fed\") " pod="openshift-insights/insights-runtime-extractor-tfh26"
Jul 21 00:42:05.193632 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.193632    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8410a2b-748e-4495-b67d-e7782149b0ad-tmp-dir\") pod \"dns-default-mrz6p\" (UID: \"f8410a2b-748e-4495-b67d-e7782149b0ad\") " pod="openshift-dns/dns-default-mrz6p"
Jul 21 00:42:05.193909 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.193680    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85kgm\" (UniqueName: \"kubernetes.io/projected/b99cf4a0-3a18-4ac3-966e-ae98d24b50d5-kube-api-access-85kgm\") pod \"ingress-canary-sznsc\" (UID: \"b99cf4a0-3a18-4ac3-966e-ae98d24b50d5\") " pod="openshift-ingress-canary/ingress-canary-sznsc"
Jul 21 00:42:05.193909 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.193707    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8410a2b-748e-4495-b67d-e7782149b0ad-metrics-tls\") pod \"dns-default-mrz6p\" (UID: \"f8410a2b-748e-4495-b67d-e7782149b0ad\") " pod="openshift-dns/dns-default-mrz6p"
Jul 21 00:42:05.193909 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.193726    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/12a92fbc-402e-4a05-88ff-ab3b48da8fed-crio-socket\") pod \"insights-runtime-extractor-tfh26\" (UID: \"12a92fbc-402e-4a05-88ff-ab3b48da8fed\") " pod="openshift-insights/insights-runtime-extractor-tfh26"
Jul 21 00:42:05.193909 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.193751    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdg55\" (UniqueName: \"kubernetes.io/projected/12a92fbc-402e-4a05-88ff-ab3b48da8fed-kube-api-access-rdg55\") pod \"insights-runtime-extractor-tfh26\" (UID: \"12a92fbc-402e-4a05-88ff-ab3b48da8fed\") " pod="openshift-insights/insights-runtime-extractor-tfh26"
Jul 21 00:42:05.193909 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.193852    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/12a92fbc-402e-4a05-88ff-ab3b48da8fed-crio-socket\") pod \"insights-runtime-extractor-tfh26\" (UID: \"12a92fbc-402e-4a05-88ff-ab3b48da8fed\") " pod="openshift-insights/insights-runtime-extractor-tfh26"
Jul 21 00:42:05.193909 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.193878    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn48b\" (UniqueName: \"kubernetes.io/projected/f8410a2b-748e-4495-b67d-e7782149b0ad-kube-api-access-hn48b\") pod \"dns-default-mrz6p\" (UID: \"f8410a2b-748e-4495-b67d-e7782149b0ad\") " pod="openshift-dns/dns-default-mrz6p"
Jul 21 00:42:05.194151 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.193934    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/12a92fbc-402e-4a05-88ff-ab3b48da8fed-data-volume\") pod \"insights-runtime-extractor-tfh26\" (UID: \"12a92fbc-402e-4a05-88ff-ab3b48da8fed\") " pod="openshift-insights/insights-runtime-extractor-tfh26"
Jul 21 00:42:05.194151 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.194018    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/12a92fbc-402e-4a05-88ff-ab3b48da8fed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tfh26\" (UID: \"12a92fbc-402e-4a05-88ff-ab3b48da8fed\") " pod="openshift-insights/insights-runtime-extractor-tfh26"
Jul 21 00:42:05.194151 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.194042    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f8410a2b-748e-4495-b67d-e7782149b0ad-config-volume\") pod \"dns-default-mrz6p\" (UID: \"f8410a2b-748e-4495-b67d-e7782149b0ad\") " pod="openshift-dns/dns-default-mrz6p"
Jul 21 00:42:05.194151 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.194072    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b99cf4a0-3a18-4ac3-966e-ae98d24b50d5-cert\") pod \"ingress-canary-sznsc\" (UID: \"b99cf4a0-3a18-4ac3-966e-ae98d24b50d5\") " pod="openshift-ingress-canary/ingress-canary-sznsc"
Jul 21 00:42:05.194151 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.194080    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8410a2b-748e-4495-b67d-e7782149b0ad-tmp-dir\") pod \"dns-default-mrz6p\" (UID: \"f8410a2b-748e-4495-b67d-e7782149b0ad\") " pod="openshift-dns/dns-default-mrz6p"
Jul 21 00:42:05.194350 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.194271    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/12a92fbc-402e-4a05-88ff-ab3b48da8fed-data-volume\") pod \"insights-runtime-extractor-tfh26\" (UID: \"12a92fbc-402e-4a05-88ff-ab3b48da8fed\") " pod="openshift-insights/insights-runtime-extractor-tfh26"
Jul 21 00:42:05.194543 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.194524    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f8410a2b-748e-4495-b67d-e7782149b0ad-config-volume\") pod \"dns-default-mrz6p\" (UID: \"f8410a2b-748e-4495-b67d-e7782149b0ad\") " pod="openshift-dns/dns-default-mrz6p"
Jul 21 00:42:05.194596 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.194566    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/12a92fbc-402e-4a05-88ff-ab3b48da8fed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tfh26\" (UID: \"12a92fbc-402e-4a05-88ff-ab3b48da8fed\") " pod="openshift-insights/insights-runtime-extractor-tfh26"
Jul 21 00:42:05.198012 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.197979    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12a92fbc-402e-4a05-88ff-ab3b48da8fed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tfh26\" (UID: \"12a92fbc-402e-4a05-88ff-ab3b48da8fed\") " pod="openshift-insights/insights-runtime-extractor-tfh26"
Jul 21 00:42:05.198142 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.197979    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8410a2b-748e-4495-b67d-e7782149b0ad-metrics-tls\") pod \"dns-default-mrz6p\" (UID: \"f8410a2b-748e-4495-b67d-e7782149b0ad\") " pod="openshift-dns/dns-default-mrz6p"
Jul 21 00:42:05.200660 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.200623    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdg55\" (UniqueName: \"kubernetes.io/projected/12a92fbc-402e-4a05-88ff-ab3b48da8fed-kube-api-access-rdg55\") pod \"insights-runtime-extractor-tfh26\" (UID: \"12a92fbc-402e-4a05-88ff-ab3b48da8fed\") " pod="openshift-insights/insights-runtime-extractor-tfh26"
Jul 21 00:42:05.200798 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.200779    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn48b\" (UniqueName: \"kubernetes.io/projected/f8410a2b-748e-4495-b67d-e7782149b0ad-kube-api-access-hn48b\") pod \"dns-default-mrz6p\" (UID: \"f8410a2b-748e-4495-b67d-e7782149b0ad\") " pod="openshift-dns/dns-default-mrz6p"
Jul 21 00:42:05.294970 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.294928    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b99cf4a0-3a18-4ac3-966e-ae98d24b50d5-cert\") pod \"ingress-canary-sznsc\" (UID: \"b99cf4a0-3a18-4ac3-966e-ae98d24b50d5\") " pod="openshift-ingress-canary/ingress-canary-sznsc"
Jul 21 00:42:05.295142 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.294992    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85kgm\" (UniqueName: \"kubernetes.io/projected/b99cf4a0-3a18-4ac3-966e-ae98d24b50d5-kube-api-access-85kgm\") pod \"ingress-canary-sznsc\" (UID: \"b99cf4a0-3a18-4ac3-966e-ae98d24b50d5\") " pod="openshift-ingress-canary/ingress-canary-sznsc"
Jul 21 00:42:05.297377 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.297348    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b99cf4a0-3a18-4ac3-966e-ae98d24b50d5-cert\") pod \"ingress-canary-sznsc\" (UID: \"b99cf4a0-3a18-4ac3-966e-ae98d24b50d5\") " pod="openshift-ingress-canary/ingress-canary-sznsc"
Jul 21 00:42:05.303672 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.303628    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85kgm\" (UniqueName: \"kubernetes.io/projected/b99cf4a0-3a18-4ac3-966e-ae98d24b50d5-kube-api-access-85kgm\") pod \"ingress-canary-sznsc\" (UID: \"b99cf4a0-3a18-4ac3-966e-ae98d24b50d5\") " pod="openshift-ingress-canary/ingress-canary-sznsc"
Jul 21 00:42:05.334456 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.334415    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mrz6p"
Jul 21 00:42:05.338687 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.338661    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:42:05.338814 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.338697    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:42:05.338814 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.338703    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:42:05.340932 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.340909    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 00:42:05.341051 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.340909    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 00:42:05.341051 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.340988    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 00:42:05.341051 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.341028    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wcfmk\""
Jul 21 00:42:05.341231 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.341065    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 00:42:05.341231 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.341124    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nqmsz\""
Jul 21 00:42:05.344406 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.344347    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tfh26"
Jul 21 00:42:05.442222 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.442184    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sznsc"
Jul 21 00:42:05.561847 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.561815    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mrz6p"]
Jul 21 00:42:05.568574 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:42:05.568529    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8410a2b_748e_4495_b67d_e7782149b0ad.slice/crio-a2b08fd2bc1c41b95d784394fc20afbc20175a39b2fd8e680c9896e25ddb595c WatchSource:0}: Error finding container a2b08fd2bc1c41b95d784394fc20afbc20175a39b2fd8e680c9896e25ddb595c: Status 404 returned error can't find the container with id a2b08fd2bc1c41b95d784394fc20afbc20175a39b2fd8e680c9896e25ddb595c
Jul 21 00:42:05.582719 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.582684    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mrz6p" event={"ID":"f8410a2b-748e-4495-b67d-e7782149b0ad","Type":"ContainerStarted","Data":"a2b08fd2bc1c41b95d784394fc20afbc20175a39b2fd8e680c9896e25ddb595c"}
Jul 21 00:42:05.584218 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.583571    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tfh26"]
Jul 21 00:42:05.617267 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:05.617198    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sznsc"]
Jul 21 00:42:05.620366 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:42:05.620343    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb99cf4a0_3a18_4ac3_966e_ae98d24b50d5.slice/crio-fc90bd57b18c125dca73e6a1318944f3bc0d69bb0c6df890fe89a91127ee3589 WatchSource:0}: Error finding container fc90bd57b18c125dca73e6a1318944f3bc0d69bb0c6df890fe89a91127ee3589: Status 404 returned error can't find the container with id fc90bd57b18c125dca73e6a1318944f3bc0d69bb0c6df890fe89a91127ee3589
Jul 21 00:42:06.588413 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:06.588369    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sznsc" event={"ID":"b99cf4a0-3a18-4ac3-966e-ae98d24b50d5","Type":"ContainerStarted","Data":"fc90bd57b18c125dca73e6a1318944f3bc0d69bb0c6df890fe89a91127ee3589"}
Jul 21 00:42:06.591578 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:06.591539    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tfh26" event={"ID":"12a92fbc-402e-4a05-88ff-ab3b48da8fed","Type":"ContainerStarted","Data":"9cf1d95df558eb94e93e1bb1e34814b947a10f472311204570e9a8cb9defdac6"}
Jul 21 00:42:09.334486 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.334457    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f49b4f48c-sldnx"]
Jul 21 00:42:09.349563 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.349530    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f49b4f48c-sldnx"]
Jul 21 00:42:09.349761 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.349691    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f49b4f48c-sldnx"
Jul 21 00:42:09.351458 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.351430    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 21 00:42:09.352404 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.351997    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 21 00:42:09.352404 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.352013    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 21 00:42:09.352404 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.352309    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 21 00:42:09.352670 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.352436    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xtfpb\""
Jul 21 00:42:09.352670 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.352444    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 21 00:42:09.352670 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.352492    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 21 00:42:09.352803 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.352716    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 21 00:42:09.432376 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.432333    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e979354-a893-4586-ac20-defa840520f2-console-serving-cert\") pod \"console-6f49b4f48c-sldnx\" (UID: \"8e979354-a893-4586-ac20-defa840520f2\") " pod="openshift-console/console-6f49b4f48c-sldnx"
Jul 21 00:42:09.432376 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.432370    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e979354-a893-4586-ac20-defa840520f2-console-oauth-config\") pod \"console-6f49b4f48c-sldnx\" (UID: \"8e979354-a893-4586-ac20-defa840520f2\") " pod="openshift-console/console-6f49b4f48c-sldnx"
Jul 21 00:42:09.432598 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.432404    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e979354-a893-4586-ac20-defa840520f2-oauth-serving-cert\") pod \"console-6f49b4f48c-sldnx\" (UID: \"8e979354-a893-4586-ac20-defa840520f2\") " pod="openshift-console/console-6f49b4f48c-sldnx"
Jul 21 00:42:09.432598 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.432428    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e979354-a893-4586-ac20-defa840520f2-service-ca\") pod \"console-6f49b4f48c-sldnx\" (UID: \"8e979354-a893-4586-ac20-defa840520f2\") " pod="openshift-console/console-6f49b4f48c-sldnx"
Jul 21 00:42:09.432598 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.432462    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmkxm\" (UniqueName: \"kubernetes.io/projected/8e979354-a893-4586-ac20-defa840520f2-kube-api-access-vmkxm\") pod \"console-6f49b4f48c-sldnx\" (UID: \"8e979354-a893-4586-ac20-defa840520f2\") " pod="openshift-console/console-6f49b4f48c-sldnx"
Jul 21 00:42:09.432598 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.432548    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e979354-a893-4586-ac20-defa840520f2-console-config\") pod \"console-6f49b4f48c-sldnx\" (UID: \"8e979354-a893-4586-ac20-defa840520f2\") " pod="openshift-console/console-6f49b4f48c-sldnx"
Jul 21 00:42:09.533494 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.533455    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e979354-a893-4586-ac20-defa840520f2-console-config\") pod \"console-6f49b4f48c-sldnx\" (UID: \"8e979354-a893-4586-ac20-defa840520f2\") " pod="openshift-console/console-6f49b4f48c-sldnx"
Jul 21 00:42:09.533720 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.533550    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e979354-a893-4586-ac20-defa840520f2-console-serving-cert\") pod \"console-6f49b4f48c-sldnx\" (UID: \"8e979354-a893-4586-ac20-defa840520f2\") " pod="openshift-console/console-6f49b4f48c-sldnx"
Jul 21 00:42:09.533720 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.533580    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e979354-a893-4586-ac20-defa840520f2-console-oauth-config\") pod \"console-6f49b4f48c-sldnx\" (UID: \"8e979354-a893-4586-ac20-defa840520f2\") " pod="openshift-console/console-6f49b4f48c-sldnx"
Jul 21 00:42:09.533720 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.533618    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e979354-a893-4586-ac20-defa840520f2-oauth-serving-cert\") pod \"console-6f49b4f48c-sldnx\" (UID: \"8e979354-a893-4586-ac20-defa840520f2\") " pod="openshift-console/console-6f49b4f48c-sldnx"
Jul 21 00:42:09.533720 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.533644    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e979354-a893-4586-ac20-defa840520f2-service-ca\") pod \"console-6f49b4f48c-sldnx\" (UID: \"8e979354-a893-4586-ac20-defa840520f2\") " pod="openshift-console/console-6f49b4f48c-sldnx"
Jul 21 00:42:09.533720 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.533692    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmkxm\" (UniqueName: \"kubernetes.io/projected/8e979354-a893-4586-ac20-defa840520f2-kube-api-access-vmkxm\") pod \"console-6f49b4f48c-sldnx\" (UID: \"8e979354-a893-4586-ac20-defa840520f2\") " pod="openshift-console/console-6f49b4f48c-sldnx"
Jul 21 00:42:09.534475 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.534445    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e979354-a893-4586-ac20-defa840520f2-console-config\") pod \"console-6f49b4f48c-sldnx\" (UID: \"8e979354-a893-4586-ac20-defa840520f2\") " pod="openshift-console/console-6f49b4f48c-sldnx"
Jul 21 00:42:09.534813 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.534767    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e979354-a893-4586-ac20-defa840520f2-oauth-serving-cert\") pod \"console-6f49b4f48c-sldnx\" (UID: \"8e979354-a893-4586-ac20-defa840520f2\") " pod="openshift-console/console-6f49b4f48c-sldnx"
Jul 21 00:42:09.534972 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.534944    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e979354-a893-4586-ac20-defa840520f2-service-ca\") pod \"console-6f49b4f48c-sldnx\" (UID: \"8e979354-a893-4586-ac20-defa840520f2\") " pod="openshift-console/console-6f49b4f48c-sldnx"
Jul 21 00:42:09.537039 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.537017    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e979354-a893-4586-ac20-defa840520f2-console-serving-cert\") pod \"console-6f49b4f48c-sldnx\" (UID: \"8e979354-a893-4586-ac20-defa840520f2\") " pod="openshift-console/console-6f49b4f48c-sldnx"
Jul 21 00:42:09.537195 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.537178    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e979354-a893-4586-ac20-defa840520f2-console-oauth-config\") pod \"console-6f49b4f48c-sldnx\" (UID: \"8e979354-a893-4586-ac20-defa840520f2\") " pod="openshift-console/console-6f49b4f48c-sldnx"
Jul 21 00:42:09.541207 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.541179    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmkxm\" (UniqueName: \"kubernetes.io/projected/8e979354-a893-4586-ac20-defa840520f2-kube-api-access-vmkxm\") pod \"console-6f49b4f48c-sldnx\" (UID: \"8e979354-a893-4586-ac20-defa840520f2\") " pod="openshift-console/console-6f49b4f48c-sldnx"
Jul 21 00:42:09.661164 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:09.661081    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f49b4f48c-sldnx"
Jul 21 00:42:10.519054 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:10.519018    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bf6gs"
Jul 21 00:42:11.309300 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:11.309218    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f49b4f48c-sldnx"]
Jul 21 00:42:11.313068 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:42:11.313038    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e979354_a893_4586_ac20_defa840520f2.slice/crio-a90f6653f7df7c89ed3168b7932b98c2982f1e99e4bd6e066f9a00d1d3af2be6 WatchSource:0}: Error finding container a90f6653f7df7c89ed3168b7932b98c2982f1e99e4bd6e066f9a00d1d3af2be6: Status 404 returned error can't find the container with id a90f6653f7df7c89ed3168b7932b98c2982f1e99e4bd6e066f9a00d1d3af2be6
Jul 21 00:42:11.441248 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:11.441221    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hkdzr"]
Jul 21 00:42:11.453803 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:11.453774    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hkdzr"]
Jul 21 00:42:11.453948 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:11.453869    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hkdzr"
Jul 21 00:42:11.456122 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:11.455915    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-vn47j\""
Jul 21 00:42:11.456308 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:11.456164    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 21 00:42:11.550841 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:11.550803    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a4fff145-f10a-4e7c-a564-5f825d1dbf71-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-hkdzr\" (UID: \"a4fff145-f10a-4e7c-a564-5f825d1dbf71\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hkdzr"
Jul 21 00:42:11.607196 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:11.607165    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sznsc" event={"ID":"b99cf4a0-3a18-4ac3-966e-ae98d24b50d5","Type":"ContainerStarted","Data":"1e6336f8f91f71d806283fe0f02a66f06c9461f7c2347b4629214deaf5443dda"}
Jul 21 00:42:11.608868 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:11.608846    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mrz6p" event={"ID":"f8410a2b-748e-4495-b67d-e7782149b0ad","Type":"ContainerStarted","Data":"51d84640dc2bed6256f9d0af4f63a10195d0c9658227a54c8415c2087cd19633"}
Jul 21 00:42:11.609001 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:11.608898    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mrz6p"
Jul 21 00:42:11.609001 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:11.608924    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mrz6p" event={"ID":"f8410a2b-748e-4495-b67d-e7782149b0ad","Type":"ContainerStarted","Data":"250e8a86cb5391954e8a732f80c70ceacdd68a39d06b37c272e3480214835c79"}
Jul 21 00:42:11.610129 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:11.610106    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f49b4f48c-sldnx" event={"ID":"8e979354-a893-4586-ac20-defa840520f2","Type":"ContainerStarted","Data":"a90f6653f7df7c89ed3168b7932b98c2982f1e99e4bd6e066f9a00d1d3af2be6"}
Jul 21 00:42:11.620796 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:11.620743    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sznsc" podStartSLOduration=1.065603282 podStartE2EDuration="6.620725434s" totalImagesPullingTime="5.555122152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:42:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:11.620099908 +0000 UTC m=+61.919796327" watchObservedRunningTime="2026-07-21 00:42:11.620725434 +0000 UTC m=+61.920421852"
Jul 21 00:42:11.635467 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:11.635416    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mrz6p" podStartSLOduration=2.030015756 podStartE2EDuration="7.635400316s" totalImagesPullingTime="5.60538456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:42:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:11.634241516 +0000 UTC m=+61.933937947" watchObservedRunningTime="2026-07-21 00:42:11.635400316 +0000 UTC m=+61.935096737"
Jul 21 00:42:11.651883 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:11.651701    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a4fff145-f10a-4e7c-a564-5f825d1dbf71-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-hkdzr\" (UID: \"a4fff145-f10a-4e7c-a564-5f825d1dbf71\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hkdzr"
Jul 21 00:42:11.651883 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:42:11.651871    2582 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 21 00:42:11.652024 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:42:11.651946    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4fff145-f10a-4e7c-a564-5f825d1dbf71-tls-certificates podName:a4fff145-f10a-4e7c-a564-5f825d1dbf71 nodeName:}" failed. No retries permitted until 2026-07-21 00:42:12.1519223 +0000 UTC m=+62.451618721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/a4fff145-f10a-4e7c-a564-5f825d1dbf71-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-hkdzr" (UID: "a4fff145-f10a-4e7c-a564-5f825d1dbf71") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 21 00:42:12.156256 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:12.156219    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a4fff145-f10a-4e7c-a564-5f825d1dbf71-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-hkdzr\" (UID: \"a4fff145-f10a-4e7c-a564-5f825d1dbf71\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hkdzr"
Jul 21 00:42:12.159072 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:12.159048    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a4fff145-f10a-4e7c-a564-5f825d1dbf71-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-hkdzr\" (UID: \"a4fff145-f10a-4e7c-a564-5f825d1dbf71\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hkdzr"
Jul 21 00:42:12.364347 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:12.364305    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hkdzr"
Jul 21 00:42:12.553039 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:12.553000    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hkdzr"]
Jul 21 00:42:12.560483 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:42:12.560305    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4fff145_f10a_4e7c_a564_5f825d1dbf71.slice/crio-805340cdb711a7b71ebbdf40cbd7a0a0afa218d83872f7b3b124a7a72624c368 WatchSource:0}: Error finding container 805340cdb711a7b71ebbdf40cbd7a0a0afa218d83872f7b3b124a7a72624c368: Status 404 returned error can't find the container with id 805340cdb711a7b71ebbdf40cbd7a0a0afa218d83872f7b3b124a7a72624c368
Jul 21 00:42:12.615759 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:12.615706    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tfh26" event={"ID":"12a92fbc-402e-4a05-88ff-ab3b48da8fed","Type":"ContainerStarted","Data":"dce0b8d397ddfec4784285a1e76040785677ffe744e8c0a58dc211b16f3d2001"}
Jul 21 00:42:12.618157 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:12.617692    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hkdzr" event={"ID":"a4fff145-f10a-4e7c-a564-5f825d1dbf71","Type":"ContainerStarted","Data":"805340cdb711a7b71ebbdf40cbd7a0a0afa218d83872f7b3b124a7a72624c368"}
Jul 21 00:42:14.137338 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:14.137304    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74dcd98d78-vqkrn"]
Jul 21 00:42:14.142420 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:14.142392    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:14.153274 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:14.153242    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74dcd98d78-vqkrn"]
Jul 21 00:42:14.154744 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:14.154713    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 21 00:42:14.276922 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:14.276881    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b81a53b-cd0e-45e4-b598-d8042696c089-service-ca\") pod \"console-74dcd98d78-vqkrn\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") " pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:14.277117 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:14.276928    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b81a53b-cd0e-45e4-b598-d8042696c089-oauth-serving-cert\") pod \"console-74dcd98d78-vqkrn\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") " pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:14.277117 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:14.276982    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b81a53b-cd0e-45e4-b598-d8042696c089-console-serving-cert\") pod \"console-74dcd98d78-vqkrn\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") " pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:14.277117 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:14.277002    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b81a53b-cd0e-45e4-b598-d8042696c089-trusted-ca-bundle\") pod \"console-74dcd98d78-vqkrn\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") " pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:14.277117 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:14.277023    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff7pj\" (UniqueName: \"kubernetes.io/projected/3b81a53b-cd0e-45e4-b598-d8042696c089-kube-api-access-ff7pj\") pod \"console-74dcd98d78-vqkrn\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") " pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:14.277117 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:14.277053    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b81a53b-cd0e-45e4-b598-d8042696c089-console-config\") pod \"console-74dcd98d78-vqkrn\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") " pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:14.277117 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:14.277079    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b81a53b-cd0e-45e4-b598-d8042696c089-console-oauth-config\") pod \"console-74dcd98d78-vqkrn\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") " pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:14.378046 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:14.378007    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b81a53b-cd0e-45e4-b598-d8042696c089-service-ca\") pod \"console-74dcd98d78-vqkrn\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") " pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:14.378046 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:14.378042    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b81a53b-cd0e-45e4-b598-d8042696c089-oauth-serving-cert\") pod \"console-74dcd98d78-vqkrn\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") " pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:14.378315 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:14.378078    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b81a53b-cd0e-45e4-b598-d8042696c089-console-serving-cert\") pod \"console-74dcd98d78-vqkrn\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") " pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:14.378315 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:14.378098    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b81a53b-cd0e-45e4-b598-d8042696c089-trusted-ca-bundle\") pod \"console-74dcd98d78-vqkrn\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") " pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:14.378315 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:14.378116    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff7pj\" (UniqueName: \"kubernetes.io/projected/3b81a53b-cd0e-45e4-b598-d8042696c089-kube-api-access-ff7pj\") pod \"console-74dcd98d78-vqkrn\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") " pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:14.378315 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:14.378146    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b81a53b-cd0e-45e4-b598-d8042696c089-console-config\") pod \"console-74dcd98d78-vqkrn\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") " pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:14.378315 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:14.378173    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b81a53b-cd0e-45e4-b598-d8042696c089-console-oauth-config\") pod \"console-74dcd98d78-vqkrn\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") " pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:14.379015 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:14.378957    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b81a53b-cd0e-45e4-b598-d8042696c089-service-ca\") pod \"console-74dcd98d78-vqkrn\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") " pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:14.379145 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:14.379019    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b81a53b-cd0e-45e4-b598-d8042696c089-oauth-serving-cert\") pod \"console-74dcd98d78-vqkrn\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") " pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:14.379265 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:14.379233    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b81a53b-cd0e-45e4-b598-d8042696c089-trusted-ca-bundle\") pod \"console-74dcd98d78-vqkrn\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") " pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:14.379386 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:14.379269    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b81a53b-cd0e-45e4-b598-d8042696c089-console-config\") pod \"console-74dcd98d78-vqkrn\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") " pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:14.381169 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:14.381144    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b81a53b-cd0e-45e4-b598-d8042696c089-console-oauth-config\") pod \"console-74dcd98d78-vqkrn\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") " pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:14.381255 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:14.381157    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b81a53b-cd0e-45e4-b598-d8042696c089-console-serving-cert\") pod \"console-74dcd98d78-vqkrn\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") " pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:14.386686 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:14.386643    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff7pj\" (UniqueName: \"kubernetes.io/projected/3b81a53b-cd0e-45e4-b598-d8042696c089-kube-api-access-ff7pj\") pod \"console-74dcd98d78-vqkrn\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") " pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:14.454667 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:14.454616    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:15.994414 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:15.994377    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lszrr\" (UniqueName: \"kubernetes.io/projected/a817dd2e-1a95-45d6-bbca-6af085ee85a5-kube-api-access-lszrr\") pod \"network-check-target-wlhjv\" (UID: \"a817dd2e-1a95-45d6-bbca-6af085ee85a5\") " pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:42:15.994414 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:15.994422    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0da7e607-7001-47f1-a96d-1c366f2dd3ef-original-pull-secret\") pod \"global-pull-secret-syncer-88txv\" (UID: \"0da7e607-7001-47f1-a96d-1c366f2dd3ef\") " pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:42:15.994922 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:15.994458    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d61aa2f7-0359-4f25-b575-dd995021228e-metrics-certs\") pod \"network-metrics-daemon-bhkcc\" (UID: \"d61aa2f7-0359-4f25-b575-dd995021228e\") " pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:42:15.996228 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:15.996212    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 00:42:15.996620 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:15.996604    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 00:42:15.996720 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:15.996603    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 00:42:16.006357 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:16.006327    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 00:42:16.007226 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:16.007200    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0da7e607-7001-47f1-a96d-1c366f2dd3ef-original-pull-secret\") pod \"global-pull-secret-syncer-88txv\" (UID: \"0da7e607-7001-47f1-a96d-1c366f2dd3ef\") " pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:42:16.007322 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:16.007256    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d61aa2f7-0359-4f25-b575-dd995021228e-metrics-certs\") pod \"network-metrics-daemon-bhkcc\" (UID: \"d61aa2f7-0359-4f25-b575-dd995021228e\") " pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:42:16.018082 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:16.018055    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lszrr\" (UniqueName: \"kubernetes.io/projected/a817dd2e-1a95-45d6-bbca-6af085ee85a5-kube-api-access-lszrr\") pod \"network-check-target-wlhjv\" (UID: \"a817dd2e-1a95-45d6-bbca-6af085ee85a5\") " pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:42:16.151509 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:16.151259    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wcfmk\""
Jul 21 00:42:16.156215 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:16.156185    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nqmsz\""
Jul 21 00:42:16.159552 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:16.159521    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhkcc"
Jul 21 00:42:16.159694 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:16.159637    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88txv"
Jul 21 00:42:16.164795 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:16.164775    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:42:16.838161 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:16.838025    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74dcd98d78-vqkrn"]
Jul 21 00:42:16.845841 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:42:16.845790    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b81a53b_cd0e_45e4_b598_d8042696c089.slice/crio-8737dc3f56eda1c6200c4d3197dbab37245f17325bacd28435786ae56a1035b4 WatchSource:0}: Error finding container 8737dc3f56eda1c6200c4d3197dbab37245f17325bacd28435786ae56a1035b4: Status 404 returned error can't find the container with id 8737dc3f56eda1c6200c4d3197dbab37245f17325bacd28435786ae56a1035b4
Jul 21 00:42:16.850550 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:16.850473    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wlhjv"]
Jul 21 00:42:16.854316 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:42:16.854193    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda817dd2e_1a95_45d6_bbca_6af085ee85a5.slice/crio-e21555c3ca58af13f5a0466070e83eb8ef47a9d818535f0e786cd65196df1c52 WatchSource:0}: Error finding container e21555c3ca58af13f5a0466070e83eb8ef47a9d818535f0e786cd65196df1c52: Status 404 returned error can't find the container with id e21555c3ca58af13f5a0466070e83eb8ef47a9d818535f0e786cd65196df1c52
Jul 21 00:42:16.873577 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:16.873548    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bhkcc"]
Jul 21 00:42:16.877292 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:42:16.877262    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd61aa2f7_0359_4f25_b575_dd995021228e.slice/crio-8ea4a70766c55697989ecf72554886361bfb13499968b9c299cf9b501ad52e47 WatchSource:0}: Error finding container 8ea4a70766c55697989ecf72554886361bfb13499968b9c299cf9b501ad52e47: Status 404 returned error can't find the container with id 8ea4a70766c55697989ecf72554886361bfb13499968b9c299cf9b501ad52e47
Jul 21 00:42:16.886716 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:16.886690    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-88txv"]
Jul 21 00:42:16.889957 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:42:16.889933    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0da7e607_7001_47f1_a96d_1c366f2dd3ef.slice/crio-6089d0847150bc1409681d4eab1bf2b69fe19c854ee68b793a4b7482c3df4df3 WatchSource:0}: Error finding container 6089d0847150bc1409681d4eab1bf2b69fe19c854ee68b793a4b7482c3df4df3: Status 404 returned error can't find the container with id 6089d0847150bc1409681d4eab1bf2b69fe19c854ee68b793a4b7482c3df4df3
Jul 21 00:42:17.634879 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:17.634836    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-88txv" event={"ID":"0da7e607-7001-47f1-a96d-1c366f2dd3ef","Type":"ContainerStarted","Data":"6089d0847150bc1409681d4eab1bf2b69fe19c854ee68b793a4b7482c3df4df3"}
Jul 21 00:42:17.636894 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:17.636863    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74dcd98d78-vqkrn" event={"ID":"3b81a53b-cd0e-45e4-b598-d8042696c089","Type":"ContainerStarted","Data":"6863e44434537741f37276d5fc836a6ab7453b7588158750dcbced175600180c"}
Jul 21 00:42:17.637024 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:17.636918    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74dcd98d78-vqkrn" event={"ID":"3b81a53b-cd0e-45e4-b598-d8042696c089","Type":"ContainerStarted","Data":"8737dc3f56eda1c6200c4d3197dbab37245f17325bacd28435786ae56a1035b4"}
Jul 21 00:42:17.639091 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:17.639065    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f49b4f48c-sldnx" event={"ID":"8e979354-a893-4586-ac20-defa840520f2","Type":"ContainerStarted","Data":"a7a7fd95a90b7d0fe529ba9745a9859923cde27cd8654df5b288ab1ea24a12cf"}
Jul 21 00:42:17.641247 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:17.641211    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wlhjv" event={"ID":"a817dd2e-1a95-45d6-bbca-6af085ee85a5","Type":"ContainerStarted","Data":"e21555c3ca58af13f5a0466070e83eb8ef47a9d818535f0e786cd65196df1c52"}
Jul 21 00:42:17.643616 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:17.643584    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tfh26" event={"ID":"12a92fbc-402e-4a05-88ff-ab3b48da8fed","Type":"ContainerStarted","Data":"aa9bd2682f5820541db5f0217893d336c1f59d1c23ba5b4535827d21fd0c5e0a"}
Jul 21 00:42:17.645023 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:17.644995    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bhkcc" event={"ID":"d61aa2f7-0359-4f25-b575-dd995021228e","Type":"ContainerStarted","Data":"8ea4a70766c55697989ecf72554886361bfb13499968b9c299cf9b501ad52e47"}
Jul 21 00:42:17.646613 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:17.646589    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hkdzr" event={"ID":"a4fff145-f10a-4e7c-a564-5f825d1dbf71","Type":"ContainerStarted","Data":"6f701fe66b5edab9e1f66e43021c059f1f4ccad668891d7efba986e7f1eaa42b"}
Jul 21 00:42:17.646903 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:17.646883    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hkdzr"
Jul 21 00:42:17.652933 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:17.652904    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hkdzr"
Jul 21 00:42:17.654990 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:17.654928    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74dcd98d78-vqkrn" podStartSLOduration=3.654907952 podStartE2EDuration="3.654907952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:42:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:17.65354462 +0000 UTC m=+67.953241042" watchObservedRunningTime="2026-07-21 00:42:17.654907952 +0000 UTC m=+67.954604355"
Jul 21 00:42:17.666565 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:17.666396    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hkdzr" podStartSLOduration=2.578462847 podStartE2EDuration="6.666379688s" totalImagesPullingTime="4.087916841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:42:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:17.666321085 +0000 UTC m=+67.966017508" watchObservedRunningTime="2026-07-21 00:42:17.666379688 +0000 UTC m=+67.966076091"
Jul 21 00:42:17.681106 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:17.681049    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f49b4f48c-sldnx" podStartSLOduration=3.322701794 podStartE2EDuration="8.681022721s" totalImagesPullingTime="5.358320927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:42:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:17.680375179 +0000 UTC m=+67.980071606" watchObservedRunningTime="2026-07-21 00:42:17.681022721 +0000 UTC m=+67.980719166"
Jul 21 00:42:18.495223 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:18.495187    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-jj7ps"]
Jul 21 00:42:18.519734 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:18.519363    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-jj7ps"]
Jul 21 00:42:18.519734 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:18.519508    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-jj7ps"
Jul 21 00:42:18.523843 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:18.522239    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 21 00:42:18.523843 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:18.522594    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-9nmgv\""
Jul 21 00:42:18.523843 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:18.522863    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 21 00:42:18.523843 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:18.523064    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 00:42:18.523843 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:18.523417    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 00:42:18.523843 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:18.523582    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 00:42:18.617006 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:18.616745    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88507101-e972-4a54-bc6a-0642ae5c1003-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-jj7ps\" (UID: \"88507101-e972-4a54-bc6a-0642ae5c1003\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jj7ps"
Jul 21 00:42:18.617006 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:18.616827    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88507101-e972-4a54-bc6a-0642ae5c1003-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-jj7ps\" (UID: \"88507101-e972-4a54-bc6a-0642ae5c1003\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jj7ps"
Jul 21 00:42:18.617006 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:18.616872    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kcwh\" (UniqueName: \"kubernetes.io/projected/88507101-e972-4a54-bc6a-0642ae5c1003-kube-api-access-7kcwh\") pod \"prometheus-operator-5945b5cfd-jj7ps\" (UID: \"88507101-e972-4a54-bc6a-0642ae5c1003\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jj7ps"
Jul 21 00:42:18.617006 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:18.616900    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/88507101-e972-4a54-bc6a-0642ae5c1003-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-jj7ps\" (UID: \"88507101-e972-4a54-bc6a-0642ae5c1003\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jj7ps"
Jul 21 00:42:18.660754 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:18.660519    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bhkcc" event={"ID":"d61aa2f7-0359-4f25-b575-dd995021228e","Type":"ContainerStarted","Data":"2467713769c6b578a925e1d7623799e2265a14ce66c22685522c052405f41d94"}
Jul 21 00:42:18.660754 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:18.660636    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bhkcc" event={"ID":"d61aa2f7-0359-4f25-b575-dd995021228e","Type":"ContainerStarted","Data":"df494d8f2556d228a5afec9c3924b52fb6c51df482770b2caf244b23614dc6e4"}
Jul 21 00:42:18.676839 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:18.676247    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bhkcc" podStartSLOduration=66.774484543 podStartE2EDuration="1m7.676225148s" totalImagesPullingTime="901.740605ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:18.675701118 +0000 UTC m=+68.975397542" watchObservedRunningTime="2026-07-21 00:42:18.676225148 +0000 UTC m=+68.975921567"
Jul 21 00:42:18.720059 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:18.718325    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88507101-e972-4a54-bc6a-0642ae5c1003-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-jj7ps\" (UID: \"88507101-e972-4a54-bc6a-0642ae5c1003\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jj7ps"
Jul 21 00:42:18.720059 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:18.718484    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88507101-e972-4a54-bc6a-0642ae5c1003-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-jj7ps\" (UID: \"88507101-e972-4a54-bc6a-0642ae5c1003\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jj7ps"
Jul 21 00:42:18.720059 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:18.718582    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kcwh\" (UniqueName: \"kubernetes.io/projected/88507101-e972-4a54-bc6a-0642ae5c1003-kube-api-access-7kcwh\") pod \"prometheus-operator-5945b5cfd-jj7ps\" (UID: \"88507101-e972-4a54-bc6a-0642ae5c1003\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jj7ps"
Jul 21 00:42:18.720059 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:18.718617    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/88507101-e972-4a54-bc6a-0642ae5c1003-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-jj7ps\" (UID: \"88507101-e972-4a54-bc6a-0642ae5c1003\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jj7ps"
Jul 21 00:42:18.720059 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:42:18.719400    2582 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 21 00:42:18.720059 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:42:18.719466    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88507101-e972-4a54-bc6a-0642ae5c1003-prometheus-operator-tls podName:88507101-e972-4a54-bc6a-0642ae5c1003 nodeName:}" failed. No retries permitted until 2026-07-21 00:42:19.219443593 +0000 UTC m=+69.519140004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/88507101-e972-4a54-bc6a-0642ae5c1003-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-jj7ps" (UID: "88507101-e972-4a54-bc6a-0642ae5c1003") : secret "prometheus-operator-tls" not found
Jul 21 00:42:18.720059 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:18.719810    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88507101-e972-4a54-bc6a-0642ae5c1003-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-jj7ps\" (UID: \"88507101-e972-4a54-bc6a-0642ae5c1003\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jj7ps"
Jul 21 00:42:18.724318 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:18.724272    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88507101-e972-4a54-bc6a-0642ae5c1003-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-jj7ps\" (UID: \"88507101-e972-4a54-bc6a-0642ae5c1003\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jj7ps"
Jul 21 00:42:18.728447 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:18.728404    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kcwh\" (UniqueName: \"kubernetes.io/projected/88507101-e972-4a54-bc6a-0642ae5c1003-kube-api-access-7kcwh\") pod \"prometheus-operator-5945b5cfd-jj7ps\" (UID: \"88507101-e972-4a54-bc6a-0642ae5c1003\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jj7ps"
Jul 21 00:42:19.222412 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:19.222376    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/88507101-e972-4a54-bc6a-0642ae5c1003-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-jj7ps\" (UID: \"88507101-e972-4a54-bc6a-0642ae5c1003\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jj7ps"
Jul 21 00:42:19.225418 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:19.225355    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/88507101-e972-4a54-bc6a-0642ae5c1003-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-jj7ps\" (UID: \"88507101-e972-4a54-bc6a-0642ae5c1003\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jj7ps"
Jul 21 00:42:19.437590 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:19.437545    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-jj7ps"
Jul 21 00:42:19.661564 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:19.661515    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f49b4f48c-sldnx"
Jul 21 00:42:19.662032 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:19.661582    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f49b4f48c-sldnx"
Jul 21 00:42:19.663483 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:19.663409    2582 patch_prober.go:28] interesting pod/console-6f49b4f48c-sldnx container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body=
Jul 21 00:42:19.663483 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:19.663465    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6f49b4f48c-sldnx" podUID="8e979354-a893-4586-ac20-defa840520f2" containerName="console" probeResult="failure" output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused"
Jul 21 00:42:21.621262 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:21.621225    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mrz6p"
Jul 21 00:42:23.587081 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:23.587047    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-jj7ps"]
Jul 21 00:42:23.590807 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:42:23.590768    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88507101_e972_4a54_bc6a_0642ae5c1003.slice/crio-3e998f62a9ff58972227157beefcc6fed7e50e5efef98db2ddb2222b0f0d0f6c WatchSource:0}: Error finding container 3e998f62a9ff58972227157beefcc6fed7e50e5efef98db2ddb2222b0f0d0f6c: Status 404 returned error can't find the container with id 3e998f62a9ff58972227157beefcc6fed7e50e5efef98db2ddb2222b0f0d0f6c
Jul 21 00:42:23.683957 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:23.683844    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-88txv" event={"ID":"0da7e607-7001-47f1-a96d-1c366f2dd3ef","Type":"ContainerStarted","Data":"840b17366ca5265b67e9f644c31d53e8e367ae0e6d25ec4dd47268b366436289"}
Jul 21 00:42:23.685401 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:23.685365    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wlhjv" event={"ID":"a817dd2e-1a95-45d6-bbca-6af085ee85a5","Type":"ContainerStarted","Data":"b8de2912918d894e58b943ecf3941ef5b8e6dcce9ccaf7bb781ab0fb44e8f4a5"}
Jul 21 00:42:23.685555 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:23.685497    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:42:23.687074 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:23.686846    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-jj7ps" event={"ID":"88507101-e972-4a54-bc6a-0642ae5c1003","Type":"ContainerStarted","Data":"3e998f62a9ff58972227157beefcc6fed7e50e5efef98db2ddb2222b0f0d0f6c"}
Jul 21 00:42:23.689392 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:23.689364    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tfh26" event={"ID":"12a92fbc-402e-4a05-88ff-ab3b48da8fed","Type":"ContainerStarted","Data":"e1e64c52b7f837873454b137fda9d556f2e8dcc9090efa83975867c3c04bb603"}
Jul 21 00:42:23.696599 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:23.696547    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-88txv" podStartSLOduration=66.133196722 podStartE2EDuration="1m12.696526521s" totalImagesPullingTime="6.563329799s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:23.695906645 +0000 UTC m=+73.995603071" watchObservedRunningTime="2026-07-21 00:42:23.696526521 +0000 UTC m=+73.996222942"
Jul 21 00:42:23.708441 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:23.708387    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wlhjv" podStartSLOduration=66.113371661 podStartE2EDuration="1m12.708370444s" totalImagesPullingTime="6.594998783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:23.7075271 +0000 UTC m=+74.007223523" watchObservedRunningTime="2026-07-21 00:42:23.708370444 +0000 UTC m=+74.008066865"
Jul 21 00:42:23.722126 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:23.721972    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tfh26" podStartSLOduration=2.109248619 podStartE2EDuration="19.721952882s" totalImagesPullingTime="17.612704263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:42:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:23.721332168 +0000 UTC m=+74.021028588" watchObservedRunningTime="2026-07-21 00:42:23.721952882 +0000 UTC m=+74.021649305"
Jul 21 00:42:24.455631 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:24.455588    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:24.455839 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:24.455681    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:24.461483 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:24.461454    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:24.697478 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:24.697451    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:42:24.742706 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:24.742596    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f49b4f48c-sldnx"]
Jul 21 00:42:25.698561 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:25.698518    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-jj7ps" event={"ID":"88507101-e972-4a54-bc6a-0642ae5c1003","Type":"ContainerStarted","Data":"b094ef10c608cd491d812805c97babc7b37d2e0fd628861a644e10db764be9e2"}
Jul 21 00:42:25.699103 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:25.698601    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-jj7ps" event={"ID":"88507101-e972-4a54-bc6a-0642ae5c1003","Type":"ContainerStarted","Data":"67fda7a09b89aecf1ee9ad9ad61f33119bfc863b8e6886f2eb023e77e070f49d"}
Jul 21 00:42:25.713473 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:25.713422    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-jj7ps" podStartSLOduration=6.2983425 podStartE2EDuration="7.71340554s" totalImagesPullingTime="1.41506304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:42:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:25.712717467 +0000 UTC m=+76.012413890" watchObservedRunningTime="2026-07-21 00:42:25.71340554 +0000 UTC m=+76.013101960"
Jul 21 00:42:27.830027 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.829992    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-8wlxd"]
Jul 21 00:42:27.833104 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.833081    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-nshfn"]
Jul 21 00:42:27.833238 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.833207    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8wlxd"
Jul 21 00:42:27.834882 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.834838    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 21 00:42:27.835020 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.834843    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-g82df\""
Jul 21 00:42:27.835109 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.835096    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 21 00:42:27.835911 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.835892    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-nshfn"
Jul 21 00:42:27.837419 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.837399    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 21 00:42:27.837517 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.837432    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-5vtc8\""
Jul 21 00:42:27.837517 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.837480    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 21 00:42:27.837686 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.837673    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 21 00:42:27.846970 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.846941    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-8wlxd"]
Jul 21 00:42:27.848190 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.848165    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-nshfn"]
Jul 21 00:42:27.851660 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.851618    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-88j8d"]
Jul 21 00:42:27.854797 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.854780    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:27.856589 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.856560    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 00:42:27.856757 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.856735    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 00:42:27.856866 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.856735    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 00:42:27.856866 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.856786    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cx8t6\""
Jul 21 00:42:27.991374 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.991316    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/19b12008-5ee1-4251-aaba-d2cf00362411-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-nshfn\" (UID: \"19b12008-5ee1-4251-aaba-d2cf00362411\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nshfn"
Jul 21 00:42:27.991374 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.991373    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/19b12008-5ee1-4251-aaba-d2cf00362411-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-nshfn\" (UID: \"19b12008-5ee1-4251-aaba-d2cf00362411\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nshfn"
Jul 21 00:42:27.991608 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.991397    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-8wlxd\" (UID: \"70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8wlxd"
Jul 21 00:42:27.991608 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.991447    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-8wlxd\" (UID: \"70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8wlxd"
Jul 21 00:42:27.991608 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.991486    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-8wlxd\" (UID: \"70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8wlxd"
Jul 21 00:42:27.991608 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.991515    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0ae3c48a-e489-4afa-b528-d07d86532b1f-node-exporter-accelerators-collector-config\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:27.991608 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.991532    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9dwl\" (UniqueName: \"kubernetes.io/projected/70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9-kube-api-access-p9dwl\") pod \"openshift-state-metrics-79f6958cdf-8wlxd\" (UID: \"70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8wlxd"
Jul 21 00:42:27.991608 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.991550    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0ae3c48a-e489-4afa-b528-d07d86532b1f-root\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:27.991608 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.991572    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0ae3c48a-e489-4afa-b528-d07d86532b1f-node-exporter-tls\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:27.991608 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.991587    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxgk9\" (UniqueName: \"kubernetes.io/projected/19b12008-5ee1-4251-aaba-d2cf00362411-kube-api-access-bxgk9\") pod \"kube-state-metrics-56c5594674-nshfn\" (UID: \"19b12008-5ee1-4251-aaba-d2cf00362411\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nshfn"
Jul 21 00:42:27.991608 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.991610    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19b12008-5ee1-4251-aaba-d2cf00362411-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-nshfn\" (UID: \"19b12008-5ee1-4251-aaba-d2cf00362411\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nshfn"
Jul 21 00:42:27.991908 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.991678    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0ae3c48a-e489-4afa-b528-d07d86532b1f-node-exporter-wtmp\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:27.991908 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.991710    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/19b12008-5ee1-4251-aaba-d2cf00362411-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-nshfn\" (UID: \"19b12008-5ee1-4251-aaba-d2cf00362411\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nshfn"
Jul 21 00:42:27.991908 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.991739    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ae3c48a-e489-4afa-b528-d07d86532b1f-metrics-client-ca\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:27.991908 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.991760    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0ae3c48a-e489-4afa-b528-d07d86532b1f-node-exporter-textfile\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:27.991908 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.991777    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ae3c48a-e489-4afa-b528-d07d86532b1f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:27.991908 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.991794    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19b12008-5ee1-4251-aaba-d2cf00362411-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-nshfn\" (UID: \"19b12008-5ee1-4251-aaba-d2cf00362411\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nshfn"
Jul 21 00:42:27.991908 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.991816    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ae3c48a-e489-4afa-b528-d07d86532b1f-sys\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:27.991908 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:27.991885    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hrwp\" (UniqueName: \"kubernetes.io/projected/0ae3c48a-e489-4afa-b528-d07d86532b1f-kube-api-access-4hrwp\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:28.092586 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.092492    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxgk9\" (UniqueName: \"kubernetes.io/projected/19b12008-5ee1-4251-aaba-d2cf00362411-kube-api-access-bxgk9\") pod \"kube-state-metrics-56c5594674-nshfn\" (UID: \"19b12008-5ee1-4251-aaba-d2cf00362411\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nshfn"
Jul 21 00:42:28.092586 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.092534    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19b12008-5ee1-4251-aaba-d2cf00362411-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-nshfn\" (UID: \"19b12008-5ee1-4251-aaba-d2cf00362411\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nshfn"
Jul 21 00:42:28.092586 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.092554    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0ae3c48a-e489-4afa-b528-d07d86532b1f-node-exporter-wtmp\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:28.092586 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.092570    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/19b12008-5ee1-4251-aaba-d2cf00362411-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-nshfn\" (UID: \"19b12008-5ee1-4251-aaba-d2cf00362411\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nshfn"
Jul 21 00:42:28.092586 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.092589    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ae3c48a-e489-4afa-b528-d07d86532b1f-metrics-client-ca\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:28.092969 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.092608    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0ae3c48a-e489-4afa-b528-d07d86532b1f-node-exporter-textfile\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:28.092969 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.092627    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ae3c48a-e489-4afa-b528-d07d86532b1f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:28.092969 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.092661    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19b12008-5ee1-4251-aaba-d2cf00362411-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-nshfn\" (UID: \"19b12008-5ee1-4251-aaba-d2cf00362411\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nshfn"
Jul 21 00:42:28.092969 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.092699    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ae3c48a-e489-4afa-b528-d07d86532b1f-sys\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:28.092969 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.092740    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hrwp\" (UniqueName: \"kubernetes.io/projected/0ae3c48a-e489-4afa-b528-d07d86532b1f-kube-api-access-4hrwp\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:28.092969 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.092766    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/19b12008-5ee1-4251-aaba-d2cf00362411-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-nshfn\" (UID: \"19b12008-5ee1-4251-aaba-d2cf00362411\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nshfn"
Jul 21 00:42:28.092969 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.092766    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0ae3c48a-e489-4afa-b528-d07d86532b1f-node-exporter-wtmp\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:28.092969 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.092789    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/19b12008-5ee1-4251-aaba-d2cf00362411-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-nshfn\" (UID: \"19b12008-5ee1-4251-aaba-d2cf00362411\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nshfn"
Jul 21 00:42:28.092969 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.092814    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-8wlxd\" (UID: \"70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8wlxd"
Jul 21 00:42:28.092969 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.092840    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-8wlxd\" (UID: \"70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8wlxd"
Jul 21 00:42:28.092969 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.092853    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ae3c48a-e489-4afa-b528-d07d86532b1f-sys\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:28.092969 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.092867    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-8wlxd\" (UID: \"70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8wlxd"
Jul 21 00:42:28.092969 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.092901    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0ae3c48a-e489-4afa-b528-d07d86532b1f-node-exporter-accelerators-collector-config\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:28.093559 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:42:28.093087    2582 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 21 00:42:28.093559 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:42:28.093167    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19b12008-5ee1-4251-aaba-d2cf00362411-kube-state-metrics-tls podName:19b12008-5ee1-4251-aaba-d2cf00362411 nodeName:}" failed. No retries permitted until 2026-07-21 00:42:28.593146957 +0000 UTC m=+78.892843359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/19b12008-5ee1-4251-aaba-d2cf00362411-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-nshfn" (UID: "19b12008-5ee1-4251-aaba-d2cf00362411") : secret "kube-state-metrics-tls" not found
Jul 21 00:42:28.093559 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.093192    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9dwl\" (UniqueName: \"kubernetes.io/projected/70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9-kube-api-access-p9dwl\") pod \"openshift-state-metrics-79f6958cdf-8wlxd\" (UID: \"70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8wlxd"
Jul 21 00:42:28.093559 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.093226    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0ae3c48a-e489-4afa-b528-d07d86532b1f-root\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:28.093559 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.093262    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0ae3c48a-e489-4afa-b528-d07d86532b1f-node-exporter-tls\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:28.093559 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.093342    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ae3c48a-e489-4afa-b528-d07d86532b1f-metrics-client-ca\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:28.093559 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.093387    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19b12008-5ee1-4251-aaba-d2cf00362411-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-nshfn\" (UID: \"19b12008-5ee1-4251-aaba-d2cf00362411\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nshfn"
Jul 21 00:42:28.093559 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.093162    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0ae3c48a-e489-4afa-b528-d07d86532b1f-node-exporter-textfile\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:28.094020 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.093885    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/19b12008-5ee1-4251-aaba-d2cf00362411-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-nshfn\" (UID: \"19b12008-5ee1-4251-aaba-d2cf00362411\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nshfn"
Jul 21 00:42:28.094020 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.093088    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/19b12008-5ee1-4251-aaba-d2cf00362411-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-nshfn\" (UID: \"19b12008-5ee1-4251-aaba-d2cf00362411\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nshfn"
Jul 21 00:42:28.094020 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.093940    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0ae3c48a-e489-4afa-b528-d07d86532b1f-node-exporter-accelerators-collector-config\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:28.094020 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.093971    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0ae3c48a-e489-4afa-b528-d07d86532b1f-root\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:28.094374 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.094349    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-8wlxd\" (UID: \"70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8wlxd"
Jul 21 00:42:28.095940 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.095907    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ae3c48a-e489-4afa-b528-d07d86532b1f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:28.095940 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.095933    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-8wlxd\" (UID: \"70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8wlxd"
Jul 21 00:42:28.096125 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.096007    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0ae3c48a-e489-4afa-b528-d07d86532b1f-node-exporter-tls\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:28.096125 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.096095    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-8wlxd\" (UID: \"70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8wlxd"
Jul 21 00:42:28.096212 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.096135    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19b12008-5ee1-4251-aaba-d2cf00362411-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-nshfn\" (UID: \"19b12008-5ee1-4251-aaba-d2cf00362411\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nshfn"
Jul 21 00:42:28.100594 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.100565    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hrwp\" (UniqueName: \"kubernetes.io/projected/0ae3c48a-e489-4afa-b528-d07d86532b1f-kube-api-access-4hrwp\") pod \"node-exporter-88j8d\" (UID: \"0ae3c48a-e489-4afa-b528-d07d86532b1f\") " pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:28.100754 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.100737    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxgk9\" (UniqueName: \"kubernetes.io/projected/19b12008-5ee1-4251-aaba-d2cf00362411-kube-api-access-bxgk9\") pod \"kube-state-metrics-56c5594674-nshfn\" (UID: \"19b12008-5ee1-4251-aaba-d2cf00362411\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nshfn"
Jul 21 00:42:28.100896 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.100880    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9dwl\" (UniqueName: \"kubernetes.io/projected/70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9-kube-api-access-p9dwl\") pod \"openshift-state-metrics-79f6958cdf-8wlxd\" (UID: \"70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8wlxd"
Jul 21 00:42:28.144039 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.143997    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8wlxd"
Jul 21 00:42:28.164417 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.164389    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-88j8d"
Jul 21 00:42:28.176490 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:42:28.176442    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ae3c48a_e489_4afa_b528_d07d86532b1f.slice/crio-b99247fa7e1005e2b1713b181de87bea619afc030faaa2415f5b8b90f0950e18 WatchSource:0}: Error finding container b99247fa7e1005e2b1713b181de87bea619afc030faaa2415f5b8b90f0950e18: Status 404 returned error can't find the container with id b99247fa7e1005e2b1713b181de87bea619afc030faaa2415f5b8b90f0950e18
Jul 21 00:42:28.289058 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.289026    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-8wlxd"]
Jul 21 00:42:28.292118 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:42:28.292075    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70dcbe7a_e7f6_4cca_bd7a_76cb3952b6d9.slice/crio-aab87ea50ec24ce5854d8a0d148696034ee0a08b57d8af2b61b7ba24347ad23f WatchSource:0}: Error finding container aab87ea50ec24ce5854d8a0d148696034ee0a08b57d8af2b61b7ba24347ad23f: Status 404 returned error can't find the container with id aab87ea50ec24ce5854d8a0d148696034ee0a08b57d8af2b61b7ba24347ad23f
Jul 21 00:42:28.597917 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.597827    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/19b12008-5ee1-4251-aaba-d2cf00362411-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-nshfn\" (UID: \"19b12008-5ee1-4251-aaba-d2cf00362411\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nshfn"
Jul 21 00:42:28.600214 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.600188    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/19b12008-5ee1-4251-aaba-d2cf00362411-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-nshfn\" (UID: \"19b12008-5ee1-4251-aaba-d2cf00362411\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nshfn"
Jul 21 00:42:28.710982 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.710948    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-88j8d" event={"ID":"0ae3c48a-e489-4afa-b528-d07d86532b1f","Type":"ContainerStarted","Data":"b99247fa7e1005e2b1713b181de87bea619afc030faaa2415f5b8b90f0950e18"}
Jul 21 00:42:28.712853 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.712827    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8wlxd" event={"ID":"70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9","Type":"ContainerStarted","Data":"8414bcd99ecc77ca88d42e227c6c9ba1a8b42c227f3063b22f3223093ff318c5"}
Jul 21 00:42:28.712964 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.712877    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8wlxd" event={"ID":"70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9","Type":"ContainerStarted","Data":"55019c93b5aa3ece8945f8fd55a71ddb4f129df24a5523057a3106a074fa513d"}
Jul 21 00:42:28.712964 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.712895    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8wlxd" event={"ID":"70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9","Type":"ContainerStarted","Data":"aab87ea50ec24ce5854d8a0d148696034ee0a08b57d8af2b61b7ba24347ad23f"}
Jul 21 00:42:28.750207 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.750176    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-nshfn"
Jul 21 00:42:28.887420 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.887330    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 00:42:28.892930 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.892546    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:28.893087 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.892901    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-nshfn"]
Jul 21 00:42:28.894704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.894535    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 21 00:42:28.894704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.894552    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 21 00:42:28.894941 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.894906    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 21 00:42:28.895005 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.894906    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 21 00:42:28.895060 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.895006    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 21 00:42:28.895112 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.895080    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 21 00:42:28.895258 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.895237    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 21 00:42:28.895321 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.895263    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 21 00:42:28.895378 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.895344    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 21 00:42:28.895378 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.895353    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vbmdd\""
Jul 21 00:42:28.899839 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:42:28.899792    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19b12008_5ee1_4251_aaba_d2cf00362411.slice/crio-f070b0fd0baffaeaeb10cc5c14ab2e370d1bb4a4ddacf1626bb75c61280a3bd5 WatchSource:0}: Error finding container f070b0fd0baffaeaeb10cc5c14ab2e370d1bb4a4ddacf1626bb75c61280a3bd5: Status 404 returned error can't find the container with id f070b0fd0baffaeaeb10cc5c14ab2e370d1bb4a4ddacf1626bb75c61280a3bd5
Jul 21 00:42:28.907853 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.907827    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 00:42:29.000012 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:28.999981    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce50dda1-c329-4f02-8f20-6342ea1a7166-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.000224 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.000019    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce50dda1-c329-4f02-8f20-6342ea1a7166-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.000224 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.000043    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce50dda1-c329-4f02-8f20-6342ea1a7166-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.000224 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.000080    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce50dda1-c329-4f02-8f20-6342ea1a7166-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.000224 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.000103    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce50dda1-c329-4f02-8f20-6342ea1a7166-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.000224 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.000198    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce50dda1-c329-4f02-8f20-6342ea1a7166-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.000492 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.000267    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce50dda1-c329-4f02-8f20-6342ea1a7166-config-out\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.000492 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.000311    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce50dda1-c329-4f02-8f20-6342ea1a7166-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.000492 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.000394    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce50dda1-c329-4f02-8f20-6342ea1a7166-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.000492 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.000436    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce50dda1-c329-4f02-8f20-6342ea1a7166-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.000492 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.000481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zthqz\" (UniqueName: \"kubernetes.io/projected/ce50dda1-c329-4f02-8f20-6342ea1a7166-kube-api-access-zthqz\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.000712 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.000512    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce50dda1-c329-4f02-8f20-6342ea1a7166-web-config\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.000712 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.000536    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce50dda1-c329-4f02-8f20-6342ea1a7166-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.101524 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.101484    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zthqz\" (UniqueName: \"kubernetes.io/projected/ce50dda1-c329-4f02-8f20-6342ea1a7166-kube-api-access-zthqz\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.101524 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.101524    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce50dda1-c329-4f02-8f20-6342ea1a7166-web-config\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.101787 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.101549    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce50dda1-c329-4f02-8f20-6342ea1a7166-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.101787 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.101702    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce50dda1-c329-4f02-8f20-6342ea1a7166-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.101787 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.101762    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce50dda1-c329-4f02-8f20-6342ea1a7166-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.101942 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.101808    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce50dda1-c329-4f02-8f20-6342ea1a7166-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.101942 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.101846    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce50dda1-c329-4f02-8f20-6342ea1a7166-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.102049 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.101975    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce50dda1-c329-4f02-8f20-6342ea1a7166-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.102049 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.102025    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce50dda1-c329-4f02-8f20-6342ea1a7166-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.102155 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.102057    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce50dda1-c329-4f02-8f20-6342ea1a7166-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.102155 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.102101    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce50dda1-c329-4f02-8f20-6342ea1a7166-config-out\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.102250 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.102152    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce50dda1-c329-4f02-8f20-6342ea1a7166-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.102250 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.102181    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce50dda1-c329-4f02-8f20-6342ea1a7166-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.102250 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.102206    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce50dda1-c329-4f02-8f20-6342ea1a7166-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.102966 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:42:29.102941    2582 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 21 00:42:29.103082 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:42:29.103024    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce50dda1-c329-4f02-8f20-6342ea1a7166-secret-alertmanager-main-tls podName:ce50dda1-c329-4f02-8f20-6342ea1a7166 nodeName:}" failed. No retries permitted until 2026-07-21 00:42:29.603004145 +0000 UTC m=+79.902700562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/ce50dda1-c329-4f02-8f20-6342ea1a7166-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "ce50dda1-c329-4f02-8f20-6342ea1a7166") : secret "alertmanager-main-tls" not found
Jul 21 00:42:29.103934 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.103904    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce50dda1-c329-4f02-8f20-6342ea1a7166-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.104109 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.104055    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce50dda1-c329-4f02-8f20-6342ea1a7166-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.104888 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.104855    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce50dda1-c329-4f02-8f20-6342ea1a7166-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.105235 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.105212    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce50dda1-c329-4f02-8f20-6342ea1a7166-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.105235 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.105227    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce50dda1-c329-4f02-8f20-6342ea1a7166-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.105356 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.105217    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce50dda1-c329-4f02-8f20-6342ea1a7166-web-config\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.105396 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.105383    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce50dda1-c329-4f02-8f20-6342ea1a7166-config-out\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.106422 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.106402    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce50dda1-c329-4f02-8f20-6342ea1a7166-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.106753 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.106732    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce50dda1-c329-4f02-8f20-6342ea1a7166-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.106790 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.106743    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce50dda1-c329-4f02-8f20-6342ea1a7166-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.116864 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.116837    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zthqz\" (UniqueName: \"kubernetes.io/projected/ce50dda1-c329-4f02-8f20-6342ea1a7166-kube-api-access-zthqz\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.606523 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.606491    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce50dda1-c329-4f02-8f20-6342ea1a7166-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.609050 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.609015    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce50dda1-c329-4f02-8f20-6342ea1a7166-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce50dda1-c329-4f02-8f20-6342ea1a7166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.718490 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.718448    2582 generic.go:356] "Generic (PLEG): container finished" podID="0ae3c48a-e489-4afa-b528-d07d86532b1f" containerID="60c80d20cb31bb05399cfd20e2b1e7650266e66a523546856b45f0a7de71e826" exitCode=0
Jul 21 00:42:29.718695 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.718539    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-88j8d" event={"ID":"0ae3c48a-e489-4afa-b528-d07d86532b1f","Type":"ContainerDied","Data":"60c80d20cb31bb05399cfd20e2b1e7650266e66a523546856b45f0a7de71e826"}
Jul 21 00:42:29.719936 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.719911    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-nshfn" event={"ID":"19b12008-5ee1-4251-aaba-d2cf00362411","Type":"ContainerStarted","Data":"f070b0fd0baffaeaeb10cc5c14ab2e370d1bb4a4ddacf1626bb75c61280a3bd5"}
Jul 21 00:42:29.802425 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.802399    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"]
Jul 21 00:42:29.806958 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.806930    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:29.808811 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.808697    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 21 00:42:29.809073 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.809044    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 21 00:42:29.809073 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.809048    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 21 00:42:29.809223 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.809090    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-b7or9ovjuiin2\""
Jul 21 00:42:29.809223 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.809106    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 21 00:42:29.809223 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.809048    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8gwxd\""
Jul 21 00:42:29.809360 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.809312    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 00:42:29.809563 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.809545    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 21 00:42:29.817536 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.817441    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"]
Jul 21 00:42:29.909364 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.909327    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/42ee621e-ff7e-4769-bc10-bda1a7e574e4-secret-grpc-tls\") pod \"thanos-querier-7c8d7f6846-z8q8r\" (UID: \"42ee621e-ff7e-4769-bc10-bda1a7e574e4\") " pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:29.909827 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.909404    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42ee621e-ff7e-4769-bc10-bda1a7e574e4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c8d7f6846-z8q8r\" (UID: \"42ee621e-ff7e-4769-bc10-bda1a7e574e4\") " pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:29.909827 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.909499    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/42ee621e-ff7e-4769-bc10-bda1a7e574e4-secret-thanos-querier-tls\") pod \"thanos-querier-7c8d7f6846-z8q8r\" (UID: \"42ee621e-ff7e-4769-bc10-bda1a7e574e4\") " pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:29.909827 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.909551    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42ee621e-ff7e-4769-bc10-bda1a7e574e4-metrics-client-ca\") pod \"thanos-querier-7c8d7f6846-z8q8r\" (UID: \"42ee621e-ff7e-4769-bc10-bda1a7e574e4\") " pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:29.909827 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.909596    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/42ee621e-ff7e-4769-bc10-bda1a7e574e4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c8d7f6846-z8q8r\" (UID: \"42ee621e-ff7e-4769-bc10-bda1a7e574e4\") " pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:29.909827 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.909638    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7jz2\" (UniqueName: \"kubernetes.io/projected/42ee621e-ff7e-4769-bc10-bda1a7e574e4-kube-api-access-j7jz2\") pod \"thanos-querier-7c8d7f6846-z8q8r\" (UID: \"42ee621e-ff7e-4769-bc10-bda1a7e574e4\") " pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:29.909827 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.909695    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42ee621e-ff7e-4769-bc10-bda1a7e574e4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c8d7f6846-z8q8r\" (UID: \"42ee621e-ff7e-4769-bc10-bda1a7e574e4\") " pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:29.909827 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.909725    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/42ee621e-ff7e-4769-bc10-bda1a7e574e4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c8d7f6846-z8q8r\" (UID: \"42ee621e-ff7e-4769-bc10-bda1a7e574e4\") " pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:29.972411 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:29.972378    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 00:42:29.976334 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:42:29.976306    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce50dda1_c329_4f02_8f20_6342ea1a7166.slice/crio-baa558b5bb8fa3b272bad13e482c030d76d36b7f98e342774a1ab6598af1226f WatchSource:0}: Error finding container baa558b5bb8fa3b272bad13e482c030d76d36b7f98e342774a1ab6598af1226f: Status 404 returned error can't find the container with id baa558b5bb8fa3b272bad13e482c030d76d36b7f98e342774a1ab6598af1226f
Jul 21 00:42:30.010736 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:30.010696    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42ee621e-ff7e-4769-bc10-bda1a7e574e4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c8d7f6846-z8q8r\" (UID: \"42ee621e-ff7e-4769-bc10-bda1a7e574e4\") " pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:30.010736 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:30.010736    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/42ee621e-ff7e-4769-bc10-bda1a7e574e4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c8d7f6846-z8q8r\" (UID: \"42ee621e-ff7e-4769-bc10-bda1a7e574e4\") " pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:30.010974 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:30.010881    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/42ee621e-ff7e-4769-bc10-bda1a7e574e4-secret-grpc-tls\") pod \"thanos-querier-7c8d7f6846-z8q8r\" (UID: \"42ee621e-ff7e-4769-bc10-bda1a7e574e4\") " pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:30.010974 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:30.010950    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42ee621e-ff7e-4769-bc10-bda1a7e574e4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c8d7f6846-z8q8r\" (UID: \"42ee621e-ff7e-4769-bc10-bda1a7e574e4\") " pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:30.011049 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:30.010992    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/42ee621e-ff7e-4769-bc10-bda1a7e574e4-secret-thanos-querier-tls\") pod \"thanos-querier-7c8d7f6846-z8q8r\" (UID: \"42ee621e-ff7e-4769-bc10-bda1a7e574e4\") " pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:30.011049 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:30.011015    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42ee621e-ff7e-4769-bc10-bda1a7e574e4-metrics-client-ca\") pod \"thanos-querier-7c8d7f6846-z8q8r\" (UID: \"42ee621e-ff7e-4769-bc10-bda1a7e574e4\") " pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:30.011148 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:30.011052    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/42ee621e-ff7e-4769-bc10-bda1a7e574e4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c8d7f6846-z8q8r\" (UID: \"42ee621e-ff7e-4769-bc10-bda1a7e574e4\") " pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:30.011763 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:30.011236    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7jz2\" (UniqueName: \"kubernetes.io/projected/42ee621e-ff7e-4769-bc10-bda1a7e574e4-kube-api-access-j7jz2\") pod \"thanos-querier-7c8d7f6846-z8q8r\" (UID: \"42ee621e-ff7e-4769-bc10-bda1a7e574e4\") " pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:30.011886 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:30.011805    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42ee621e-ff7e-4769-bc10-bda1a7e574e4-metrics-client-ca\") pod \"thanos-querier-7c8d7f6846-z8q8r\" (UID: \"42ee621e-ff7e-4769-bc10-bda1a7e574e4\") " pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:30.013771 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:30.013749    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/42ee621e-ff7e-4769-bc10-bda1a7e574e4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c8d7f6846-z8q8r\" (UID: \"42ee621e-ff7e-4769-bc10-bda1a7e574e4\") " pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:30.013911 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:30.013892    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/42ee621e-ff7e-4769-bc10-bda1a7e574e4-secret-thanos-querier-tls\") pod \"thanos-querier-7c8d7f6846-z8q8r\" (UID: \"42ee621e-ff7e-4769-bc10-bda1a7e574e4\") " pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:30.013958 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:30.013911    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42ee621e-ff7e-4769-bc10-bda1a7e574e4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c8d7f6846-z8q8r\" (UID: \"42ee621e-ff7e-4769-bc10-bda1a7e574e4\") " pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:30.014001 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:30.013983    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42ee621e-ff7e-4769-bc10-bda1a7e574e4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c8d7f6846-z8q8r\" (UID: \"42ee621e-ff7e-4769-bc10-bda1a7e574e4\") " pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:30.014036 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:30.014001    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/42ee621e-ff7e-4769-bc10-bda1a7e574e4-secret-grpc-tls\") pod \"thanos-querier-7c8d7f6846-z8q8r\" (UID: \"42ee621e-ff7e-4769-bc10-bda1a7e574e4\") " pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:30.014073 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:30.014056    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/42ee621e-ff7e-4769-bc10-bda1a7e574e4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c8d7f6846-z8q8r\" (UID: \"42ee621e-ff7e-4769-bc10-bda1a7e574e4\") " pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:30.018049 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:30.018030    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7jz2\" (UniqueName: \"kubernetes.io/projected/42ee621e-ff7e-4769-bc10-bda1a7e574e4-kube-api-access-j7jz2\") pod \"thanos-querier-7c8d7f6846-z8q8r\" (UID: \"42ee621e-ff7e-4769-bc10-bda1a7e574e4\") " pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:30.131131 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:30.131066    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:30.456967 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:30.456935    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"]
Jul 21 00:42:30.460312 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:42:30.460284    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42ee621e_ff7e_4769_bc10_bda1a7e574e4.slice/crio-dfc9cdaf846df20abe5c227bf366f4b1e36706f4af189f551ea7f6016bc8f2f5 WatchSource:0}: Error finding container dfc9cdaf846df20abe5c227bf366f4b1e36706f4af189f551ea7f6016bc8f2f5: Status 404 returned error can't find the container with id dfc9cdaf846df20abe5c227bf366f4b1e36706f4af189f551ea7f6016bc8f2f5
Jul 21 00:42:30.726707 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:30.726671    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-88j8d" event={"ID":"0ae3c48a-e489-4afa-b528-d07d86532b1f","Type":"ContainerStarted","Data":"49ef31f399aefce29f7611223402e6181dffe6125d2c23ad3c2b1b2672257376"}
Jul 21 00:42:30.726919 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:30.726733    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-88j8d" event={"ID":"0ae3c48a-e489-4afa-b528-d07d86532b1f","Type":"ContainerStarted","Data":"18ccb23af88d3834f3a333154f6211f8cabbc4330c08d1be70a34128a4a96423"}
Jul 21 00:42:30.728818 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:30.728789    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8wlxd" event={"ID":"70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9","Type":"ContainerStarted","Data":"c040853b04d2a58dbd849e42c016fc8877970da481349d4c09f6069116f00b44"}
Jul 21 00:42:30.730158 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:30.730133    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r" event={"ID":"42ee621e-ff7e-4769-bc10-bda1a7e574e4","Type":"ContainerStarted","Data":"dfc9cdaf846df20abe5c227bf366f4b1e36706f4af189f551ea7f6016bc8f2f5"}
Jul 21 00:42:30.731377 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:30.731353    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce50dda1-c329-4f02-8f20-6342ea1a7166","Type":"ContainerStarted","Data":"baa558b5bb8fa3b272bad13e482c030d76d36b7f98e342774a1ab6598af1226f"}
Jul 21 00:42:30.742041 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:30.741984    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-88j8d" podStartSLOduration=2.311734592 podStartE2EDuration="3.741964199s" totalImagesPullingTime="1.362307718s" totalInitContainerRuntime="67.921889ms" isStatefulPod=true podCreationTimestamp="2026-07-21 00:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:30.741661117 +0000 UTC m=+81.041357539" watchObservedRunningTime="2026-07-21 00:42:30.741964199 +0000 UTC m=+81.041660618"
Jul 21 00:42:30.756867 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:30.756811    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8wlxd" podStartSLOduration=1.810377045 podStartE2EDuration="3.756794074s" totalImagesPullingTime="1.946417029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:30.755995309 +0000 UTC m=+81.055691732" watchObservedRunningTime="2026-07-21 00:42:30.756794074 +0000 UTC m=+81.056490494"
Jul 21 00:42:32.138905 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.138844    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"]
Jul 21 00:42:32.143167 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.143136    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:42:32.144982 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.144935    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-c9uj984h582jl\""
Jul 21 00:42:32.145186 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.145040    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-sqwdv\""
Jul 21 00:42:32.145186 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.145088    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 21 00:42:32.145186 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.145045    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 21 00:42:32.145186 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.145169    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 21 00:42:32.145480 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.145329    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 21 00:42:32.153434 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.153407    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"]
Jul 21 00:42:32.234114 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.234071    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/53897821-6243-42d3-9d9e-1b513e27014b-secret-metrics-server-tls\") pod \"metrics-server-5fc6dbfbbd-g747b\" (UID: \"53897821-6243-42d3-9d9e-1b513e27014b\") " pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:42:32.234114 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.234115    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/53897821-6243-42d3-9d9e-1b513e27014b-secret-metrics-server-client-certs\") pod \"metrics-server-5fc6dbfbbd-g747b\" (UID: \"53897821-6243-42d3-9d9e-1b513e27014b\") " pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:42:32.234326 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.234137    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53897821-6243-42d3-9d9e-1b513e27014b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5fc6dbfbbd-g747b\" (UID: \"53897821-6243-42d3-9d9e-1b513e27014b\") " pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:42:32.234326 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.234224    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53897821-6243-42d3-9d9e-1b513e27014b-client-ca-bundle\") pod \"metrics-server-5fc6dbfbbd-g747b\" (UID: \"53897821-6243-42d3-9d9e-1b513e27014b\") " pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:42:32.234326 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.234284    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbdms\" (UniqueName: \"kubernetes.io/projected/53897821-6243-42d3-9d9e-1b513e27014b-kube-api-access-zbdms\") pod \"metrics-server-5fc6dbfbbd-g747b\" (UID: \"53897821-6243-42d3-9d9e-1b513e27014b\") " pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:42:32.234326 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.234319    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/53897821-6243-42d3-9d9e-1b513e27014b-audit-log\") pod \"metrics-server-5fc6dbfbbd-g747b\" (UID: \"53897821-6243-42d3-9d9e-1b513e27014b\") " pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:42:32.234441 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.234343    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/53897821-6243-42d3-9d9e-1b513e27014b-metrics-server-audit-profiles\") pod \"metrics-server-5fc6dbfbbd-g747b\" (UID: \"53897821-6243-42d3-9d9e-1b513e27014b\") " pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:42:32.335681 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.335618    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/53897821-6243-42d3-9d9e-1b513e27014b-secret-metrics-server-tls\") pod \"metrics-server-5fc6dbfbbd-g747b\" (UID: \"53897821-6243-42d3-9d9e-1b513e27014b\") " pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:42:32.336121 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.335700    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/53897821-6243-42d3-9d9e-1b513e27014b-secret-metrics-server-client-certs\") pod \"metrics-server-5fc6dbfbbd-g747b\" (UID: \"53897821-6243-42d3-9d9e-1b513e27014b\") " pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:42:32.336121 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.335735    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53897821-6243-42d3-9d9e-1b513e27014b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5fc6dbfbbd-g747b\" (UID: \"53897821-6243-42d3-9d9e-1b513e27014b\") " pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:42:32.336121 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.335777    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53897821-6243-42d3-9d9e-1b513e27014b-client-ca-bundle\") pod \"metrics-server-5fc6dbfbbd-g747b\" (UID: \"53897821-6243-42d3-9d9e-1b513e27014b\") " pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:42:32.336121 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.335817    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbdms\" (UniqueName: \"kubernetes.io/projected/53897821-6243-42d3-9d9e-1b513e27014b-kube-api-access-zbdms\") pod \"metrics-server-5fc6dbfbbd-g747b\" (UID: \"53897821-6243-42d3-9d9e-1b513e27014b\") " pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:42:32.336121 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.335863    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/53897821-6243-42d3-9d9e-1b513e27014b-audit-log\") pod \"metrics-server-5fc6dbfbbd-g747b\" (UID: \"53897821-6243-42d3-9d9e-1b513e27014b\") " pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:42:32.336121 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.335894    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/53897821-6243-42d3-9d9e-1b513e27014b-metrics-server-audit-profiles\") pod \"metrics-server-5fc6dbfbbd-g747b\" (UID: \"53897821-6243-42d3-9d9e-1b513e27014b\") " pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:42:32.337263 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.337232    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/53897821-6243-42d3-9d9e-1b513e27014b-metrics-server-audit-profiles\") pod \"metrics-server-5fc6dbfbbd-g747b\" (UID: \"53897821-6243-42d3-9d9e-1b513e27014b\") " pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:42:32.337370 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.337346    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53897821-6243-42d3-9d9e-1b513e27014b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5fc6dbfbbd-g747b\" (UID: \"53897821-6243-42d3-9d9e-1b513e27014b\") " pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:42:32.337504 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.337470    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/53897821-6243-42d3-9d9e-1b513e27014b-audit-log\") pod \"metrics-server-5fc6dbfbbd-g747b\" (UID: \"53897821-6243-42d3-9d9e-1b513e27014b\") " pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:42:32.338890 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.338851    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/53897821-6243-42d3-9d9e-1b513e27014b-secret-metrics-server-tls\") pod \"metrics-server-5fc6dbfbbd-g747b\" (UID: \"53897821-6243-42d3-9d9e-1b513e27014b\") " pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:42:32.339012 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.338987    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53897821-6243-42d3-9d9e-1b513e27014b-client-ca-bundle\") pod \"metrics-server-5fc6dbfbbd-g747b\" (UID: \"53897821-6243-42d3-9d9e-1b513e27014b\") " pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:42:32.339082 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.339061    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/53897821-6243-42d3-9d9e-1b513e27014b-secret-metrics-server-client-certs\") pod \"metrics-server-5fc6dbfbbd-g747b\" (UID: \"53897821-6243-42d3-9d9e-1b513e27014b\") " pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:42:32.345110 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.345048    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbdms\" (UniqueName: \"kubernetes.io/projected/53897821-6243-42d3-9d9e-1b513e27014b-kube-api-access-zbdms\") pod \"metrics-server-5fc6dbfbbd-g747b\" (UID: \"53897821-6243-42d3-9d9e-1b513e27014b\") " pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:42:32.454375 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.454341    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:42:32.616737 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.616639    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-576848c965-9sbkb"]
Jul 21 00:42:32.620167 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.620136    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hnbzd"]
Jul 21 00:42:32.620329 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.620271    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:32.623594 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.623563    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hnbzd"
Jul 21 00:42:32.625689 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.625443    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-d4gzb\""
Jul 21 00:42:32.625689 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.625490    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 21 00:42:32.629614 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.629587    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-576848c965-9sbkb"]
Jul 21 00:42:32.633065 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.632245    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hnbzd"]
Jul 21 00:42:32.738676 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.738626    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fa4408d-e7f1-4364-8da7-d84a730049aa-console-oauth-config\") pod \"console-576848c965-9sbkb\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") " pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:32.738897 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.738687    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r29rr\" (UniqueName: \"kubernetes.io/projected/6fa4408d-e7f1-4364-8da7-d84a730049aa-kube-api-access-r29rr\") pod \"console-576848c965-9sbkb\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") " pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:32.738897 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.738707    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fa4408d-e7f1-4364-8da7-d84a730049aa-console-serving-cert\") pod \"console-576848c965-9sbkb\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") " pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:32.738897 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.738726    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fa4408d-e7f1-4364-8da7-d84a730049aa-service-ca\") pod \"console-576848c965-9sbkb\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") " pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:32.738897 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.738832    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjr9c\" (UniqueName: \"kubernetes.io/projected/a1ee52cf-b0d5-4fa2-84c6-6af6bac0f744-kube-api-access-fjr9c\") pod \"monitoring-plugin-7b7b7bc8bf-hnbzd\" (UID: \"a1ee52cf-b0d5-4fa2-84c6-6af6bac0f744\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hnbzd"
Jul 21 00:42:32.739175 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.738898    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fa4408d-e7f1-4364-8da7-d84a730049aa-oauth-serving-cert\") pod \"console-576848c965-9sbkb\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") " pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:32.739175 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.738981    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1ee52cf-b0d5-4fa2-84c6-6af6bac0f744-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-hnbzd\" (UID: \"a1ee52cf-b0d5-4fa2-84c6-6af6bac0f744\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hnbzd"
Jul 21 00:42:32.739175 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.739020    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa4408d-e7f1-4364-8da7-d84a730049aa-trusted-ca-bundle\") pod \"console-576848c965-9sbkb\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") " pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:32.739175 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.739048    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fa4408d-e7f1-4364-8da7-d84a730049aa-console-config\") pod \"console-576848c965-9sbkb\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") " pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:32.747009 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.746965    2582 generic.go:356] "Generic (PLEG): container finished" podID="ce50dda1-c329-4f02-8f20-6342ea1a7166" containerID="2e2b55a98f21fa777f5c7d4e2e278629677ab80d81563ad732d13ca21edea28d" exitCode=0
Jul 21 00:42:32.747206 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.747065    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce50dda1-c329-4f02-8f20-6342ea1a7166","Type":"ContainerDied","Data":"2e2b55a98f21fa777f5c7d4e2e278629677ab80d81563ad732d13ca21edea28d"}
Jul 21 00:42:32.749905 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.749866    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-nshfn" event={"ID":"19b12008-5ee1-4251-aaba-d2cf00362411","Type":"ContainerStarted","Data":"31f6294ceec99e0d740f07ee93f2d0887108bef17fda751550c1eee25395be97"}
Jul 21 00:42:32.750047 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.749934    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-nshfn" event={"ID":"19b12008-5ee1-4251-aaba-d2cf00362411","Type":"ContainerStarted","Data":"ce0ef45b84e3fa14307cb65e80e75b7381c908fdd0e283d91b7bc036bed5cd90"}
Jul 21 00:42:32.750047 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.749962    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-nshfn" event={"ID":"19b12008-5ee1-4251-aaba-d2cf00362411","Type":"ContainerStarted","Data":"ab00fed186701df31c25b0816a1674ae37ac9874306853001c7cb078e2485fe9"}
Jul 21 00:42:32.786173 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.786100    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-nshfn" podStartSLOduration=2.844271337 podStartE2EDuration="5.786075189s" totalImagesPullingTime="2.941803852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:32.78510711 +0000 UTC m=+83.084803531" watchObservedRunningTime="2026-07-21 00:42:32.786075189 +0000 UTC m=+83.085771610"
Jul 21 00:42:32.840142 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.840098    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fa4408d-e7f1-4364-8da7-d84a730049aa-oauth-serving-cert\") pod \"console-576848c965-9sbkb\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") " pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:32.840327 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.840227    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1ee52cf-b0d5-4fa2-84c6-6af6bac0f744-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-hnbzd\" (UID: \"a1ee52cf-b0d5-4fa2-84c6-6af6bac0f744\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hnbzd"
Jul 21 00:42:32.840327 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.840260    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa4408d-e7f1-4364-8da7-d84a730049aa-trusted-ca-bundle\") pod \"console-576848c965-9sbkb\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") " pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:32.840327 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.840287    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fa4408d-e7f1-4364-8da7-d84a730049aa-console-config\") pod \"console-576848c965-9sbkb\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") " pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:32.840467 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.840357    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fa4408d-e7f1-4364-8da7-d84a730049aa-console-oauth-config\") pod \"console-576848c965-9sbkb\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") " pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:32.840467 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.840384    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r29rr\" (UniqueName: \"kubernetes.io/projected/6fa4408d-e7f1-4364-8da7-d84a730049aa-kube-api-access-r29rr\") pod \"console-576848c965-9sbkb\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") " pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:32.840467 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.840423    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fa4408d-e7f1-4364-8da7-d84a730049aa-console-serving-cert\") pod \"console-576848c965-9sbkb\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") " pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:32.840467 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.840446    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fa4408d-e7f1-4364-8da7-d84a730049aa-service-ca\") pod \"console-576848c965-9sbkb\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") " pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:32.841029 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.840759    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjr9c\" (UniqueName: \"kubernetes.io/projected/a1ee52cf-b0d5-4fa2-84c6-6af6bac0f744-kube-api-access-fjr9c\") pod \"monitoring-plugin-7b7b7bc8bf-hnbzd\" (UID: \"a1ee52cf-b0d5-4fa2-84c6-6af6bac0f744\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hnbzd"
Jul 21 00:42:32.841029 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.841007    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fa4408d-e7f1-4364-8da7-d84a730049aa-oauth-serving-cert\") pod \"console-576848c965-9sbkb\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") " pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:32.841887 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.841692    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fa4408d-e7f1-4364-8da7-d84a730049aa-service-ca\") pod \"console-576848c965-9sbkb\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") " pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:32.842270 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.842232    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fa4408d-e7f1-4364-8da7-d84a730049aa-console-config\") pod \"console-576848c965-9sbkb\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") " pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:32.842548 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.842389    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa4408d-e7f1-4364-8da7-d84a730049aa-trusted-ca-bundle\") pod \"console-576848c965-9sbkb\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") " pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:32.843786 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.843724    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fa4408d-e7f1-4364-8da7-d84a730049aa-console-serving-cert\") pod \"console-576848c965-9sbkb\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") " pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:32.843786 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.843752    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1ee52cf-b0d5-4fa2-84c6-6af6bac0f744-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-hnbzd\" (UID: \"a1ee52cf-b0d5-4fa2-84c6-6af6bac0f744\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hnbzd"
Jul 21 00:42:32.843928 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.843839    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fa4408d-e7f1-4364-8da7-d84a730049aa-console-oauth-config\") pod \"console-576848c965-9sbkb\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") " pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:32.853809 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.853776    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r29rr\" (UniqueName: \"kubernetes.io/projected/6fa4408d-e7f1-4364-8da7-d84a730049aa-kube-api-access-r29rr\") pod \"console-576848c965-9sbkb\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") " pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:32.853961 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.853784    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjr9c\" (UniqueName: \"kubernetes.io/projected/a1ee52cf-b0d5-4fa2-84c6-6af6bac0f744-kube-api-access-fjr9c\") pod \"monitoring-plugin-7b7b7bc8bf-hnbzd\" (UID: \"a1ee52cf-b0d5-4fa2-84c6-6af6bac0f744\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hnbzd"
Jul 21 00:42:32.934923 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.934864    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:32.944266 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:32.943298    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hnbzd"
Jul 21 00:42:33.078847 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:33.078491    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"]
Jul 21 00:42:33.083152 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:42:33.083103    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53897821_6243_42d3_9d9e_1b513e27014b.slice/crio-7e820fd1e8be44f7b43bca1c7c5b2a96429275f8895169d559bdf40dcc74390d WatchSource:0}: Error finding container 7e820fd1e8be44f7b43bca1c7c5b2a96429275f8895169d559bdf40dcc74390d: Status 404 returned error can't find the container with id 7e820fd1e8be44f7b43bca1c7c5b2a96429275f8895169d559bdf40dcc74390d
Jul 21 00:42:33.129385 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:33.129351    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-576848c965-9sbkb"]
Jul 21 00:42:33.133055 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:42:33.133028    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fa4408d_e7f1_4364_8da7_d84a730049aa.slice/crio-98e2c4dd0ef35195adb7eacfc57d65ef5542ec4a989b94cf8c379fbe096379a7 WatchSource:0}: Error finding container 98e2c4dd0ef35195adb7eacfc57d65ef5542ec4a989b94cf8c379fbe096379a7: Status 404 returned error can't find the container with id 98e2c4dd0ef35195adb7eacfc57d65ef5542ec4a989b94cf8c379fbe096379a7
Jul 21 00:42:33.149627 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:33.149600    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hnbzd"]
Jul 21 00:42:33.163490 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:42:33.163461    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1ee52cf_b0d5_4fa2_84c6_6af6bac0f744.slice/crio-b6c6f46a50ad6f750aba19855e2e2f0a24f04835785b5855c2d95f19b7d9c028 WatchSource:0}: Error finding container b6c6f46a50ad6f750aba19855e2e2f0a24f04835785b5855c2d95f19b7d9c028: Status 404 returned error can't find the container with id b6c6f46a50ad6f750aba19855e2e2f0a24f04835785b5855c2d95f19b7d9c028
Jul 21 00:42:33.760859 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:33.760813    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r" event={"ID":"42ee621e-ff7e-4769-bc10-bda1a7e574e4","Type":"ContainerStarted","Data":"7000c1328fd6ea8b16fc15b393fe0b53026d9ed4042e4791ce56f2ae2c86acc2"}
Jul 21 00:42:33.761082 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:33.760911    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r" event={"ID":"42ee621e-ff7e-4769-bc10-bda1a7e574e4","Type":"ContainerStarted","Data":"b08a1f1fe886d06d8de5ccf352ea3c238f5b663c4c94c4209145778f61874de4"}
Jul 21 00:42:33.761082 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:33.760953    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r" event={"ID":"42ee621e-ff7e-4769-bc10-bda1a7e574e4","Type":"ContainerStarted","Data":"d6728e4328057a70890d8e28c3f40aa307f040183e5fbbb7841de8bcd5141968"}
Jul 21 00:42:33.763052 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:33.763011    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-576848c965-9sbkb" event={"ID":"6fa4408d-e7f1-4364-8da7-d84a730049aa","Type":"ContainerStarted","Data":"a82024c0b844185c8028cdf0cb93325f16999c3cdfcd8f777fc1750569f4dc64"}
Jul 21 00:42:33.763218 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:33.763071    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-576848c965-9sbkb" event={"ID":"6fa4408d-e7f1-4364-8da7-d84a730049aa","Type":"ContainerStarted","Data":"98e2c4dd0ef35195adb7eacfc57d65ef5542ec4a989b94cf8c379fbe096379a7"}
Jul 21 00:42:33.764564 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:33.764532    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hnbzd" event={"ID":"a1ee52cf-b0d5-4fa2-84c6-6af6bac0f744","Type":"ContainerStarted","Data":"b6c6f46a50ad6f750aba19855e2e2f0a24f04835785b5855c2d95f19b7d9c028"}
Jul 21 00:42:33.767102 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:33.766729    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b" event={"ID":"53897821-6243-42d3-9d9e-1b513e27014b","Type":"ContainerStarted","Data":"7e820fd1e8be44f7b43bca1c7c5b2a96429275f8895169d559bdf40dcc74390d"}
Jul 21 00:42:33.784115 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:33.783920    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-576848c965-9sbkb" podStartSLOduration=1.7836208519999999 podStartE2EDuration="1.783620852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:42:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:33.781818514 +0000 UTC m=+84.081514949" watchObservedRunningTime="2026-07-21 00:42:33.783620852 +0000 UTC m=+84.083317275"
Jul 21 00:42:34.774589 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:34.774555    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r" event={"ID":"42ee621e-ff7e-4769-bc10-bda1a7e574e4","Type":"ContainerStarted","Data":"3978297e8f9dd291fa2302575e335c1e3a078211151161eafe97f3195165321e"}
Jul 21 00:42:35.781004 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:35.780972    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hnbzd" event={"ID":"a1ee52cf-b0d5-4fa2-84c6-6af6bac0f744","Type":"ContainerStarted","Data":"d9e6fbc5682c778b023bcef5ccc17dd8f2cd662e73704491b0861ac88a950f7e"}
Jul 21 00:42:35.781733 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:35.781679    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hnbzd"
Jul 21 00:42:35.785470 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:35.785442    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce50dda1-c329-4f02-8f20-6342ea1a7166","Type":"ContainerStarted","Data":"d3529a0b79d551ee07a02feedd66e6004aa435c0de41cc2e193c43c4745fcaec"}
Jul 21 00:42:35.785599 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:35.785522    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce50dda1-c329-4f02-8f20-6342ea1a7166","Type":"ContainerStarted","Data":"f138e6eef67e782660db849e1f3bc31e571be22ac8848389c229775d1647212a"}
Jul 21 00:42:35.788274 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:35.788208    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b" event={"ID":"53897821-6243-42d3-9d9e-1b513e27014b","Type":"ContainerStarted","Data":"e064595b02b9ace0ff5c39d7932f96ea2be9e6a21763e5852fa07e902b84fb86"}
Jul 21 00:42:35.788822 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:35.788782    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hnbzd"
Jul 21 00:42:35.791707 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:35.791642    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r" event={"ID":"42ee621e-ff7e-4769-bc10-bda1a7e574e4","Type":"ContainerStarted","Data":"19852f2bd6e9af5d4e72f61c10010ed84d637e104f5ad48de671e8519404f902"}
Jul 21 00:42:35.791787 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:35.791754    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r" event={"ID":"42ee621e-ff7e-4769-bc10-bda1a7e574e4","Type":"ContainerStarted","Data":"70efd0222a7877f4fc006033040c1620ee427b230018ab41e6db0a60430197bd"}
Jul 21 00:42:35.792109 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:35.792071    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:35.795074 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:35.795020    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hnbzd" podStartSLOduration=1.384457287 podStartE2EDuration="3.795003293s" totalImagesPullingTime="2.410546006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:42:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:35.793720204 +0000 UTC m=+86.093416622" watchObservedRunningTime="2026-07-21 00:42:35.795003293 +0000 UTC m=+86.094699716"
Jul 21 00:42:35.808380 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:35.808316    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b" podStartSLOduration=1.319853572 podStartE2EDuration="3.808295419s" totalImagesPullingTime="2.488441847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:42:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:35.807206867 +0000 UTC m=+86.106903290" watchObservedRunningTime="2026-07-21 00:42:35.808295419 +0000 UTC m=+86.107991837"
Jul 21 00:42:35.826913 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:35.826825    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r" podStartSLOduration=3.203677805 podStartE2EDuration="6.826797654s" totalImagesPullingTime="3.623119849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:42:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:35.824348836 +0000 UTC m=+86.124045258" watchObservedRunningTime="2026-07-21 00:42:35.826797654 +0000 UTC m=+86.126494076"
Jul 21 00:42:36.802937 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:36.802878    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce50dda1-c329-4f02-8f20-6342ea1a7166","Type":"ContainerStarted","Data":"1af29f9577e400db4cba0221cf9af843bd4a7dcb33fc98a5896805d04150f968"}
Jul 21 00:42:36.803320 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:36.802995    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce50dda1-c329-4f02-8f20-6342ea1a7166","Type":"ContainerStarted","Data":"279f6a797b6e1deb5c8ea568e02987f38bcc967245aca57ab8b0e070ee874992"}
Jul 21 00:42:36.803320 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:36.803022    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce50dda1-c329-4f02-8f20-6342ea1a7166","Type":"ContainerStarted","Data":"dd46536b3f246d55ecc639d5e4c54083a4e59c2f5d45326771d3e18b38f9dd55"}
Jul 21 00:42:36.803320 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:36.803052    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce50dda1-c329-4f02-8f20-6342ea1a7166","Type":"ContainerStarted","Data":"d370529f37fc399641060d4781ff14819f592c43bf490c28c7ea40bacdabe8db"}
Jul 21 00:42:36.826232 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:36.826172    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.106511277 podStartE2EDuration="8.826154203s" totalImagesPullingTime="4.690631065s" totalInitContainerRuntime="29.011861ms" isStatefulPod=false podCreationTimestamp="2026-07-21 00:42:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:36.824868308 +0000 UTC m=+87.124564728" watchObservedRunningTime="2026-07-21 00:42:36.826154203 +0000 UTC m=+87.125850707"
Jul 21 00:42:41.809144 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:41.809116    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7c8d7f6846-z8q8r"
Jul 21 00:42:42.935220 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:42.935175    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:42.935717 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:42.935247    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:42.940135 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:42.940113    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:43.845072 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:43.845039    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:42:43.892811 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:43.892771    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74dcd98d78-vqkrn"]
Jul 21 00:42:49.767549 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:49.767453    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f49b4f48c-sldnx" podUID="8e979354-a893-4586-ac20-defa840520f2" containerName="console" containerID="cri-o://a7a7fd95a90b7d0fe529ba9745a9859923cde27cd8654df5b288ab1ea24a12cf" gracePeriod=15
Jul 21 00:42:50.567776 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.567739    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f49b4f48c-sldnx"
Jul 21 00:42:50.592748 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.592713    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e979354-a893-4586-ac20-defa840520f2-console-serving-cert\") pod \"8e979354-a893-4586-ac20-defa840520f2\" (UID: \"8e979354-a893-4586-ac20-defa840520f2\") "
Jul 21 00:42:50.592922 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.592775    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e979354-a893-4586-ac20-defa840520f2-oauth-serving-cert\") pod \"8e979354-a893-4586-ac20-defa840520f2\" (UID: \"8e979354-a893-4586-ac20-defa840520f2\") "
Jul 21 00:42:50.592922 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.592802    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e979354-a893-4586-ac20-defa840520f2-console-oauth-config\") pod \"8e979354-a893-4586-ac20-defa840520f2\" (UID: \"8e979354-a893-4586-ac20-defa840520f2\") "
Jul 21 00:42:50.592922 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.592835    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e979354-a893-4586-ac20-defa840520f2-service-ca\") pod \"8e979354-a893-4586-ac20-defa840520f2\" (UID: \"8e979354-a893-4586-ac20-defa840520f2\") "
Jul 21 00:42:50.592922 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.592867    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmkxm\" (UniqueName: \"kubernetes.io/projected/8e979354-a893-4586-ac20-defa840520f2-kube-api-access-vmkxm\") pod \"8e979354-a893-4586-ac20-defa840520f2\" (UID: \"8e979354-a893-4586-ac20-defa840520f2\") "
Jul 21 00:42:50.592922 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.592895    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e979354-a893-4586-ac20-defa840520f2-console-config\") pod \"8e979354-a893-4586-ac20-defa840520f2\" (UID: \"8e979354-a893-4586-ac20-defa840520f2\") "
Jul 21 00:42:50.593360 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.593321    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e979354-a893-4586-ac20-defa840520f2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8e979354-a893-4586-ac20-defa840520f2" (UID: "8e979354-a893-4586-ac20-defa840520f2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:42:50.593360 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.593333    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e979354-a893-4586-ac20-defa840520f2-service-ca" (OuterVolumeSpecName: "service-ca") pod "8e979354-a893-4586-ac20-defa840520f2" (UID: "8e979354-a893-4586-ac20-defa840520f2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:42:50.593535 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.593369    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e979354-a893-4586-ac20-defa840520f2-console-config" (OuterVolumeSpecName: "console-config") pod "8e979354-a893-4586-ac20-defa840520f2" (UID: "8e979354-a893-4586-ac20-defa840520f2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:42:50.595454 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.595423    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e979354-a893-4586-ac20-defa840520f2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8e979354-a893-4586-ac20-defa840520f2" (UID: "8e979354-a893-4586-ac20-defa840520f2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:42:50.595616 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.595595    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e979354-a893-4586-ac20-defa840520f2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8e979354-a893-4586-ac20-defa840520f2" (UID: "8e979354-a893-4586-ac20-defa840520f2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:42:50.595733 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.595712    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e979354-a893-4586-ac20-defa840520f2-kube-api-access-vmkxm" (OuterVolumeSpecName: "kube-api-access-vmkxm") pod "8e979354-a893-4586-ac20-defa840520f2" (UID: "8e979354-a893-4586-ac20-defa840520f2"). InnerVolumeSpecName "kube-api-access-vmkxm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:42:50.694410 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.694367    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e979354-a893-4586-ac20-defa840520f2-console-serving-cert\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:42:50.694410 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.694400    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e979354-a893-4586-ac20-defa840520f2-oauth-serving-cert\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:42:50.694410 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.694411    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e979354-a893-4586-ac20-defa840520f2-console-oauth-config\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:42:50.694410 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.694422    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e979354-a893-4586-ac20-defa840520f2-service-ca\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:42:50.694727 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.694434    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmkxm\" (UniqueName: \"kubernetes.io/projected/8e979354-a893-4586-ac20-defa840520f2-kube-api-access-vmkxm\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:42:50.694727 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.694445    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e979354-a893-4586-ac20-defa840520f2-console-config\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:42:50.871772 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.871691    2582 generic.go:356] "Generic (PLEG): container finished" podID="8e979354-a893-4586-ac20-defa840520f2" containerID="a7a7fd95a90b7d0fe529ba9745a9859923cde27cd8654df5b288ab1ea24a12cf" exitCode=0
Jul 21 00:42:50.871772 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.871739    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f49b4f48c-sldnx"
Jul 21 00:42:50.872236 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.871774    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f49b4f48c-sldnx" event={"ID":"8e979354-a893-4586-ac20-defa840520f2","Type":"ContainerDied","Data":"a7a7fd95a90b7d0fe529ba9745a9859923cde27cd8654df5b288ab1ea24a12cf"}
Jul 21 00:42:50.872236 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.871826    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f49b4f48c-sldnx" event={"ID":"8e979354-a893-4586-ac20-defa840520f2","Type":"ContainerDied","Data":"a90f6653f7df7c89ed3168b7932b98c2982f1e99e4bd6e066f9a00d1d3af2be6"}
Jul 21 00:42:50.872236 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.871848    2582 scope.go:117] "RemoveContainer" containerID="a7a7fd95a90b7d0fe529ba9745a9859923cde27cd8654df5b288ab1ea24a12cf"
Jul 21 00:42:50.885276 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.885252    2582 scope.go:117] "RemoveContainer" containerID="a7a7fd95a90b7d0fe529ba9745a9859923cde27cd8654df5b288ab1ea24a12cf"
Jul 21 00:42:50.885597 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:42:50.885577    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7a7fd95a90b7d0fe529ba9745a9859923cde27cd8654df5b288ab1ea24a12cf\": container with ID starting with a7a7fd95a90b7d0fe529ba9745a9859923cde27cd8654df5b288ab1ea24a12cf not found: ID does not exist" containerID="a7a7fd95a90b7d0fe529ba9745a9859923cde27cd8654df5b288ab1ea24a12cf"
Jul 21 00:42:50.885638 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.885608    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7a7fd95a90b7d0fe529ba9745a9859923cde27cd8654df5b288ab1ea24a12cf"} err="failed to get container status \"a7a7fd95a90b7d0fe529ba9745a9859923cde27cd8654df5b288ab1ea24a12cf\": rpc error: code = NotFound desc = could not find container \"a7a7fd95a90b7d0fe529ba9745a9859923cde27cd8654df5b288ab1ea24a12cf\": container with ID starting with a7a7fd95a90b7d0fe529ba9745a9859923cde27cd8654df5b288ab1ea24a12cf not found: ID does not exist"
Jul 21 00:42:50.897776 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.897744    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f49b4f48c-sldnx"]
Jul 21 00:42:50.903156 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:50.903128    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f49b4f48c-sldnx"]
Jul 21 00:42:52.343925 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:52.343888    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e979354-a893-4586-ac20-defa840520f2" path="/var/lib/kubelet/pods/8e979354-a893-4586-ac20-defa840520f2/volumes"
Jul 21 00:42:52.454799 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:52.454754    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:42:52.455001 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:52.454828    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:42:54.695895 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:42:54.695866    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wlhjv"
Jul 21 00:43:08.920271 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:08.920230    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-74dcd98d78-vqkrn" podUID="3b81a53b-cd0e-45e4-b598-d8042696c089" containerName="console" containerID="cri-o://6863e44434537741f37276d5fc836a6ab7453b7588158750dcbced175600180c" gracePeriod=15
Jul 21 00:43:09.174575 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.174505    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:43:09.265929 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.265888    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b81a53b-cd0e-45e4-b598-d8042696c089-trusted-ca-bundle\") pod \"3b81a53b-cd0e-45e4-b598-d8042696c089\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") "
Jul 21 00:43:09.265929 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.265932    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b81a53b-cd0e-45e4-b598-d8042696c089-console-oauth-config\") pod \"3b81a53b-cd0e-45e4-b598-d8042696c089\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") "
Jul 21 00:43:09.266157 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.265956    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ff7pj\" (UniqueName: \"kubernetes.io/projected/3b81a53b-cd0e-45e4-b598-d8042696c089-kube-api-access-ff7pj\") pod \"3b81a53b-cd0e-45e4-b598-d8042696c089\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") "
Jul 21 00:43:09.266157 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.265981    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b81a53b-cd0e-45e4-b598-d8042696c089-console-config\") pod \"3b81a53b-cd0e-45e4-b598-d8042696c089\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") "
Jul 21 00:43:09.266157 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.266115    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b81a53b-cd0e-45e4-b598-d8042696c089-console-serving-cert\") pod \"3b81a53b-cd0e-45e4-b598-d8042696c089\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") "
Jul 21 00:43:09.266304 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.266173    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b81a53b-cd0e-45e4-b598-d8042696c089-oauth-serving-cert\") pod \"3b81a53b-cd0e-45e4-b598-d8042696c089\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") "
Jul 21 00:43:09.266304 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.266211    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b81a53b-cd0e-45e4-b598-d8042696c089-service-ca\") pod \"3b81a53b-cd0e-45e4-b598-d8042696c089\" (UID: \"3b81a53b-cd0e-45e4-b598-d8042696c089\") "
Jul 21 00:43:09.266408 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.266380    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b81a53b-cd0e-45e4-b598-d8042696c089-console-config" (OuterVolumeSpecName: "console-config") pod "3b81a53b-cd0e-45e4-b598-d8042696c089" (UID: "3b81a53b-cd0e-45e4-b598-d8042696c089"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:43:09.266526 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.266386    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b81a53b-cd0e-45e4-b598-d8042696c089-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3b81a53b-cd0e-45e4-b598-d8042696c089" (UID: "3b81a53b-cd0e-45e4-b598-d8042696c089"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:43:09.266690 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.266580    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b81a53b-cd0e-45e4-b598-d8042696c089-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3b81a53b-cd0e-45e4-b598-d8042696c089" (UID: "3b81a53b-cd0e-45e4-b598-d8042696c089"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:43:09.266690 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.266641    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b81a53b-cd0e-45e4-b598-d8042696c089-console-config\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:43:09.266690 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.266679    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b81a53b-cd0e-45e4-b598-d8042696c089-oauth-serving-cert\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:43:09.266690 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.266688    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b81a53b-cd0e-45e4-b598-d8042696c089-trusted-ca-bundle\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:43:09.266862 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.266690    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b81a53b-cd0e-45e4-b598-d8042696c089-service-ca" (OuterVolumeSpecName: "service-ca") pod "3b81a53b-cd0e-45e4-b598-d8042696c089" (UID: "3b81a53b-cd0e-45e4-b598-d8042696c089"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:43:09.268272 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.268249    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b81a53b-cd0e-45e4-b598-d8042696c089-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3b81a53b-cd0e-45e4-b598-d8042696c089" (UID: "3b81a53b-cd0e-45e4-b598-d8042696c089"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:43:09.268682 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.268643    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b81a53b-cd0e-45e4-b598-d8042696c089-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3b81a53b-cd0e-45e4-b598-d8042696c089" (UID: "3b81a53b-cd0e-45e4-b598-d8042696c089"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:43:09.268682 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.268661    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b81a53b-cd0e-45e4-b598-d8042696c089-kube-api-access-ff7pj" (OuterVolumeSpecName: "kube-api-access-ff7pj") pod "3b81a53b-cd0e-45e4-b598-d8042696c089" (UID: "3b81a53b-cd0e-45e4-b598-d8042696c089"). InnerVolumeSpecName "kube-api-access-ff7pj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:43:09.367520 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.367468    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b81a53b-cd0e-45e4-b598-d8042696c089-console-oauth-config\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:43:09.367520 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.367504    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ff7pj\" (UniqueName: \"kubernetes.io/projected/3b81a53b-cd0e-45e4-b598-d8042696c089-kube-api-access-ff7pj\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:43:09.367520 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.367516    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b81a53b-cd0e-45e4-b598-d8042696c089-console-serving-cert\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:43:09.367520 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.367526    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b81a53b-cd0e-45e4-b598-d8042696c089-service-ca\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:43:09.948808 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.948776    2582 generic.go:356] "Generic (PLEG): container finished" podID="3b81a53b-cd0e-45e4-b598-d8042696c089" containerID="6863e44434537741f37276d5fc836a6ab7453b7588158750dcbced175600180c" exitCode=0
Jul 21 00:43:09.949255 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.948825    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74dcd98d78-vqkrn"
Jul 21 00:43:09.949255 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.948853    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74dcd98d78-vqkrn" event={"ID":"3b81a53b-cd0e-45e4-b598-d8042696c089","Type":"ContainerDied","Data":"6863e44434537741f37276d5fc836a6ab7453b7588158750dcbced175600180c"}
Jul 21 00:43:09.949255 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.948897    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74dcd98d78-vqkrn" event={"ID":"3b81a53b-cd0e-45e4-b598-d8042696c089","Type":"ContainerDied","Data":"8737dc3f56eda1c6200c4d3197dbab37245f17325bacd28435786ae56a1035b4"}
Jul 21 00:43:09.949255 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.948917    2582 scope.go:117] "RemoveContainer" containerID="6863e44434537741f37276d5fc836a6ab7453b7588158750dcbced175600180c"
Jul 21 00:43:09.957780 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.957761    2582 scope.go:117] "RemoveContainer" containerID="6863e44434537741f37276d5fc836a6ab7453b7588158750dcbced175600180c"
Jul 21 00:43:09.958098 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:43:09.958077    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6863e44434537741f37276d5fc836a6ab7453b7588158750dcbced175600180c\": container with ID starting with 6863e44434537741f37276d5fc836a6ab7453b7588158750dcbced175600180c not found: ID does not exist" containerID="6863e44434537741f37276d5fc836a6ab7453b7588158750dcbced175600180c"
Jul 21 00:43:09.958165 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.958111    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6863e44434537741f37276d5fc836a6ab7453b7588158750dcbced175600180c"} err="failed to get container status \"6863e44434537741f37276d5fc836a6ab7453b7588158750dcbced175600180c\": rpc error: code = NotFound desc = could not find container \"6863e44434537741f37276d5fc836a6ab7453b7588158750dcbced175600180c\": container with ID starting with 6863e44434537741f37276d5fc836a6ab7453b7588158750dcbced175600180c not found: ID does not exist"
Jul 21 00:43:09.968433 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.968402    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74dcd98d78-vqkrn"]
Jul 21 00:43:09.972044 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:09.972011    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74dcd98d78-vqkrn"]
Jul 21 00:43:10.343342 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:10.343263    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b81a53b-cd0e-45e4-b598-d8042696c089" path="/var/lib/kubelet/pods/3b81a53b-cd0e-45e4-b598-d8042696c089/volumes"
Jul 21 00:43:12.459989 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:12.459956    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:43:12.464208 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:12.464171    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5fc6dbfbbd-g747b"
Jul 21 00:43:52.053487 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.053450    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-597466cf78-5l86g"]
Jul 21 00:43:52.053949 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.053797    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e979354-a893-4586-ac20-defa840520f2" containerName="console"
Jul 21 00:43:52.053949 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.053811    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e979354-a893-4586-ac20-defa840520f2" containerName="console"
Jul 21 00:43:52.053949 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.053825    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b81a53b-cd0e-45e4-b598-d8042696c089" containerName="console"
Jul 21 00:43:52.053949 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.053830    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b81a53b-cd0e-45e4-b598-d8042696c089" containerName="console"
Jul 21 00:43:52.053949 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.053892    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b81a53b-cd0e-45e4-b598-d8042696c089" containerName="console"
Jul 21 00:43:52.053949 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.053900    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e979354-a893-4586-ac20-defa840520f2" containerName="console"
Jul 21 00:43:52.056684 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.056643    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-597466cf78-5l86g"
Jul 21 00:43:52.058816 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.058786    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2gzww\""
Jul 21 00:43:52.058979 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.058840    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 21 00:43:52.059117 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.059099    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 21 00:43:52.059326 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.059304    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 21 00:43:52.059481 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.059327    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 21 00:43:52.059481 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.059329    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 21 00:43:52.064483 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.064461    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 21 00:43:52.067399 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.067376    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-597466cf78-5l86g"]
Jul 21 00:43:52.131699 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.131663    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fac5109-abae-41dc-bc11-68795a57382c-metrics-client-ca\") pod \"telemeter-client-597466cf78-5l86g\" (UID: \"2fac5109-abae-41dc-bc11-68795a57382c\") " pod="openshift-monitoring/telemeter-client-597466cf78-5l86g"
Jul 21 00:43:52.131699 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.131713    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fac5109-abae-41dc-bc11-68795a57382c-serving-certs-ca-bundle\") pod \"telemeter-client-597466cf78-5l86g\" (UID: \"2fac5109-abae-41dc-bc11-68795a57382c\") " pod="openshift-monitoring/telemeter-client-597466cf78-5l86g"
Jul 21 00:43:52.131963 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.131740    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2fac5109-abae-41dc-bc11-68795a57382c-telemeter-client-tls\") pod \"telemeter-client-597466cf78-5l86g\" (UID: \"2fac5109-abae-41dc-bc11-68795a57382c\") " pod="openshift-monitoring/telemeter-client-597466cf78-5l86g"
Jul 21 00:43:52.131963 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.131776    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fac5109-abae-41dc-bc11-68795a57382c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-597466cf78-5l86g\" (UID: \"2fac5109-abae-41dc-bc11-68795a57382c\") " pod="openshift-monitoring/telemeter-client-597466cf78-5l86g"
Jul 21 00:43:52.131963 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.131860    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2fac5109-abae-41dc-bc11-68795a57382c-secret-telemeter-client\") pod \"telemeter-client-597466cf78-5l86g\" (UID: \"2fac5109-abae-41dc-bc11-68795a57382c\") " pod="openshift-monitoring/telemeter-client-597466cf78-5l86g"
Jul 21 00:43:52.131963 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.131895    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fac5109-abae-41dc-bc11-68795a57382c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-597466cf78-5l86g\" (UID: \"2fac5109-abae-41dc-bc11-68795a57382c\") " pod="openshift-monitoring/telemeter-client-597466cf78-5l86g"
Jul 21 00:43:52.131963 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.131919    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqmsd\" (UniqueName: \"kubernetes.io/projected/2fac5109-abae-41dc-bc11-68795a57382c-kube-api-access-kqmsd\") pod \"telemeter-client-597466cf78-5l86g\" (UID: \"2fac5109-abae-41dc-bc11-68795a57382c\") " pod="openshift-monitoring/telemeter-client-597466cf78-5l86g"
Jul 21 00:43:52.131963 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.131942    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2fac5109-abae-41dc-bc11-68795a57382c-federate-client-tls\") pod \"telemeter-client-597466cf78-5l86g\" (UID: \"2fac5109-abae-41dc-bc11-68795a57382c\") " pod="openshift-monitoring/telemeter-client-597466cf78-5l86g"
Jul 21 00:43:52.232626 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.232569    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqmsd\" (UniqueName: \"kubernetes.io/projected/2fac5109-abae-41dc-bc11-68795a57382c-kube-api-access-kqmsd\") pod \"telemeter-client-597466cf78-5l86g\" (UID: \"2fac5109-abae-41dc-bc11-68795a57382c\") " pod="openshift-monitoring/telemeter-client-597466cf78-5l86g"
Jul 21 00:43:52.232838 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.232638    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2fac5109-abae-41dc-bc11-68795a57382c-federate-client-tls\") pod \"telemeter-client-597466cf78-5l86g\" (UID: \"2fac5109-abae-41dc-bc11-68795a57382c\") " pod="openshift-monitoring/telemeter-client-597466cf78-5l86g"
Jul 21 00:43:52.232838 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.232710    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fac5109-abae-41dc-bc11-68795a57382c-metrics-client-ca\") pod \"telemeter-client-597466cf78-5l86g\" (UID: \"2fac5109-abae-41dc-bc11-68795a57382c\") " pod="openshift-monitoring/telemeter-client-597466cf78-5l86g"
Jul 21 00:43:52.232838 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.232737    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fac5109-abae-41dc-bc11-68795a57382c-serving-certs-ca-bundle\") pod \"telemeter-client-597466cf78-5l86g\" (UID: \"2fac5109-abae-41dc-bc11-68795a57382c\") " pod="openshift-monitoring/telemeter-client-597466cf78-5l86g"
Jul 21 00:43:52.232838 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.232769    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2fac5109-abae-41dc-bc11-68795a57382c-telemeter-client-tls\") pod \"telemeter-client-597466cf78-5l86g\" (UID: \"2fac5109-abae-41dc-bc11-68795a57382c\") " pod="openshift-monitoring/telemeter-client-597466cf78-5l86g"
Jul 21 00:43:52.232838 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.232812    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fac5109-abae-41dc-bc11-68795a57382c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-597466cf78-5l86g\" (UID: \"2fac5109-abae-41dc-bc11-68795a57382c\") " pod="openshift-monitoring/telemeter-client-597466cf78-5l86g"
Jul 21 00:43:52.233073 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.232867    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2fac5109-abae-41dc-bc11-68795a57382c-secret-telemeter-client\") pod \"telemeter-client-597466cf78-5l86g\" (UID: \"2fac5109-abae-41dc-bc11-68795a57382c\") " pod="openshift-monitoring/telemeter-client-597466cf78-5l86g"
Jul 21 00:43:52.233073 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.232901    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fac5109-abae-41dc-bc11-68795a57382c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-597466cf78-5l86g\" (UID: \"2fac5109-abae-41dc-bc11-68795a57382c\") " pod="openshift-monitoring/telemeter-client-597466cf78-5l86g"
Jul 21 00:43:52.233839 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.233810    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fac5109-abae-41dc-bc11-68795a57382c-serving-certs-ca-bundle\") pod \"telemeter-client-597466cf78-5l86g\" (UID: \"2fac5109-abae-41dc-bc11-68795a57382c\") " pod="openshift-monitoring/telemeter-client-597466cf78-5l86g"
Jul 21 00:43:52.233948 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.233874    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fac5109-abae-41dc-bc11-68795a57382c-metrics-client-ca\") pod \"telemeter-client-597466cf78-5l86g\" (UID: \"2fac5109-abae-41dc-bc11-68795a57382c\") " pod="openshift-monitoring/telemeter-client-597466cf78-5l86g"
Jul 21 00:43:52.234074 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.234053    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fac5109-abae-41dc-bc11-68795a57382c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-597466cf78-5l86g\" (UID: \"2fac5109-abae-41dc-bc11-68795a57382c\") " pod="openshift-monitoring/telemeter-client-597466cf78-5l86g"
Jul 21 00:43:52.235373 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.235351    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2fac5109-abae-41dc-bc11-68795a57382c-telemeter-client-tls\") pod \"telemeter-client-597466cf78-5l86g\" (UID: \"2fac5109-abae-41dc-bc11-68795a57382c\") " pod="openshift-monitoring/telemeter-client-597466cf78-5l86g"
Jul 21 00:43:52.235473 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.235442    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fac5109-abae-41dc-bc11-68795a57382c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-597466cf78-5l86g\" (UID: \"2fac5109-abae-41dc-bc11-68795a57382c\") " pod="openshift-monitoring/telemeter-client-597466cf78-5l86g"
Jul 21 00:43:52.235711 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.235691    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2fac5109-abae-41dc-bc11-68795a57382c-federate-client-tls\") pod \"telemeter-client-597466cf78-5l86g\" (UID: \"2fac5109-abae-41dc-bc11-68795a57382c\") " pod="openshift-monitoring/telemeter-client-597466cf78-5l86g"
Jul 21 00:43:52.235752 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.235704    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2fac5109-abae-41dc-bc11-68795a57382c-secret-telemeter-client\") pod \"telemeter-client-597466cf78-5l86g\" (UID: \"2fac5109-abae-41dc-bc11-68795a57382c\") " pod="openshift-monitoring/telemeter-client-597466cf78-5l86g"
Jul 21 00:43:52.239890 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.239868    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqmsd\" (UniqueName: \"kubernetes.io/projected/2fac5109-abae-41dc-bc11-68795a57382c-kube-api-access-kqmsd\") pod \"telemeter-client-597466cf78-5l86g\" (UID: \"2fac5109-abae-41dc-bc11-68795a57382c\") " pod="openshift-monitoring/telemeter-client-597466cf78-5l86g"
Jul 21 00:43:52.369419 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.369342    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-597466cf78-5l86g"
Jul 21 00:43:52.505536 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:52.505503    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-597466cf78-5l86g"]
Jul 21 00:43:52.509098 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:43:52.509071    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fac5109_abae_41dc_bc11_68795a57382c.slice/crio-09e3e0177875d4ffcc606b5c3f0bda8f8b5c0b3c3c40c2ecd0f604d6f1679a94 WatchSource:0}: Error finding container 09e3e0177875d4ffcc606b5c3f0bda8f8b5c0b3c3c40c2ecd0f604d6f1679a94: Status 404 returned error can't find the container with id 09e3e0177875d4ffcc606b5c3f0bda8f8b5c0b3c3c40c2ecd0f604d6f1679a94
Jul 21 00:43:53.134746 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:53.134702    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-597466cf78-5l86g" event={"ID":"2fac5109-abae-41dc-bc11-68795a57382c","Type":"ContainerStarted","Data":"09e3e0177875d4ffcc606b5c3f0bda8f8b5c0b3c3c40c2ecd0f604d6f1679a94"}
Jul 21 00:43:55.144917 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.144830    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-597466cf78-5l86g" event={"ID":"2fac5109-abae-41dc-bc11-68795a57382c","Type":"ContainerStarted","Data":"c476188847d2eff0a39836541a120ef22d2f356208fff482e61d2b003e375b4b"}
Jul 21 00:43:55.144917 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.144889    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-597466cf78-5l86g" event={"ID":"2fac5109-abae-41dc-bc11-68795a57382c","Type":"ContainerStarted","Data":"d8f6e41258f53468984361bf2c7f42747bc9491d2f489f3eac7d845179f4315c"}
Jul 21 00:43:55.144917 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.144909    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-597466cf78-5l86g" event={"ID":"2fac5109-abae-41dc-bc11-68795a57382c","Type":"ContainerStarted","Data":"1869180e730ad04b1e33ee68f8781de3372622400779e1b6482de9456e163cb0"}
Jul 21 00:43:55.167318 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.167260    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-597466cf78-5l86g" podStartSLOduration=0.949537667 podStartE2EDuration="3.167242036s" totalImagesPullingTime="2.217704369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:43:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:43:55.164691567 +0000 UTC m=+165.464387982" watchObservedRunningTime="2026-07-21 00:43:55.167242036 +0000 UTC m=+165.466938458"
Jul 21 00:43:55.806469 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.806440    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fdf87bfb6-mphh8"]
Jul 21 00:43:55.808996 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.808978    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdf87bfb6-mphh8"
Jul 21 00:43:55.820374 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.820350    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fdf87bfb6-mphh8"]
Jul 21 00:43:55.866937 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.866901    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-oauth-serving-cert\") pod \"console-fdf87bfb6-mphh8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") " pod="openshift-console/console-fdf87bfb6-mphh8"
Jul 21 00:43:55.867187 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.866959    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-console-config\") pod \"console-fdf87bfb6-mphh8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") " pod="openshift-console/console-fdf87bfb6-mphh8"
Jul 21 00:43:55.867187 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.866992    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-service-ca\") pod \"console-fdf87bfb6-mphh8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") " pod="openshift-console/console-fdf87bfb6-mphh8"
Jul 21 00:43:55.867187 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.867031    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-console-oauth-config\") pod \"console-fdf87bfb6-mphh8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") " pod="openshift-console/console-fdf87bfb6-mphh8"
Jul 21 00:43:55.867187 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.867079    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-trusted-ca-bundle\") pod \"console-fdf87bfb6-mphh8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") " pod="openshift-console/console-fdf87bfb6-mphh8"
Jul 21 00:43:55.867187 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.867122    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-console-serving-cert\") pod \"console-fdf87bfb6-mphh8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") " pod="openshift-console/console-fdf87bfb6-mphh8"
Jul 21 00:43:55.867187 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.867163    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8csfz\" (UniqueName: \"kubernetes.io/projected/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-kube-api-access-8csfz\") pod \"console-fdf87bfb6-mphh8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") " pod="openshift-console/console-fdf87bfb6-mphh8"
Jul 21 00:43:55.968931 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.968889    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-console-config\") pod \"console-fdf87bfb6-mphh8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") " pod="openshift-console/console-fdf87bfb6-mphh8"
Jul 21 00:43:55.969140 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.968956    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-service-ca\") pod \"console-fdf87bfb6-mphh8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") " pod="openshift-console/console-fdf87bfb6-mphh8"
Jul 21 00:43:55.969140 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.969018    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-console-oauth-config\") pod \"console-fdf87bfb6-mphh8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") " pod="openshift-console/console-fdf87bfb6-mphh8"
Jul 21 00:43:55.969140 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.969051    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-trusted-ca-bundle\") pod \"console-fdf87bfb6-mphh8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") " pod="openshift-console/console-fdf87bfb6-mphh8"
Jul 21 00:43:55.969140 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.969085    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-console-serving-cert\") pod \"console-fdf87bfb6-mphh8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") " pod="openshift-console/console-fdf87bfb6-mphh8"
Jul 21 00:43:55.969140 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.969126    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8csfz\" (UniqueName: \"kubernetes.io/projected/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-kube-api-access-8csfz\") pod \"console-fdf87bfb6-mphh8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") " pod="openshift-console/console-fdf87bfb6-mphh8"
Jul 21 00:43:55.969375 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.969182    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-oauth-serving-cert\") pod \"console-fdf87bfb6-mphh8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") " pod="openshift-console/console-fdf87bfb6-mphh8"
Jul 21 00:43:55.970000 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.969975    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-oauth-serving-cert\") pod \"console-fdf87bfb6-mphh8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") " pod="openshift-console/console-fdf87bfb6-mphh8"
Jul 21 00:43:55.970545 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.970525    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-console-config\") pod \"console-fdf87bfb6-mphh8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") " pod="openshift-console/console-fdf87bfb6-mphh8"
Jul 21 00:43:55.971147 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.971126    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-service-ca\") pod \"console-fdf87bfb6-mphh8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") " pod="openshift-console/console-fdf87bfb6-mphh8"
Jul 21 00:43:55.974925 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.974897    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-console-oauth-config\") pod \"console-fdf87bfb6-mphh8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") " pod="openshift-console/console-fdf87bfb6-mphh8"
Jul 21 00:43:55.975464 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.975442    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-trusted-ca-bundle\") pod \"console-fdf87bfb6-mphh8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") " pod="openshift-console/console-fdf87bfb6-mphh8"
Jul 21 00:43:55.976604 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.976582    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-console-serving-cert\") pod \"console-fdf87bfb6-mphh8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") " pod="openshift-console/console-fdf87bfb6-mphh8"
Jul 21 00:43:55.981830 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:55.981807    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8csfz\" (UniqueName: \"kubernetes.io/projected/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-kube-api-access-8csfz\") pod \"console-fdf87bfb6-mphh8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") " pod="openshift-console/console-fdf87bfb6-mphh8"
Jul 21 00:43:56.118290 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:56.118191    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdf87bfb6-mphh8"
Jul 21 00:43:56.271308 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:56.271274    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fdf87bfb6-mphh8"]
Jul 21 00:43:56.274279 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:43:56.274255    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfef4c384_ad2e_497c_bd52_0aeffd7c98c8.slice/crio-bf75c7f5dcd4530ecde011fdd970cea8d9bb325b5dd155244961c9878f8dc52d WatchSource:0}: Error finding container bf75c7f5dcd4530ecde011fdd970cea8d9bb325b5dd155244961c9878f8dc52d: Status 404 returned error can't find the container with id bf75c7f5dcd4530ecde011fdd970cea8d9bb325b5dd155244961c9878f8dc52d
Jul 21 00:43:57.154911 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:57.154875    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdf87bfb6-mphh8" event={"ID":"fef4c384-ad2e-497c-bd52-0aeffd7c98c8","Type":"ContainerStarted","Data":"915f821394137f4e43a0b67a274abed4d664825931654a2352bc755323d322ff"}
Jul 21 00:43:57.155099 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:57.154928    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdf87bfb6-mphh8" event={"ID":"fef4c384-ad2e-497c-bd52-0aeffd7c98c8","Type":"ContainerStarted","Data":"bf75c7f5dcd4530ecde011fdd970cea8d9bb325b5dd155244961c9878f8dc52d"}
Jul 21 00:43:57.172331 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:43:57.172278    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fdf87bfb6-mphh8" podStartSLOduration=2.172257749 podStartE2EDuration="2.172257749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:43:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:43:57.171259818 +0000 UTC m=+167.470956240" watchObservedRunningTime="2026-07-21 00:43:57.172257749 +0000 UTC m=+167.471954169"
Jul 21 00:44:04.440276 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.440200    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fdf87bfb6-mphh8"]
Jul 21 00:44:04.466244 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.466215    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f6999dd7-rtjtm"]
Jul 21 00:44:04.468573 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.468548    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:04.480056 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.480031    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f6999dd7-rtjtm"]
Jul 21 00:44:04.542941 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.542906    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcfcp\" (UniqueName: \"kubernetes.io/projected/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-kube-api-access-hcfcp\") pod \"console-7f6999dd7-rtjtm\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") " pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:04.543118 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.542944    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-oauth-serving-cert\") pod \"console-7f6999dd7-rtjtm\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") " pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:04.543118 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.542983    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-console-config\") pod \"console-7f6999dd7-rtjtm\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") " pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:04.543118 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.543029    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-console-oauth-config\") pod \"console-7f6999dd7-rtjtm\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") " pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:04.543118 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.543048    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-console-serving-cert\") pod \"console-7f6999dd7-rtjtm\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") " pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:04.543118 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.543062    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-trusted-ca-bundle\") pod \"console-7f6999dd7-rtjtm\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") " pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:04.543118 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.543077    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-service-ca\") pod \"console-7f6999dd7-rtjtm\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") " pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:04.644359 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.644321    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcfcp\" (UniqueName: \"kubernetes.io/projected/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-kube-api-access-hcfcp\") pod \"console-7f6999dd7-rtjtm\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") " pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:04.644500 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.644368    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-oauth-serving-cert\") pod \"console-7f6999dd7-rtjtm\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") " pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:04.644500 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.644402    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-console-config\") pod \"console-7f6999dd7-rtjtm\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") " pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:04.644500 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.644455    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-console-oauth-config\") pod \"console-7f6999dd7-rtjtm\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") " pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:04.644500 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.644490    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-console-serving-cert\") pod \"console-7f6999dd7-rtjtm\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") " pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:04.644724 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.644512    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-trusted-ca-bundle\") pod \"console-7f6999dd7-rtjtm\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") " pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:04.644724 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.644536    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-service-ca\") pod \"console-7f6999dd7-rtjtm\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") " pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:04.645157 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.645127    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-oauth-serving-cert\") pod \"console-7f6999dd7-rtjtm\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") " pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:04.645275 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.645160    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-console-config\") pod \"console-7f6999dd7-rtjtm\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") " pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:04.645374 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.645348    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-service-ca\") pod \"console-7f6999dd7-rtjtm\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") " pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:04.645476 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.645461    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-trusted-ca-bundle\") pod \"console-7f6999dd7-rtjtm\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") " pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:04.646956 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.646916    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-console-oauth-config\") pod \"console-7f6999dd7-rtjtm\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") " pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:04.647127 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.647106    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-console-serving-cert\") pod \"console-7f6999dd7-rtjtm\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") " pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:04.651350 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.651327    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcfcp\" (UniqueName: \"kubernetes.io/projected/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-kube-api-access-hcfcp\") pod \"console-7f6999dd7-rtjtm\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") " pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:04.780600 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.780507    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:04.908686 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:04.908642    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f6999dd7-rtjtm"]
Jul 21 00:44:04.911817 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:44:04.911779    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode74ba291_849b_4c80_ad6c_75c42e1fe6b3.slice/crio-7cfa39170b200bc1c64f52c51804b203797dfcbfc1e0ebee65ebc79d16f23f93 WatchSource:0}: Error finding container 7cfa39170b200bc1c64f52c51804b203797dfcbfc1e0ebee65ebc79d16f23f93: Status 404 returned error can't find the container with id 7cfa39170b200bc1c64f52c51804b203797dfcbfc1e0ebee65ebc79d16f23f93
Jul 21 00:44:05.186887 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:05.186854    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f6999dd7-rtjtm" event={"ID":"e74ba291-849b-4c80-ad6c-75c42e1fe6b3","Type":"ContainerStarted","Data":"f7592d731df9f445cb0bc9fcb027a72812e0bda9a27fae2e0af14ca659fb2479"}
Jul 21 00:44:05.187114 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:05.186903    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f6999dd7-rtjtm" event={"ID":"e74ba291-849b-4c80-ad6c-75c42e1fe6b3","Type":"ContainerStarted","Data":"7cfa39170b200bc1c64f52c51804b203797dfcbfc1e0ebee65ebc79d16f23f93"}
Jul 21 00:44:05.203929 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:05.203883    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f6999dd7-rtjtm" podStartSLOduration=1.203866321 podStartE2EDuration="1.203866321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:44:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:44:05.202536757 +0000 UTC m=+175.502233176" watchObservedRunningTime="2026-07-21 00:44:05.203866321 +0000 UTC m=+175.503562743"
Jul 21 00:44:06.119243 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:06.119200    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fdf87bfb6-mphh8"
Jul 21 00:44:14.780761 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:14.780721    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:14.781168 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:14.780790    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:14.785575 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:14.785550    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:15.232366 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:15.232339    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:44:15.272377 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:15.272342    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-576848c965-9sbkb"]
Jul 21 00:44:29.460238 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:29.460191    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-fdf87bfb6-mphh8" podUID="fef4c384-ad2e-497c-bd52-0aeffd7c98c8" containerName="console" containerID="cri-o://915f821394137f4e43a0b67a274abed4d664825931654a2352bc755323d322ff" gracePeriod=15
Jul 21 00:44:29.708766 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:29.708739    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdf87bfb6-mphh8"
Jul 21 00:44:29.763049 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:29.762957    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8csfz\" (UniqueName: \"kubernetes.io/projected/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-kube-api-access-8csfz\") pod \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") "
Jul 21 00:44:29.763049 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:29.763032    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-service-ca\") pod \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") "
Jul 21 00:44:29.763277 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:29.763087    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-oauth-serving-cert\") pod \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") "
Jul 21 00:44:29.763277 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:29.763114    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-console-oauth-config\") pod \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") "
Jul 21 00:44:29.763277 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:29.763148    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-console-config\") pod \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") "
Jul 21 00:44:29.763277 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:29.763170    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-trusted-ca-bundle\") pod \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") "
Jul 21 00:44:29.763740 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:29.763696    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-console-serving-cert\") pod \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\" (UID: \"fef4c384-ad2e-497c-bd52-0aeffd7c98c8\") "
Jul 21 00:44:29.763847 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:29.763760    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fef4c384-ad2e-497c-bd52-0aeffd7c98c8" (UID: "fef4c384-ad2e-497c-bd52-0aeffd7c98c8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:44:29.763847 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:29.763794    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-service-ca" (OuterVolumeSpecName: "service-ca") pod "fef4c384-ad2e-497c-bd52-0aeffd7c98c8" (UID: "fef4c384-ad2e-497c-bd52-0aeffd7c98c8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:44:29.763959 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:29.763854    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fef4c384-ad2e-497c-bd52-0aeffd7c98c8" (UID: "fef4c384-ad2e-497c-bd52-0aeffd7c98c8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:44:29.769665 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:29.764136    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-oauth-serving-cert\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:44:29.769665 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:29.764170    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-console-config" (OuterVolumeSpecName: "console-config") pod "fef4c384-ad2e-497c-bd52-0aeffd7c98c8" (UID: "fef4c384-ad2e-497c-bd52-0aeffd7c98c8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:44:29.769665 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:29.764200    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-trusted-ca-bundle\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:44:29.769665 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:29.764225    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-service-ca\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:44:29.770276 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:29.770192    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fef4c384-ad2e-497c-bd52-0aeffd7c98c8" (UID: "fef4c384-ad2e-497c-bd52-0aeffd7c98c8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:44:29.770276 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:29.770212    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fef4c384-ad2e-497c-bd52-0aeffd7c98c8" (UID: "fef4c384-ad2e-497c-bd52-0aeffd7c98c8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:44:29.770276 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:29.770238    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-kube-api-access-8csfz" (OuterVolumeSpecName: "kube-api-access-8csfz") pod "fef4c384-ad2e-497c-bd52-0aeffd7c98c8" (UID: "fef4c384-ad2e-497c-bd52-0aeffd7c98c8"). InnerVolumeSpecName "kube-api-access-8csfz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:44:29.865006 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:29.864970    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-console-oauth-config\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:44:29.865006 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:29.864998    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-console-config\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:44:29.865006 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:29.865008    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-console-serving-cert\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:44:29.865006 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:29.865018    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8csfz\" (UniqueName: \"kubernetes.io/projected/fef4c384-ad2e-497c-bd52-0aeffd7c98c8-kube-api-access-8csfz\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:44:30.287823 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:30.287790    2582 generic.go:356] "Generic (PLEG): container finished" podID="fef4c384-ad2e-497c-bd52-0aeffd7c98c8" containerID="915f821394137f4e43a0b67a274abed4d664825931654a2352bc755323d322ff" exitCode=0
Jul 21 00:44:30.288011 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:30.287856    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdf87bfb6-mphh8"
Jul 21 00:44:30.288011 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:30.287875    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdf87bfb6-mphh8" event={"ID":"fef4c384-ad2e-497c-bd52-0aeffd7c98c8","Type":"ContainerDied","Data":"915f821394137f4e43a0b67a274abed4d664825931654a2352bc755323d322ff"}
Jul 21 00:44:30.288011 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:30.287972    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdf87bfb6-mphh8" event={"ID":"fef4c384-ad2e-497c-bd52-0aeffd7c98c8","Type":"ContainerDied","Data":"bf75c7f5dcd4530ecde011fdd970cea8d9bb325b5dd155244961c9878f8dc52d"}
Jul 21 00:44:30.288011 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:30.287998    2582 scope.go:117] "RemoveContainer" containerID="915f821394137f4e43a0b67a274abed4d664825931654a2352bc755323d322ff"
Jul 21 00:44:30.296817 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:30.296801    2582 scope.go:117] "RemoveContainer" containerID="915f821394137f4e43a0b67a274abed4d664825931654a2352bc755323d322ff"
Jul 21 00:44:30.297052 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:44:30.297034    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"915f821394137f4e43a0b67a274abed4d664825931654a2352bc755323d322ff\": container with ID starting with 915f821394137f4e43a0b67a274abed4d664825931654a2352bc755323d322ff not found: ID does not exist" containerID="915f821394137f4e43a0b67a274abed4d664825931654a2352bc755323d322ff"
Jul 21 00:44:30.297106 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:30.297062    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"915f821394137f4e43a0b67a274abed4d664825931654a2352bc755323d322ff"} err="failed to get container status \"915f821394137f4e43a0b67a274abed4d664825931654a2352bc755323d322ff\": rpc error: code = NotFound desc = could not find container \"915f821394137f4e43a0b67a274abed4d664825931654a2352bc755323d322ff\": container with ID starting with 915f821394137f4e43a0b67a274abed4d664825931654a2352bc755323d322ff not found: ID does not exist"
Jul 21 00:44:30.306575 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:30.306527    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fdf87bfb6-mphh8"]
Jul 21 00:44:30.308555 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:30.308536    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fdf87bfb6-mphh8"]
Jul 21 00:44:30.343080 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:30.343047    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fef4c384-ad2e-497c-bd52-0aeffd7c98c8" path="/var/lib/kubelet/pods/fef4c384-ad2e-497c-bd52-0aeffd7c98c8/volumes"
Jul 21 00:44:40.293065 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:40.293005    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-576848c965-9sbkb" podUID="6fa4408d-e7f1-4364-8da7-d84a730049aa" containerName="console" containerID="cri-o://a82024c0b844185c8028cdf0cb93325f16999c3cdfcd8f777fc1750569f4dc64" gracePeriod=15
Jul 21 00:44:40.534911 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:40.534886    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:44:40.658860 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:40.658772    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fa4408d-e7f1-4364-8da7-d84a730049aa-oauth-serving-cert\") pod \"6fa4408d-e7f1-4364-8da7-d84a730049aa\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") "
Jul 21 00:44:40.658860 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:40.658817    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fa4408d-e7f1-4364-8da7-d84a730049aa-console-serving-cert\") pod \"6fa4408d-e7f1-4364-8da7-d84a730049aa\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") "
Jul 21 00:44:40.658860 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:40.658861    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fa4408d-e7f1-4364-8da7-d84a730049aa-console-oauth-config\") pod \"6fa4408d-e7f1-4364-8da7-d84a730049aa\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") "
Jul 21 00:44:40.659134 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:40.658886    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fa4408d-e7f1-4364-8da7-d84a730049aa-console-config\") pod \"6fa4408d-e7f1-4364-8da7-d84a730049aa\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") "
Jul 21 00:44:40.659134 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:40.658935    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fa4408d-e7f1-4364-8da7-d84a730049aa-service-ca\") pod \"6fa4408d-e7f1-4364-8da7-d84a730049aa\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") "
Jul 21 00:44:40.659134 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:40.658976    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa4408d-e7f1-4364-8da7-d84a730049aa-trusted-ca-bundle\") pod \"6fa4408d-e7f1-4364-8da7-d84a730049aa\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") "
Jul 21 00:44:40.659134 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:40.659016    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r29rr\" (UniqueName: \"kubernetes.io/projected/6fa4408d-e7f1-4364-8da7-d84a730049aa-kube-api-access-r29rr\") pod \"6fa4408d-e7f1-4364-8da7-d84a730049aa\" (UID: \"6fa4408d-e7f1-4364-8da7-d84a730049aa\") "
Jul 21 00:44:40.659335 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:40.659245    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fa4408d-e7f1-4364-8da7-d84a730049aa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6fa4408d-e7f1-4364-8da7-d84a730049aa" (UID: "6fa4408d-e7f1-4364-8da7-d84a730049aa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:44:40.659390 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:40.659352    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fa4408d-e7f1-4364-8da7-d84a730049aa-oauth-serving-cert\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:44:40.659440 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:40.659378    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fa4408d-e7f1-4364-8da7-d84a730049aa-service-ca" (OuterVolumeSpecName: "service-ca") pod "6fa4408d-e7f1-4364-8da7-d84a730049aa" (UID: "6fa4408d-e7f1-4364-8da7-d84a730049aa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:44:40.659477 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:40.659449    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fa4408d-e7f1-4364-8da7-d84a730049aa-console-config" (OuterVolumeSpecName: "console-config") pod "6fa4408d-e7f1-4364-8da7-d84a730049aa" (UID: "6fa4408d-e7f1-4364-8da7-d84a730049aa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:44:40.659477 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:40.659460    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fa4408d-e7f1-4364-8da7-d84a730049aa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6fa4408d-e7f1-4364-8da7-d84a730049aa" (UID: "6fa4408d-e7f1-4364-8da7-d84a730049aa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:44:40.661136 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:40.661104    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fa4408d-e7f1-4364-8da7-d84a730049aa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6fa4408d-e7f1-4364-8da7-d84a730049aa" (UID: "6fa4408d-e7f1-4364-8da7-d84a730049aa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:44:40.661235 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:40.661149    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fa4408d-e7f1-4364-8da7-d84a730049aa-kube-api-access-r29rr" (OuterVolumeSpecName: "kube-api-access-r29rr") pod "6fa4408d-e7f1-4364-8da7-d84a730049aa" (UID: "6fa4408d-e7f1-4364-8da7-d84a730049aa"). InnerVolumeSpecName "kube-api-access-r29rr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:44:40.661235 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:40.661164    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fa4408d-e7f1-4364-8da7-d84a730049aa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6fa4408d-e7f1-4364-8da7-d84a730049aa" (UID: "6fa4408d-e7f1-4364-8da7-d84a730049aa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:44:40.760023 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:40.759989    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa4408d-e7f1-4364-8da7-d84a730049aa-trusted-ca-bundle\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:44:40.760023 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:40.760016    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r29rr\" (UniqueName: \"kubernetes.io/projected/6fa4408d-e7f1-4364-8da7-d84a730049aa-kube-api-access-r29rr\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:44:40.760023 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:40.760025    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fa4408d-e7f1-4364-8da7-d84a730049aa-console-serving-cert\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:44:40.760023 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:40.760034    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fa4408d-e7f1-4364-8da7-d84a730049aa-console-oauth-config\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:44:40.760268 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:40.760042    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fa4408d-e7f1-4364-8da7-d84a730049aa-console-config\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:44:40.760268 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:40.760051    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fa4408d-e7f1-4364-8da7-d84a730049aa-service-ca\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:44:41.333849 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:41.333818    2582 generic.go:356] "Generic (PLEG): container finished" podID="6fa4408d-e7f1-4364-8da7-d84a730049aa" containerID="a82024c0b844185c8028cdf0cb93325f16999c3cdfcd8f777fc1750569f4dc64" exitCode=0
Jul 21 00:44:41.334269 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:41.333863    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-576848c965-9sbkb"
Jul 21 00:44:41.334269 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:41.333902    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-576848c965-9sbkb" event={"ID":"6fa4408d-e7f1-4364-8da7-d84a730049aa","Type":"ContainerDied","Data":"a82024c0b844185c8028cdf0cb93325f16999c3cdfcd8f777fc1750569f4dc64"}
Jul 21 00:44:41.334269 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:41.333950    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-576848c965-9sbkb" event={"ID":"6fa4408d-e7f1-4364-8da7-d84a730049aa","Type":"ContainerDied","Data":"98e2c4dd0ef35195adb7eacfc57d65ef5542ec4a989b94cf8c379fbe096379a7"}
Jul 21 00:44:41.334269 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:41.333970    2582 scope.go:117] "RemoveContainer" containerID="a82024c0b844185c8028cdf0cb93325f16999c3cdfcd8f777fc1750569f4dc64"
Jul 21 00:44:41.342783 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:41.342766    2582 scope.go:117] "RemoveContainer" containerID="a82024c0b844185c8028cdf0cb93325f16999c3cdfcd8f777fc1750569f4dc64"
Jul 21 00:44:41.343052 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:44:41.343033    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a82024c0b844185c8028cdf0cb93325f16999c3cdfcd8f777fc1750569f4dc64\": container with ID starting with a82024c0b844185c8028cdf0cb93325f16999c3cdfcd8f777fc1750569f4dc64 not found: ID does not exist" containerID="a82024c0b844185c8028cdf0cb93325f16999c3cdfcd8f777fc1750569f4dc64"
Jul 21 00:44:41.343110 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:41.343058    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a82024c0b844185c8028cdf0cb93325f16999c3cdfcd8f777fc1750569f4dc64"} err="failed to get container status \"a82024c0b844185c8028cdf0cb93325f16999c3cdfcd8f777fc1750569f4dc64\": rpc error: code = NotFound desc = could not find container \"a82024c0b844185c8028cdf0cb93325f16999c3cdfcd8f777fc1750569f4dc64\": container with ID starting with a82024c0b844185c8028cdf0cb93325f16999c3cdfcd8f777fc1750569f4dc64 not found: ID does not exist"
Jul 21 00:44:41.353014 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:41.352991    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-576848c965-9sbkb"]
Jul 21 00:44:41.358268 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:41.358247    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-576848c965-9sbkb"]
Jul 21 00:44:42.342806 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:44:42.342778    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fa4408d-e7f1-4364-8da7-d84a730049aa" path="/var/lib/kubelet/pods/6fa4408d-e7f1-4364-8da7-d84a730049aa/volumes"
Jul 21 00:45:28.143595 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:28.143556    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt"]
Jul 21 00:45:28.144094 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:28.143897    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa4408d-e7f1-4364-8da7-d84a730049aa" containerName="console"
Jul 21 00:45:28.144094 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:28.143909    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa4408d-e7f1-4364-8da7-d84a730049aa" containerName="console"
Jul 21 00:45:28.144094 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:28.143925    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fef4c384-ad2e-497c-bd52-0aeffd7c98c8" containerName="console"
Jul 21 00:45:28.144094 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:28.143931    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fef4c384-ad2e-497c-bd52-0aeffd7c98c8" containerName="console"
Jul 21 00:45:28.144094 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:28.143979    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fa4408d-e7f1-4364-8da7-d84a730049aa" containerName="console"
Jul 21 00:45:28.144094 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:28.143992    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fef4c384-ad2e-497c-bd52-0aeffd7c98c8" containerName="console"
Jul 21 00:45:28.148393 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:28.148370    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt"
Jul 21 00:45:28.150561 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:28.150540    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 00:45:28.150711 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:28.150624    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ms6gv\""
Jul 21 00:45:28.150970 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:28.150955    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 00:45:28.157149 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:28.157126    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt"]
Jul 21 00:45:28.238573 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:28.238531    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4824daa4-464b-40b1-b403-4a1b1f358203-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt\" (UID: \"4824daa4-464b-40b1-b403-4a1b1f358203\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt"
Jul 21 00:45:28.238573 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:28.238571    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4824daa4-464b-40b1-b403-4a1b1f358203-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt\" (UID: \"4824daa4-464b-40b1-b403-4a1b1f358203\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt"
Jul 21 00:45:28.238852 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:28.238609    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfwnk\" (UniqueName: \"kubernetes.io/projected/4824daa4-464b-40b1-b403-4a1b1f358203-kube-api-access-qfwnk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt\" (UID: \"4824daa4-464b-40b1-b403-4a1b1f358203\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt"
Jul 21 00:45:28.339336 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:28.339306    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4824daa4-464b-40b1-b403-4a1b1f358203-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt\" (UID: \"4824daa4-464b-40b1-b403-4a1b1f358203\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt"
Jul 21 00:45:28.339473 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:28.339340    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4824daa4-464b-40b1-b403-4a1b1f358203-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt\" (UID: \"4824daa4-464b-40b1-b403-4a1b1f358203\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt"
Jul 21 00:45:28.339473 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:28.339394    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfwnk\" (UniqueName: \"kubernetes.io/projected/4824daa4-464b-40b1-b403-4a1b1f358203-kube-api-access-qfwnk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt\" (UID: \"4824daa4-464b-40b1-b403-4a1b1f358203\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt"
Jul 21 00:45:28.339758 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:28.339738    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4824daa4-464b-40b1-b403-4a1b1f358203-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt\" (UID: \"4824daa4-464b-40b1-b403-4a1b1f358203\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt"
Jul 21 00:45:28.339802 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:28.339757    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4824daa4-464b-40b1-b403-4a1b1f358203-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt\" (UID: \"4824daa4-464b-40b1-b403-4a1b1f358203\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt"
Jul 21 00:45:28.347135 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:28.347100    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfwnk\" (UniqueName: \"kubernetes.io/projected/4824daa4-464b-40b1-b403-4a1b1f358203-kube-api-access-qfwnk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt\" (UID: \"4824daa4-464b-40b1-b403-4a1b1f358203\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt"
Jul 21 00:45:28.457813 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:28.457772    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt"
Jul 21 00:45:28.594056 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:28.594020    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt"]
Jul 21 00:45:28.597437 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:45:28.597404    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4824daa4_464b_40b1_b403_4a1b1f358203.slice/crio-0be7f54cc0424cb23606fe54a55feccac1630787708df5a958743bd51d1a5a3d WatchSource:0}: Error finding container 0be7f54cc0424cb23606fe54a55feccac1630787708df5a958743bd51d1a5a3d: Status 404 returned error can't find the container with id 0be7f54cc0424cb23606fe54a55feccac1630787708df5a958743bd51d1a5a3d
Jul 21 00:45:29.522523 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:29.522487    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt" event={"ID":"4824daa4-464b-40b1-b403-4a1b1f358203","Type":"ContainerStarted","Data":"0be7f54cc0424cb23606fe54a55feccac1630787708df5a958743bd51d1a5a3d"}
Jul 21 00:45:36.558109 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:36.558071    2582 generic.go:356] "Generic (PLEG): container finished" podID="4824daa4-464b-40b1-b403-4a1b1f358203" containerID="945746e1454f38754c710ba18a21a42eaee77f3fc9c0d64d89486707c83486d7" exitCode=0
Jul 21 00:45:36.558522 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:36.558164    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt" event={"ID":"4824daa4-464b-40b1-b403-4a1b1f358203","Type":"ContainerDied","Data":"945746e1454f38754c710ba18a21a42eaee77f3fc9c0d64d89486707c83486d7"}
Jul 21 00:45:39.572707 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:39.572643    2582 generic.go:356] "Generic (PLEG): container finished" podID="4824daa4-464b-40b1-b403-4a1b1f358203" containerID="72c0a749dea709fdf574fcd087f28e80341de90ae4eaf23eaa1660a688447236" exitCode=0
Jul 21 00:45:39.573084 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:39.572750    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt" event={"ID":"4824daa4-464b-40b1-b403-4a1b1f358203","Type":"ContainerDied","Data":"72c0a749dea709fdf574fcd087f28e80341de90ae4eaf23eaa1660a688447236"}
Jul 21 00:45:47.610600 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:47.610563    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt" event={"ID":"4824daa4-464b-40b1-b403-4a1b1f358203","Type":"ContainerStarted","Data":"c3914e8701ba031d7b3a1dbe15f7620346b85303db1f1c9e4074cdd9b935dccb"}
Jul 21 00:45:47.626725 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:47.626619    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt" podStartSLOduration=2.371686541 podStartE2EDuration="19.626600956s" totalImagesPullingTime="17.254914415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:45:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:45:47.625042364 +0000 UTC m=+277.924738787" watchObservedRunningTime="2026-07-21 00:45:47.626600956 +0000 UTC m=+277.926297373"
Jul 21 00:45:48.616169 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:48.616129    2582 generic.go:356] "Generic (PLEG): container finished" podID="4824daa4-464b-40b1-b403-4a1b1f358203" containerID="c3914e8701ba031d7b3a1dbe15f7620346b85303db1f1c9e4074cdd9b935dccb" exitCode=0
Jul 21 00:45:48.616554 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:48.616214    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt" event={"ID":"4824daa4-464b-40b1-b403-4a1b1f358203","Type":"ContainerDied","Data":"c3914e8701ba031d7b3a1dbe15f7620346b85303db1f1c9e4074cdd9b935dccb"}
Jul 21 00:45:49.748081 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:49.748015    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt"
Jul 21 00:45:49.830151 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:49.830111    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4824daa4-464b-40b1-b403-4a1b1f358203-util\") pod \"4824daa4-464b-40b1-b403-4a1b1f358203\" (UID: \"4824daa4-464b-40b1-b403-4a1b1f358203\") "
Jul 21 00:45:49.830353 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:49.830180    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4824daa4-464b-40b1-b403-4a1b1f358203-bundle\") pod \"4824daa4-464b-40b1-b403-4a1b1f358203\" (UID: \"4824daa4-464b-40b1-b403-4a1b1f358203\") "
Jul 21 00:45:49.830353 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:49.830253    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfwnk\" (UniqueName: \"kubernetes.io/projected/4824daa4-464b-40b1-b403-4a1b1f358203-kube-api-access-qfwnk\") pod \"4824daa4-464b-40b1-b403-4a1b1f358203\" (UID: \"4824daa4-464b-40b1-b403-4a1b1f358203\") "
Jul 21 00:45:49.833017 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:49.831346    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4824daa4-464b-40b1-b403-4a1b1f358203-bundle" (OuterVolumeSpecName: "bundle") pod "4824daa4-464b-40b1-b403-4a1b1f358203" (UID: "4824daa4-464b-40b1-b403-4a1b1f358203"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 00:45:49.837719 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:49.837675    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4824daa4-464b-40b1-b403-4a1b1f358203-kube-api-access-qfwnk" (OuterVolumeSpecName: "kube-api-access-qfwnk") pod "4824daa4-464b-40b1-b403-4a1b1f358203" (UID: "4824daa4-464b-40b1-b403-4a1b1f358203"). InnerVolumeSpecName "kube-api-access-qfwnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:45:49.838269 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:49.838235    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4824daa4-464b-40b1-b403-4a1b1f358203-util" (OuterVolumeSpecName: "util") pod "4824daa4-464b-40b1-b403-4a1b1f358203" (UID: "4824daa4-464b-40b1-b403-4a1b1f358203"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 00:45:49.931948 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:49.931896    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4824daa4-464b-40b1-b403-4a1b1f358203-util\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:45:49.931948 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:49.931940    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4824daa4-464b-40b1-b403-4a1b1f358203-bundle\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:45:49.931948 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:49.931951    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfwnk\" (UniqueName: \"kubernetes.io/projected/4824daa4-464b-40b1-b403-4a1b1f358203-kube-api-access-qfwnk\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:45:50.626385 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:50.626305    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt" event={"ID":"4824daa4-464b-40b1-b403-4a1b1f358203","Type":"ContainerDied","Data":"0be7f54cc0424cb23606fe54a55feccac1630787708df5a958743bd51d1a5a3d"}
Jul 21 00:45:50.626385 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:50.626363    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0be7f54cc0424cb23606fe54a55feccac1630787708df5a958743bd51d1a5a3d"
Jul 21 00:45:50.626385 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:50.626324    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scwrt"
Jul 21 00:45:55.899192 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:55.899121    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-thzm4"]
Jul 21 00:45:55.900512 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:55.900481    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4824daa4-464b-40b1-b403-4a1b1f358203" containerName="util"
Jul 21 00:45:55.900685 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:55.900673    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4824daa4-464b-40b1-b403-4a1b1f358203" containerName="util"
Jul 21 00:45:55.900793 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:55.900783    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4824daa4-464b-40b1-b403-4a1b1f358203" containerName="extract"
Jul 21 00:45:55.900862 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:55.900854    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4824daa4-464b-40b1-b403-4a1b1f358203" containerName="extract"
Jul 21 00:45:55.900959 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:55.900950    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4824daa4-464b-40b1-b403-4a1b1f358203" containerName="pull"
Jul 21 00:45:55.901023 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:55.901015    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4824daa4-464b-40b1-b403-4a1b1f358203" containerName="pull"
Jul 21 00:45:55.901265 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:55.901253    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4824daa4-464b-40b1-b403-4a1b1f358203" containerName="extract"
Jul 21 00:45:55.906534 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:55.906498    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-thzm4"
Jul 21 00:45:55.908534 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:55.908508    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 21 00:45:55.908534 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:55.908511    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 21 00:45:55.908930 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:55.908914    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-q7p5w\""
Jul 21 00:45:55.915519 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:55.915488    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-thzm4"]
Jul 21 00:45:55.986407 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:55.986369    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c3c9b93-f8a7-4d2e-a9cd-0200bc2b713d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-thzm4\" (UID: \"1c3c9b93-f8a7-4d2e-a9cd-0200bc2b713d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-thzm4"
Jul 21 00:45:55.986592 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:55.986412    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg5bj\" (UniqueName: \"kubernetes.io/projected/1c3c9b93-f8a7-4d2e-a9cd-0200bc2b713d-kube-api-access-sg5bj\") pod \"cert-manager-operator-controller-manager-55c444bf86-thzm4\" (UID: \"1c3c9b93-f8a7-4d2e-a9cd-0200bc2b713d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-thzm4"
Jul 21 00:45:56.087973 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:56.087935    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c3c9b93-f8a7-4d2e-a9cd-0200bc2b713d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-thzm4\" (UID: \"1c3c9b93-f8a7-4d2e-a9cd-0200bc2b713d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-thzm4"
Jul 21 00:45:56.087973 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:56.087973    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg5bj\" (UniqueName: \"kubernetes.io/projected/1c3c9b93-f8a7-4d2e-a9cd-0200bc2b713d-kube-api-access-sg5bj\") pod \"cert-manager-operator-controller-manager-55c444bf86-thzm4\" (UID: \"1c3c9b93-f8a7-4d2e-a9cd-0200bc2b713d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-thzm4"
Jul 21 00:45:56.088342 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:56.088319    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c3c9b93-f8a7-4d2e-a9cd-0200bc2b713d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-thzm4\" (UID: \"1c3c9b93-f8a7-4d2e-a9cd-0200bc2b713d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-thzm4"
Jul 21 00:45:56.098574 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:56.098551    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg5bj\" (UniqueName: \"kubernetes.io/projected/1c3c9b93-f8a7-4d2e-a9cd-0200bc2b713d-kube-api-access-sg5bj\") pod \"cert-manager-operator-controller-manager-55c444bf86-thzm4\" (UID: \"1c3c9b93-f8a7-4d2e-a9cd-0200bc2b713d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-thzm4"
Jul 21 00:45:56.217075 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:56.217035    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-thzm4"
Jul 21 00:45:56.359273 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:56.359232    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-thzm4"]
Jul 21 00:45:56.363449 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:45:56.363420    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c3c9b93_f8a7_4d2e_a9cd_0200bc2b713d.slice/crio-1dd9171b57f9ca909607e177c19866dab92cdad41847363ef65b0f54f4e09d29 WatchSource:0}: Error finding container 1dd9171b57f9ca909607e177c19866dab92cdad41847363ef65b0f54f4e09d29: Status 404 returned error can't find the container with id 1dd9171b57f9ca909607e177c19866dab92cdad41847363ef65b0f54f4e09d29
Jul 21 00:45:56.650944 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:45:56.650845    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-thzm4" event={"ID":"1c3c9b93-f8a7-4d2e-a9cd-0200bc2b713d","Type":"ContainerStarted","Data":"1dd9171b57f9ca909607e177c19866dab92cdad41847363ef65b0f54f4e09d29"}
Jul 21 00:46:00.669882 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:00.669848    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-thzm4" event={"ID":"1c3c9b93-f8a7-4d2e-a9cd-0200bc2b713d","Type":"ContainerStarted","Data":"1a65382e39fa4acd3d1c78997e97a1ff2664247aa9b91c1eb29be719819f2178"}
Jul 21 00:46:00.687768 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:00.687701    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-thzm4" podStartSLOduration=1.8918729380000001 podStartE2EDuration="5.687677677s" totalImagesPullingTime="3.795804739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:45:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:46:00.68695192 +0000 UTC m=+290.986648342" watchObservedRunningTime="2026-07-21 00:46:00.687677677 +0000 UTC m=+290.987374099"
Jul 21 00:46:01.094325 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.091843    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-k6khx"]
Jul 21 00:46:01.095979 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.095546    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-k6khx"
Jul 21 00:46:01.100361 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.100339    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-65ng9\""
Jul 21 00:46:01.100361 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.100351    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 21 00:46:01.100565 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.100354    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 21 00:46:01.107287 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.107259    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-k6khx"]
Jul 21 00:46:01.235156 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.235114    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f01c5f0a-fb58-46af-893b-e62a36e92379-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-k6khx\" (UID: \"f01c5f0a-fb58-46af-893b-e62a36e92379\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k6khx"
Jul 21 00:46:01.235156 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.235152    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knkcw\" (UniqueName: \"kubernetes.io/projected/f01c5f0a-fb58-46af-893b-e62a36e92379-kube-api-access-knkcw\") pod \"cert-manager-webhook-6486ffd997-k6khx\" (UID: \"f01c5f0a-fb58-46af-893b-e62a36e92379\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k6khx"
Jul 21 00:46:01.294162 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.294123    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6"]
Jul 21 00:46:01.296879 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.296856    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6"
Jul 21 00:46:01.298726 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.298699    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 00:46:01.298863 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.298780    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 00:46:01.298920 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.298862    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ms6gv\""
Jul 21 00:46:01.307744 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.307714    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6"]
Jul 21 00:46:01.336392 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.336359    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f01c5f0a-fb58-46af-893b-e62a36e92379-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-k6khx\" (UID: \"f01c5f0a-fb58-46af-893b-e62a36e92379\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k6khx"
Jul 21 00:46:01.336392 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.336396    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knkcw\" (UniqueName: \"kubernetes.io/projected/f01c5f0a-fb58-46af-893b-e62a36e92379-kube-api-access-knkcw\") pod \"cert-manager-webhook-6486ffd997-k6khx\" (UID: \"f01c5f0a-fb58-46af-893b-e62a36e92379\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k6khx"
Jul 21 00:46:01.349275 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.349208    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f01c5f0a-fb58-46af-893b-e62a36e92379-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-k6khx\" (UID: \"f01c5f0a-fb58-46af-893b-e62a36e92379\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k6khx"
Jul 21 00:46:01.349488 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.349463    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knkcw\" (UniqueName: \"kubernetes.io/projected/f01c5f0a-fb58-46af-893b-e62a36e92379-kube-api-access-knkcw\") pod \"cert-manager-webhook-6486ffd997-k6khx\" (UID: \"f01c5f0a-fb58-46af-893b-e62a36e92379\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k6khx"
Jul 21 00:46:01.417550 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.417508    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-k6khx"
Jul 21 00:46:01.436901 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.436865    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x69c4\" (UniqueName: \"kubernetes.io/projected/b2e1ad2b-8c62-481e-882a-12f8b8381d9d-kube-api-access-x69c4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6\" (UID: \"b2e1ad2b-8c62-481e-882a-12f8b8381d9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6"
Jul 21 00:46:01.437077 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.436927    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2e1ad2b-8c62-481e-882a-12f8b8381d9d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6\" (UID: \"b2e1ad2b-8c62-481e-882a-12f8b8381d9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6"
Jul 21 00:46:01.437077 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.436956    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2e1ad2b-8c62-481e-882a-12f8b8381d9d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6\" (UID: \"b2e1ad2b-8c62-481e-882a-12f8b8381d9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6"
Jul 21 00:46:01.538045 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.538010    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x69c4\" (UniqueName: \"kubernetes.io/projected/b2e1ad2b-8c62-481e-882a-12f8b8381d9d-kube-api-access-x69c4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6\" (UID: \"b2e1ad2b-8c62-481e-882a-12f8b8381d9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6"
Jul 21 00:46:01.538226 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.538060    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2e1ad2b-8c62-481e-882a-12f8b8381d9d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6\" (UID: \"b2e1ad2b-8c62-481e-882a-12f8b8381d9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6"
Jul 21 00:46:01.538226 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.538083    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2e1ad2b-8c62-481e-882a-12f8b8381d9d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6\" (UID: \"b2e1ad2b-8c62-481e-882a-12f8b8381d9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6"
Jul 21 00:46:01.538430 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.538416    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2e1ad2b-8c62-481e-882a-12f8b8381d9d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6\" (UID: \"b2e1ad2b-8c62-481e-882a-12f8b8381d9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6"
Jul 21 00:46:01.538470 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.538447    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2e1ad2b-8c62-481e-882a-12f8b8381d9d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6\" (UID: \"b2e1ad2b-8c62-481e-882a-12f8b8381d9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6"
Jul 21 00:46:01.547890 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.547854    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x69c4\" (UniqueName: \"kubernetes.io/projected/b2e1ad2b-8c62-481e-882a-12f8b8381d9d-kube-api-access-x69c4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6\" (UID: \"b2e1ad2b-8c62-481e-882a-12f8b8381d9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6"
Jul 21 00:46:01.559599 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.559571    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-k6khx"]
Jul 21 00:46:01.562016 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:46:01.561989    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf01c5f0a_fb58_46af_893b_e62a36e92379.slice/crio-6845659054d4b6b442130a7ee6d6033457dc3215807789f9d621cedd70cc6ddd WatchSource:0}: Error finding container 6845659054d4b6b442130a7ee6d6033457dc3215807789f9d621cedd70cc6ddd: Status 404 returned error can't find the container with id 6845659054d4b6b442130a7ee6d6033457dc3215807789f9d621cedd70cc6ddd
Jul 21 00:46:01.606363 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.606278    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6"
Jul 21 00:46:01.676390 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.676351    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-k6khx" event={"ID":"f01c5f0a-fb58-46af-893b-e62a36e92379","Type":"ContainerStarted","Data":"6845659054d4b6b442130a7ee6d6033457dc3215807789f9d621cedd70cc6ddd"}
Jul 21 00:46:01.741194 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:01.741164    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6"]
Jul 21 00:46:01.744706 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:46:01.744678    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e1ad2b_8c62_481e_882a_12f8b8381d9d.slice/crio-357f34ccbb67621caae5e72c9fbdc10cef1d2aa4d289cb47a0299af462edc163 WatchSource:0}: Error finding container 357f34ccbb67621caae5e72c9fbdc10cef1d2aa4d289cb47a0299af462edc163: Status 404 returned error can't find the container with id 357f34ccbb67621caae5e72c9fbdc10cef1d2aa4d289cb47a0299af462edc163
Jul 21 00:46:02.682174 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:02.682141    2582 generic.go:356] "Generic (PLEG): container finished" podID="b2e1ad2b-8c62-481e-882a-12f8b8381d9d" containerID="2e2879962397a502d4d69fd01b1e7288a4f790daf286936a545eb482ffbb37e8" exitCode=0
Jul 21 00:46:02.682634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:02.682222    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6" event={"ID":"b2e1ad2b-8c62-481e-882a-12f8b8381d9d","Type":"ContainerDied","Data":"2e2879962397a502d4d69fd01b1e7288a4f790daf286936a545eb482ffbb37e8"}
Jul 21 00:46:02.682634 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:02.682283    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6" event={"ID":"b2e1ad2b-8c62-481e-882a-12f8b8381d9d","Type":"ContainerStarted","Data":"357f34ccbb67621caae5e72c9fbdc10cef1d2aa4d289cb47a0299af462edc163"}
Jul 21 00:46:05.699340 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:05.699302    2582 generic.go:356] "Generic (PLEG): container finished" podID="b2e1ad2b-8c62-481e-882a-12f8b8381d9d" containerID="c0148eb52adf2c798e492abfdf38ac890da2c291589dbcab712c2d1dd99a2204" exitCode=0
Jul 21 00:46:05.699340 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:05.699335    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6" event={"ID":"b2e1ad2b-8c62-481e-882a-12f8b8381d9d","Type":"ContainerDied","Data":"c0148eb52adf2c798e492abfdf38ac890da2c291589dbcab712c2d1dd99a2204"}
Jul 21 00:46:06.705894 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:06.705859    2582 generic.go:356] "Generic (PLEG): container finished" podID="b2e1ad2b-8c62-481e-882a-12f8b8381d9d" containerID="5bd1a58571c1fa2814fcce28c8642c3f19497c2c39a25a073ed6fb6de42ae42c" exitCode=0
Jul 21 00:46:06.705894 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:06.705897    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6" event={"ID":"b2e1ad2b-8c62-481e-882a-12f8b8381d9d","Type":"ContainerDied","Data":"5bd1a58571c1fa2814fcce28c8642c3f19497c2c39a25a073ed6fb6de42ae42c"}
Jul 21 00:46:07.850379 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:07.850348    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6"
Jul 21 00:46:07.889531 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:07.889498    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2e1ad2b-8c62-481e-882a-12f8b8381d9d-util\") pod \"b2e1ad2b-8c62-481e-882a-12f8b8381d9d\" (UID: \"b2e1ad2b-8c62-481e-882a-12f8b8381d9d\") "
Jul 21 00:46:07.889733 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:07.889547    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x69c4\" (UniqueName: \"kubernetes.io/projected/b2e1ad2b-8c62-481e-882a-12f8b8381d9d-kube-api-access-x69c4\") pod \"b2e1ad2b-8c62-481e-882a-12f8b8381d9d\" (UID: \"b2e1ad2b-8c62-481e-882a-12f8b8381d9d\") "
Jul 21 00:46:07.889733 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:07.889623    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2e1ad2b-8c62-481e-882a-12f8b8381d9d-bundle\") pod \"b2e1ad2b-8c62-481e-882a-12f8b8381d9d\" (UID: \"b2e1ad2b-8c62-481e-882a-12f8b8381d9d\") "
Jul 21 00:46:07.890023 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:07.889989    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2e1ad2b-8c62-481e-882a-12f8b8381d9d-bundle" (OuterVolumeSpecName: "bundle") pod "b2e1ad2b-8c62-481e-882a-12f8b8381d9d" (UID: "b2e1ad2b-8c62-481e-882a-12f8b8381d9d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 00:46:07.891704 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:07.891679    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2e1ad2b-8c62-481e-882a-12f8b8381d9d-kube-api-access-x69c4" (OuterVolumeSpecName: "kube-api-access-x69c4") pod "b2e1ad2b-8c62-481e-882a-12f8b8381d9d" (UID: "b2e1ad2b-8c62-481e-882a-12f8b8381d9d"). InnerVolumeSpecName "kube-api-access-x69c4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:46:07.894420 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:07.894388    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2e1ad2b-8c62-481e-882a-12f8b8381d9d-util" (OuterVolumeSpecName: "util") pod "b2e1ad2b-8c62-481e-882a-12f8b8381d9d" (UID: "b2e1ad2b-8c62-481e-882a-12f8b8381d9d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 00:46:07.990228 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:07.990134    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2e1ad2b-8c62-481e-882a-12f8b8381d9d-bundle\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:46:07.990228 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:07.990166    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2e1ad2b-8c62-481e-882a-12f8b8381d9d-util\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:46:07.990228 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:07.990176    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x69c4\" (UniqueName: \"kubernetes.io/projected/b2e1ad2b-8c62-481e-882a-12f8b8381d9d-kube-api-access-x69c4\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:46:08.719083 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:08.719039    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6" event={"ID":"b2e1ad2b-8c62-481e-882a-12f8b8381d9d","Type":"ContainerDied","Data":"357f34ccbb67621caae5e72c9fbdc10cef1d2aa4d289cb47a0299af462edc163"}
Jul 21 00:46:08.719083 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:08.719074    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg5bs6"
Jul 21 00:46:08.719340 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:08.719105    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="357f34ccbb67621caae5e72c9fbdc10cef1d2aa4d289cb47a0299af462edc163"
Jul 21 00:46:09.066195 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:09.066109    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-256fz"]
Jul 21 00:46:09.066632 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:09.066527    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2e1ad2b-8c62-481e-882a-12f8b8381d9d" containerName="extract"
Jul 21 00:46:09.066632 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:09.066544    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2e1ad2b-8c62-481e-882a-12f8b8381d9d" containerName="extract"
Jul 21 00:46:09.066632 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:09.066586    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2e1ad2b-8c62-481e-882a-12f8b8381d9d" containerName="util"
Jul 21 00:46:09.066632 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:09.066596    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2e1ad2b-8c62-481e-882a-12f8b8381d9d" containerName="util"
Jul 21 00:46:09.066632 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:09.066604    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2e1ad2b-8c62-481e-882a-12f8b8381d9d" containerName="pull"
Jul 21 00:46:09.066632 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:09.066613    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2e1ad2b-8c62-481e-882a-12f8b8381d9d" containerName="pull"
Jul 21 00:46:09.066993 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:09.066776    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2e1ad2b-8c62-481e-882a-12f8b8381d9d" containerName="extract"
Jul 21 00:46:09.069466 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:09.069445    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-256fz"
Jul 21 00:46:09.071503 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:09.071477    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-rk72s\""
Jul 21 00:46:09.079587 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:09.079559    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-256fz"]
Jul 21 00:46:09.099539 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:09.099499    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn8sf\" (UniqueName: \"kubernetes.io/projected/d72ad145-625b-4289-b559-b4a9713977bb-kube-api-access-tn8sf\") pod \"cert-manager-cainjector-559cdd8c87-256fz\" (UID: \"d72ad145-625b-4289-b559-b4a9713977bb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-256fz"
Jul 21 00:46:09.099733 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:09.099555    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d72ad145-625b-4289-b559-b4a9713977bb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-256fz\" (UID: \"d72ad145-625b-4289-b559-b4a9713977bb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-256fz"
Jul 21 00:46:09.200236 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:09.200188    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn8sf\" (UniqueName: \"kubernetes.io/projected/d72ad145-625b-4289-b559-b4a9713977bb-kube-api-access-tn8sf\") pod \"cert-manager-cainjector-559cdd8c87-256fz\" (UID: \"d72ad145-625b-4289-b559-b4a9713977bb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-256fz"
Jul 21 00:46:09.200466 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:09.200244    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d72ad145-625b-4289-b559-b4a9713977bb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-256fz\" (UID: \"d72ad145-625b-4289-b559-b4a9713977bb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-256fz"
Jul 21 00:46:09.208903 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:09.208858    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d72ad145-625b-4289-b559-b4a9713977bb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-256fz\" (UID: \"d72ad145-625b-4289-b559-b4a9713977bb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-256fz"
Jul 21 00:46:09.209091 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:09.209062    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn8sf\" (UniqueName: \"kubernetes.io/projected/d72ad145-625b-4289-b559-b4a9713977bb-kube-api-access-tn8sf\") pod \"cert-manager-cainjector-559cdd8c87-256fz\" (UID: \"d72ad145-625b-4289-b559-b4a9713977bb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-256fz"
Jul 21 00:46:09.381624 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:09.381595    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-256fz"
Jul 21 00:46:09.513778 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:09.513744    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-256fz"]
Jul 21 00:46:09.517640 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:46:09.517612    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd72ad145_625b_4289_b559_b4a9713977bb.slice/crio-3560a2cc3a4f2c8e86fd9c44ec6364e16cc946d68db6391a9f758ca804904572 WatchSource:0}: Error finding container 3560a2cc3a4f2c8e86fd9c44ec6364e16cc946d68db6391a9f758ca804904572: Status 404 returned error can't find the container with id 3560a2cc3a4f2c8e86fd9c44ec6364e16cc946d68db6391a9f758ca804904572
Jul 21 00:46:09.726258 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:09.726226    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-k6khx" event={"ID":"f01c5f0a-fb58-46af-893b-e62a36e92379","Type":"ContainerStarted","Data":"955b4c2d71e6626dc9b7b6a37b254f51501a83ce62bd66672a44c4ff4577330a"}
Jul 21 00:46:09.726483 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:09.726304    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-k6khx"
Jul 21 00:46:09.728008 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:09.727978    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-256fz" event={"ID":"d72ad145-625b-4289-b559-b4a9713977bb","Type":"ContainerStarted","Data":"ddc381eb8fbc58b215fbba6618abd298eeeb78b212fd7e3d432499bca2e69685"}
Jul 21 00:46:09.728008 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:09.728010    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-256fz" event={"ID":"d72ad145-625b-4289-b559-b4a9713977bb","Type":"ContainerStarted","Data":"3560a2cc3a4f2c8e86fd9c44ec6364e16cc946d68db6391a9f758ca804904572"}
Jul 21 00:46:09.743770 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:09.743713    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-k6khx" podStartSLOduration=1.020146123 podStartE2EDuration="8.743694307s" totalImagesPullingTime="7.723548184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:46:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:46:09.74143399 +0000 UTC m=+300.041130410" watchObservedRunningTime="2026-07-21 00:46:09.743694307 +0000 UTC m=+300.043390728"
Jul 21 00:46:09.757728 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:09.757662    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-256fz" podStartSLOduration=0.757627162 podStartE2EDuration="757.627162ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:46:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:46:09.755683114 +0000 UTC m=+300.055379538" watchObservedRunningTime="2026-07-21 00:46:09.757627162 +0000 UTC m=+300.057323582"
Jul 21 00:46:10.189827 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:10.189798    2582 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 00:46:12.146440 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:12.146403    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-f6wz6"]
Jul 21 00:46:12.148506 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:12.148490    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-f6wz6"
Jul 21 00:46:12.150093 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:12.150073    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-2gwmc\""
Jul 21 00:46:12.158609 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:12.158583    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-f6wz6"]
Jul 21 00:46:12.223495 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:12.223457    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6jfv\" (UniqueName: \"kubernetes.io/projected/532e7fd0-3ee1-4d7a-9c37-bca4b5432cc9-kube-api-access-b6jfv\") pod \"cert-manager-55b4d954d5-f6wz6\" (UID: \"532e7fd0-3ee1-4d7a-9c37-bca4b5432cc9\") " pod="cert-manager/cert-manager-55b4d954d5-f6wz6"
Jul 21 00:46:12.223709 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:12.223504    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/532e7fd0-3ee1-4d7a-9c37-bca4b5432cc9-bound-sa-token\") pod \"cert-manager-55b4d954d5-f6wz6\" (UID: \"532e7fd0-3ee1-4d7a-9c37-bca4b5432cc9\") " pod="cert-manager/cert-manager-55b4d954d5-f6wz6"
Jul 21 00:46:12.325003 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:12.324951    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6jfv\" (UniqueName: \"kubernetes.io/projected/532e7fd0-3ee1-4d7a-9c37-bca4b5432cc9-kube-api-access-b6jfv\") pod \"cert-manager-55b4d954d5-f6wz6\" (UID: \"532e7fd0-3ee1-4d7a-9c37-bca4b5432cc9\") " pod="cert-manager/cert-manager-55b4d954d5-f6wz6"
Jul 21 00:46:12.325003 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:12.325013    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/532e7fd0-3ee1-4d7a-9c37-bca4b5432cc9-bound-sa-token\") pod \"cert-manager-55b4d954d5-f6wz6\" (UID: \"532e7fd0-3ee1-4d7a-9c37-bca4b5432cc9\") " pod="cert-manager/cert-manager-55b4d954d5-f6wz6"
Jul 21 00:46:12.332233 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:12.332198    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/532e7fd0-3ee1-4d7a-9c37-bca4b5432cc9-bound-sa-token\") pod \"cert-manager-55b4d954d5-f6wz6\" (UID: \"532e7fd0-3ee1-4d7a-9c37-bca4b5432cc9\") " pod="cert-manager/cert-manager-55b4d954d5-f6wz6"
Jul 21 00:46:12.332485 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:12.332461    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6jfv\" (UniqueName: \"kubernetes.io/projected/532e7fd0-3ee1-4d7a-9c37-bca4b5432cc9-kube-api-access-b6jfv\") pod \"cert-manager-55b4d954d5-f6wz6\" (UID: \"532e7fd0-3ee1-4d7a-9c37-bca4b5432cc9\") " pod="cert-manager/cert-manager-55b4d954d5-f6wz6"
Jul 21 00:46:12.458818 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:12.458784    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-f6wz6"
Jul 21 00:46:12.593552 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:12.593524    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-f6wz6"]
Jul 21 00:46:12.596181 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:46:12.596153    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod532e7fd0_3ee1_4d7a_9c37_bca4b5432cc9.slice/crio-780a4bd529b773cce0b607b686db99eadb0b5d8cac847641c8ce157f76c7a6dc WatchSource:0}: Error finding container 780a4bd529b773cce0b607b686db99eadb0b5d8cac847641c8ce157f76c7a6dc: Status 404 returned error can't find the container with id 780a4bd529b773cce0b607b686db99eadb0b5d8cac847641c8ce157f76c7a6dc
Jul 21 00:46:12.742927 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:12.742838    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-f6wz6" event={"ID":"532e7fd0-3ee1-4d7a-9c37-bca4b5432cc9","Type":"ContainerStarted","Data":"8b32843dbc983b4d6540cf3fe78914034b7e01cd13317a3681b6232ffdd42314"}
Jul 21 00:46:12.742927 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:12.742886    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-f6wz6" event={"ID":"532e7fd0-3ee1-4d7a-9c37-bca4b5432cc9","Type":"ContainerStarted","Data":"780a4bd529b773cce0b607b686db99eadb0b5d8cac847641c8ce157f76c7a6dc"}
Jul 21 00:46:12.756838 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:12.756778    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-f6wz6" podStartSLOduration=0.756758442 podStartE2EDuration="756.758442ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:46:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:46:12.755595461 +0000 UTC m=+303.055291885" watchObservedRunningTime="2026-07-21 00:46:12.756758442 +0000 UTC m=+303.056454863"
Jul 21 00:46:15.078207 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:15.078171    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tcwpb"]
Jul 21 00:46:15.082659 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:15.082620    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tcwpb"
Jul 21 00:46:15.084492 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:15.084467    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 00:46:15.084608 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:15.084513    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 00:46:15.084608 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:15.084537    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-mpv5v\""
Jul 21 00:46:15.090428 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:15.090401    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tcwpb"]
Jul 21 00:46:15.148183 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:15.148149    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2475b781-6569-461a-ae48-3973d95fe19c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tcwpb\" (UID: \"2475b781-6569-461a-ae48-3973d95fe19c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tcwpb"
Jul 21 00:46:15.148183 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:15.148188    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvmft\" (UniqueName: \"kubernetes.io/projected/2475b781-6569-461a-ae48-3973d95fe19c-kube-api-access-nvmft\") pod \"openshift-lws-operator-fd8ccff4c-tcwpb\" (UID: \"2475b781-6569-461a-ae48-3973d95fe19c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tcwpb"
Jul 21 00:46:15.249272 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:15.249235    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2475b781-6569-461a-ae48-3973d95fe19c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tcwpb\" (UID: \"2475b781-6569-461a-ae48-3973d95fe19c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tcwpb"
Jul 21 00:46:15.249272 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:15.249275    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvmft\" (UniqueName: \"kubernetes.io/projected/2475b781-6569-461a-ae48-3973d95fe19c-kube-api-access-nvmft\") pod \"openshift-lws-operator-fd8ccff4c-tcwpb\" (UID: \"2475b781-6569-461a-ae48-3973d95fe19c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tcwpb"
Jul 21 00:46:15.249641 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:15.249621    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2475b781-6569-461a-ae48-3973d95fe19c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tcwpb\" (UID: \"2475b781-6569-461a-ae48-3973d95fe19c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tcwpb"
Jul 21 00:46:15.256705 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:15.256678    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvmft\" (UniqueName: \"kubernetes.io/projected/2475b781-6569-461a-ae48-3973d95fe19c-kube-api-access-nvmft\") pod \"openshift-lws-operator-fd8ccff4c-tcwpb\" (UID: \"2475b781-6569-461a-ae48-3973d95fe19c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tcwpb"
Jul 21 00:46:15.393714 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:15.393603    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tcwpb"
Jul 21 00:46:15.530938 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:15.530882    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tcwpb"]
Jul 21 00:46:15.535265 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:46:15.535232    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2475b781_6569_461a_ae48_3973d95fe19c.slice/crio-61ceba23f83f15924ca7d0215448b7ef0325551d130f695b5f33569dde96fecc WatchSource:0}: Error finding container 61ceba23f83f15924ca7d0215448b7ef0325551d130f695b5f33569dde96fecc: Status 404 returned error can't find the container with id 61ceba23f83f15924ca7d0215448b7ef0325551d130f695b5f33569dde96fecc
Jul 21 00:46:15.537983 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:15.537964    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 00:46:15.734301 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:15.734266    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-k6khx"
Jul 21 00:46:15.759564 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:15.759529    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tcwpb" event={"ID":"2475b781-6569-461a-ae48-3973d95fe19c","Type":"ContainerStarted","Data":"61ceba23f83f15924ca7d0215448b7ef0325551d130f695b5f33569dde96fecc"}
Jul 21 00:46:29.832158 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:29.832118    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tcwpb" event={"ID":"2475b781-6569-461a-ae48-3973d95fe19c","Type":"ContainerStarted","Data":"fee4978b8fabfd0a2a36dda71684f10892be4b316162ce5e1b493efbd3db01dc"}
Jul 21 00:46:29.845830 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:29.845767    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tcwpb" podStartSLOduration=1.5621377669999998 podStartE2EDuration="14.84574484s" totalImagesPullingTime="13.283607073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:46:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:46:29.844859485 +0000 UTC m=+320.144555907" watchObservedRunningTime="2026-07-21 00:46:29.84574484 +0000 UTC m=+320.145441261"
Jul 21 00:46:32.245026 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:32.244990    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx"]
Jul 21 00:46:32.247787 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:32.247766    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx"
Jul 21 00:46:32.249803 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:32.249778    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 00:46:32.249917 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:32.249826    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 00:46:32.249917 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:32.249913    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ms6gv\""
Jul 21 00:46:32.258032 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:32.258006    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx"]
Jul 21 00:46:32.309729 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:32.309695    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95362ed1-eb6b-4fce-b85b-7ad020a5d397-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx\" (UID: \"95362ed1-eb6b-4fce-b85b-7ad020a5d397\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx"
Jul 21 00:46:32.309915 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:32.309746    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7jdt\" (UniqueName: \"kubernetes.io/projected/95362ed1-eb6b-4fce-b85b-7ad020a5d397-kube-api-access-v7jdt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx\" (UID: \"95362ed1-eb6b-4fce-b85b-7ad020a5d397\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx"
Jul 21 00:46:32.309915 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:32.309840    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95362ed1-eb6b-4fce-b85b-7ad020a5d397-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx\" (UID: \"95362ed1-eb6b-4fce-b85b-7ad020a5d397\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx"
Jul 21 00:46:32.410955 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:32.410917    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7jdt\" (UniqueName: \"kubernetes.io/projected/95362ed1-eb6b-4fce-b85b-7ad020a5d397-kube-api-access-v7jdt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx\" (UID: \"95362ed1-eb6b-4fce-b85b-7ad020a5d397\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx"
Jul 21 00:46:32.411151 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:32.411064    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95362ed1-eb6b-4fce-b85b-7ad020a5d397-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx\" (UID: \"95362ed1-eb6b-4fce-b85b-7ad020a5d397\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx"
Jul 21 00:46:32.411400 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:32.411373    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95362ed1-eb6b-4fce-b85b-7ad020a5d397-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx\" (UID: \"95362ed1-eb6b-4fce-b85b-7ad020a5d397\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx"
Jul 21 00:46:32.411486 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:32.411430    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95362ed1-eb6b-4fce-b85b-7ad020a5d397-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx\" (UID: \"95362ed1-eb6b-4fce-b85b-7ad020a5d397\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx"
Jul 21 00:46:32.411747 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:32.411723    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95362ed1-eb6b-4fce-b85b-7ad020a5d397-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx\" (UID: \"95362ed1-eb6b-4fce-b85b-7ad020a5d397\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx"
Jul 21 00:46:32.418179 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:32.418154    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7jdt\" (UniqueName: \"kubernetes.io/projected/95362ed1-eb6b-4fce-b85b-7ad020a5d397-kube-api-access-v7jdt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx\" (UID: \"95362ed1-eb6b-4fce-b85b-7ad020a5d397\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx"
Jul 21 00:46:32.558155 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:32.558058    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx"
Jul 21 00:46:32.699031 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:32.698953    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx"]
Jul 21 00:46:32.701357 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:46:32.701311    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95362ed1_eb6b_4fce_b85b_7ad020a5d397.slice/crio-cab2022fb7a23e0fa5f4c39a142fd38505fbb470875445b18632bdb63b678248 WatchSource:0}: Error finding container cab2022fb7a23e0fa5f4c39a142fd38505fbb470875445b18632bdb63b678248: Status 404 returned error can't find the container with id cab2022fb7a23e0fa5f4c39a142fd38505fbb470875445b18632bdb63b678248
Jul 21 00:46:32.847740 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:32.847626    2582 generic.go:356] "Generic (PLEG): container finished" podID="95362ed1-eb6b-4fce-b85b-7ad020a5d397" containerID="b6fd08ecc2a41ee9dcb0f8d672f1fdb6442c9019678a02fb4c36a3a4c56f55ee" exitCode=0
Jul 21 00:46:32.847740 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:32.847685    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx" event={"ID":"95362ed1-eb6b-4fce-b85b-7ad020a5d397","Type":"ContainerDied","Data":"b6fd08ecc2a41ee9dcb0f8d672f1fdb6442c9019678a02fb4c36a3a4c56f55ee"}
Jul 21 00:46:32.847950 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:32.847750    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx" event={"ID":"95362ed1-eb6b-4fce-b85b-7ad020a5d397","Type":"ContainerStarted","Data":"cab2022fb7a23e0fa5f4c39a142fd38505fbb470875445b18632bdb63b678248"}
Jul 21 00:46:33.854864 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:33.854826    2582 generic.go:356] "Generic (PLEG): container finished" podID="95362ed1-eb6b-4fce-b85b-7ad020a5d397" containerID="0e90ba9234132ce6b860f4242cc14b42f415cb8b35fabae508186c23ced7d912" exitCode=0
Jul 21 00:46:33.855269 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:33.854915    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx" event={"ID":"95362ed1-eb6b-4fce-b85b-7ad020a5d397","Type":"ContainerDied","Data":"0e90ba9234132ce6b860f4242cc14b42f415cb8b35fabae508186c23ced7d912"}
Jul 21 00:46:34.861677 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:34.861628    2582 generic.go:356] "Generic (PLEG): container finished" podID="95362ed1-eb6b-4fce-b85b-7ad020a5d397" containerID="238f9ef8465d8892ee57a4e06dc232c86a3f2bb80cddc4946ce7c63fb254e066" exitCode=0
Jul 21 00:46:34.862092 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:34.861712    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx" event={"ID":"95362ed1-eb6b-4fce-b85b-7ad020a5d397","Type":"ContainerDied","Data":"238f9ef8465d8892ee57a4e06dc232c86a3f2bb80cddc4946ce7c63fb254e066"}
Jul 21 00:46:36.000664 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:36.000632    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx"
Jul 21 00:46:36.146468 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:36.146378    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95362ed1-eb6b-4fce-b85b-7ad020a5d397-bundle\") pod \"95362ed1-eb6b-4fce-b85b-7ad020a5d397\" (UID: \"95362ed1-eb6b-4fce-b85b-7ad020a5d397\") "
Jul 21 00:46:36.146468 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:36.146467    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7jdt\" (UniqueName: \"kubernetes.io/projected/95362ed1-eb6b-4fce-b85b-7ad020a5d397-kube-api-access-v7jdt\") pod \"95362ed1-eb6b-4fce-b85b-7ad020a5d397\" (UID: \"95362ed1-eb6b-4fce-b85b-7ad020a5d397\") "
Jul 21 00:46:36.146706 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:36.146533    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95362ed1-eb6b-4fce-b85b-7ad020a5d397-util\") pod \"95362ed1-eb6b-4fce-b85b-7ad020a5d397\" (UID: \"95362ed1-eb6b-4fce-b85b-7ad020a5d397\") "
Jul 21 00:46:36.147203 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:36.147173    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95362ed1-eb6b-4fce-b85b-7ad020a5d397-bundle" (OuterVolumeSpecName: "bundle") pod "95362ed1-eb6b-4fce-b85b-7ad020a5d397" (UID: "95362ed1-eb6b-4fce-b85b-7ad020a5d397"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 00:46:36.148631 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:36.148606    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95362ed1-eb6b-4fce-b85b-7ad020a5d397-kube-api-access-v7jdt" (OuterVolumeSpecName: "kube-api-access-v7jdt") pod "95362ed1-eb6b-4fce-b85b-7ad020a5d397" (UID: "95362ed1-eb6b-4fce-b85b-7ad020a5d397"). InnerVolumeSpecName "kube-api-access-v7jdt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:46:36.152360 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:36.152335    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95362ed1-eb6b-4fce-b85b-7ad020a5d397-util" (OuterVolumeSpecName: "util") pod "95362ed1-eb6b-4fce-b85b-7ad020a5d397" (UID: "95362ed1-eb6b-4fce-b85b-7ad020a5d397"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 00:46:36.247742 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:36.247700    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7jdt\" (UniqueName: \"kubernetes.io/projected/95362ed1-eb6b-4fce-b85b-7ad020a5d397-kube-api-access-v7jdt\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:46:36.247742 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:36.247731    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95362ed1-eb6b-4fce-b85b-7ad020a5d397-util\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:46:36.247742 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:36.247741    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95362ed1-eb6b-4fce-b85b-7ad020a5d397-bundle\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:46:36.873341 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:36.873306    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx" event={"ID":"95362ed1-eb6b-4fce-b85b-7ad020a5d397","Type":"ContainerDied","Data":"cab2022fb7a23e0fa5f4c39a142fd38505fbb470875445b18632bdb63b678248"}
Jul 21 00:46:36.873341 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:36.873346    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp78lx"
Jul 21 00:46:36.873560 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:36.873354    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cab2022fb7a23e0fa5f4c39a142fd38505fbb470875445b18632bdb63b678248"
Jul 21 00:46:47.091515 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.091474    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-656b686d8c-2t69n"]
Jul 21 00:46:47.092013 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.091853    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95362ed1-eb6b-4fce-b85b-7ad020a5d397" containerName="pull"
Jul 21 00:46:47.092013 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.091869    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="95362ed1-eb6b-4fce-b85b-7ad020a5d397" containerName="pull"
Jul 21 00:46:47.092013 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.091884    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95362ed1-eb6b-4fce-b85b-7ad020a5d397" containerName="util"
Jul 21 00:46:47.092013 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.091891    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="95362ed1-eb6b-4fce-b85b-7ad020a5d397" containerName="util"
Jul 21 00:46:47.092013 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.091910    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95362ed1-eb6b-4fce-b85b-7ad020a5d397" containerName="extract"
Jul 21 00:46:47.092013 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.091915    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="95362ed1-eb6b-4fce-b85b-7ad020a5d397" containerName="extract"
Jul 21 00:46:47.092013 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.091987    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="95362ed1-eb6b-4fce-b85b-7ad020a5d397" containerName="extract"
Jul 21 00:46:47.094420 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.094400    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-656b686d8c-2t69n"
Jul 21 00:46:47.097087 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.097062    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 21 00:46:47.097087 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.097062    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 21 00:46:47.097305 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.097122    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-dntcs\""
Jul 21 00:46:47.097305 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.097127    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 21 00:46:47.107744 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.107713    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-656b686d8c-2t69n"]
Jul 21 00:46:47.244858 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.244813    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/820d3ed3-5dea-4176-b41e-aeb1a9b47f69-manager-config\") pod \"lws-controller-manager-656b686d8c-2t69n\" (UID: \"820d3ed3-5dea-4176-b41e-aeb1a9b47f69\") " pod="openshift-lws-operator/lws-controller-manager-656b686d8c-2t69n"
Jul 21 00:46:47.245047 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.244896    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/820d3ed3-5dea-4176-b41e-aeb1a9b47f69-metrics-cert\") pod \"lws-controller-manager-656b686d8c-2t69n\" (UID: \"820d3ed3-5dea-4176-b41e-aeb1a9b47f69\") " pod="openshift-lws-operator/lws-controller-manager-656b686d8c-2t69n"
Jul 21 00:46:47.245047 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.244927    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/820d3ed3-5dea-4176-b41e-aeb1a9b47f69-cert\") pod \"lws-controller-manager-656b686d8c-2t69n\" (UID: \"820d3ed3-5dea-4176-b41e-aeb1a9b47f69\") " pod="openshift-lws-operator/lws-controller-manager-656b686d8c-2t69n"
Jul 21 00:46:47.245047 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.244999    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x22mb\" (UniqueName: \"kubernetes.io/projected/820d3ed3-5dea-4176-b41e-aeb1a9b47f69-kube-api-access-x22mb\") pod \"lws-controller-manager-656b686d8c-2t69n\" (UID: \"820d3ed3-5dea-4176-b41e-aeb1a9b47f69\") " pod="openshift-lws-operator/lws-controller-manager-656b686d8c-2t69n"
Jul 21 00:46:47.257744 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.257708    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn"]
Jul 21 00:46:47.260199 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.260177    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn"
Jul 21 00:46:47.264491 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.264468    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 00:46:47.264673 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.264628    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-j5g8w\""
Jul 21 00:46:47.265236 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.265222    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 00:46:47.265630 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.265612    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 00:46:47.265742 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.265615    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 00:46:47.302254 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.302211    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn"]
Jul 21 00:46:47.345798 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.345704    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af57b7ae-99ca-422b-95f5-d7093d336210-tmp\") pod \"opendatahub-operator-controller-manager-5f889c5d8-plgrn\" (UID: \"af57b7ae-99ca-422b-95f5-d7093d336210\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn"
Jul 21 00:46:47.345798 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.345773    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/820d3ed3-5dea-4176-b41e-aeb1a9b47f69-manager-config\") pod \"lws-controller-manager-656b686d8c-2t69n\" (UID: \"820d3ed3-5dea-4176-b41e-aeb1a9b47f69\") " pod="openshift-lws-operator/lws-controller-manager-656b686d8c-2t69n"
Jul 21 00:46:47.345994 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.345836    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/820d3ed3-5dea-4176-b41e-aeb1a9b47f69-metrics-cert\") pod \"lws-controller-manager-656b686d8c-2t69n\" (UID: \"820d3ed3-5dea-4176-b41e-aeb1a9b47f69\") " pod="openshift-lws-operator/lws-controller-manager-656b686d8c-2t69n"
Jul 21 00:46:47.345994 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.345873    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/af57b7ae-99ca-422b-95f5-d7093d336210-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f889c5d8-plgrn\" (UID: \"af57b7ae-99ca-422b-95f5-d7093d336210\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn"
Jul 21 00:46:47.345994 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.345895    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/af57b7ae-99ca-422b-95f5-d7093d336210-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f889c5d8-plgrn\" (UID: \"af57b7ae-99ca-422b-95f5-d7093d336210\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn"
Jul 21 00:46:47.346115 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.345998    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/820d3ed3-5dea-4176-b41e-aeb1a9b47f69-cert\") pod \"lws-controller-manager-656b686d8c-2t69n\" (UID: \"820d3ed3-5dea-4176-b41e-aeb1a9b47f69\") " pod="openshift-lws-operator/lws-controller-manager-656b686d8c-2t69n"
Jul 21 00:46:47.346115 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.346023    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/af57b7ae-99ca-422b-95f5-d7093d336210-manifests\") pod \"opendatahub-operator-controller-manager-5f889c5d8-plgrn\" (UID: \"af57b7ae-99ca-422b-95f5-d7093d336210\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn"
Jul 21 00:46:47.346115 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.346059    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x22mb\" (UniqueName: \"kubernetes.io/projected/820d3ed3-5dea-4176-b41e-aeb1a9b47f69-kube-api-access-x22mb\") pod \"lws-controller-manager-656b686d8c-2t69n\" (UID: \"820d3ed3-5dea-4176-b41e-aeb1a9b47f69\") " pod="openshift-lws-operator/lws-controller-manager-656b686d8c-2t69n"
Jul 21 00:46:47.346115 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.346081    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhwrc\" (UniqueName: \"kubernetes.io/projected/af57b7ae-99ca-422b-95f5-d7093d336210-kube-api-access-dhwrc\") pod \"opendatahub-operator-controller-manager-5f889c5d8-plgrn\" (UID: \"af57b7ae-99ca-422b-95f5-d7093d336210\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn"
Jul 21 00:46:47.346469 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.346444    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/820d3ed3-5dea-4176-b41e-aeb1a9b47f69-manager-config\") pod \"lws-controller-manager-656b686d8c-2t69n\" (UID: \"820d3ed3-5dea-4176-b41e-aeb1a9b47f69\") " pod="openshift-lws-operator/lws-controller-manager-656b686d8c-2t69n"
Jul 21 00:46:47.348574 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.348553    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/820d3ed3-5dea-4176-b41e-aeb1a9b47f69-cert\") pod \"lws-controller-manager-656b686d8c-2t69n\" (UID: \"820d3ed3-5dea-4176-b41e-aeb1a9b47f69\") " pod="openshift-lws-operator/lws-controller-manager-656b686d8c-2t69n"
Jul 21 00:46:47.348672 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.348556    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/820d3ed3-5dea-4176-b41e-aeb1a9b47f69-metrics-cert\") pod \"lws-controller-manager-656b686d8c-2t69n\" (UID: \"820d3ed3-5dea-4176-b41e-aeb1a9b47f69\") " pod="openshift-lws-operator/lws-controller-manager-656b686d8c-2t69n"
Jul 21 00:46:47.359782 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.359752    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x22mb\" (UniqueName: \"kubernetes.io/projected/820d3ed3-5dea-4176-b41e-aeb1a9b47f69-kube-api-access-x22mb\") pod \"lws-controller-manager-656b686d8c-2t69n\" (UID: \"820d3ed3-5dea-4176-b41e-aeb1a9b47f69\") " pod="openshift-lws-operator/lws-controller-manager-656b686d8c-2t69n"
Jul 21 00:46:47.404822 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.404776    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-656b686d8c-2t69n"
Jul 21 00:46:47.447535 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.447500    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af57b7ae-99ca-422b-95f5-d7093d336210-tmp\") pod \"opendatahub-operator-controller-manager-5f889c5d8-plgrn\" (UID: \"af57b7ae-99ca-422b-95f5-d7093d336210\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn"
Jul 21 00:46:47.447769 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.447568    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/af57b7ae-99ca-422b-95f5-d7093d336210-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f889c5d8-plgrn\" (UID: \"af57b7ae-99ca-422b-95f5-d7093d336210\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn"
Jul 21 00:46:47.447769 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.447589    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/af57b7ae-99ca-422b-95f5-d7093d336210-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f889c5d8-plgrn\" (UID: \"af57b7ae-99ca-422b-95f5-d7093d336210\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn"
Jul 21 00:46:47.447769 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.447608    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/af57b7ae-99ca-422b-95f5-d7093d336210-manifests\") pod \"opendatahub-operator-controller-manager-5f889c5d8-plgrn\" (UID: \"af57b7ae-99ca-422b-95f5-d7093d336210\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn"
Jul 21 00:46:47.447769 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.447665    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhwrc\" (UniqueName: \"kubernetes.io/projected/af57b7ae-99ca-422b-95f5-d7093d336210-kube-api-access-dhwrc\") pod \"opendatahub-operator-controller-manager-5f889c5d8-plgrn\" (UID: \"af57b7ae-99ca-422b-95f5-d7093d336210\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn"
Jul 21 00:46:47.448095 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.448061    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/af57b7ae-99ca-422b-95f5-d7093d336210-manifests\") pod \"opendatahub-operator-controller-manager-5f889c5d8-plgrn\" (UID: \"af57b7ae-99ca-422b-95f5-d7093d336210\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn"
Jul 21 00:46:47.450035 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.450007    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af57b7ae-99ca-422b-95f5-d7093d336210-tmp\") pod \"opendatahub-operator-controller-manager-5f889c5d8-plgrn\" (UID: \"af57b7ae-99ca-422b-95f5-d7093d336210\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn"
Jul 21 00:46:47.450192 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.450175    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/af57b7ae-99ca-422b-95f5-d7093d336210-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f889c5d8-plgrn\" (UID: \"af57b7ae-99ca-422b-95f5-d7093d336210\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn"
Jul 21 00:46:47.450235 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.450221    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/af57b7ae-99ca-422b-95f5-d7093d336210-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f889c5d8-plgrn\" (UID: \"af57b7ae-99ca-422b-95f5-d7093d336210\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn"
Jul 21 00:46:47.468192 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.468125    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhwrc\" (UniqueName: \"kubernetes.io/projected/af57b7ae-99ca-422b-95f5-d7093d336210-kube-api-access-dhwrc\") pod \"opendatahub-operator-controller-manager-5f889c5d8-plgrn\" (UID: \"af57b7ae-99ca-422b-95f5-d7093d336210\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn"
Jul 21 00:46:47.557369 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.557336    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-656b686d8c-2t69n"]
Jul 21 00:46:47.559795 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:46:47.559770    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod820d3ed3_5dea_4176_b41e_aeb1a9b47f69.slice/crio-7fc036a37952ea34b6ff57f3b6d42575d1b0735272ca42d10918e4dda3ab4522 WatchSource:0}: Error finding container 7fc036a37952ea34b6ff57f3b6d42575d1b0735272ca42d10918e4dda3ab4522: Status 404 returned error can't find the container with id 7fc036a37952ea34b6ff57f3b6d42575d1b0735272ca42d10918e4dda3ab4522
Jul 21 00:46:47.571026 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.570994    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn"
Jul 21 00:46:47.712532 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.712505    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn"]
Jul 21 00:46:47.715291 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:46:47.715265    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf57b7ae_99ca_422b_95f5_d7093d336210.slice/crio-33bb85b396d57502d34e499790fd7d64e88cac874f95aecf79db36b1011fcb63 WatchSource:0}: Error finding container 33bb85b396d57502d34e499790fd7d64e88cac874f95aecf79db36b1011fcb63: Status 404 returned error can't find the container with id 33bb85b396d57502d34e499790fd7d64e88cac874f95aecf79db36b1011fcb63
Jul 21 00:46:47.928778 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.928744    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-656b686d8c-2t69n" event={"ID":"820d3ed3-5dea-4176-b41e-aeb1a9b47f69","Type":"ContainerStarted","Data":"7fc036a37952ea34b6ff57f3b6d42575d1b0735272ca42d10918e4dda3ab4522"}
Jul 21 00:46:47.929973 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:47.929936    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn" event={"ID":"af57b7ae-99ca-422b-95f5-d7093d336210","Type":"ContainerStarted","Data":"33bb85b396d57502d34e499790fd7d64e88cac874f95aecf79db36b1011fcb63"}
Jul 21 00:46:51.953807 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:51.953763    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn" event={"ID":"af57b7ae-99ca-422b-95f5-d7093d336210","Type":"ContainerStarted","Data":"e1e9329a33f7ce6c29497445380d35e87af01d96e1f640ef661b4ade9e939003"}
Jul 21 00:46:51.955354 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:51.955320    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-656b686d8c-2t69n" event={"ID":"820d3ed3-5dea-4176-b41e-aeb1a9b47f69","Type":"ContainerStarted","Data":"66f9f5debbff443f1d8b504d14d57ebdc7f57061d31868a3e3f02e73b4495ac6"}
Jul 21 00:46:51.955455 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:51.955408    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-656b686d8c-2t69n"
Jul 21 00:46:51.993945 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:51.993883    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-656b686d8c-2t69n" podStartSLOduration=1.552868288 podStartE2EDuration="4.993866326s" totalImagesPullingTime="3.440998038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:46:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:46:51.991958744 +0000 UTC m=+342.291655201" watchObservedRunningTime="2026-07-21 00:46:51.993866326 +0000 UTC m=+342.293562746"
Jul 21 00:46:52.961747 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:52.961712    2582 generic.go:356] "Generic (PLEG): container finished" podID="af57b7ae-99ca-422b-95f5-d7093d336210" containerID="e1e9329a33f7ce6c29497445380d35e87af01d96e1f640ef661b4ade9e939003" exitCode=0
Jul 21 00:46:52.962163 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:52.961787    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn" event={"ID":"af57b7ae-99ca-422b-95f5-d7093d336210","Type":"ContainerDied","Data":"e1e9329a33f7ce6c29497445380d35e87af01d96e1f640ef661b4ade9e939003"}
Jul 21 00:46:53.969162 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:53.969128    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn" event={"ID":"af57b7ae-99ca-422b-95f5-d7093d336210","Type":"ContainerStarted","Data":"45a8c2ec15569ad91abc72ee3f8ff2cafd2ddaea62966b2ef908d6dc9137adf8"}
Jul 21 00:46:53.969523 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:53.969273    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn"
Jul 21 00:46:53.987530 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:46:53.987435    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn" podStartSLOduration=2.244870028 podStartE2EDuration="6.987413267s" totalImagesPullingTime="3.700382778s" totalInitContainerRuntime="1.042160461s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:46:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:46:53.986113303 +0000 UTC m=+344.285809724" watchObservedRunningTime="2026-07-21 00:46:53.987413267 +0000 UTC m=+344.287109689"
Jul 21 00:47:02.964452 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:47:02.964370    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-656b686d8c-2t69n"
Jul 21 00:47:04.976753 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:47:04.976716    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-plgrn"
Jul 21 00:47:07.053155 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:47:07.053124    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5c7494f749-z626n"]
Jul 21 00:47:07.057206 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:47:07.057189    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c7494f749-z626n"
Jul 21 00:47:07.059436 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:47:07.059411    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 21 00:47:07.059586 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:47:07.059411    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 21 00:47:07.059788 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:47:07.059773    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 00:47:07.059908 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:47:07.059893    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-g72pk\""
Jul 21 00:47:07.060005 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:47:07.059991    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 00:47:07.081435 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:47:07.081398    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c7494f749-z626n"]
Jul 21 00:47:07.110846 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:47:07.110805    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt7kj\" (UniqueName: \"kubernetes.io/projected/71da8102-aeb1-4acc-a5d7-ed346dc8eecc-kube-api-access-wt7kj\") pod \"kube-auth-proxy-5c7494f749-z626n\" (UID: \"71da8102-aeb1-4acc-a5d7-ed346dc8eecc\") " pod="openshift-ingress/kube-auth-proxy-5c7494f749-z626n"
Jul 21 00:47:07.111024 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:47:07.110896    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71da8102-aeb1-4acc-a5d7-ed346dc8eecc-tls-certs\") pod \"kube-auth-proxy-5c7494f749-z626n\" (UID: \"71da8102-aeb1-4acc-a5d7-ed346dc8eecc\") " pod="openshift-ingress/kube-auth-proxy-5c7494f749-z626n"
Jul 21 00:47:07.111024 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:47:07.110916    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71da8102-aeb1-4acc-a5d7-ed346dc8eecc-tmp\") pod \"kube-auth-proxy-5c7494f749-z626n\" (UID: \"71da8102-aeb1-4acc-a5d7-ed346dc8eecc\") " pod="openshift-ingress/kube-auth-proxy-5c7494f749-z626n"
Jul 21 00:47:07.211811 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:47:07.211764    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71da8102-aeb1-4acc-a5d7-ed346dc8eecc-tls-certs\") pod \"kube-auth-proxy-5c7494f749-z626n\" (UID: \"71da8102-aeb1-4acc-a5d7-ed346dc8eecc\") " pod="openshift-ingress/kube-auth-proxy-5c7494f749-z626n"
Jul 21 00:47:07.212005 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:47:07.211822    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71da8102-aeb1-4acc-a5d7-ed346dc8eecc-tmp\") pod \"kube-auth-proxy-5c7494f749-z626n\" (UID: \"71da8102-aeb1-4acc-a5d7-ed346dc8eecc\") " pod="openshift-ingress/kube-auth-proxy-5c7494f749-z626n"
Jul 21 00:47:07.212047 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:47:07.212008    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt7kj\" (UniqueName: \"kubernetes.io/projected/71da8102-aeb1-4acc-a5d7-ed346dc8eecc-kube-api-access-wt7kj\") pod \"kube-auth-proxy-5c7494f749-z626n\" (UID: \"71da8102-aeb1-4acc-a5d7-ed346dc8eecc\") " pod="openshift-ingress/kube-auth-proxy-5c7494f749-z626n"
Jul 21 00:47:07.214114 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:47:07.214084    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71da8102-aeb1-4acc-a5d7-ed346dc8eecc-tmp\") pod \"kube-auth-proxy-5c7494f749-z626n\" (UID: \"71da8102-aeb1-4acc-a5d7-ed346dc8eecc\") " pod="openshift-ingress/kube-auth-proxy-5c7494f749-z626n"
Jul 21 00:47:07.214313 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:47:07.214296    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71da8102-aeb1-4acc-a5d7-ed346dc8eecc-tls-certs\") pod \"kube-auth-proxy-5c7494f749-z626n\" (UID: \"71da8102-aeb1-4acc-a5d7-ed346dc8eecc\") " pod="openshift-ingress/kube-auth-proxy-5c7494f749-z626n"
Jul 21 00:47:07.220500 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:47:07.220475    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt7kj\" (UniqueName: \"kubernetes.io/projected/71da8102-aeb1-4acc-a5d7-ed346dc8eecc-kube-api-access-wt7kj\") pod \"kube-auth-proxy-5c7494f749-z626n\" (UID: \"71da8102-aeb1-4acc-a5d7-ed346dc8eecc\") " pod="openshift-ingress/kube-auth-proxy-5c7494f749-z626n"
Jul 21 00:47:07.367138 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:47:07.367056    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c7494f749-z626n"
Jul 21 00:47:07.527212 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:47:07.527185    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c7494f749-z626n"]
Jul 21 00:47:07.529942 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:47:07.529919    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71da8102_aeb1_4acc_a5d7_ed346dc8eecc.slice/crio-0b0c398fd655d54084f918c1131fd7fb2c323a0cd3abcf6ebb9fdee57f9e325b WatchSource:0}: Error finding container 0b0c398fd655d54084f918c1131fd7fb2c323a0cd3abcf6ebb9fdee57f9e325b: Status 404 returned error can't find the container with id 0b0c398fd655d54084f918c1131fd7fb2c323a0cd3abcf6ebb9fdee57f9e325b
Jul 21 00:47:08.042812 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:47:08.042763    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c7494f749-z626n" event={"ID":"71da8102-aeb1-4acc-a5d7-ed346dc8eecc","Type":"ContainerStarted","Data":"0b0c398fd655d54084f918c1131fd7fb2c323a0cd3abcf6ebb9fdee57f9e325b"}
Jul 21 00:47:11.060699 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:47:11.060630    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c7494f749-z626n" event={"ID":"71da8102-aeb1-4acc-a5d7-ed346dc8eecc","Type":"ContainerStarted","Data":"f309f427dc5613d7fad69cf6f7f0ece27fb3e72b819f2f719e10ce18d875f294"}
Jul 21 00:47:11.074997 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:47:11.074935    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5c7494f749-z626n" podStartSLOduration=1.504820734 podStartE2EDuration="4.074852501s" totalImagesPullingTime="2.570031767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:47:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:47:11.074779986 +0000 UTC m=+361.374476409" watchObservedRunningTime="2026-07-21 00:47:11.074852501 +0000 UTC m=+361.374548921"
Jul 21 00:48:24.453174 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:24.453137    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz"]
Jul 21 00:48:24.456702 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:24.456685    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz"
Jul 21 00:48:24.458585 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:24.458548    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 00:48:24.458746 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:24.458678    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-d5rtl\""
Jul 21 00:48:24.458746 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:24.458713    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 00:48:24.470593 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:24.465151    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz"]
Jul 21 00:48:24.542306 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:24.542269    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz\" (UID: \"57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz"
Jul 21 00:48:24.542481 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:24.542313    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znt6w\" (UniqueName: \"kubernetes.io/projected/57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c-kube-api-access-znt6w\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz\" (UID: \"57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz"
Jul 21 00:48:24.542481 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:24.542367    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz\" (UID: \"57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz"
Jul 21 00:48:24.643511 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:24.643467    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz\" (UID: \"57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz"
Jul 21 00:48:24.643722 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:24.643520    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znt6w\" (UniqueName: \"kubernetes.io/projected/57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c-kube-api-access-znt6w\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz\" (UID: \"57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz"
Jul 21 00:48:24.643722 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:24.643562    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz\" (UID: \"57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz"
Jul 21 00:48:24.643879 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:24.643859    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz\" (UID: \"57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz"
Jul 21 00:48:24.643978 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:24.643949    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz\" (UID: \"57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz"
Jul 21 00:48:24.651809 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:24.651788    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znt6w\" (UniqueName: \"kubernetes.io/projected/57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c-kube-api-access-znt6w\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz\" (UID: \"57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz"
Jul 21 00:48:24.773860 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:24.773766    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz"
Jul 21 00:48:24.908046 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:24.908012    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz"]
Jul 21 00:48:24.911147 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:48:24.911116    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57a6b6b1_aee9_4de5_b3e9_19a26ac94a5c.slice/crio-633ecb079d1c337ce8a4e8310cba4083db97646831b8983e8523d6bf5b2a6479 WatchSource:0}: Error finding container 633ecb079d1c337ce8a4e8310cba4083db97646831b8983e8523d6bf5b2a6479: Status 404 returned error can't find the container with id 633ecb079d1c337ce8a4e8310cba4083db97646831b8983e8523d6bf5b2a6479
Jul 21 00:48:25.066049 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.065968    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2"]
Jul 21 00:48:25.069801 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.069782    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2"
Jul 21 00:48:25.077669 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.077629    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2"]
Jul 21 00:48:25.146244 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.146212    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f440cbf-b6c6-45e8-875b-2941a5ac4926-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2\" (UID: \"2f440cbf-b6c6-45e8-875b-2941a5ac4926\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2"
Jul 21 00:48:25.146244 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.146250    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f440cbf-b6c6-45e8-875b-2941a5ac4926-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2\" (UID: \"2f440cbf-b6c6-45e8-875b-2941a5ac4926\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2"
Jul 21 00:48:25.146464 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.146295    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv7x5\" (UniqueName: \"kubernetes.io/projected/2f440cbf-b6c6-45e8-875b-2941a5ac4926-kube-api-access-tv7x5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2\" (UID: \"2f440cbf-b6c6-45e8-875b-2941a5ac4926\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2"
Jul 21 00:48:25.246939 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.246901    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv7x5\" (UniqueName: \"kubernetes.io/projected/2f440cbf-b6c6-45e8-875b-2941a5ac4926-kube-api-access-tv7x5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2\" (UID: \"2f440cbf-b6c6-45e8-875b-2941a5ac4926\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2"
Jul 21 00:48:25.247120 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.246979    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f440cbf-b6c6-45e8-875b-2941a5ac4926-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2\" (UID: \"2f440cbf-b6c6-45e8-875b-2941a5ac4926\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2"
Jul 21 00:48:25.247120 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.247009    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f440cbf-b6c6-45e8-875b-2941a5ac4926-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2\" (UID: \"2f440cbf-b6c6-45e8-875b-2941a5ac4926\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2"
Jul 21 00:48:25.247344 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.247328    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f440cbf-b6c6-45e8-875b-2941a5ac4926-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2\" (UID: \"2f440cbf-b6c6-45e8-875b-2941a5ac4926\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2"
Jul 21 00:48:25.247385 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.247362    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f440cbf-b6c6-45e8-875b-2941a5ac4926-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2\" (UID: \"2f440cbf-b6c6-45e8-875b-2941a5ac4926\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2"
Jul 21 00:48:25.253942 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.253923    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv7x5\" (UniqueName: \"kubernetes.io/projected/2f440cbf-b6c6-45e8-875b-2941a5ac4926-kube-api-access-tv7x5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2\" (UID: \"2f440cbf-b6c6-45e8-875b-2941a5ac4926\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2"
Jul 21 00:48:25.380543 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.380459    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2"
Jul 21 00:48:25.428203 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.428170    2582 generic.go:356] "Generic (PLEG): container finished" podID="57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c" containerID="4f4065655e9973e85038aa29b8211787d9a0846388db20133ab150be146d12d7" exitCode=0
Jul 21 00:48:25.428365 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.428219    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz" event={"ID":"57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c","Type":"ContainerDied","Data":"4f4065655e9973e85038aa29b8211787d9a0846388db20133ab150be146d12d7"}
Jul 21 00:48:25.428365 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.428257    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz" event={"ID":"57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c","Type":"ContainerStarted","Data":"633ecb079d1c337ce8a4e8310cba4083db97646831b8983e8523d6bf5b2a6479"}
Jul 21 00:48:25.453714 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.453683    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7"]
Jul 21 00:48:25.457512 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.457493    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7"
Jul 21 00:48:25.464731 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.464594    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7"]
Jul 21 00:48:25.522816 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.522793    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2"]
Jul 21 00:48:25.525011 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:48:25.524990    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f440cbf_b6c6_45e8_875b_2941a5ac4926.slice/crio-37234600c832fc636831f8e9f3855291708154d2660fdaa3c8b5d7487fec085c WatchSource:0}: Error finding container 37234600c832fc636831f8e9f3855291708154d2660fdaa3c8b5d7487fec085c: Status 404 returned error can't find the container with id 37234600c832fc636831f8e9f3855291708154d2660fdaa3c8b5d7487fec085c
Jul 21 00:48:25.549610 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.549583    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xz4t\" (UniqueName: \"kubernetes.io/projected/52966269-46ec-4e0a-97f7-c1a86b1150df-kube-api-access-2xz4t\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7\" (UID: \"52966269-46ec-4e0a-97f7-c1a86b1150df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7"
Jul 21 00:48:25.549734 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.549621    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52966269-46ec-4e0a-97f7-c1a86b1150df-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7\" (UID: \"52966269-46ec-4e0a-97f7-c1a86b1150df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7"
Jul 21 00:48:25.549734 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.549701    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52966269-46ec-4e0a-97f7-c1a86b1150df-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7\" (UID: \"52966269-46ec-4e0a-97f7-c1a86b1150df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7"
Jul 21 00:48:25.650600 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.650514    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xz4t\" (UniqueName: \"kubernetes.io/projected/52966269-46ec-4e0a-97f7-c1a86b1150df-kube-api-access-2xz4t\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7\" (UID: \"52966269-46ec-4e0a-97f7-c1a86b1150df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7"
Jul 21 00:48:25.650600 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.650557    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52966269-46ec-4e0a-97f7-c1a86b1150df-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7\" (UID: \"52966269-46ec-4e0a-97f7-c1a86b1150df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7"
Jul 21 00:48:25.650600 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.650598    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52966269-46ec-4e0a-97f7-c1a86b1150df-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7\" (UID: \"52966269-46ec-4e0a-97f7-c1a86b1150df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7"
Jul 21 00:48:25.650987 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.650967    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52966269-46ec-4e0a-97f7-c1a86b1150df-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7\" (UID: \"52966269-46ec-4e0a-97f7-c1a86b1150df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7"
Jul 21 00:48:25.651034 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.651007    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52966269-46ec-4e0a-97f7-c1a86b1150df-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7\" (UID: \"52966269-46ec-4e0a-97f7-c1a86b1150df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7"
Jul 21 00:48:25.658267 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.658247    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xz4t\" (UniqueName: \"kubernetes.io/projected/52966269-46ec-4e0a-97f7-c1a86b1150df-kube-api-access-2xz4t\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7\" (UID: \"52966269-46ec-4e0a-97f7-c1a86b1150df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7"
Jul 21 00:48:25.769363 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.769328    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7"
Jul 21 00:48:25.858347 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.858316    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7"]
Jul 21 00:48:25.863939 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.863911    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7"
Jul 21 00:48:25.873064 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.872765    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7"]
Jul 21 00:48:25.907249 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.907222    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7"]
Jul 21 00:48:25.909523 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:48:25.909497    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52966269_46ec_4e0a_97f7_c1a86b1150df.slice/crio-7f974d285a3da453a2bd46b77ee464003cee23cfdb3a3181fbcf6690b5bb8616 WatchSource:0}: Error finding container 7f974d285a3da453a2bd46b77ee464003cee23cfdb3a3181fbcf6690b5bb8616: Status 404 returned error can't find the container with id 7f974d285a3da453a2bd46b77ee464003cee23cfdb3a3181fbcf6690b5bb8616
Jul 21 00:48:25.952920 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.952897    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36726fd8-5232-4b41-8c78-8b62e388c70b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7\" (UID: \"36726fd8-5232-4b41-8c78-8b62e388c70b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7"
Jul 21 00:48:25.953036 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.952926    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv728\" (UniqueName: \"kubernetes.io/projected/36726fd8-5232-4b41-8c78-8b62e388c70b-kube-api-access-nv728\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7\" (UID: \"36726fd8-5232-4b41-8c78-8b62e388c70b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7"
Jul 21 00:48:25.953036 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:25.953007    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36726fd8-5232-4b41-8c78-8b62e388c70b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7\" (UID: \"36726fd8-5232-4b41-8c78-8b62e388c70b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7"
Jul 21 00:48:26.054000 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:26.053959    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36726fd8-5232-4b41-8c78-8b62e388c70b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7\" (UID: \"36726fd8-5232-4b41-8c78-8b62e388c70b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7"
Jul 21 00:48:26.054000 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:26.054005    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv728\" (UniqueName: \"kubernetes.io/projected/36726fd8-5232-4b41-8c78-8b62e388c70b-kube-api-access-nv728\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7\" (UID: \"36726fd8-5232-4b41-8c78-8b62e388c70b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7"
Jul 21 00:48:26.054256 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:26.054080    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36726fd8-5232-4b41-8c78-8b62e388c70b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7\" (UID: \"36726fd8-5232-4b41-8c78-8b62e388c70b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7"
Jul 21 00:48:26.054338 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:26.054317    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36726fd8-5232-4b41-8c78-8b62e388c70b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7\" (UID: \"36726fd8-5232-4b41-8c78-8b62e388c70b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7"
Jul 21 00:48:26.054435 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:26.054417    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36726fd8-5232-4b41-8c78-8b62e388c70b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7\" (UID: \"36726fd8-5232-4b41-8c78-8b62e388c70b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7"
Jul 21 00:48:26.062622 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:26.062596    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv728\" (UniqueName: \"kubernetes.io/projected/36726fd8-5232-4b41-8c78-8b62e388c70b-kube-api-access-nv728\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7\" (UID: \"36726fd8-5232-4b41-8c78-8b62e388c70b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7"
Jul 21 00:48:26.176632 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:26.176530    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7"
Jul 21 00:48:26.313251 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:26.313229    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7"]
Jul 21 00:48:26.315333 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:48:26.315308    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36726fd8_5232_4b41_8c78_8b62e388c70b.slice/crio-ccae2adfde1b8bbf31f25be7a6c18b49b98d2c7bde1ed3104b0ea633b3ac2d96 WatchSource:0}: Error finding container ccae2adfde1b8bbf31f25be7a6c18b49b98d2c7bde1ed3104b0ea633b3ac2d96: Status 404 returned error can't find the container with id ccae2adfde1b8bbf31f25be7a6c18b49b98d2c7bde1ed3104b0ea633b3ac2d96
Jul 21 00:48:26.434254 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:26.434223    2582 generic.go:356] "Generic (PLEG): container finished" podID="52966269-46ec-4e0a-97f7-c1a86b1150df" containerID="4fec5fea4bdc8bd103c56c4343bbb6a9ad75b9ea1b9758e4a91aa93f4cfa2f59" exitCode=0
Jul 21 00:48:26.434426 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:26.434305    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7" event={"ID":"52966269-46ec-4e0a-97f7-c1a86b1150df","Type":"ContainerDied","Data":"4fec5fea4bdc8bd103c56c4343bbb6a9ad75b9ea1b9758e4a91aa93f4cfa2f59"}
Jul 21 00:48:26.434426 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:26.434360    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7" event={"ID":"52966269-46ec-4e0a-97f7-c1a86b1150df","Type":"ContainerStarted","Data":"7f974d285a3da453a2bd46b77ee464003cee23cfdb3a3181fbcf6690b5bb8616"}
Jul 21 00:48:26.435828 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:26.435809    2582 generic.go:356] "Generic (PLEG): container finished" podID="2f440cbf-b6c6-45e8-875b-2941a5ac4926" containerID="6cfefa155567334788a27307ba0f09043a40b8d15b51dae44ff51bcff629722d" exitCode=0
Jul 21 00:48:26.435906 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:26.435887    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2" event={"ID":"2f440cbf-b6c6-45e8-875b-2941a5ac4926","Type":"ContainerDied","Data":"6cfefa155567334788a27307ba0f09043a40b8d15b51dae44ff51bcff629722d"}
Jul 21 00:48:26.435952 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:26.435925    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2" event={"ID":"2f440cbf-b6c6-45e8-875b-2941a5ac4926","Type":"ContainerStarted","Data":"37234600c832fc636831f8e9f3855291708154d2660fdaa3c8b5d7487fec085c"}
Jul 21 00:48:26.437497 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:26.437476    2582 generic.go:356] "Generic (PLEG): container finished" podID="36726fd8-5232-4b41-8c78-8b62e388c70b" containerID="cd4ef19436d69f138ce24c4de183fc1a84f3eb79c5050cf05c0fb1cec4efc43b" exitCode=0
Jul 21 00:48:26.437581 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:26.437535    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7" event={"ID":"36726fd8-5232-4b41-8c78-8b62e388c70b","Type":"ContainerDied","Data":"cd4ef19436d69f138ce24c4de183fc1a84f3eb79c5050cf05c0fb1cec4efc43b"}
Jul 21 00:48:26.437639 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:26.437578    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7" event={"ID":"36726fd8-5232-4b41-8c78-8b62e388c70b","Type":"ContainerStarted","Data":"ccae2adfde1b8bbf31f25be7a6c18b49b98d2c7bde1ed3104b0ea633b3ac2d96"}
Jul 21 00:48:26.439676 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:26.439643    2582 generic.go:356] "Generic (PLEG): container finished" podID="57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c" containerID="09dbee5ad6fd578a3ef0f681efa8cc2e28fe173f3b34ab5d1c8e22be482b4815" exitCode=0
Jul 21 00:48:26.439737 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:26.439691    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz" event={"ID":"57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c","Type":"ContainerDied","Data":"09dbee5ad6fd578a3ef0f681efa8cc2e28fe173f3b34ab5d1c8e22be482b4815"}
Jul 21 00:48:27.446374 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:27.446339    2582 generic.go:356] "Generic (PLEG): container finished" podID="2f440cbf-b6c6-45e8-875b-2941a5ac4926" containerID="7660874ca04e70e6a50031e80a269080233b6bd88fd9b013cc4590aa7d10c2a1" exitCode=0
Jul 21 00:48:27.446816 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:27.446424    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2" event={"ID":"2f440cbf-b6c6-45e8-875b-2941a5ac4926","Type":"ContainerDied","Data":"7660874ca04e70e6a50031e80a269080233b6bd88fd9b013cc4590aa7d10c2a1"}
Jul 21 00:48:27.449089 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:27.449065    2582 generic.go:356] "Generic (PLEG): container finished" podID="57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c" containerID="ee04253f775ee2a0d291bade86d225015fd25d1bfe5f93b835ed03675a1f625e" exitCode=0
Jul 21 00:48:27.449211 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:27.449167    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz" event={"ID":"57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c","Type":"ContainerDied","Data":"ee04253f775ee2a0d291bade86d225015fd25d1bfe5f93b835ed03675a1f625e"}
Jul 21 00:48:28.455940 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:28.455907    2582 generic.go:356] "Generic (PLEG): container finished" podID="52966269-46ec-4e0a-97f7-c1a86b1150df" containerID="e60d216ac78bcc0e4e33df666e9f3b41867f8593a54002cf39d4ebda535b7a30" exitCode=0
Jul 21 00:48:28.456405 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:28.456004    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7" event={"ID":"52966269-46ec-4e0a-97f7-c1a86b1150df","Type":"ContainerDied","Data":"e60d216ac78bcc0e4e33df666e9f3b41867f8593a54002cf39d4ebda535b7a30"}
Jul 21 00:48:28.458157 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:28.458131    2582 generic.go:356] "Generic (PLEG): container finished" podID="2f440cbf-b6c6-45e8-875b-2941a5ac4926" containerID="14cb079ea59964b9f55237c1c730d72691556027a3afd03fed565aff606287ca" exitCode=0
Jul 21 00:48:28.458252 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:28.458218    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2" event={"ID":"2f440cbf-b6c6-45e8-875b-2941a5ac4926","Type":"ContainerDied","Data":"14cb079ea59964b9f55237c1c730d72691556027a3afd03fed565aff606287ca"}
Jul 21 00:48:28.459991 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:28.459972    2582 generic.go:356] "Generic (PLEG): container finished" podID="36726fd8-5232-4b41-8c78-8b62e388c70b" containerID="030d73f8f90d387866172afbcacc4af708fa68e5db9ed0122e16f8c3f3a29ec5" exitCode=0
Jul 21 00:48:28.460070 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:28.460052    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7" event={"ID":"36726fd8-5232-4b41-8c78-8b62e388c70b","Type":"ContainerDied","Data":"030d73f8f90d387866172afbcacc4af708fa68e5db9ed0122e16f8c3f3a29ec5"}
Jul 21 00:48:28.610598 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:28.610577    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz"
Jul 21 00:48:28.672581 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:28.672548    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c-bundle\") pod \"57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c\" (UID: \"57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c\") "
Jul 21 00:48:28.672785 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:28.672629    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c-util\") pod \"57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c\" (UID: \"57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c\") "
Jul 21 00:48:28.672785 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:28.672697    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znt6w\" (UniqueName: \"kubernetes.io/projected/57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c-kube-api-access-znt6w\") pod \"57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c\" (UID: \"57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c\") "
Jul 21 00:48:28.673182 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:28.673153    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c-bundle" (OuterVolumeSpecName: "bundle") pod "57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c" (UID: "57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 00:48:28.674883 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:28.674858    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c-kube-api-access-znt6w" (OuterVolumeSpecName: "kube-api-access-znt6w") pod "57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c" (UID: "57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c"). InnerVolumeSpecName "kube-api-access-znt6w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:48:28.677455 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:28.677433    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c-util" (OuterVolumeSpecName: "util") pod "57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c" (UID: "57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 00:48:28.774238 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:28.774151    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c-util\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:48:28.774238 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:28.774179    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znt6w\" (UniqueName: \"kubernetes.io/projected/57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c-kube-api-access-znt6w\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:48:28.774238 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:28.774189    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c-bundle\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:48:29.467926 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:29.467892    2582 generic.go:356] "Generic (PLEG): container finished" podID="52966269-46ec-4e0a-97f7-c1a86b1150df" containerID="e88ab99e8db25f662fee243ee7fc4ecf5ea0a99a951391bac24a4218f030ac94" exitCode=0
Jul 21 00:48:29.468368 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:29.467997    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7" event={"ID":"52966269-46ec-4e0a-97f7-c1a86b1150df","Type":"ContainerDied","Data":"e88ab99e8db25f662fee243ee7fc4ecf5ea0a99a951391bac24a4218f030ac94"}
Jul 21 00:48:29.469936 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:29.469905    2582 generic.go:356] "Generic (PLEG): container finished" podID="36726fd8-5232-4b41-8c78-8b62e388c70b" containerID="0c0a0c4857b475343841a93867e3201aa17e8382df9d228e817c849c82a29fd8" exitCode=0
Jul 21 00:48:29.470042 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:29.469989    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7" event={"ID":"36726fd8-5232-4b41-8c78-8b62e388c70b","Type":"ContainerDied","Data":"0c0a0c4857b475343841a93867e3201aa17e8382df9d228e817c849c82a29fd8"}
Jul 21 00:48:29.471913 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:29.471895    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz"
Jul 21 00:48:29.472002 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:29.471922    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz" event={"ID":"57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c","Type":"ContainerDied","Data":"633ecb079d1c337ce8a4e8310cba4083db97646831b8983e8523d6bf5b2a6479"}
Jul 21 00:48:29.472002 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:29.471954    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="633ecb079d1c337ce8a4e8310cba4083db97646831b8983e8523d6bf5b2a6479"
Jul 21 00:48:29.603766 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:29.603743    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2"
Jul 21 00:48:29.680590 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:29.680557    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tv7x5\" (UniqueName: \"kubernetes.io/projected/2f440cbf-b6c6-45e8-875b-2941a5ac4926-kube-api-access-tv7x5\") pod \"2f440cbf-b6c6-45e8-875b-2941a5ac4926\" (UID: \"2f440cbf-b6c6-45e8-875b-2941a5ac4926\") "
Jul 21 00:48:29.680788 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:29.680673    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f440cbf-b6c6-45e8-875b-2941a5ac4926-bundle\") pod \"2f440cbf-b6c6-45e8-875b-2941a5ac4926\" (UID: \"2f440cbf-b6c6-45e8-875b-2941a5ac4926\") "
Jul 21 00:48:29.680788 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:29.680726    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f440cbf-b6c6-45e8-875b-2941a5ac4926-util\") pod \"2f440cbf-b6c6-45e8-875b-2941a5ac4926\" (UID: \"2f440cbf-b6c6-45e8-875b-2941a5ac4926\") "
Jul 21 00:48:29.681118 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:29.681092    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f440cbf-b6c6-45e8-875b-2941a5ac4926-bundle" (OuterVolumeSpecName: "bundle") pod "2f440cbf-b6c6-45e8-875b-2941a5ac4926" (UID: "2f440cbf-b6c6-45e8-875b-2941a5ac4926"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 00:48:29.682745 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:29.682719    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f440cbf-b6c6-45e8-875b-2941a5ac4926-kube-api-access-tv7x5" (OuterVolumeSpecName: "kube-api-access-tv7x5") pod "2f440cbf-b6c6-45e8-875b-2941a5ac4926" (UID: "2f440cbf-b6c6-45e8-875b-2941a5ac4926"). InnerVolumeSpecName "kube-api-access-tv7x5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:48:29.686155 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:29.686134    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f440cbf-b6c6-45e8-875b-2941a5ac4926-util" (OuterVolumeSpecName: "util") pod "2f440cbf-b6c6-45e8-875b-2941a5ac4926" (UID: "2f440cbf-b6c6-45e8-875b-2941a5ac4926"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 00:48:29.781886 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:29.781798    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f440cbf-b6c6-45e8-875b-2941a5ac4926-bundle\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:48:29.781886 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:29.781825    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f440cbf-b6c6-45e8-875b-2941a5ac4926-util\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:48:29.781886 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:29.781833    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tv7x5\" (UniqueName: \"kubernetes.io/projected/2f440cbf-b6c6-45e8-875b-2941a5ac4926-kube-api-access-tv7x5\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:48:30.478939 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:30.478908    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2"
Jul 21 00:48:30.479305 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:30.478914    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2" event={"ID":"2f440cbf-b6c6-45e8-875b-2941a5ac4926","Type":"ContainerDied","Data":"37234600c832fc636831f8e9f3855291708154d2660fdaa3c8b5d7487fec085c"}
Jul 21 00:48:30.479305 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:30.479041    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37234600c832fc636831f8e9f3855291708154d2660fdaa3c8b5d7487fec085c"
Jul 21 00:48:30.628782 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:30.628761    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7"
Jul 21 00:48:30.630988 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:30.630968    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7"
Jul 21 00:48:30.689397 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:30.689352    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xz4t\" (UniqueName: \"kubernetes.io/projected/52966269-46ec-4e0a-97f7-c1a86b1150df-kube-api-access-2xz4t\") pod \"52966269-46ec-4e0a-97f7-c1a86b1150df\" (UID: \"52966269-46ec-4e0a-97f7-c1a86b1150df\") "
Jul 21 00:48:30.689397 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:30.689389    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52966269-46ec-4e0a-97f7-c1a86b1150df-bundle\") pod \"52966269-46ec-4e0a-97f7-c1a86b1150df\" (UID: \"52966269-46ec-4e0a-97f7-c1a86b1150df\") "
Jul 21 00:48:30.689397 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:30.689407    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36726fd8-5232-4b41-8c78-8b62e388c70b-bundle\") pod \"36726fd8-5232-4b41-8c78-8b62e388c70b\" (UID: \"36726fd8-5232-4b41-8c78-8b62e388c70b\") "
Jul 21 00:48:30.689739 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:30.689445    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52966269-46ec-4e0a-97f7-c1a86b1150df-util\") pod \"52966269-46ec-4e0a-97f7-c1a86b1150df\" (UID: \"52966269-46ec-4e0a-97f7-c1a86b1150df\") "
Jul 21 00:48:30.689739 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:30.689502    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nv728\" (UniqueName: \"kubernetes.io/projected/36726fd8-5232-4b41-8c78-8b62e388c70b-kube-api-access-nv728\") pod \"36726fd8-5232-4b41-8c78-8b62e388c70b\" (UID: \"36726fd8-5232-4b41-8c78-8b62e388c70b\") "
Jul 21 00:48:30.689739 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:30.689587    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36726fd8-5232-4b41-8c78-8b62e388c70b-util\") pod \"36726fd8-5232-4b41-8c78-8b62e388c70b\" (UID: \"36726fd8-5232-4b41-8c78-8b62e388c70b\") "
Jul 21 00:48:30.690107 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:30.690078    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36726fd8-5232-4b41-8c78-8b62e388c70b-bundle" (OuterVolumeSpecName: "bundle") pod "36726fd8-5232-4b41-8c78-8b62e388c70b" (UID: "36726fd8-5232-4b41-8c78-8b62e388c70b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 00:48:30.690211 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:30.690103    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52966269-46ec-4e0a-97f7-c1a86b1150df-bundle" (OuterVolumeSpecName: "bundle") pod "52966269-46ec-4e0a-97f7-c1a86b1150df" (UID: "52966269-46ec-4e0a-97f7-c1a86b1150df"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 00:48:30.691963 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:30.691935    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52966269-46ec-4e0a-97f7-c1a86b1150df-kube-api-access-2xz4t" (OuterVolumeSpecName: "kube-api-access-2xz4t") pod "52966269-46ec-4e0a-97f7-c1a86b1150df" (UID: "52966269-46ec-4e0a-97f7-c1a86b1150df"). InnerVolumeSpecName "kube-api-access-2xz4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:48:30.692338 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:30.692319    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36726fd8-5232-4b41-8c78-8b62e388c70b-kube-api-access-nv728" (OuterVolumeSpecName: "kube-api-access-nv728") pod "36726fd8-5232-4b41-8c78-8b62e388c70b" (UID: "36726fd8-5232-4b41-8c78-8b62e388c70b"). InnerVolumeSpecName "kube-api-access-nv728". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:48:30.695484 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:30.695461    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36726fd8-5232-4b41-8c78-8b62e388c70b-util" (OuterVolumeSpecName: "util") pod "36726fd8-5232-4b41-8c78-8b62e388c70b" (UID: "36726fd8-5232-4b41-8c78-8b62e388c70b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 00:48:30.696167 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:30.696148    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52966269-46ec-4e0a-97f7-c1a86b1150df-util" (OuterVolumeSpecName: "util") pod "52966269-46ec-4e0a-97f7-c1a86b1150df" (UID: "52966269-46ec-4e0a-97f7-c1a86b1150df"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 00:48:30.790963 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:30.790922    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36726fd8-5232-4b41-8c78-8b62e388c70b-util\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:48:30.790963 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:30.790955    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xz4t\" (UniqueName: \"kubernetes.io/projected/52966269-46ec-4e0a-97f7-c1a86b1150df-kube-api-access-2xz4t\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:48:30.790963 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:30.790966    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52966269-46ec-4e0a-97f7-c1a86b1150df-bundle\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:48:30.790963 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:30.790974    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36726fd8-5232-4b41-8c78-8b62e388c70b-bundle\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:48:30.791252 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:30.790982    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52966269-46ec-4e0a-97f7-c1a86b1150df-util\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:48:30.791252 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:30.790990    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nv728\" (UniqueName: \"kubernetes.io/projected/36726fd8-5232-4b41-8c78-8b62e388c70b-kube-api-access-nv728\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:48:31.486274 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:31.486193    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7"
Jul 21 00:48:31.486274 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:31.486211    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7" event={"ID":"52966269-46ec-4e0a-97f7-c1a86b1150df","Type":"ContainerDied","Data":"7f974d285a3da453a2bd46b77ee464003cee23cfdb3a3181fbcf6690b5bb8616"}
Jul 21 00:48:31.486274 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:31.486257    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f974d285a3da453a2bd46b77ee464003cee23cfdb3a3181fbcf6690b5bb8616"
Jul 21 00:48:31.488098 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:31.488082    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7"
Jul 21 00:48:31.488098 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:31.488088    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7" event={"ID":"36726fd8-5232-4b41-8c78-8b62e388c70b","Type":"ContainerDied","Data":"ccae2adfde1b8bbf31f25be7a6c18b49b98d2c7bde1ed3104b0ea633b3ac2d96"}
Jul 21 00:48:31.488278 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:31.488119    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ccae2adfde1b8bbf31f25be7a6c18b49b98d2c7bde1ed3104b0ea633b3ac2d96"
Jul 21 00:48:58.360661 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.360617    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-99jj6"]
Jul 21 00:48:58.361164 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.360980    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f440cbf-b6c6-45e8-875b-2941a5ac4926" containerName="util"
Jul 21 00:48:58.361164 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.360992    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f440cbf-b6c6-45e8-875b-2941a5ac4926" containerName="util"
Jul 21 00:48:58.361164 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.361006    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c" containerName="extract"
Jul 21 00:48:58.361164 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.361014    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c" containerName="extract"
Jul 21 00:48:58.361164 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.361023    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52966269-46ec-4e0a-97f7-c1a86b1150df" containerName="util"
Jul 21 00:48:58.361164 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.361030    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="52966269-46ec-4e0a-97f7-c1a86b1150df" containerName="util"
Jul 21 00:48:58.361164 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.361038    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c" containerName="util"
Jul 21 00:48:58.361164 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.361044    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c" containerName="util"
Jul 21 00:48:58.361164 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.361055    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36726fd8-5232-4b41-8c78-8b62e388c70b" containerName="util"
Jul 21 00:48:58.361164 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.361060    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="36726fd8-5232-4b41-8c78-8b62e388c70b" containerName="util"
Jul 21 00:48:58.361164 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.361067    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52966269-46ec-4e0a-97f7-c1a86b1150df" containerName="pull"
Jul 21 00:48:58.361164 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.361071    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="52966269-46ec-4e0a-97f7-c1a86b1150df" containerName="pull"
Jul 21 00:48:58.361164 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.361078    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36726fd8-5232-4b41-8c78-8b62e388c70b" containerName="pull"
Jul 21 00:48:58.361164 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.361082    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="36726fd8-5232-4b41-8c78-8b62e388c70b" containerName="pull"
Jul 21 00:48:58.361164 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.361092    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c" containerName="pull"
Jul 21 00:48:58.361164 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.361096    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c" containerName="pull"
Jul 21 00:48:58.361164 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.361101    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f440cbf-b6c6-45e8-875b-2941a5ac4926" containerName="pull"
Jul 21 00:48:58.361164 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.361106    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f440cbf-b6c6-45e8-875b-2941a5ac4926" containerName="pull"
Jul 21 00:48:58.361164 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.361111    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f440cbf-b6c6-45e8-875b-2941a5ac4926" containerName="extract"
Jul 21 00:48:58.361164 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.361115    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f440cbf-b6c6-45e8-875b-2941a5ac4926" containerName="extract"
Jul 21 00:48:58.361164 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.361124    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52966269-46ec-4e0a-97f7-c1a86b1150df" containerName="extract"
Jul 21 00:48:58.361164 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.361130    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="52966269-46ec-4e0a-97f7-c1a86b1150df" containerName="extract"
Jul 21 00:48:58.361164 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.361135    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36726fd8-5232-4b41-8c78-8b62e388c70b" containerName="extract"
Jul 21 00:48:58.361164 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.361140    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="36726fd8-5232-4b41-8c78-8b62e388c70b" containerName="extract"
Jul 21 00:48:58.361937 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.361187    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c" containerName="extract"
Jul 21 00:48:58.361937 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.361194    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="36726fd8-5232-4b41-8c78-8b62e388c70b" containerName="extract"
Jul 21 00:48:58.361937 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.361201    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f440cbf-b6c6-45e8-875b-2941a5ac4926" containerName="extract"
Jul 21 00:48:58.361937 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.361207    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="52966269-46ec-4e0a-97f7-c1a86b1150df" containerName="extract"
Jul 21 00:48:58.364460 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.364446    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-99jj6"
Jul 21 00:48:58.366314 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.366292    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 00:48:58.366424 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.366390    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 21 00:48:58.366424 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.366401    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 21 00:48:58.366510 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.366491    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 00:48:58.366822 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.366803    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-d5rtl\""
Jul 21 00:48:58.376172 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.372213    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-99jj6"]
Jul 21 00:48:58.439584 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.439547    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f9657560-a5a3-4847-89d0-986f199507b7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-99jj6\" (UID: \"f9657560-a5a3-4847-89d0-986f199507b7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-99jj6"
Jul 21 00:48:58.439793 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.439716    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bhhb\" (UniqueName: \"kubernetes.io/projected/f9657560-a5a3-4847-89d0-986f199507b7-kube-api-access-4bhhb\") pod \"kuadrant-console-plugin-66b5774985-99jj6\" (UID: \"f9657560-a5a3-4847-89d0-986f199507b7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-99jj6"
Jul 21 00:48:58.439793 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.439744    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9657560-a5a3-4847-89d0-986f199507b7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-99jj6\" (UID: \"f9657560-a5a3-4847-89d0-986f199507b7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-99jj6"
Jul 21 00:48:58.540728 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.540694    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bhhb\" (UniqueName: \"kubernetes.io/projected/f9657560-a5a3-4847-89d0-986f199507b7-kube-api-access-4bhhb\") pod \"kuadrant-console-plugin-66b5774985-99jj6\" (UID: \"f9657560-a5a3-4847-89d0-986f199507b7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-99jj6"
Jul 21 00:48:58.540907 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.540735    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9657560-a5a3-4847-89d0-986f199507b7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-99jj6\" (UID: \"f9657560-a5a3-4847-89d0-986f199507b7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-99jj6"
Jul 21 00:48:58.540907 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.540766    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f9657560-a5a3-4847-89d0-986f199507b7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-99jj6\" (UID: \"f9657560-a5a3-4847-89d0-986f199507b7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-99jj6"
Jul 21 00:48:58.541482 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.541464    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f9657560-a5a3-4847-89d0-986f199507b7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-99jj6\" (UID: \"f9657560-a5a3-4847-89d0-986f199507b7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-99jj6"
Jul 21 00:48:58.543020 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.543000    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9657560-a5a3-4847-89d0-986f199507b7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-99jj6\" (UID: \"f9657560-a5a3-4847-89d0-986f199507b7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-99jj6"
Jul 21 00:48:58.547888 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.547865    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bhhb\" (UniqueName: \"kubernetes.io/projected/f9657560-a5a3-4847-89d0-986f199507b7-kube-api-access-4bhhb\") pod \"kuadrant-console-plugin-66b5774985-99jj6\" (UID: \"f9657560-a5a3-4847-89d0-986f199507b7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-99jj6"
Jul 21 00:48:58.676232 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.676142    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-99jj6"
Jul 21 00:48:58.808591 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.808566    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-99jj6"]
Jul 21 00:48:58.810967 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:48:58.810942    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9657560_a5a3_4847_89d0_986f199507b7.slice/crio-cc1e61f29083a66c9b2be687bf50552bf9704d88ffc44ddc3549a125a1109142 WatchSource:0}: Error finding container cc1e61f29083a66c9b2be687bf50552bf9704d88ffc44ddc3549a125a1109142: Status 404 returned error can't find the container with id cc1e61f29083a66c9b2be687bf50552bf9704d88ffc44ddc3549a125a1109142
Jul 21 00:48:58.975418 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.975386    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-644d7647f4-zw8nw"]
Jul 21 00:48:58.980135 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.980112    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:48:58.989940 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:58.989908    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-644d7647f4-zw8nw"]
Jul 21 00:48:59.145609 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.145568    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/23adb4b9-0acb-4d5f-a606-a1e25c56e337-service-ca\") pod \"console-644d7647f4-zw8nw\" (UID: \"23adb4b9-0acb-4d5f-a606-a1e25c56e337\") " pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:48:59.145820 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.145621    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/23adb4b9-0acb-4d5f-a606-a1e25c56e337-console-oauth-config\") pod \"console-644d7647f4-zw8nw\" (UID: \"23adb4b9-0acb-4d5f-a606-a1e25c56e337\") " pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:48:59.145820 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.145673    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/23adb4b9-0acb-4d5f-a606-a1e25c56e337-oauth-serving-cert\") pod \"console-644d7647f4-zw8nw\" (UID: \"23adb4b9-0acb-4d5f-a606-a1e25c56e337\") " pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:48:59.145820 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.145732    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfs65\" (UniqueName: \"kubernetes.io/projected/23adb4b9-0acb-4d5f-a606-a1e25c56e337-kube-api-access-dfs65\") pod \"console-644d7647f4-zw8nw\" (UID: \"23adb4b9-0acb-4d5f-a606-a1e25c56e337\") " pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:48:59.145820 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.145781    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/23adb4b9-0acb-4d5f-a606-a1e25c56e337-console-serving-cert\") pod \"console-644d7647f4-zw8nw\" (UID: \"23adb4b9-0acb-4d5f-a606-a1e25c56e337\") " pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:48:59.145820 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.145807    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23adb4b9-0acb-4d5f-a606-a1e25c56e337-trusted-ca-bundle\") pod \"console-644d7647f4-zw8nw\" (UID: \"23adb4b9-0acb-4d5f-a606-a1e25c56e337\") " pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:48:59.146009 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.145839    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/23adb4b9-0acb-4d5f-a606-a1e25c56e337-console-config\") pod \"console-644d7647f4-zw8nw\" (UID: \"23adb4b9-0acb-4d5f-a606-a1e25c56e337\") " pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:48:59.246524 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.246426    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/23adb4b9-0acb-4d5f-a606-a1e25c56e337-service-ca\") pod \"console-644d7647f4-zw8nw\" (UID: \"23adb4b9-0acb-4d5f-a606-a1e25c56e337\") " pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:48:59.246524 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.246487    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/23adb4b9-0acb-4d5f-a606-a1e25c56e337-console-oauth-config\") pod \"console-644d7647f4-zw8nw\" (UID: \"23adb4b9-0acb-4d5f-a606-a1e25c56e337\") " pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:48:59.246524 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.246509    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/23adb4b9-0acb-4d5f-a606-a1e25c56e337-oauth-serving-cert\") pod \"console-644d7647f4-zw8nw\" (UID: \"23adb4b9-0acb-4d5f-a606-a1e25c56e337\") " pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:48:59.246892 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.246534    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfs65\" (UniqueName: \"kubernetes.io/projected/23adb4b9-0acb-4d5f-a606-a1e25c56e337-kube-api-access-dfs65\") pod \"console-644d7647f4-zw8nw\" (UID: \"23adb4b9-0acb-4d5f-a606-a1e25c56e337\") " pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:48:59.246892 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.246580    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/23adb4b9-0acb-4d5f-a606-a1e25c56e337-console-serving-cert\") pod \"console-644d7647f4-zw8nw\" (UID: \"23adb4b9-0acb-4d5f-a606-a1e25c56e337\") " pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:48:59.246892 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.246641    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23adb4b9-0acb-4d5f-a606-a1e25c56e337-trusted-ca-bundle\") pod \"console-644d7647f4-zw8nw\" (UID: \"23adb4b9-0acb-4d5f-a606-a1e25c56e337\") " pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:48:59.246892 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.246722    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/23adb4b9-0acb-4d5f-a606-a1e25c56e337-console-config\") pod \"console-644d7647f4-zw8nw\" (UID: \"23adb4b9-0acb-4d5f-a606-a1e25c56e337\") " pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:48:59.247336 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.247308    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/23adb4b9-0acb-4d5f-a606-a1e25c56e337-service-ca\") pod \"console-644d7647f4-zw8nw\" (UID: \"23adb4b9-0acb-4d5f-a606-a1e25c56e337\") " pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:48:59.247421 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.247395    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/23adb4b9-0acb-4d5f-a606-a1e25c56e337-console-config\") pod \"console-644d7647f4-zw8nw\" (UID: \"23adb4b9-0acb-4d5f-a606-a1e25c56e337\") " pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:48:59.247480 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.247414    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/23adb4b9-0acb-4d5f-a606-a1e25c56e337-oauth-serving-cert\") pod \"console-644d7647f4-zw8nw\" (UID: \"23adb4b9-0acb-4d5f-a606-a1e25c56e337\") " pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:48:59.247550 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.247529    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23adb4b9-0acb-4d5f-a606-a1e25c56e337-trusted-ca-bundle\") pod \"console-644d7647f4-zw8nw\" (UID: \"23adb4b9-0acb-4d5f-a606-a1e25c56e337\") " pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:48:59.249031 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.249010    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/23adb4b9-0acb-4d5f-a606-a1e25c56e337-console-oauth-config\") pod \"console-644d7647f4-zw8nw\" (UID: \"23adb4b9-0acb-4d5f-a606-a1e25c56e337\") " pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:48:59.249143 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.249126    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/23adb4b9-0acb-4d5f-a606-a1e25c56e337-console-serving-cert\") pod \"console-644d7647f4-zw8nw\" (UID: \"23adb4b9-0acb-4d5f-a606-a1e25c56e337\") " pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:48:59.254379 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.254361    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfs65\" (UniqueName: \"kubernetes.io/projected/23adb4b9-0acb-4d5f-a606-a1e25c56e337-kube-api-access-dfs65\") pod \"console-644d7647f4-zw8nw\" (UID: \"23adb4b9-0acb-4d5f-a606-a1e25c56e337\") " pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:48:59.290499 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.290460    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:48:59.426517 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.426484    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-644d7647f4-zw8nw"]
Jul 21 00:48:59.430230 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:48:59.430206    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23adb4b9_0acb_4d5f_a606_a1e25c56e337.slice/crio-08a43f5a94f976341e9b3add096fb6420b01d76384a0aca10753502d8a1d2abc WatchSource:0}: Error finding container 08a43f5a94f976341e9b3add096fb6420b01d76384a0aca10753502d8a1d2abc: Status 404 returned error can't find the container with id 08a43f5a94f976341e9b3add096fb6420b01d76384a0aca10753502d8a1d2abc
Jul 21 00:48:59.632423 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.632384    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644d7647f4-zw8nw" event={"ID":"23adb4b9-0acb-4d5f-a606-a1e25c56e337","Type":"ContainerStarted","Data":"4f262633450d1f386ff3e477a46a84cced07252db89fab6bccb3077121bf6e96"}
Jul 21 00:48:59.632621 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.632449    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644d7647f4-zw8nw" event={"ID":"23adb4b9-0acb-4d5f-a606-a1e25c56e337","Type":"ContainerStarted","Data":"08a43f5a94f976341e9b3add096fb6420b01d76384a0aca10753502d8a1d2abc"}
Jul 21 00:48:59.633873 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.633837    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-99jj6" event={"ID":"f9657560-a5a3-4847-89d0-986f199507b7","Type":"ContainerStarted","Data":"cc1e61f29083a66c9b2be687bf50552bf9704d88ffc44ddc3549a125a1109142"}
Jul 21 00:48:59.650322 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:48:59.650172    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-644d7647f4-zw8nw" podStartSLOduration=1.6501564869999998 podStartE2EDuration="1.650156487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:48:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:48:59.649027721 +0000 UTC m=+469.948724143" watchObservedRunningTime="2026-07-21 00:48:59.650156487 +0000 UTC m=+469.949852907"
Jul 21 00:49:09.291831 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:09.291775    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:49:09.292381 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:09.291915    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:49:09.297611 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:09.297587    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:49:09.709209 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:09.709181    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-644d7647f4-zw8nw"
Jul 21 00:49:09.805189 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:09.805155    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f6999dd7-rtjtm"]
Jul 21 00:49:21.780009 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:21.779970    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-99jj6" event={"ID":"f9657560-a5a3-4847-89d0-986f199507b7","Type":"ContainerStarted","Data":"2b771b5a07a14a25da8272a2013aad25068d6c6cac6e7ae8924995334a5b527f"}
Jul 21 00:49:21.800866 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:21.800800    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-99jj6" podStartSLOduration=1.37688603 podStartE2EDuration="23.800782299s" totalImagesPullingTime="22.423896269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:49:21.798188645 +0000 UTC m=+492.097885065" watchObservedRunningTime="2026-07-21 00:49:21.800782299 +0000 UTC m=+492.100478719"
Jul 21 00:49:34.829372 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:34.829327    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f6999dd7-rtjtm" podUID="e74ba291-849b-4c80-ad6c-75c42e1fe6b3" containerName="console" containerID="cri-o://f7592d731df9f445cb0bc9fcb027a72812e0bda9a27fae2e0af14ca659fb2479" gracePeriod=15
Jul 21 00:49:35.079545 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.079480    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:49:35.192385 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.192347    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-console-config\") pod \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") "
Jul 21 00:49:35.192580 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.192406    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-service-ca\") pod \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") "
Jul 21 00:49:35.192580 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.192468    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcfcp\" (UniqueName: \"kubernetes.io/projected/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-kube-api-access-hcfcp\") pod \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") "
Jul 21 00:49:35.192580 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.192492    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-trusted-ca-bundle\") pod \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") "
Jul 21 00:49:35.192580 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.192521    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-console-oauth-config\") pod \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") "
Jul 21 00:49:35.192580 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.192564    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-oauth-serving-cert\") pod \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") "
Jul 21 00:49:35.192924 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.192621    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-console-serving-cert\") pod \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\" (UID: \"e74ba291-849b-4c80-ad6c-75c42e1fe6b3\") "
Jul 21 00:49:35.192924 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.192898    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-service-ca" (OuterVolumeSpecName: "service-ca") pod "e74ba291-849b-4c80-ad6c-75c42e1fe6b3" (UID: "e74ba291-849b-4c80-ad6c-75c42e1fe6b3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:49:35.193010 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.192928    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-console-config" (OuterVolumeSpecName: "console-config") pod "e74ba291-849b-4c80-ad6c-75c42e1fe6b3" (UID: "e74ba291-849b-4c80-ad6c-75c42e1fe6b3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:49:35.193010 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.192990    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e74ba291-849b-4c80-ad6c-75c42e1fe6b3" (UID: "e74ba291-849b-4c80-ad6c-75c42e1fe6b3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:49:35.193077 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.193005    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e74ba291-849b-4c80-ad6c-75c42e1fe6b3" (UID: "e74ba291-849b-4c80-ad6c-75c42e1fe6b3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:49:35.194612 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.194584    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-kube-api-access-hcfcp" (OuterVolumeSpecName: "kube-api-access-hcfcp") pod "e74ba291-849b-4c80-ad6c-75c42e1fe6b3" (UID: "e74ba291-849b-4c80-ad6c-75c42e1fe6b3"). InnerVolumeSpecName "kube-api-access-hcfcp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:49:35.194808 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.194772    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e74ba291-849b-4c80-ad6c-75c42e1fe6b3" (UID: "e74ba291-849b-4c80-ad6c-75c42e1fe6b3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:49:35.194860 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.194824    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e74ba291-849b-4c80-ad6c-75c42e1fe6b3" (UID: "e74ba291-849b-4c80-ad6c-75c42e1fe6b3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:49:35.293526 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.293488    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-console-serving-cert\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:49:35.293526 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.293520    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-console-config\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:49:35.293526 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.293529    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-service-ca\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:49:35.293526 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.293538    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcfcp\" (UniqueName: \"kubernetes.io/projected/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-kube-api-access-hcfcp\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:49:35.293825 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.293547    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-trusted-ca-bundle\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:49:35.293825 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.293555    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-console-oauth-config\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:49:35.293825 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.293563    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e74ba291-849b-4c80-ad6c-75c42e1fe6b3-oauth-serving-cert\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 00:49:35.854516 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.854482    2582 generic.go:356] "Generic (PLEG): container finished" podID="e74ba291-849b-4c80-ad6c-75c42e1fe6b3" containerID="f7592d731df9f445cb0bc9fcb027a72812e0bda9a27fae2e0af14ca659fb2479" exitCode=0
Jul 21 00:49:35.855005 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.854530    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f6999dd7-rtjtm"
Jul 21 00:49:35.855005 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.854579    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f6999dd7-rtjtm" event={"ID":"e74ba291-849b-4c80-ad6c-75c42e1fe6b3","Type":"ContainerDied","Data":"f7592d731df9f445cb0bc9fcb027a72812e0bda9a27fae2e0af14ca659fb2479"}
Jul 21 00:49:35.855005 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.854628    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f6999dd7-rtjtm" event={"ID":"e74ba291-849b-4c80-ad6c-75c42e1fe6b3","Type":"ContainerDied","Data":"7cfa39170b200bc1c64f52c51804b203797dfcbfc1e0ebee65ebc79d16f23f93"}
Jul 21 00:49:35.855005 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.854667    2582 scope.go:117] "RemoveContainer" containerID="f7592d731df9f445cb0bc9fcb027a72812e0bda9a27fae2e0af14ca659fb2479"
Jul 21 00:49:35.864084 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.864067    2582 scope.go:117] "RemoveContainer" containerID="f7592d731df9f445cb0bc9fcb027a72812e0bda9a27fae2e0af14ca659fb2479"
Jul 21 00:49:35.864360 ip-10-0-133-75 kubenswrapper[2582]: E0721 00:49:35.864341    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7592d731df9f445cb0bc9fcb027a72812e0bda9a27fae2e0af14ca659fb2479\": container with ID starting with f7592d731df9f445cb0bc9fcb027a72812e0bda9a27fae2e0af14ca659fb2479 not found: ID does not exist" containerID="f7592d731df9f445cb0bc9fcb027a72812e0bda9a27fae2e0af14ca659fb2479"
Jul 21 00:49:35.864420 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.864372    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7592d731df9f445cb0bc9fcb027a72812e0bda9a27fae2e0af14ca659fb2479"} err="failed to get container status \"f7592d731df9f445cb0bc9fcb027a72812e0bda9a27fae2e0af14ca659fb2479\": rpc error: code = NotFound desc = could not find container \"f7592d731df9f445cb0bc9fcb027a72812e0bda9a27fae2e0af14ca659fb2479\": container with ID starting with f7592d731df9f445cb0bc9fcb027a72812e0bda9a27fae2e0af14ca659fb2479 not found: ID does not exist"
Jul 21 00:49:35.873894 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.873872    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f6999dd7-rtjtm"]
Jul 21 00:49:35.876924 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:35.876903    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f6999dd7-rtjtm"]
Jul 21 00:49:36.344496 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:36.344464    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e74ba291-849b-4c80-ad6c-75c42e1fe6b3" path="/var/lib/kubelet/pods/e74ba291-849b-4c80-ad6c-75c42e1fe6b3/volumes"
Jul 21 00:49:52.377514 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:52.377477    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 00:49:52.377937 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:52.377923    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e74ba291-849b-4c80-ad6c-75c42e1fe6b3" containerName="console"
Jul 21 00:49:52.377937 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:52.377938    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e74ba291-849b-4c80-ad6c-75c42e1fe6b3" containerName="console"
Jul 21 00:49:52.378014 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:52.378006    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e74ba291-849b-4c80-ad6c-75c42e1fe6b3" containerName="console"
Jul 21 00:49:52.428561 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:52.428523    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 00:49:52.428561 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:52.428561    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 00:49:52.428818 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:52.428638    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"
Jul 21 00:49:52.430475 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:52.430455    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 21 00:49:52.447407 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:52.447381    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w6dm\" (UniqueName: \"kubernetes.io/projected/ced3e099-5ce1-49b1-961a-c55ffc861ca0-kube-api-access-2w6dm\") pod \"limitador-limitador-54d6d988d5-xmfbr\" (UID: \"ced3e099-5ce1-49b1-961a-c55ffc861ca0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"
Jul 21 00:49:52.447736 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:52.447630    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ced3e099-5ce1-49b1-961a-c55ffc861ca0-config-file\") pod \"limitador-limitador-54d6d988d5-xmfbr\" (UID: \"ced3e099-5ce1-49b1-961a-c55ffc861ca0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"
Jul 21 00:49:52.549047 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:52.549009    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w6dm\" (UniqueName: \"kubernetes.io/projected/ced3e099-5ce1-49b1-961a-c55ffc861ca0-kube-api-access-2w6dm\") pod \"limitador-limitador-54d6d988d5-xmfbr\" (UID: \"ced3e099-5ce1-49b1-961a-c55ffc861ca0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"
Jul 21 00:49:52.549232 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:52.549064    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ced3e099-5ce1-49b1-961a-c55ffc861ca0-config-file\") pod \"limitador-limitador-54d6d988d5-xmfbr\" (UID: \"ced3e099-5ce1-49b1-961a-c55ffc861ca0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"
Jul 21 00:49:52.549623 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:52.549606    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ced3e099-5ce1-49b1-961a-c55ffc861ca0-config-file\") pod \"limitador-limitador-54d6d988d5-xmfbr\" (UID: \"ced3e099-5ce1-49b1-961a-c55ffc861ca0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"
Jul 21 00:49:52.556192 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:52.556166    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w6dm\" (UniqueName: \"kubernetes.io/projected/ced3e099-5ce1-49b1-961a-c55ffc861ca0-kube-api-access-2w6dm\") pod \"limitador-limitador-54d6d988d5-xmfbr\" (UID: \"ced3e099-5ce1-49b1-961a-c55ffc861ca0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"
Jul 21 00:49:52.739272 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:52.739231    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"
Jul 21 00:49:52.880059 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:52.880037    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 00:49:52.882449 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:49:52.882421    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podced3e099_5ce1_49b1_961a_c55ffc861ca0.slice/crio-ac19bdea86d725b88ad90fc401a286392dec49852cf80537b7bb1c9ac34e7181 WatchSource:0}: Error finding container ac19bdea86d725b88ad90fc401a286392dec49852cf80537b7bb1c9ac34e7181: Status 404 returned error can't find the container with id ac19bdea86d725b88ad90fc401a286392dec49852cf80537b7bb1c9ac34e7181
Jul 21 00:49:52.947303 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:52.947269    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-xmfbr" event={"ID":"ced3e099-5ce1-49b1-961a-c55ffc861ca0","Type":"ContainerStarted","Data":"ac19bdea86d725b88ad90fc401a286392dec49852cf80537b7bb1c9ac34e7181"}
Jul 21 00:49:55.966636 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:55.966603    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-xmfbr" event={"ID":"ced3e099-5ce1-49b1-961a-c55ffc861ca0","Type":"ContainerStarted","Data":"cdeb74541a06505c7b52614a4ef282f49fc987f7b35fc8b56224d74bd0ce9e50"}
Jul 21 00:49:55.967069 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:55.966720    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"
Jul 21 00:49:55.981685 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:49:55.981616    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-xmfbr" podStartSLOduration=1.571905522 podStartE2EDuration="3.981600317s" totalImagesPullingTime="2.409694795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:49:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:49:55.98019816 +0000 UTC m=+526.279894580" watchObservedRunningTime="2026-07-21 00:49:55.981600317 +0000 UTC m=+526.281296737"
Jul 21 00:50:06.972748 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:50:06.972716    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"
Jul 21 00:51:09.511091 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:51:09.511055    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 00:51:30.526124 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:51:30.526082    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 00:52:15.101257 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:15.101220    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 00:52:18.405088 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:18.405052    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 00:52:39.499869 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.499838    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"]
Jul 21 00:52:39.502262 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.502242    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"
Jul 21 00:52:39.504269 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.504247    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 00:52:39.504403 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.504279    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xtkz5\""
Jul 21 00:52:39.504903 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.504884    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 21 00:52:39.505030 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.504884    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 00:52:39.518717 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.518691    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"]
Jul 21 00:52:39.641177 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.641141    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fce3ed18-961a-414f-8ac9-23dabf3e9f73-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv\" (UID: \"fce3ed18-961a-414f-8ac9-23dabf3e9f73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"
Jul 21 00:52:39.641177 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.641178    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fce3ed18-961a-414f-8ac9-23dabf3e9f73-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv\" (UID: \"fce3ed18-961a-414f-8ac9-23dabf3e9f73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"
Jul 21 00:52:39.641437 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.641202    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwh9r\" (UniqueName: \"kubernetes.io/projected/fce3ed18-961a-414f-8ac9-23dabf3e9f73-kube-api-access-wwh9r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv\" (UID: \"fce3ed18-961a-414f-8ac9-23dabf3e9f73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"
Jul 21 00:52:39.641437 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.641304    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fce3ed18-961a-414f-8ac9-23dabf3e9f73-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv\" (UID: \"fce3ed18-961a-414f-8ac9-23dabf3e9f73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"
Jul 21 00:52:39.641437 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.641375    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fce3ed18-961a-414f-8ac9-23dabf3e9f73-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv\" (UID: \"fce3ed18-961a-414f-8ac9-23dabf3e9f73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"
Jul 21 00:52:39.641437 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.641409    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fce3ed18-961a-414f-8ac9-23dabf3e9f73-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv\" (UID: \"fce3ed18-961a-414f-8ac9-23dabf3e9f73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"
Jul 21 00:52:39.741975 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.741935    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fce3ed18-961a-414f-8ac9-23dabf3e9f73-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv\" (UID: \"fce3ed18-961a-414f-8ac9-23dabf3e9f73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"
Jul 21 00:52:39.741975 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.741981    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fce3ed18-961a-414f-8ac9-23dabf3e9f73-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv\" (UID: \"fce3ed18-961a-414f-8ac9-23dabf3e9f73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"
Jul 21 00:52:39.742253 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.742024    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fce3ed18-961a-414f-8ac9-23dabf3e9f73-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv\" (UID: \"fce3ed18-961a-414f-8ac9-23dabf3e9f73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"
Jul 21 00:52:39.742253 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.742043    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fce3ed18-961a-414f-8ac9-23dabf3e9f73-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv\" (UID: \"fce3ed18-961a-414f-8ac9-23dabf3e9f73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"
Jul 21 00:52:39.742253 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.742067    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwh9r\" (UniqueName: \"kubernetes.io/projected/fce3ed18-961a-414f-8ac9-23dabf3e9f73-kube-api-access-wwh9r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv\" (UID: \"fce3ed18-961a-414f-8ac9-23dabf3e9f73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"
Jul 21 00:52:39.742253 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.742096    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fce3ed18-961a-414f-8ac9-23dabf3e9f73-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv\" (UID: \"fce3ed18-961a-414f-8ac9-23dabf3e9f73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"
Jul 21 00:52:39.742460 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.742422    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fce3ed18-961a-414f-8ac9-23dabf3e9f73-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv\" (UID: \"fce3ed18-961a-414f-8ac9-23dabf3e9f73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"
Jul 21 00:52:39.742505 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.742487    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fce3ed18-961a-414f-8ac9-23dabf3e9f73-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv\" (UID: \"fce3ed18-961a-414f-8ac9-23dabf3e9f73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"
Jul 21 00:52:39.742547 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.742497    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fce3ed18-961a-414f-8ac9-23dabf3e9f73-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv\" (UID: \"fce3ed18-961a-414f-8ac9-23dabf3e9f73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"
Jul 21 00:52:39.744345 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.744322    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fce3ed18-961a-414f-8ac9-23dabf3e9f73-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv\" (UID: \"fce3ed18-961a-414f-8ac9-23dabf3e9f73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"
Jul 21 00:52:39.744497 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.744481    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fce3ed18-961a-414f-8ac9-23dabf3e9f73-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv\" (UID: \"fce3ed18-961a-414f-8ac9-23dabf3e9f73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"
Jul 21 00:52:39.749253 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.749229    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwh9r\" (UniqueName: \"kubernetes.io/projected/fce3ed18-961a-414f-8ac9-23dabf3e9f73-kube-api-access-wwh9r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv\" (UID: \"fce3ed18-961a-414f-8ac9-23dabf3e9f73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"
Jul 21 00:52:39.813423 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.813329    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"
Jul 21 00:52:39.947826 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.947794    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"]
Jul 21 00:52:39.950743 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:52:39.950720    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfce3ed18_961a_414f_8ac9_23dabf3e9f73.slice/crio-fae76ee82d46bb914e4dcfb873b45c9495b50d43714e11484edf678dd09174ca WatchSource:0}: Error finding container fae76ee82d46bb914e4dcfb873b45c9495b50d43714e11484edf678dd09174ca: Status 404 returned error can't find the container with id fae76ee82d46bb914e4dcfb873b45c9495b50d43714e11484edf678dd09174ca
Jul 21 00:52:39.952248 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:39.952226    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 00:52:40.393350 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:40.393320    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 00:52:40.831946 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:40.831905    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv" event={"ID":"fce3ed18-961a-414f-8ac9-23dabf3e9f73","Type":"ContainerStarted","Data":"fae76ee82d46bb914e4dcfb873b45c9495b50d43714e11484edf678dd09174ca"}
Jul 21 00:52:41.839083 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:41.839042    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv" event={"ID":"fce3ed18-961a-414f-8ac9-23dabf3e9f73","Type":"ContainerStarted","Data":"29592d64fac5e47dcde4d172209063bb422a69affa2b53463458df7026cb58a6"}
Jul 21 00:52:41.857173 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:41.857125    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv" podStartSLOduration=1.90335046 podStartE2EDuration="2.857107836s" totalImagesPullingTime="953.757376ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:52:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:52:41.854685317 +0000 UTC m=+692.154381730" watchObservedRunningTime="2026-07-21 00:52:41.857107836 +0000 UTC m=+692.156804257"
Jul 21 00:52:47.997588 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:47.997551    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 00:52:49.813926 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:49.813845    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"
Jul 21 00:52:49.813926 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:49.813900    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"
Jul 21 00:52:49.825962 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:49.825939    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"
Jul 21 00:52:49.890471 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:52:49.890445    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv"
Jul 21 00:53:00.208695 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.208635    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"]
Jul 21 00:53:00.211354 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.211332    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"
Jul 21 00:53:00.213269 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.213250    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 21 00:53:00.223584 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.223555    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"]
Jul 21 00:53:00.225196 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.225173    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca28beb9-b9b1-44f6-929d-afc104e4ff9d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz\" (UID: \"ca28beb9-b9b1-44f6-929d-afc104e4ff9d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"
Jul 21 00:53:00.225292 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.225207    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca28beb9-b9b1-44f6-929d-afc104e4ff9d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz\" (UID: \"ca28beb9-b9b1-44f6-929d-afc104e4ff9d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"
Jul 21 00:53:00.225292 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.225235    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca28beb9-b9b1-44f6-929d-afc104e4ff9d-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz\" (UID: \"ca28beb9-b9b1-44f6-929d-afc104e4ff9d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"
Jul 21 00:53:00.225369 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.225337    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca28beb9-b9b1-44f6-929d-afc104e4ff9d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz\" (UID: \"ca28beb9-b9b1-44f6-929d-afc104e4ff9d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"
Jul 21 00:53:00.225369 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.225364    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca28beb9-b9b1-44f6-929d-afc104e4ff9d-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz\" (UID: \"ca28beb9-b9b1-44f6-929d-afc104e4ff9d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"
Jul 21 00:53:00.225439 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.225384    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rrt8\" (UniqueName: \"kubernetes.io/projected/ca28beb9-b9b1-44f6-929d-afc104e4ff9d-kube-api-access-4rrt8\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz\" (UID: \"ca28beb9-b9b1-44f6-929d-afc104e4ff9d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"
Jul 21 00:53:00.326414 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.326384    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca28beb9-b9b1-44f6-929d-afc104e4ff9d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz\" (UID: \"ca28beb9-b9b1-44f6-929d-afc104e4ff9d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"
Jul 21 00:53:00.326414 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.326421    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca28beb9-b9b1-44f6-929d-afc104e4ff9d-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz\" (UID: \"ca28beb9-b9b1-44f6-929d-afc104e4ff9d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"
Jul 21 00:53:00.326677 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.326446    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rrt8\" (UniqueName: \"kubernetes.io/projected/ca28beb9-b9b1-44f6-929d-afc104e4ff9d-kube-api-access-4rrt8\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz\" (UID: \"ca28beb9-b9b1-44f6-929d-afc104e4ff9d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"
Jul 21 00:53:00.326677 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.326500    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca28beb9-b9b1-44f6-929d-afc104e4ff9d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz\" (UID: \"ca28beb9-b9b1-44f6-929d-afc104e4ff9d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"
Jul 21 00:53:00.326677 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.326548    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca28beb9-b9b1-44f6-929d-afc104e4ff9d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz\" (UID: \"ca28beb9-b9b1-44f6-929d-afc104e4ff9d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"
Jul 21 00:53:00.326907 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.326692    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca28beb9-b9b1-44f6-929d-afc104e4ff9d-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz\" (UID: \"ca28beb9-b9b1-44f6-929d-afc104e4ff9d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"
Jul 21 00:53:00.326907 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.326886    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca28beb9-b9b1-44f6-929d-afc104e4ff9d-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz\" (UID: \"ca28beb9-b9b1-44f6-929d-afc104e4ff9d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"
Jul 21 00:53:00.327017 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.326930    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca28beb9-b9b1-44f6-929d-afc104e4ff9d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz\" (UID: \"ca28beb9-b9b1-44f6-929d-afc104e4ff9d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"
Jul 21 00:53:00.327017 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.326976    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca28beb9-b9b1-44f6-929d-afc104e4ff9d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz\" (UID: \"ca28beb9-b9b1-44f6-929d-afc104e4ff9d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"
Jul 21 00:53:00.328821 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.328799    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca28beb9-b9b1-44f6-929d-afc104e4ff9d-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz\" (UID: \"ca28beb9-b9b1-44f6-929d-afc104e4ff9d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"
Jul 21 00:53:00.328964 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.328947    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca28beb9-b9b1-44f6-929d-afc104e4ff9d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz\" (UID: \"ca28beb9-b9b1-44f6-929d-afc104e4ff9d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"
Jul 21 00:53:00.332950 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.332931    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rrt8\" (UniqueName: \"kubernetes.io/projected/ca28beb9-b9b1-44f6-929d-afc104e4ff9d-kube-api-access-4rrt8\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz\" (UID: \"ca28beb9-b9b1-44f6-929d-afc104e4ff9d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"
Jul 21 00:53:00.520500 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.520415    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"
Jul 21 00:53:00.652125 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.652084    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"]
Jul 21 00:53:00.654731 ip-10-0-133-75 kubenswrapper[2582]: W0721 00:53:00.654706    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca28beb9_b9b1_44f6_929d_afc104e4ff9d.slice/crio-ff448008bbabac592647a0107b16e25f8a63a74adf983587f9b21c9c16953f44 WatchSource:0}: Error finding container ff448008bbabac592647a0107b16e25f8a63a74adf983587f9b21c9c16953f44: Status 404 returned error can't find the container with id ff448008bbabac592647a0107b16e25f8a63a74adf983587f9b21c9c16953f44
Jul 21 00:53:00.937455 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.937416    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz" event={"ID":"ca28beb9-b9b1-44f6-929d-afc104e4ff9d","Type":"ContainerStarted","Data":"93f14fdddf1a3cdf47541248005900cc88d9200756f339a4c74c9e71865fd02a"}
Jul 21 00:53:00.937455 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.937458    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz" event={"ID":"ca28beb9-b9b1-44f6-929d-afc104e4ff9d","Type":"ContainerStarted","Data":"ff448008bbabac592647a0107b16e25f8a63a74adf983587f9b21c9c16953f44"}
Jul 21 00:53:00.954450 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:00.954118    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz" podStartSLOduration=0.769522371 podStartE2EDuration="954.097317ms" totalImagesPullingTime="184.574946ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:53:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:53:00.951914537 +0000 UTC m=+711.251610967" watchObservedRunningTime="2026-07-21 00:53:00.954097317 +0000 UTC m=+711.253793738"
Jul 21 00:53:02.604288 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:02.604216    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 00:53:10.521168 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:10.521136    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"
Jul 21 00:53:10.521734 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:10.521186    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"
Jul 21 00:53:10.533493 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:10.533471    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"
Jul 21 00:53:11.006593 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:53:11.006563    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz"
Jul 21 00:55:22.605574 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:55:22.605535    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 00:55:32.495448 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:55:32.495406    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 00:55:43.402957 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:55:43.402920    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 00:57:24.697092 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:57:24.697059    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 00:57:33.707317 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:57:33.707223    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 00:58:03.995398 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:58:03.995364    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 00:58:11.313766 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:58:11.313726    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 00:58:22.309039 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:58:22.309002    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 00:58:29.899615 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:58:29.899583    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 00:58:40.503422 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:58:40.503390    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 00:58:50.100875 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:58:50.100838    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 00:59:00.501899 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:59:00.501854    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 00:59:10.400260 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:59:10.400217    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 00:59:32.309354 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:59:32.309313    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 00:59:44.600438 ip-10-0-133-75 kubenswrapper[2582]: I0721 00:59:44.600398    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:00:07.703848 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:00:07.703807    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:00:18.799631 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:00:18.799594    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:00:35.504047 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:00:35.503961    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:00:45.014127 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:00:45.014086    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:00:55.203521 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:00:55.203482    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:01:04.705947 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:01:04.705902    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:01:14.504588 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:01:14.504551    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:03:03.808217 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:03:03.808177    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:03:15.593320 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:03:15.593279    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:03:24.206011 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:03:24.205978    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:03:35.408406 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:03:35.408320    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:03:47.306406 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:03:47.306364    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:03:58.301182 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:03:58.301143    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:04:06.897460 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:04:06.897416    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:04:17.403991 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:04:17.403955    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:04:29.197684 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:04:29.197627    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:04:37.799220 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:04:37.799186    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:04:48.898994 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:04:48.898956    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:05:14.099494 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:14.099452    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:05:21.511703 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:21.511642    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:05:29.211536 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:29.211498    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"]
Jul 21 01:05:29.214290 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:29.214275    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"
Jul 21 01:05:29.216279 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:29.216257    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-de973fc9-kserve-self-signed-certs\""
Jul 21 01:05:29.232326 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:29.232304    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"]
Jul 21 01:05:29.270315 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:29.270292    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee5cbe35-e693-436c-9e4b-2897883b67f6-dshm\") pod \"e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b\" (UID: \"ee5cbe35-e693-436c-9e4b-2897883b67f6\") " pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"
Jul 21 01:05:29.270439 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:29.270320    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee5cbe35-e693-436c-9e4b-2897883b67f6-tls-certs\") pod \"e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b\" (UID: \"ee5cbe35-e693-436c-9e4b-2897883b67f6\") " pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"
Jul 21 01:05:29.270439 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:29.270348    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee5cbe35-e693-436c-9e4b-2897883b67f6-model-cache\") pod \"e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b\" (UID: \"ee5cbe35-e693-436c-9e4b-2897883b67f6\") " pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"
Jul 21 01:05:29.270439 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:29.270370    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee5cbe35-e693-436c-9e4b-2897883b67f6-home\") pod \"e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b\" (UID: \"ee5cbe35-e693-436c-9e4b-2897883b67f6\") " pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"
Jul 21 01:05:29.270564 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:29.270437    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee5cbe35-e693-436c-9e4b-2897883b67f6-tmp-dir\") pod \"e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b\" (UID: \"ee5cbe35-e693-436c-9e4b-2897883b67f6\") " pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"
Jul 21 01:05:29.270564 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:29.270503    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmnjd\" (UniqueName: \"kubernetes.io/projected/ee5cbe35-e693-436c-9e4b-2897883b67f6-kube-api-access-lmnjd\") pod \"e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b\" (UID: \"ee5cbe35-e693-436c-9e4b-2897883b67f6\") " pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"
Jul 21 01:05:29.370980 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:29.370953    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee5cbe35-e693-436c-9e4b-2897883b67f6-dshm\") pod \"e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b\" (UID: \"ee5cbe35-e693-436c-9e4b-2897883b67f6\") " pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"
Jul 21 01:05:29.370980 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:29.370981    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee5cbe35-e693-436c-9e4b-2897883b67f6-tls-certs\") pod \"e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b\" (UID: \"ee5cbe35-e693-436c-9e4b-2897883b67f6\") " pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"
Jul 21 01:05:29.371120 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:29.371007    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee5cbe35-e693-436c-9e4b-2897883b67f6-model-cache\") pod \"e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b\" (UID: \"ee5cbe35-e693-436c-9e4b-2897883b67f6\") " pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"
Jul 21 01:05:29.371120 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:29.371028    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee5cbe35-e693-436c-9e4b-2897883b67f6-home\") pod \"e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b\" (UID: \"ee5cbe35-e693-436c-9e4b-2897883b67f6\") " pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"
Jul 21 01:05:29.371120 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:29.371061    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee5cbe35-e693-436c-9e4b-2897883b67f6-tmp-dir\") pod \"e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b\" (UID: \"ee5cbe35-e693-436c-9e4b-2897883b67f6\") " pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"
Jul 21 01:05:29.371242 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:29.371127    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmnjd\" (UniqueName: \"kubernetes.io/projected/ee5cbe35-e693-436c-9e4b-2897883b67f6-kube-api-access-lmnjd\") pod \"e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b\" (UID: \"ee5cbe35-e693-436c-9e4b-2897883b67f6\") " pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"
Jul 21 01:05:29.371444 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:29.371415    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee5cbe35-e693-436c-9e4b-2897883b67f6-model-cache\") pod \"e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b\" (UID: \"ee5cbe35-e693-436c-9e4b-2897883b67f6\") " pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"
Jul 21 01:05:29.371546 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:29.371469    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee5cbe35-e693-436c-9e4b-2897883b67f6-tmp-dir\") pod \"e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b\" (UID: \"ee5cbe35-e693-436c-9e4b-2897883b67f6\") " pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"
Jul 21 01:05:29.371546 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:29.371511    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee5cbe35-e693-436c-9e4b-2897883b67f6-home\") pod \"e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b\" (UID: \"ee5cbe35-e693-436c-9e4b-2897883b67f6\") " pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"
Jul 21 01:05:29.373206 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:29.373184    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee5cbe35-e693-436c-9e4b-2897883b67f6-dshm\") pod \"e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b\" (UID: \"ee5cbe35-e693-436c-9e4b-2897883b67f6\") " pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"
Jul 21 01:05:29.373349 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:29.373333    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee5cbe35-e693-436c-9e4b-2897883b67f6-tls-certs\") pod \"e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b\" (UID: \"ee5cbe35-e693-436c-9e4b-2897883b67f6\") " pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"
Jul 21 01:05:29.378716 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:29.378699    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmnjd\" (UniqueName: \"kubernetes.io/projected/ee5cbe35-e693-436c-9e4b-2897883b67f6-kube-api-access-lmnjd\") pod \"e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b\" (UID: \"ee5cbe35-e693-436c-9e4b-2897883b67f6\") " pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"
Jul 21 01:05:29.524139 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:29.524043    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"
Jul 21 01:05:29.652512 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:29.652486    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"]
Jul 21 01:05:29.654485 ip-10-0-133-75 kubenswrapper[2582]: W0721 01:05:29.654460    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee5cbe35_e693_436c_9e4b_2897883b67f6.slice/crio-99085d9264b90cc6d973a20d9e99baa1a32de1a6519616250f84b387a1e386bd WatchSource:0}: Error finding container 99085d9264b90cc6d973a20d9e99baa1a32de1a6519616250f84b387a1e386bd: Status 404 returned error can't find the container with id 99085d9264b90cc6d973a20d9e99baa1a32de1a6519616250f84b387a1e386bd
Jul 21 01:05:29.996027 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:29.995994    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b" event={"ID":"ee5cbe35-e693-436c-9e4b-2897883b67f6","Type":"ContainerStarted","Data":"ae5fb1ca5ea2dafd6b700b2513f75b8de91c7e16586eecd16906f7a6f2c4573c"}
Jul 21 01:05:29.996027 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:29.996035    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b" event={"ID":"ee5cbe35-e693-436c-9e4b-2897883b67f6","Type":"ContainerStarted","Data":"99085d9264b90cc6d973a20d9e99baa1a32de1a6519616250f84b387a1e386bd"}
Jul 21 01:05:30.011658 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:30.011609    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b" podStartSLOduration=1.011593061 podStartE2EDuration="1.011593061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:05:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:05:30.008792963 +0000 UTC m=+1460.308489383" watchObservedRunningTime="2026-07-21 01:05:30.011593061 +0000 UTC m=+1460.311289536"
Jul 21 01:05:33.202838 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:33.202808    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"]
Jul 21 01:05:33.205327 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:33.205310    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"
Jul 21 01:05:33.206998 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:33.206979    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-de973fc9-kserve-self-signed-certs\""
Jul 21 01:05:33.212454 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:33.212435    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"]
Jul 21 01:05:33.307596 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:33.307560    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f865ee3-d49e-401e-962d-aa03c2f1a583-dshm\") pod \"e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x\" (UID: \"4f865ee3-d49e-401e-962d-aa03c2f1a583\") " pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"
Jul 21 01:05:33.307596 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:33.307599    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8mm8\" (UniqueName: \"kubernetes.io/projected/4f865ee3-d49e-401e-962d-aa03c2f1a583-kube-api-access-t8mm8\") pod \"e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x\" (UID: \"4f865ee3-d49e-401e-962d-aa03c2f1a583\") " pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"
Jul 21 01:05:33.307857 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:33.307684    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f865ee3-d49e-401e-962d-aa03c2f1a583-model-cache\") pod \"e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x\" (UID: \"4f865ee3-d49e-401e-962d-aa03c2f1a583\") " pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"
Jul 21 01:05:33.307857 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:33.307758    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f865ee3-d49e-401e-962d-aa03c2f1a583-tls-certs\") pod \"e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x\" (UID: \"4f865ee3-d49e-401e-962d-aa03c2f1a583\") " pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"
Jul 21 01:05:33.307857 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:33.307786    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f865ee3-d49e-401e-962d-aa03c2f1a583-home\") pod \"e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x\" (UID: \"4f865ee3-d49e-401e-962d-aa03c2f1a583\") " pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"
Jul 21 01:05:33.307857 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:33.307813    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f865ee3-d49e-401e-962d-aa03c2f1a583-tmp-dir\") pod \"e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x\" (UID: \"4f865ee3-d49e-401e-962d-aa03c2f1a583\") " pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"
Jul 21 01:05:33.409112 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:33.409067    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f865ee3-d49e-401e-962d-aa03c2f1a583-tls-certs\") pod \"e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x\" (UID: \"4f865ee3-d49e-401e-962d-aa03c2f1a583\") " pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"
Jul 21 01:05:33.409112 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:33.409117    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f865ee3-d49e-401e-962d-aa03c2f1a583-home\") pod \"e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x\" (UID: \"4f865ee3-d49e-401e-962d-aa03c2f1a583\") " pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"
Jul 21 01:05:33.409391 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:33.409156    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f865ee3-d49e-401e-962d-aa03c2f1a583-tmp-dir\") pod \"e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x\" (UID: \"4f865ee3-d49e-401e-962d-aa03c2f1a583\") " pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"
Jul 21 01:05:33.409391 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:33.409219    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f865ee3-d49e-401e-962d-aa03c2f1a583-dshm\") pod \"e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x\" (UID: \"4f865ee3-d49e-401e-962d-aa03c2f1a583\") " pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"
Jul 21 01:05:33.409391 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:33.409241    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8mm8\" (UniqueName: \"kubernetes.io/projected/4f865ee3-d49e-401e-962d-aa03c2f1a583-kube-api-access-t8mm8\") pod \"e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x\" (UID: \"4f865ee3-d49e-401e-962d-aa03c2f1a583\") " pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"
Jul 21 01:05:33.409391 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:33.409293    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f865ee3-d49e-401e-962d-aa03c2f1a583-model-cache\") pod \"e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x\" (UID: \"4f865ee3-d49e-401e-962d-aa03c2f1a583\") " pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"
Jul 21 01:05:33.409636 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:33.409610    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f865ee3-d49e-401e-962d-aa03c2f1a583-tmp-dir\") pod \"e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x\" (UID: \"4f865ee3-d49e-401e-962d-aa03c2f1a583\") " pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"
Jul 21 01:05:33.409738 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:33.409678    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f865ee3-d49e-401e-962d-aa03c2f1a583-home\") pod \"e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x\" (UID: \"4f865ee3-d49e-401e-962d-aa03c2f1a583\") " pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"
Jul 21 01:05:33.409811 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:33.409789    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f865ee3-d49e-401e-962d-aa03c2f1a583-model-cache\") pod \"e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x\" (UID: \"4f865ee3-d49e-401e-962d-aa03c2f1a583\") " pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"
Jul 21 01:05:33.411468 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:33.411441    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f865ee3-d49e-401e-962d-aa03c2f1a583-dshm\") pod \"e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x\" (UID: \"4f865ee3-d49e-401e-962d-aa03c2f1a583\") " pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"
Jul 21 01:05:33.411596 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:33.411583    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f865ee3-d49e-401e-962d-aa03c2f1a583-tls-certs\") pod \"e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x\" (UID: \"4f865ee3-d49e-401e-962d-aa03c2f1a583\") " pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"
Jul 21 01:05:33.415765 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:33.415748    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8mm8\" (UniqueName: \"kubernetes.io/projected/4f865ee3-d49e-401e-962d-aa03c2f1a583-kube-api-access-t8mm8\") pod \"e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x\" (UID: \"4f865ee3-d49e-401e-962d-aa03c2f1a583\") " pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"
Jul 21 01:05:33.515537 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:33.515452    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"
Jul 21 01:05:33.649367 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:33.649339    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"]
Jul 21 01:05:33.651395 ip-10-0-133-75 kubenswrapper[2582]: W0721 01:05:33.651369    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f865ee3_d49e_401e_962d_aa03c2f1a583.slice/crio-5622500ff095b641d45c1ac10bec622f726d2f0a9afdc8da93b2d2d1570f568f WatchSource:0}: Error finding container 5622500ff095b641d45c1ac10bec622f726d2f0a9afdc8da93b2d2d1570f568f: Status 404 returned error can't find the container with id 5622500ff095b641d45c1ac10bec622f726d2f0a9afdc8da93b2d2d1570f568f
Jul 21 01:05:34.019237 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:34.019203    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x" event={"ID":"4f865ee3-d49e-401e-962d-aa03c2f1a583","Type":"ContainerStarted","Data":"186773f628dfdf37cbcd4a76957399604a03f1a513ed9874152ef63a3e4a0fb2"}
Jul 21 01:05:34.019444 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:34.019247    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x" event={"ID":"4f865ee3-d49e-401e-962d-aa03c2f1a583","Type":"ContainerStarted","Data":"5622500ff095b641d45c1ac10bec622f726d2f0a9afdc8da93b2d2d1570f568f"}
Jul 21 01:05:34.034515 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:34.034465    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x" podStartSLOduration=1.034447726 podStartE2EDuration="1.034447726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:05:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:05:34.032801056 +0000 UTC m=+1464.332497478" watchObservedRunningTime="2026-07-21 01:05:34.034447726 +0000 UTC m=+1464.334144148"
Jul 21 01:05:34.698262 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:34.698226    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:05:39.524869 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:39.524767    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"
Jul 21 01:05:39.524869 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:39.524825    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"
Jul 21 01:05:39.537111 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:39.537088    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"
Jul 21 01:05:40.062088 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:40.062059    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"
Jul 21 01:05:43.516154 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:43.516122    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"
Jul 21 01:05:43.516557 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:43.516170    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"
Jul 21 01:05:43.528335 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:43.528306    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"
Jul 21 01:05:44.084103 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:44.084075    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"
Jul 21 01:05:48.400589 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:05:48.400556    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:06:06.515422 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:06.515386    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"]
Jul 21 01:06:07.821144 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:07.821103    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"]
Jul 21 01:06:09.806574 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:09.806539    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:06:21.537322 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:21.537255    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b" podUID="ee5cbe35-e693-436c-9e4b-2897883b67f6" containerName="main" containerID="cri-o://ae5fb1ca5ea2dafd6b700b2513f75b8de91c7e16586eecd16906f7a6f2c4573c" gracePeriod=45
Jul 21 01:06:21.789070 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:21.789006    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"
Jul 21 01:06:21.979450 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:21.979410    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee5cbe35-e693-436c-9e4b-2897883b67f6-home\") pod \"ee5cbe35-e693-436c-9e4b-2897883b67f6\" (UID: \"ee5cbe35-e693-436c-9e4b-2897883b67f6\") "
Jul 21 01:06:21.979683 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:21.979470    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmnjd\" (UniqueName: \"kubernetes.io/projected/ee5cbe35-e693-436c-9e4b-2897883b67f6-kube-api-access-lmnjd\") pod \"ee5cbe35-e693-436c-9e4b-2897883b67f6\" (UID: \"ee5cbe35-e693-436c-9e4b-2897883b67f6\") "
Jul 21 01:06:21.979683 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:21.979542    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee5cbe35-e693-436c-9e4b-2897883b67f6-tls-certs\") pod \"ee5cbe35-e693-436c-9e4b-2897883b67f6\" (UID: \"ee5cbe35-e693-436c-9e4b-2897883b67f6\") "
Jul 21 01:06:21.979683 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:21.979572    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee5cbe35-e693-436c-9e4b-2897883b67f6-model-cache\") pod \"ee5cbe35-e693-436c-9e4b-2897883b67f6\" (UID: \"ee5cbe35-e693-436c-9e4b-2897883b67f6\") "
Jul 21 01:06:21.979683 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:21.979603    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee5cbe35-e693-436c-9e4b-2897883b67f6-dshm\") pod \"ee5cbe35-e693-436c-9e4b-2897883b67f6\" (UID: \"ee5cbe35-e693-436c-9e4b-2897883b67f6\") "
Jul 21 01:06:21.979683 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:21.979636    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee5cbe35-e693-436c-9e4b-2897883b67f6-tmp-dir\") pod \"ee5cbe35-e693-436c-9e4b-2897883b67f6\" (UID: \"ee5cbe35-e693-436c-9e4b-2897883b67f6\") "
Jul 21 01:06:21.980193 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:21.979726    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5cbe35-e693-436c-9e4b-2897883b67f6-home" (OuterVolumeSpecName: "home") pod "ee5cbe35-e693-436c-9e4b-2897883b67f6" (UID: "ee5cbe35-e693-436c-9e4b-2897883b67f6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:06:21.980193 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:21.979887    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5cbe35-e693-436c-9e4b-2897883b67f6-model-cache" (OuterVolumeSpecName: "model-cache") pod "ee5cbe35-e693-436c-9e4b-2897883b67f6" (UID: "ee5cbe35-e693-436c-9e4b-2897883b67f6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:06:21.980193 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:21.979904    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5cbe35-e693-436c-9e4b-2897883b67f6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ee5cbe35-e693-436c-9e4b-2897883b67f6" (UID: "ee5cbe35-e693-436c-9e4b-2897883b67f6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:06:21.980193 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:21.979998    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee5cbe35-e693-436c-9e4b-2897883b67f6-home\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:06:21.980193 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:21.980028    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee5cbe35-e693-436c-9e4b-2897883b67f6-model-cache\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:06:21.980193 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:21.980060    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee5cbe35-e693-436c-9e4b-2897883b67f6-tmp-dir\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:06:21.981863 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:21.981839    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee5cbe35-e693-436c-9e4b-2897883b67f6-kube-api-access-lmnjd" (OuterVolumeSpecName: "kube-api-access-lmnjd") pod "ee5cbe35-e693-436c-9e4b-2897883b67f6" (UID: "ee5cbe35-e693-436c-9e4b-2897883b67f6"). InnerVolumeSpecName "kube-api-access-lmnjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:06:21.981957 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:21.981845    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5cbe35-e693-436c-9e4b-2897883b67f6-dshm" (OuterVolumeSpecName: "dshm") pod "ee5cbe35-e693-436c-9e4b-2897883b67f6" (UID: "ee5cbe35-e693-436c-9e4b-2897883b67f6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:06:21.981957 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:21.981884    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee5cbe35-e693-436c-9e4b-2897883b67f6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ee5cbe35-e693-436c-9e4b-2897883b67f6" (UID: "ee5cbe35-e693-436c-9e4b-2897883b67f6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:06:22.081085 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:22.080989    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmnjd\" (UniqueName: \"kubernetes.io/projected/ee5cbe35-e693-436c-9e4b-2897883b67f6-kube-api-access-lmnjd\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:06:22.081085 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:22.081022    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee5cbe35-e693-436c-9e4b-2897883b67f6-tls-certs\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:06:22.081085 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:22.081034    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee5cbe35-e693-436c-9e4b-2897883b67f6-dshm\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:06:22.288795 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:22.288762    2582 generic.go:356] "Generic (PLEG): container finished" podID="ee5cbe35-e693-436c-9e4b-2897883b67f6" containerID="ae5fb1ca5ea2dafd6b700b2513f75b8de91c7e16586eecd16906f7a6f2c4573c" exitCode=0
Jul 21 01:06:22.289007 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:22.288806    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"
Jul 21 01:06:22.289007 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:22.288843    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b" event={"ID":"ee5cbe35-e693-436c-9e4b-2897883b67f6","Type":"ContainerDied","Data":"ae5fb1ca5ea2dafd6b700b2513f75b8de91c7e16586eecd16906f7a6f2c4573c"}
Jul 21 01:06:22.289007 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:22.288882    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b" event={"ID":"ee5cbe35-e693-436c-9e4b-2897883b67f6","Type":"ContainerDied","Data":"99085d9264b90cc6d973a20d9e99baa1a32de1a6519616250f84b387a1e386bd"}
Jul 21 01:06:22.289007 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:22.288899    2582 scope.go:117] "RemoveContainer" containerID="ae5fb1ca5ea2dafd6b700b2513f75b8de91c7e16586eecd16906f7a6f2c4573c"
Jul 21 01:06:22.298326 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:22.298309    2582 scope.go:117] "RemoveContainer" containerID="ae5fb1ca5ea2dafd6b700b2513f75b8de91c7e16586eecd16906f7a6f2c4573c"
Jul 21 01:06:22.298591 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:06:22.298573    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae5fb1ca5ea2dafd6b700b2513f75b8de91c7e16586eecd16906f7a6f2c4573c\": container with ID starting with ae5fb1ca5ea2dafd6b700b2513f75b8de91c7e16586eecd16906f7a6f2c4573c not found: ID does not exist" containerID="ae5fb1ca5ea2dafd6b700b2513f75b8de91c7e16586eecd16906f7a6f2c4573c"
Jul 21 01:06:22.298644 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:22.298601    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae5fb1ca5ea2dafd6b700b2513f75b8de91c7e16586eecd16906f7a6f2c4573c"} err="failed to get container status \"ae5fb1ca5ea2dafd6b700b2513f75b8de91c7e16586eecd16906f7a6f2c4573c\": rpc error: code = NotFound desc = could not find container \"ae5fb1ca5ea2dafd6b700b2513f75b8de91c7e16586eecd16906f7a6f2c4573c\": container with ID starting with ae5fb1ca5ea2dafd6b700b2513f75b8de91c7e16586eecd16906f7a6f2c4573c not found: ID does not exist"
Jul 21 01:06:22.311074 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:22.311042    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"]
Jul 21 01:06:22.314918 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:22.314893    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-de973fc9-kserve-84df9cc4ff-msd8b"]
Jul 21 01:06:22.344705 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:22.344603    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee5cbe35-e693-436c-9e4b-2897883b67f6" path="/var/lib/kubelet/pods/ee5cbe35-e693-436c-9e4b-2897883b67f6/volumes"
Jul 21 01:06:22.841664 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:22.841609    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x" podUID="4f865ee3-d49e-401e-962d-aa03c2f1a583" containerName="main" containerID="cri-o://186773f628dfdf37cbcd4a76957399604a03f1a513ed9874152ef63a3e4a0fb2" gracePeriod=45
Jul 21 01:06:23.093957 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.093891    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"
Jul 21 01:06:23.190294 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.190256    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f865ee3-d49e-401e-962d-aa03c2f1a583-dshm\") pod \"4f865ee3-d49e-401e-962d-aa03c2f1a583\" (UID: \"4f865ee3-d49e-401e-962d-aa03c2f1a583\") "
Jul 21 01:06:23.190294 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.190294    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f865ee3-d49e-401e-962d-aa03c2f1a583-model-cache\") pod \"4f865ee3-d49e-401e-962d-aa03c2f1a583\" (UID: \"4f865ee3-d49e-401e-962d-aa03c2f1a583\") "
Jul 21 01:06:23.190561 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.190308    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f865ee3-d49e-401e-962d-aa03c2f1a583-home\") pod \"4f865ee3-d49e-401e-962d-aa03c2f1a583\" (UID: \"4f865ee3-d49e-401e-962d-aa03c2f1a583\") "
Jul 21 01:06:23.190561 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.190327    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f865ee3-d49e-401e-962d-aa03c2f1a583-tls-certs\") pod \"4f865ee3-d49e-401e-962d-aa03c2f1a583\" (UID: \"4f865ee3-d49e-401e-962d-aa03c2f1a583\") "
Jul 21 01:06:23.190561 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.190400    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f865ee3-d49e-401e-962d-aa03c2f1a583-tmp-dir\") pod \"4f865ee3-d49e-401e-962d-aa03c2f1a583\" (UID: \"4f865ee3-d49e-401e-962d-aa03c2f1a583\") "
Jul 21 01:06:23.190561 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.190486    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8mm8\" (UniqueName: \"kubernetes.io/projected/4f865ee3-d49e-401e-962d-aa03c2f1a583-kube-api-access-t8mm8\") pod \"4f865ee3-d49e-401e-962d-aa03c2f1a583\" (UID: \"4f865ee3-d49e-401e-962d-aa03c2f1a583\") "
Jul 21 01:06:23.190819 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.190576    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f865ee3-d49e-401e-962d-aa03c2f1a583-home" (OuterVolumeSpecName: "home") pod "4f865ee3-d49e-401e-962d-aa03c2f1a583" (UID: "4f865ee3-d49e-401e-962d-aa03c2f1a583"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:06:23.190819 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.190700    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f865ee3-d49e-401e-962d-aa03c2f1a583-model-cache" (OuterVolumeSpecName: "model-cache") pod "4f865ee3-d49e-401e-962d-aa03c2f1a583" (UID: "4f865ee3-d49e-401e-962d-aa03c2f1a583"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:06:23.190819 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.190736    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f865ee3-d49e-401e-962d-aa03c2f1a583-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4f865ee3-d49e-401e-962d-aa03c2f1a583" (UID: "4f865ee3-d49e-401e-962d-aa03c2f1a583"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:06:23.191012 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.190860    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f865ee3-d49e-401e-962d-aa03c2f1a583-tmp-dir\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:06:23.191012 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.190875    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f865ee3-d49e-401e-962d-aa03c2f1a583-model-cache\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:06:23.191012 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.190890    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f865ee3-d49e-401e-962d-aa03c2f1a583-home\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:06:23.192569 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.192545    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f865ee3-d49e-401e-962d-aa03c2f1a583-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4f865ee3-d49e-401e-962d-aa03c2f1a583" (UID: "4f865ee3-d49e-401e-962d-aa03c2f1a583"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:06:23.192569 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.192558    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f865ee3-d49e-401e-962d-aa03c2f1a583-dshm" (OuterVolumeSpecName: "dshm") pod "4f865ee3-d49e-401e-962d-aa03c2f1a583" (UID: "4f865ee3-d49e-401e-962d-aa03c2f1a583"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:06:23.192745 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.192599    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f865ee3-d49e-401e-962d-aa03c2f1a583-kube-api-access-t8mm8" (OuterVolumeSpecName: "kube-api-access-t8mm8") pod "4f865ee3-d49e-401e-962d-aa03c2f1a583" (UID: "4f865ee3-d49e-401e-962d-aa03c2f1a583"). InnerVolumeSpecName "kube-api-access-t8mm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:06:23.291938 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.291903    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8mm8\" (UniqueName: \"kubernetes.io/projected/4f865ee3-d49e-401e-962d-aa03c2f1a583-kube-api-access-t8mm8\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:06:23.291938 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.291935    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f865ee3-d49e-401e-962d-aa03c2f1a583-dshm\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:06:23.292166 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.291949    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f865ee3-d49e-401e-962d-aa03c2f1a583-tls-certs\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:06:23.297206 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.297176    2582 generic.go:356] "Generic (PLEG): container finished" podID="4f865ee3-d49e-401e-962d-aa03c2f1a583" containerID="186773f628dfdf37cbcd4a76957399604a03f1a513ed9874152ef63a3e4a0fb2" exitCode=0
Jul 21 01:06:23.297356 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.297221    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"
Jul 21 01:06:23.297356 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.297258    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x" event={"ID":"4f865ee3-d49e-401e-962d-aa03c2f1a583","Type":"ContainerDied","Data":"186773f628dfdf37cbcd4a76957399604a03f1a513ed9874152ef63a3e4a0fb2"}
Jul 21 01:06:23.297356 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.297303    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x" event={"ID":"4f865ee3-d49e-401e-962d-aa03c2f1a583","Type":"ContainerDied","Data":"5622500ff095b641d45c1ac10bec622f726d2f0a9afdc8da93b2d2d1570f568f"}
Jul 21 01:06:23.297356 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.297326    2582 scope.go:117] "RemoveContainer" containerID="186773f628dfdf37cbcd4a76957399604a03f1a513ed9874152ef63a3e4a0fb2"
Jul 21 01:06:23.302555 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.302528    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:06:23.308292 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.308276    2582 scope.go:117] "RemoveContainer" containerID="186773f628dfdf37cbcd4a76957399604a03f1a513ed9874152ef63a3e4a0fb2"
Jul 21 01:06:23.308603 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:06:23.308583    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"186773f628dfdf37cbcd4a76957399604a03f1a513ed9874152ef63a3e4a0fb2\": container with ID starting with 186773f628dfdf37cbcd4a76957399604a03f1a513ed9874152ef63a3e4a0fb2 not found: ID does not exist" containerID="186773f628dfdf37cbcd4a76957399604a03f1a513ed9874152ef63a3e4a0fb2"
Jul 21 01:06:23.308675 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.308612    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"186773f628dfdf37cbcd4a76957399604a03f1a513ed9874152ef63a3e4a0fb2"} err="failed to get container status \"186773f628dfdf37cbcd4a76957399604a03f1a513ed9874152ef63a3e4a0fb2\": rpc error: code = NotFound desc = could not find container \"186773f628dfdf37cbcd4a76957399604a03f1a513ed9874152ef63a3e4a0fb2\": container with ID starting with 186773f628dfdf37cbcd4a76957399604a03f1a513ed9874152ef63a3e4a0fb2 not found: ID does not exist"
Jul 21 01:06:23.317468 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.317440    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"]
Jul 21 01:06:23.323108 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:23.323083    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-de973fc9-kserve-6589d7c85f-gdc2x"]
Jul 21 01:06:24.344896 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:24.344863    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f865ee3-d49e-401e-962d-aa03c2f1a583" path="/var/lib/kubelet/pods/4f865ee3-d49e-401e-962d-aa03c2f1a583/volumes"
Jul 21 01:06:33.605542 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:33.605468    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:06:46.202480 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:46.202443    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:06:55.798342 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:06:55.798301    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:07:05.405091 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:07:05.405055    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:07:14.311464 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:07:14.311430    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:07:25.301614 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:07:25.301572    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:07:34.306774 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:07:34.306737    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:07:47.603430 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:07:47.603391    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:07:56.898666 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:07:56.898611    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:08:06.396538 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:08:06.396495    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:08:17.297493 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:08:17.297462    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:08:28.195419 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:08:28.195379    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:08:34.995383 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:08:34.995338    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:08:51.304326 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:08:51.304287    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:09:04.103147 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:04.103107    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:09:13.104590 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:13.104554    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:09:25.809610 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:25.809565    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:09:40.305640 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:40.305562    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:09:48.895939 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:48.895902    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5"]
Jul 21 01:09:48.896405 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:48.896298    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f865ee3-d49e-401e-962d-aa03c2f1a583" containerName="main"
Jul 21 01:09:48.896405 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:48.896309    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f865ee3-d49e-401e-962d-aa03c2f1a583" containerName="main"
Jul 21 01:09:48.896405 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:48.896336    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee5cbe35-e693-436c-9e4b-2897883b67f6" containerName="main"
Jul 21 01:09:48.896405 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:48.896342    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee5cbe35-e693-436c-9e4b-2897883b67f6" containerName="main"
Jul 21 01:09:48.896531 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:48.896408    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f865ee3-d49e-401e-962d-aa03c2f1a583" containerName="main"
Jul 21 01:09:48.896531 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:48.896418    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee5cbe35-e693-436c-9e4b-2897883b67f6" containerName="main"
Jul 21 01:09:48.899673 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:48.899642    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5"
Jul 21 01:09:48.901390 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:48.901366    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-fb3c8577-serving-cert\""
Jul 21 01:09:48.901523 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:48.901398    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 01:09:48.901523 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:48.901402    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 01:09:48.901737 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:48.901721    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8b65c\""
Jul 21 01:09:48.908880 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:48.908857    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5"]
Jul 21 01:09:48.998678 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:48.998632    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/434ae93d-6e8c-4a81-816c-63eaec71257e-maas-api-tls\") pod \"maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5\" (UID: \"434ae93d-6e8c-4a81-816c-63eaec71257e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5"
Jul 21 01:09:48.998882 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:48.998781    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/434ae93d-6e8c-4a81-816c-63eaec71257e-openshift-service-ca\") pod \"maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5\" (UID: \"434ae93d-6e8c-4a81-816c-63eaec71257e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5"
Jul 21 01:09:48.998882 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:48.998855    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hnzn\" (UniqueName: \"kubernetes.io/projected/434ae93d-6e8c-4a81-816c-63eaec71257e-kube-api-access-2hnzn\") pod \"maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5\" (UID: \"434ae93d-6e8c-4a81-816c-63eaec71257e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5"
Jul 21 01:09:49.100198 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:49.100155    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/434ae93d-6e8c-4a81-816c-63eaec71257e-openshift-service-ca\") pod \"maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5\" (UID: \"434ae93d-6e8c-4a81-816c-63eaec71257e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5"
Jul 21 01:09:49.100382 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:49.100209    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hnzn\" (UniqueName: \"kubernetes.io/projected/434ae93d-6e8c-4a81-816c-63eaec71257e-kube-api-access-2hnzn\") pod \"maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5\" (UID: \"434ae93d-6e8c-4a81-816c-63eaec71257e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5"
Jul 21 01:09:49.100382 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:49.100245    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/434ae93d-6e8c-4a81-816c-63eaec71257e-maas-api-tls\") pod \"maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5\" (UID: \"434ae93d-6e8c-4a81-816c-63eaec71257e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5"
Jul 21 01:09:49.100382 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:09:49.100374    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-serving-cert: secret "maas-api-e2e-ait-fb3c8577-serving-cert" not found
Jul 21 01:09:49.100482 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:09:49.100429    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/434ae93d-6e8c-4a81-816c-63eaec71257e-maas-api-tls podName:434ae93d-6e8c-4a81-816c-63eaec71257e nodeName:}" failed. No retries permitted until 2026-07-21 01:09:49.600413162 +0000 UTC m=+1719.900109562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/434ae93d-6e8c-4a81-816c-63eaec71257e-maas-api-tls") pod "maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5" (UID: "434ae93d-6e8c-4a81-816c-63eaec71257e") : secret "maas-api-e2e-ait-fb3c8577-serving-cert" not found
Jul 21 01:09:49.100848 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:49.100829    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/434ae93d-6e8c-4a81-816c-63eaec71257e-openshift-service-ca\") pod \"maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5\" (UID: \"434ae93d-6e8c-4a81-816c-63eaec71257e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5"
Jul 21 01:09:49.108683 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:49.108643    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hnzn\" (UniqueName: \"kubernetes.io/projected/434ae93d-6e8c-4a81-816c-63eaec71257e-kube-api-access-2hnzn\") pod \"maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5\" (UID: \"434ae93d-6e8c-4a81-816c-63eaec71257e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5"
Jul 21 01:09:49.605737 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:49.605687    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/434ae93d-6e8c-4a81-816c-63eaec71257e-maas-api-tls\") pod \"maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5\" (UID: \"434ae93d-6e8c-4a81-816c-63eaec71257e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5"
Jul 21 01:09:49.608132 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:49.608108    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/434ae93d-6e8c-4a81-816c-63eaec71257e-maas-api-tls\") pod \"maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5\" (UID: \"434ae93d-6e8c-4a81-816c-63eaec71257e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5"
Jul 21 01:09:49.810817 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:49.810769    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5"
Jul 21 01:09:49.942461 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:49.942429    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5"]
Jul 21 01:09:49.944741 ip-10-0-133-75 kubenswrapper[2582]: W0721 01:09:49.944715    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod434ae93d_6e8c_4a81_816c_63eaec71257e.slice/crio-25558d71972889e1814fadb4bcd10e31e284e6b7f9578e330e9cf79d429cefae WatchSource:0}: Error finding container 25558d71972889e1814fadb4bcd10e31e284e6b7f9578e330e9cf79d429cefae: Status 404 returned error can't find the container with id 25558d71972889e1814fadb4bcd10e31e284e6b7f9578e330e9cf79d429cefae
Jul 21 01:09:49.946007 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:49.945989    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 01:09:50.405975 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:50.405936    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5" event={"ID":"434ae93d-6e8c-4a81-816c-63eaec71257e","Type":"ContainerStarted","Data":"25558d71972889e1814fadb4bcd10e31e284e6b7f9578e330e9cf79d429cefae"}
Jul 21 01:09:52.419527 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:52.419433    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5" event={"ID":"434ae93d-6e8c-4a81-816c-63eaec71257e","Type":"ContainerStarted","Data":"2675fa5f350a784c53640625e9c22a39bb483efebd0bc70cfd19661eb4297e29"}
Jul 21 01:09:52.419527 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:52.419501    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5"
Jul 21 01:09:52.435262 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:52.435212    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5" podStartSLOduration=2.243764102 podStartE2EDuration="4.435197833s" totalImagesPullingTime="2.191433731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:09:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:09:52.433170511 +0000 UTC m=+1722.732866931" watchObservedRunningTime="2026-07-21 01:09:52.435197833 +0000 UTC m=+1722.734894233"
Jul 21 01:09:56.597262 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:56.597221    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:09:58.430691 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:09:58.430658    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5"
Jul 21 01:10:24.776547 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:24.776517    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5"]
Jul 21 01:10:24.777111 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:24.776775    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5" podUID="434ae93d-6e8c-4a81-816c-63eaec71257e" containerName="maas-api" containerID="cri-o://2675fa5f350a784c53640625e9c22a39bb483efebd0bc70cfd19661eb4297e29" gracePeriod=30
Jul 21 01:10:25.024161 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:25.024138    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5"
Jul 21 01:10:25.121936 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:25.121874    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hnzn\" (UniqueName: \"kubernetes.io/projected/434ae93d-6e8c-4a81-816c-63eaec71257e-kube-api-access-2hnzn\") pod \"434ae93d-6e8c-4a81-816c-63eaec71257e\" (UID: \"434ae93d-6e8c-4a81-816c-63eaec71257e\") "
Jul 21 01:10:25.121936 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:25.121919    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/434ae93d-6e8c-4a81-816c-63eaec71257e-openshift-service-ca\") pod \"434ae93d-6e8c-4a81-816c-63eaec71257e\" (UID: \"434ae93d-6e8c-4a81-816c-63eaec71257e\") "
Jul 21 01:10:25.122094 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:25.121944    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/434ae93d-6e8c-4a81-816c-63eaec71257e-maas-api-tls\") pod \"434ae93d-6e8c-4a81-816c-63eaec71257e\" (UID: \"434ae93d-6e8c-4a81-816c-63eaec71257e\") "
Jul 21 01:10:25.122299 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:25.122268    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/434ae93d-6e8c-4a81-816c-63eaec71257e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "434ae93d-6e8c-4a81-816c-63eaec71257e" (UID: "434ae93d-6e8c-4a81-816c-63eaec71257e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:10:25.123984 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:25.123957    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/434ae93d-6e8c-4a81-816c-63eaec71257e-kube-api-access-2hnzn" (OuterVolumeSpecName: "kube-api-access-2hnzn") pod "434ae93d-6e8c-4a81-816c-63eaec71257e" (UID: "434ae93d-6e8c-4a81-816c-63eaec71257e"). InnerVolumeSpecName "kube-api-access-2hnzn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:10:25.124067 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:25.123992    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/434ae93d-6e8c-4a81-816c-63eaec71257e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "434ae93d-6e8c-4a81-816c-63eaec71257e" (UID: "434ae93d-6e8c-4a81-816c-63eaec71257e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:10:25.223505 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:25.223468    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hnzn\" (UniqueName: \"kubernetes.io/projected/434ae93d-6e8c-4a81-816c-63eaec71257e-kube-api-access-2hnzn\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:10:25.223505 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:25.223504    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/434ae93d-6e8c-4a81-816c-63eaec71257e-openshift-service-ca\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:10:25.223505 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:25.223514    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/434ae93d-6e8c-4a81-816c-63eaec71257e-maas-api-tls\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:10:25.606525 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:25.606494    2582 generic.go:356] "Generic (PLEG): container finished" podID="434ae93d-6e8c-4a81-816c-63eaec71257e" containerID="2675fa5f350a784c53640625e9c22a39bb483efebd0bc70cfd19661eb4297e29" exitCode=0
Jul 21 01:10:25.606728 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:25.606537    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5"
Jul 21 01:10:25.606728 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:25.606579    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5" event={"ID":"434ae93d-6e8c-4a81-816c-63eaec71257e","Type":"ContainerDied","Data":"2675fa5f350a784c53640625e9c22a39bb483efebd0bc70cfd19661eb4297e29"}
Jul 21 01:10:25.606728 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:25.606630    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5" event={"ID":"434ae93d-6e8c-4a81-816c-63eaec71257e","Type":"ContainerDied","Data":"25558d71972889e1814fadb4bcd10e31e284e6b7f9578e330e9cf79d429cefae"}
Jul 21 01:10:25.606728 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:25.606681    2582 scope.go:117] "RemoveContainer" containerID="2675fa5f350a784c53640625e9c22a39bb483efebd0bc70cfd19661eb4297e29"
Jul 21 01:10:25.615381 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:25.615366    2582 scope.go:117] "RemoveContainer" containerID="2675fa5f350a784c53640625e9c22a39bb483efebd0bc70cfd19661eb4297e29"
Jul 21 01:10:25.615605 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:10:25.615588    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2675fa5f350a784c53640625e9c22a39bb483efebd0bc70cfd19661eb4297e29\": container with ID starting with 2675fa5f350a784c53640625e9c22a39bb483efebd0bc70cfd19661eb4297e29 not found: ID does not exist" containerID="2675fa5f350a784c53640625e9c22a39bb483efebd0bc70cfd19661eb4297e29"
Jul 21 01:10:25.615682 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:25.615613    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2675fa5f350a784c53640625e9c22a39bb483efebd0bc70cfd19661eb4297e29"} err="failed to get container status \"2675fa5f350a784c53640625e9c22a39bb483efebd0bc70cfd19661eb4297e29\": rpc error: code = NotFound desc = could not find container \"2675fa5f350a784c53640625e9c22a39bb483efebd0bc70cfd19661eb4297e29\": container with ID starting with 2675fa5f350a784c53640625e9c22a39bb483efebd0bc70cfd19661eb4297e29 not found: ID does not exist"
Jul 21 01:10:25.625979 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:25.625957    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5"]
Jul 21 01:10:25.629838 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:25.629818    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fb3c8577-955b8855f-c9cd5"]
Jul 21 01:10:26.346005 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:26.345967    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="434ae93d-6e8c-4a81-816c-63eaec71257e" path="/var/lib/kubelet/pods/434ae93d-6e8c-4a81-816c-63eaec71257e/volumes"
Jul 21 01:10:26.693793 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:26.693762    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:10:33.192742 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:33.192705    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t"]
Jul 21 01:10:33.193330 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:33.193307    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="434ae93d-6e8c-4a81-816c-63eaec71257e" containerName="maas-api"
Jul 21 01:10:33.193394 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:33.193337    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="434ae93d-6e8c-4a81-816c-63eaec71257e" containerName="maas-api"
Jul 21 01:10:33.193481 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:33.193468    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="434ae93d-6e8c-4a81-816c-63eaec71257e" containerName="maas-api"
Jul 21 01:10:33.202120 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:33.202098    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t"
Jul 21 01:10:33.202571 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:33.202541    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t"]
Jul 21 01:10:33.204150 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:33.204109    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-b3d9b6c6-serving-cert\""
Jul 21 01:10:33.204345 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:33.204233    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8b65c\""
Jul 21 01:10:33.204345 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:33.204250    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 01:10:33.204345 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:33.204117    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 01:10:33.286964 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:33.286938    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng6pf\" (UniqueName: \"kubernetes.io/projected/ff3d9f94-4899-4363-b622-f1326ea64d7f-kube-api-access-ng6pf\") pod \"maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t\" (UID: \"ff3d9f94-4899-4363-b622-f1326ea64d7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t"
Jul 21 01:10:33.287072 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:33.286994    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff3d9f94-4899-4363-b622-f1326ea64d7f-maas-api-tls\") pod \"maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t\" (UID: \"ff3d9f94-4899-4363-b622-f1326ea64d7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t"
Jul 21 01:10:33.287072 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:33.287061    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff3d9f94-4899-4363-b622-f1326ea64d7f-openshift-service-ca\") pod \"maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t\" (UID: \"ff3d9f94-4899-4363-b622-f1326ea64d7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t"
Jul 21 01:10:33.387431 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:33.387403    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng6pf\" (UniqueName: \"kubernetes.io/projected/ff3d9f94-4899-4363-b622-f1326ea64d7f-kube-api-access-ng6pf\") pod \"maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t\" (UID: \"ff3d9f94-4899-4363-b622-f1326ea64d7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t"
Jul 21 01:10:33.387539 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:33.387460    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff3d9f94-4899-4363-b622-f1326ea64d7f-maas-api-tls\") pod \"maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t\" (UID: \"ff3d9f94-4899-4363-b622-f1326ea64d7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t"
Jul 21 01:10:33.387539 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:33.387490    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff3d9f94-4899-4363-b622-f1326ea64d7f-openshift-service-ca\") pod \"maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t\" (UID: \"ff3d9f94-4899-4363-b622-f1326ea64d7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t"
Jul 21 01:10:33.388094 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:33.388074    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff3d9f94-4899-4363-b622-f1326ea64d7f-openshift-service-ca\") pod \"maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t\" (UID: \"ff3d9f94-4899-4363-b622-f1326ea64d7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t"
Jul 21 01:10:33.389897 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:33.389882    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff3d9f94-4899-4363-b622-f1326ea64d7f-maas-api-tls\") pod \"maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t\" (UID: \"ff3d9f94-4899-4363-b622-f1326ea64d7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t"
Jul 21 01:10:33.394213 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:33.394196    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng6pf\" (UniqueName: \"kubernetes.io/projected/ff3d9f94-4899-4363-b622-f1326ea64d7f-kube-api-access-ng6pf\") pod \"maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t\" (UID: \"ff3d9f94-4899-4363-b622-f1326ea64d7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t"
Jul 21 01:10:33.512954 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:33.512896    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t"
Jul 21 01:10:33.645827 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:33.645804    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t"]
Jul 21 01:10:33.647766 ip-10-0-133-75 kubenswrapper[2582]: W0721 01:10:33.647738    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff3d9f94_4899_4363_b622_f1326ea64d7f.slice/crio-685fbbf15a217fe9ad7e9085f3b70206169e1d90a493054d5658305336f4b9e3 WatchSource:0}: Error finding container 685fbbf15a217fe9ad7e9085f3b70206169e1d90a493054d5658305336f4b9e3: Status 404 returned error can't find the container with id 685fbbf15a217fe9ad7e9085f3b70206169e1d90a493054d5658305336f4b9e3
Jul 21 01:10:34.657341 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:34.657298    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t" event={"ID":"ff3d9f94-4899-4363-b622-f1326ea64d7f","Type":"ContainerStarted","Data":"0560ab21ae04ff6d96d63660f4c0f8da4ebfe5a055d1a3cfc2f95c73a22998d7"}
Jul 21 01:10:34.657744 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:34.657365    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t" event={"ID":"ff3d9f94-4899-4363-b622-f1326ea64d7f","Type":"ContainerStarted","Data":"685fbbf15a217fe9ad7e9085f3b70206169e1d90a493054d5658305336f4b9e3"}
Jul 21 01:10:34.657744 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:34.657391    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t"
Jul 21 01:10:34.672616 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:34.672555    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t" podStartSLOduration=1.309596988 podStartE2EDuration="1.67253897s" totalImagesPullingTime="362.941982ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:10:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:10:34.671329335 +0000 UTC m=+1764.971025756" watchObservedRunningTime="2026-07-21 01:10:34.67253897 +0000 UTC m=+1764.972235369"
Jul 21 01:10:37.896213 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:37.896176    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:10:40.668514 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:10:40.668484    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t"
Jul 21 01:11:08.549051 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:08.549013    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t"]
Jul 21 01:11:08.549530 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:08.549212    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t" podUID="ff3d9f94-4899-4363-b622-f1326ea64d7f" containerName="maas-api" containerID="cri-o://0560ab21ae04ff6d96d63660f4c0f8da4ebfe5a055d1a3cfc2f95c73a22998d7" gracePeriod=30
Jul 21 01:11:08.781070 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:08.781044    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t"
Jul 21 01:11:08.838023 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:08.837949    2582 generic.go:356] "Generic (PLEG): container finished" podID="ff3d9f94-4899-4363-b622-f1326ea64d7f" containerID="0560ab21ae04ff6d96d63660f4c0f8da4ebfe5a055d1a3cfc2f95c73a22998d7" exitCode=0
Jul 21 01:11:08.838023 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:08.837986    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t"
Jul 21 01:11:08.838190 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:08.838030    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t" event={"ID":"ff3d9f94-4899-4363-b622-f1326ea64d7f","Type":"ContainerDied","Data":"0560ab21ae04ff6d96d63660f4c0f8da4ebfe5a055d1a3cfc2f95c73a22998d7"}
Jul 21 01:11:08.838190 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:08.838078    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t" event={"ID":"ff3d9f94-4899-4363-b622-f1326ea64d7f","Type":"ContainerDied","Data":"685fbbf15a217fe9ad7e9085f3b70206169e1d90a493054d5658305336f4b9e3"}
Jul 21 01:11:08.838190 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:08.838101    2582 scope.go:117] "RemoveContainer" containerID="0560ab21ae04ff6d96d63660f4c0f8da4ebfe5a055d1a3cfc2f95c73a22998d7"
Jul 21 01:11:08.846142 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:08.846128    2582 scope.go:117] "RemoveContainer" containerID="0560ab21ae04ff6d96d63660f4c0f8da4ebfe5a055d1a3cfc2f95c73a22998d7"
Jul 21 01:11:08.846337 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:11:08.846318    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0560ab21ae04ff6d96d63660f4c0f8da4ebfe5a055d1a3cfc2f95c73a22998d7\": container with ID starting with 0560ab21ae04ff6d96d63660f4c0f8da4ebfe5a055d1a3cfc2f95c73a22998d7 not found: ID does not exist" containerID="0560ab21ae04ff6d96d63660f4c0f8da4ebfe5a055d1a3cfc2f95c73a22998d7"
Jul 21 01:11:08.846383 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:08.846353    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0560ab21ae04ff6d96d63660f4c0f8da4ebfe5a055d1a3cfc2f95c73a22998d7"} err="failed to get container status \"0560ab21ae04ff6d96d63660f4c0f8da4ebfe5a055d1a3cfc2f95c73a22998d7\": rpc error: code = NotFound desc = could not find container \"0560ab21ae04ff6d96d63660f4c0f8da4ebfe5a055d1a3cfc2f95c73a22998d7\": container with ID starting with 0560ab21ae04ff6d96d63660f4c0f8da4ebfe5a055d1a3cfc2f95c73a22998d7 not found: ID does not exist"
Jul 21 01:11:08.869202 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:08.869179    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ng6pf\" (UniqueName: \"kubernetes.io/projected/ff3d9f94-4899-4363-b622-f1326ea64d7f-kube-api-access-ng6pf\") pod \"ff3d9f94-4899-4363-b622-f1326ea64d7f\" (UID: \"ff3d9f94-4899-4363-b622-f1326ea64d7f\") "
Jul 21 01:11:08.869275 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:08.869210    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff3d9f94-4899-4363-b622-f1326ea64d7f-openshift-service-ca\") pod \"ff3d9f94-4899-4363-b622-f1326ea64d7f\" (UID: \"ff3d9f94-4899-4363-b622-f1326ea64d7f\") "
Jul 21 01:11:08.869321 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:08.869307    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff3d9f94-4899-4363-b622-f1326ea64d7f-maas-api-tls\") pod \"ff3d9f94-4899-4363-b622-f1326ea64d7f\" (UID: \"ff3d9f94-4899-4363-b622-f1326ea64d7f\") "
Jul 21 01:11:08.869569 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:08.869547    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff3d9f94-4899-4363-b622-f1326ea64d7f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ff3d9f94-4899-4363-b622-f1326ea64d7f" (UID: "ff3d9f94-4899-4363-b622-f1326ea64d7f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:11:08.871153 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:08.871133    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff3d9f94-4899-4363-b622-f1326ea64d7f-kube-api-access-ng6pf" (OuterVolumeSpecName: "kube-api-access-ng6pf") pod "ff3d9f94-4899-4363-b622-f1326ea64d7f" (UID: "ff3d9f94-4899-4363-b622-f1326ea64d7f"). InnerVolumeSpecName "kube-api-access-ng6pf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:11:08.871215 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:08.871201    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff3d9f94-4899-4363-b622-f1326ea64d7f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ff3d9f94-4899-4363-b622-f1326ea64d7f" (UID: "ff3d9f94-4899-4363-b622-f1326ea64d7f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:11:08.970321 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:08.970299    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ng6pf\" (UniqueName: \"kubernetes.io/projected/ff3d9f94-4899-4363-b622-f1326ea64d7f-kube-api-access-ng6pf\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:11:08.970321 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:08.970320    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff3d9f94-4899-4363-b622-f1326ea64d7f-openshift-service-ca\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:11:08.970448 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:08.970330    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff3d9f94-4899-4363-b622-f1326ea64d7f-maas-api-tls\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:11:09.158761 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:09.158743    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t"]
Jul 21 01:11:09.160865 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:09.160848    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b3d9b6c6-5bc5647698-zjb4t"]
Jul 21 01:11:10.344016 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:10.343983    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff3d9f94-4899-4363-b622-f1326ea64d7f" path="/var/lib/kubelet/pods/ff3d9f94-4899-4363-b622-f1326ea64d7f/volumes"
Jul 21 01:11:11.197523 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:11.197491    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:11:16.271312 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:16.271283    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2"]
Jul 21 01:11:16.271680 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:16.271632    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff3d9f94-4899-4363-b622-f1326ea64d7f" containerName="maas-api"
Jul 21 01:11:16.271680 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:16.271642    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff3d9f94-4899-4363-b622-f1326ea64d7f" containerName="maas-api"
Jul 21 01:11:16.271765 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:16.271721    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff3d9f94-4899-4363-b622-f1326ea64d7f" containerName="maas-api"
Jul 21 01:11:16.274776 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:16.274759    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2"
Jul 21 01:11:16.276831 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:16.276807    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a2c78d91-serving-cert\""
Jul 21 01:11:16.276970 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:16.276849    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8b65c\""
Jul 21 01:11:16.276970 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:16.276852    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 01:11:16.277197 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:16.277183    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 01:11:16.286031 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:16.286013    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2"]
Jul 21 01:11:16.329263 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:16.329245    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfa651a6-1710-48a3-a3b1-072d95023fff-maas-api-tls\") pod \"maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2\" (UID: \"cfa651a6-1710-48a3-a3b1-072d95023fff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2"
Jul 21 01:11:16.329351 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:16.329276    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q98hs\" (UniqueName: \"kubernetes.io/projected/cfa651a6-1710-48a3-a3b1-072d95023fff-kube-api-access-q98hs\") pod \"maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2\" (UID: \"cfa651a6-1710-48a3-a3b1-072d95023fff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2"
Jul 21 01:11:16.329351 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:16.329312    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfa651a6-1710-48a3-a3b1-072d95023fff-openshift-service-ca\") pod \"maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2\" (UID: \"cfa651a6-1710-48a3-a3b1-072d95023fff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2"
Jul 21 01:11:16.429677 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:16.429642    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfa651a6-1710-48a3-a3b1-072d95023fff-maas-api-tls\") pod \"maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2\" (UID: \"cfa651a6-1710-48a3-a3b1-072d95023fff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2"
Jul 21 01:11:16.429780 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:16.429682    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q98hs\" (UniqueName: \"kubernetes.io/projected/cfa651a6-1710-48a3-a3b1-072d95023fff-kube-api-access-q98hs\") pod \"maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2\" (UID: \"cfa651a6-1710-48a3-a3b1-072d95023fff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2"
Jul 21 01:11:16.429780 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:16.429716    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfa651a6-1710-48a3-a3b1-072d95023fff-openshift-service-ca\") pod \"maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2\" (UID: \"cfa651a6-1710-48a3-a3b1-072d95023fff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2"
Jul 21 01:11:16.429895 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:11:16.429790    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-serving-cert: secret "maas-api-e2e-ait-a2c78d91-serving-cert" not found
Jul 21 01:11:16.429895 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:11:16.429850    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfa651a6-1710-48a3-a3b1-072d95023fff-maas-api-tls podName:cfa651a6-1710-48a3-a3b1-072d95023fff nodeName:}" failed. No retries permitted until 2026-07-21 01:11:16.929834181 +0000 UTC m=+1807.229530580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cfa651a6-1710-48a3-a3b1-072d95023fff-maas-api-tls") pod "maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2" (UID: "cfa651a6-1710-48a3-a3b1-072d95023fff") : secret "maas-api-e2e-ait-a2c78d91-serving-cert" not found
Jul 21 01:11:16.430215 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:16.430198    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfa651a6-1710-48a3-a3b1-072d95023fff-openshift-service-ca\") pod \"maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2\" (UID: \"cfa651a6-1710-48a3-a3b1-072d95023fff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2"
Jul 21 01:11:16.439379 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:16.439357    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q98hs\" (UniqueName: \"kubernetes.io/projected/cfa651a6-1710-48a3-a3b1-072d95023fff-kube-api-access-q98hs\") pod \"maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2\" (UID: \"cfa651a6-1710-48a3-a3b1-072d95023fff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2"
Jul 21 01:11:16.933175 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:16.933149    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfa651a6-1710-48a3-a3b1-072d95023fff-maas-api-tls\") pod \"maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2\" (UID: \"cfa651a6-1710-48a3-a3b1-072d95023fff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2"
Jul 21 01:11:16.935412 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:16.935393    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfa651a6-1710-48a3-a3b1-072d95023fff-maas-api-tls\") pod \"maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2\" (UID: \"cfa651a6-1710-48a3-a3b1-072d95023fff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2"
Jul 21 01:11:17.185404 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:17.185352    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2"
Jul 21 01:11:17.310830 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:17.310797    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2"]
Jul 21 01:11:17.312232 ip-10-0-133-75 kubenswrapper[2582]: W0721 01:11:17.312207    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfa651a6_1710_48a3_a3b1_072d95023fff.slice/crio-9be4e73e4d126273639d341b2fe0a73e990e5b22d17df849657cb590f288734f WatchSource:0}: Error finding container 9be4e73e4d126273639d341b2fe0a73e990e5b22d17df849657cb590f288734f: Status 404 returned error can't find the container with id 9be4e73e4d126273639d341b2fe0a73e990e5b22d17df849657cb590f288734f
Jul 21 01:11:17.890243 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:17.890175    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2" event={"ID":"cfa651a6-1710-48a3-a3b1-072d95023fff","Type":"ContainerStarted","Data":"5ddd7c6ae3147a52a52d1ef34717cab26c3185a2fcbed867e64e6f2c8de2c2ee"}
Jul 21 01:11:17.890243 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:17.890235    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2"
Jul 21 01:11:17.890388 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:17.890253    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2" event={"ID":"cfa651a6-1710-48a3-a3b1-072d95023fff","Type":"ContainerStarted","Data":"9be4e73e4d126273639d341b2fe0a73e990e5b22d17df849657cb590f288734f"}
Jul 21 01:11:17.905963 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:17.905917    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2" podStartSLOduration=1.537416103 podStartE2EDuration="1.905901234s" totalImagesPullingTime="368.485131ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:11:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:11:17.904216416 +0000 UTC m=+1808.203912835" watchObservedRunningTime="2026-07-21 01:11:17.905901234 +0000 UTC m=+1808.205597649"
Jul 21 01:11:23.597348 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:23.597310    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:11:23.906698 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:23.902668    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2"
Jul 21 01:11:52.450950 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:52.450919    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2"]
Jul 21 01:11:52.451484 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:52.451116    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2" podUID="cfa651a6-1710-48a3-a3b1-072d95023fff" containerName="maas-api" containerID="cri-o://5ddd7c6ae3147a52a52d1ef34717cab26c3185a2fcbed867e64e6f2c8de2c2ee" gracePeriod=30
Jul 21 01:11:52.689590 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:52.689564    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2"
Jul 21 01:11:52.739779 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:52.739710    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfa651a6-1710-48a3-a3b1-072d95023fff-openshift-service-ca\") pod \"cfa651a6-1710-48a3-a3b1-072d95023fff\" (UID: \"cfa651a6-1710-48a3-a3b1-072d95023fff\") "
Jul 21 01:11:52.739779 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:52.739749    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfa651a6-1710-48a3-a3b1-072d95023fff-maas-api-tls\") pod \"cfa651a6-1710-48a3-a3b1-072d95023fff\" (UID: \"cfa651a6-1710-48a3-a3b1-072d95023fff\") "
Jul 21 01:11:52.739779 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:52.739772    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q98hs\" (UniqueName: \"kubernetes.io/projected/cfa651a6-1710-48a3-a3b1-072d95023fff-kube-api-access-q98hs\") pod \"cfa651a6-1710-48a3-a3b1-072d95023fff\" (UID: \"cfa651a6-1710-48a3-a3b1-072d95023fff\") "
Jul 21 01:11:52.740112 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:52.740087    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfa651a6-1710-48a3-a3b1-072d95023fff-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cfa651a6-1710-48a3-a3b1-072d95023fff" (UID: "cfa651a6-1710-48a3-a3b1-072d95023fff"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:11:52.741728 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:52.741709    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfa651a6-1710-48a3-a3b1-072d95023fff-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cfa651a6-1710-48a3-a3b1-072d95023fff" (UID: "cfa651a6-1710-48a3-a3b1-072d95023fff"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:11:52.741846 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:52.741829    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfa651a6-1710-48a3-a3b1-072d95023fff-kube-api-access-q98hs" (OuterVolumeSpecName: "kube-api-access-q98hs") pod "cfa651a6-1710-48a3-a3b1-072d95023fff" (UID: "cfa651a6-1710-48a3-a3b1-072d95023fff"). InnerVolumeSpecName "kube-api-access-q98hs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:11:52.841246 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:52.841218    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfa651a6-1710-48a3-a3b1-072d95023fff-openshift-service-ca\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:11:52.841246 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:52.841241    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfa651a6-1710-48a3-a3b1-072d95023fff-maas-api-tls\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:11:52.841385 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:52.841254    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q98hs\" (UniqueName: \"kubernetes.io/projected/cfa651a6-1710-48a3-a3b1-072d95023fff-kube-api-access-q98hs\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:11:53.085360 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:53.085284    2582 generic.go:356] "Generic (PLEG): container finished" podID="cfa651a6-1710-48a3-a3b1-072d95023fff" containerID="5ddd7c6ae3147a52a52d1ef34717cab26c3185a2fcbed867e64e6f2c8de2c2ee" exitCode=0
Jul 21 01:11:53.085472 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:53.085352    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2"
Jul 21 01:11:53.085472 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:53.085358    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2" event={"ID":"cfa651a6-1710-48a3-a3b1-072d95023fff","Type":"ContainerDied","Data":"5ddd7c6ae3147a52a52d1ef34717cab26c3185a2fcbed867e64e6f2c8de2c2ee"}
Jul 21 01:11:53.085549 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:53.085481    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2" event={"ID":"cfa651a6-1710-48a3-a3b1-072d95023fff","Type":"ContainerDied","Data":"9be4e73e4d126273639d341b2fe0a73e990e5b22d17df849657cb590f288734f"}
Jul 21 01:11:53.085549 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:53.085504    2582 scope.go:117] "RemoveContainer" containerID="5ddd7c6ae3147a52a52d1ef34717cab26c3185a2fcbed867e64e6f2c8de2c2ee"
Jul 21 01:11:53.095574 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:53.095547    2582 scope.go:117] "RemoveContainer" containerID="5ddd7c6ae3147a52a52d1ef34717cab26c3185a2fcbed867e64e6f2c8de2c2ee"
Jul 21 01:11:53.095850 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:11:53.095818    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ddd7c6ae3147a52a52d1ef34717cab26c3185a2fcbed867e64e6f2c8de2c2ee\": container with ID starting with 5ddd7c6ae3147a52a52d1ef34717cab26c3185a2fcbed867e64e6f2c8de2c2ee not found: ID does not exist" containerID="5ddd7c6ae3147a52a52d1ef34717cab26c3185a2fcbed867e64e6f2c8de2c2ee"
Jul 21 01:11:53.095950 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:53.095849    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ddd7c6ae3147a52a52d1ef34717cab26c3185a2fcbed867e64e6f2c8de2c2ee"} err="failed to get container status \"5ddd7c6ae3147a52a52d1ef34717cab26c3185a2fcbed867e64e6f2c8de2c2ee\": rpc error: code = NotFound desc = could not find container \"5ddd7c6ae3147a52a52d1ef34717cab26c3185a2fcbed867e64e6f2c8de2c2ee\": container with ID starting with 5ddd7c6ae3147a52a52d1ef34717cab26c3185a2fcbed867e64e6f2c8de2c2ee not found: ID does not exist"
Jul 21 01:11:53.105492 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:53.105467    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2"]
Jul 21 01:11:53.107767 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:53.107745    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a2c78d91-57f67d9dd7-9fdq2"]
Jul 21 01:11:54.344927 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:54.344885    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfa651a6-1710-48a3-a3b1-072d95023fff" path="/var/lib/kubelet/pods/cfa651a6-1710-48a3-a3b1-072d95023fff/volumes"
Jul 21 01:11:55.103398 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:11:55.103364    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:12:01.562353 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:01.562317    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk"]
Jul 21 01:12:01.562834 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:01.562708    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfa651a6-1710-48a3-a3b1-072d95023fff" containerName="maas-api"
Jul 21 01:12:01.562834 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:01.562719    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfa651a6-1710-48a3-a3b1-072d95023fff" containerName="maas-api"
Jul 21 01:12:01.562834 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:01.562776    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfa651a6-1710-48a3-a3b1-072d95023fff" containerName="maas-api"
Jul 21 01:12:01.566985 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:01.566968    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk"
Jul 21 01:12:01.568818 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:01.568796    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 01:12:01.568934 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:01.568852    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-0a237698-serving-cert\""
Jul 21 01:12:01.568934 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:01.568860    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8b65c\""
Jul 21 01:12:01.569150 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:01.569133    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 01:12:01.576764 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:01.576742    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk"]
Jul 21 01:12:01.619871 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:01.619830    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpp5m\" (UniqueName: \"kubernetes.io/projected/4a8c8ee3-4478-4773-890e-cbf4dc1aafc8-kube-api-access-lpp5m\") pod \"maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk\" (UID: \"4a8c8ee3-4478-4773-890e-cbf4dc1aafc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk"
Jul 21 01:12:01.620048 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:01.619886    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a8c8ee3-4478-4773-890e-cbf4dc1aafc8-maas-api-tls\") pod \"maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk\" (UID: \"4a8c8ee3-4478-4773-890e-cbf4dc1aafc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk"
Jul 21 01:12:01.620048 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:01.619921    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a8c8ee3-4478-4773-890e-cbf4dc1aafc8-openshift-service-ca\") pod \"maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk\" (UID: \"4a8c8ee3-4478-4773-890e-cbf4dc1aafc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk"
Jul 21 01:12:01.720822 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:01.720788    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpp5m\" (UniqueName: \"kubernetes.io/projected/4a8c8ee3-4478-4773-890e-cbf4dc1aafc8-kube-api-access-lpp5m\") pod \"maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk\" (UID: \"4a8c8ee3-4478-4773-890e-cbf4dc1aafc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk"
Jul 21 01:12:01.720993 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:01.720834    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a8c8ee3-4478-4773-890e-cbf4dc1aafc8-maas-api-tls\") pod \"maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk\" (UID: \"4a8c8ee3-4478-4773-890e-cbf4dc1aafc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk"
Jul 21 01:12:01.720993 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:12:01.720931    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-serving-cert: secret "maas-api-e2e-derive-0a237698-serving-cert" not found
Jul 21 01:12:01.720993 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:01.720952    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a8c8ee3-4478-4773-890e-cbf4dc1aafc8-openshift-service-ca\") pod \"maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk\" (UID: \"4a8c8ee3-4478-4773-890e-cbf4dc1aafc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk"
Jul 21 01:12:01.720993 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:12:01.720983    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a8c8ee3-4478-4773-890e-cbf4dc1aafc8-maas-api-tls podName:4a8c8ee3-4478-4773-890e-cbf4dc1aafc8 nodeName:}" failed. No retries permitted until 2026-07-21 01:12:02.22096824 +0000 UTC m=+1852.520664642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4a8c8ee3-4478-4773-890e-cbf4dc1aafc8-maas-api-tls") pod "maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk" (UID: "4a8c8ee3-4478-4773-890e-cbf4dc1aafc8") : secret "maas-api-e2e-derive-0a237698-serving-cert" not found
Jul 21 01:12:01.721518 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:01.721500    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a8c8ee3-4478-4773-890e-cbf4dc1aafc8-openshift-service-ca\") pod \"maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk\" (UID: \"4a8c8ee3-4478-4773-890e-cbf4dc1aafc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk"
Jul 21 01:12:01.728528 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:01.728509    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpp5m\" (UniqueName: \"kubernetes.io/projected/4a8c8ee3-4478-4773-890e-cbf4dc1aafc8-kube-api-access-lpp5m\") pod \"maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk\" (UID: \"4a8c8ee3-4478-4773-890e-cbf4dc1aafc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk"
Jul 21 01:12:02.226548 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:02.226502    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a8c8ee3-4478-4773-890e-cbf4dc1aafc8-maas-api-tls\") pod \"maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk\" (UID: \"4a8c8ee3-4478-4773-890e-cbf4dc1aafc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk"
Jul 21 01:12:02.229084 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:02.229057    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a8c8ee3-4478-4773-890e-cbf4dc1aafc8-maas-api-tls\") pod \"maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk\" (UID: \"4a8c8ee3-4478-4773-890e-cbf4dc1aafc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk"
Jul 21 01:12:02.479664 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:02.479564    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk"
Jul 21 01:12:02.610830 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:02.610795    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk"]
Jul 21 01:12:02.612565 ip-10-0-133-75 kubenswrapper[2582]: W0721 01:12:02.612541    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a8c8ee3_4478_4773_890e_cbf4dc1aafc8.slice/crio-334b97eae974d7e2a83e0e37fe4ed9dad65481e5d3e9cbb51e6e2cad66e69d25 WatchSource:0}: Error finding container 334b97eae974d7e2a83e0e37fe4ed9dad65481e5d3e9cbb51e6e2cad66e69d25: Status 404 returned error can't find the container with id 334b97eae974d7e2a83e0e37fe4ed9dad65481e5d3e9cbb51e6e2cad66e69d25
Jul 21 01:12:03.141315 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:03.141279    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk" event={"ID":"4a8c8ee3-4478-4773-890e-cbf4dc1aafc8","Type":"ContainerStarted","Data":"01bc51623cc590eb99225bbb1447b3bc5281cbb7785555762ce3c2c605542ec0"}
Jul 21 01:12:03.141526 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:03.141370    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk"
Jul 21 01:12:03.141526 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:03.141390    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk" event={"ID":"4a8c8ee3-4478-4773-890e-cbf4dc1aafc8","Type":"ContainerStarted","Data":"334b97eae974d7e2a83e0e37fe4ed9dad65481e5d3e9cbb51e6e2cad66e69d25"}
Jul 21 01:12:03.156590 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:03.156531    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk" podStartSLOduration=1.745215602 podStartE2EDuration="2.156515115s" totalImagesPullingTime="411.299513ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:12:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:12:03.15595661 +0000 UTC m=+1853.455653031" watchObservedRunningTime="2026-07-21 01:12:03.156515115 +0000 UTC m=+1853.456211536"
Jul 21 01:12:07.595893 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:07.595857    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:12:09.152618 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:09.152586    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk"
Jul 21 01:12:36.640684 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:36.640590    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk"]
Jul 21 01:12:36.641310 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:36.640858    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk" podUID="4a8c8ee3-4478-4773-890e-cbf4dc1aafc8" containerName="maas-api" containerID="cri-o://01bc51623cc590eb99225bbb1447b3bc5281cbb7785555762ce3c2c605542ec0" gracePeriod=30
Jul 21 01:12:36.905945 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:36.905882    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk"
Jul 21 01:12:36.946031 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:36.946002    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a8c8ee3-4478-4773-890e-cbf4dc1aafc8-maas-api-tls\") pod \"4a8c8ee3-4478-4773-890e-cbf4dc1aafc8\" (UID: \"4a8c8ee3-4478-4773-890e-cbf4dc1aafc8\") "
Jul 21 01:12:36.946207 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:36.946094    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpp5m\" (UniqueName: \"kubernetes.io/projected/4a8c8ee3-4478-4773-890e-cbf4dc1aafc8-kube-api-access-lpp5m\") pod \"4a8c8ee3-4478-4773-890e-cbf4dc1aafc8\" (UID: \"4a8c8ee3-4478-4773-890e-cbf4dc1aafc8\") "
Jul 21 01:12:36.946207 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:36.946129    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a8c8ee3-4478-4773-890e-cbf4dc1aafc8-openshift-service-ca\") pod \"4a8c8ee3-4478-4773-890e-cbf4dc1aafc8\" (UID: \"4a8c8ee3-4478-4773-890e-cbf4dc1aafc8\") "
Jul 21 01:12:36.946516 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:36.946487    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a8c8ee3-4478-4773-890e-cbf4dc1aafc8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4a8c8ee3-4478-4773-890e-cbf4dc1aafc8" (UID: "4a8c8ee3-4478-4773-890e-cbf4dc1aafc8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:12:36.948155 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:36.948131    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a8c8ee3-4478-4773-890e-cbf4dc1aafc8-kube-api-access-lpp5m" (OuterVolumeSpecName: "kube-api-access-lpp5m") pod "4a8c8ee3-4478-4773-890e-cbf4dc1aafc8" (UID: "4a8c8ee3-4478-4773-890e-cbf4dc1aafc8"). InnerVolumeSpecName "kube-api-access-lpp5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:12:36.948235 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:36.948208    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a8c8ee3-4478-4773-890e-cbf4dc1aafc8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4a8c8ee3-4478-4773-890e-cbf4dc1aafc8" (UID: "4a8c8ee3-4478-4773-890e-cbf4dc1aafc8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:12:37.047501 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:37.047462    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a8c8ee3-4478-4773-890e-cbf4dc1aafc8-maas-api-tls\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:12:37.047501 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:37.047492    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpp5m\" (UniqueName: \"kubernetes.io/projected/4a8c8ee3-4478-4773-890e-cbf4dc1aafc8-kube-api-access-lpp5m\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:12:37.047501 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:37.047502    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a8c8ee3-4478-4773-890e-cbf4dc1aafc8-openshift-service-ca\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:12:37.329976 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:37.329938    2582 generic.go:356] "Generic (PLEG): container finished" podID="4a8c8ee3-4478-4773-890e-cbf4dc1aafc8" containerID="01bc51623cc590eb99225bbb1447b3bc5281cbb7785555762ce3c2c605542ec0" exitCode=0
Jul 21 01:12:37.330134 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:37.329984    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk"
Jul 21 01:12:37.330134 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:37.330014    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk" event={"ID":"4a8c8ee3-4478-4773-890e-cbf4dc1aafc8","Type":"ContainerDied","Data":"01bc51623cc590eb99225bbb1447b3bc5281cbb7785555762ce3c2c605542ec0"}
Jul 21 01:12:37.330134 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:37.330061    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk" event={"ID":"4a8c8ee3-4478-4773-890e-cbf4dc1aafc8","Type":"ContainerDied","Data":"334b97eae974d7e2a83e0e37fe4ed9dad65481e5d3e9cbb51e6e2cad66e69d25"}
Jul 21 01:12:37.330134 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:37.330088    2582 scope.go:117] "RemoveContainer" containerID="01bc51623cc590eb99225bbb1447b3bc5281cbb7785555762ce3c2c605542ec0"
Jul 21 01:12:37.339465 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:37.339448    2582 scope.go:117] "RemoveContainer" containerID="01bc51623cc590eb99225bbb1447b3bc5281cbb7785555762ce3c2c605542ec0"
Jul 21 01:12:37.339728 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:12:37.339710    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01bc51623cc590eb99225bbb1447b3bc5281cbb7785555762ce3c2c605542ec0\": container with ID starting with 01bc51623cc590eb99225bbb1447b3bc5281cbb7785555762ce3c2c605542ec0 not found: ID does not exist" containerID="01bc51623cc590eb99225bbb1447b3bc5281cbb7785555762ce3c2c605542ec0"
Jul 21 01:12:37.339785 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:37.339736    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01bc51623cc590eb99225bbb1447b3bc5281cbb7785555762ce3c2c605542ec0"} err="failed to get container status \"01bc51623cc590eb99225bbb1447b3bc5281cbb7785555762ce3c2c605542ec0\": rpc error: code = NotFound desc = could not find container \"01bc51623cc590eb99225bbb1447b3bc5281cbb7785555762ce3c2c605542ec0\": container with ID starting with 01bc51623cc590eb99225bbb1447b3bc5281cbb7785555762ce3c2c605542ec0 not found: ID does not exist"
Jul 21 01:12:37.349530 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:37.349505    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk"]
Jul 21 01:12:37.352731 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:37.352712    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0a237698-57dbf4f84f-lb4mk"]
Jul 21 01:12:38.344702 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:38.344670    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a8c8ee3-4478-4773-890e-cbf4dc1aafc8" path="/var/lib/kubelet/pods/4a8c8ee3-4478-4773-890e-cbf4dc1aafc8/volumes"
Jul 21 01:12:39.599479 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:12:39.599440    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:14:54.859077 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:14:54.859040    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp"]
Jul 21 01:14:54.859587 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:14:54.859394    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a8c8ee3-4478-4773-890e-cbf4dc1aafc8" containerName="maas-api"
Jul 21 01:14:54.859587 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:14:54.859405    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a8c8ee3-4478-4773-890e-cbf4dc1aafc8" containerName="maas-api"
Jul 21 01:14:54.859587 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:14:54.859487    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a8c8ee3-4478-4773-890e-cbf4dc1aafc8" containerName="maas-api"
Jul 21 01:14:54.862442 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:14:54.862427    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp"
Jul 21 01:14:54.865304 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:14:54.865280    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 01:14:54.865304 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:14:54.865302    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-6eed7610-serving-cert\""
Jul 21 01:14:54.865472 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:14:54.865302    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 01:14:54.865866 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:14:54.865847    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8b65c\""
Jul 21 01:14:54.874050 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:14:54.874026    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp"]
Jul 21 01:14:55.021371 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:14:55.021336    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65d535d0-665c-4bd5-82e5-39293608025f-maas-api-tls\") pod \"maas-api-e2e-mt-6eed7610-df459b667-l8pcp\" (UID: \"65d535d0-665c-4bd5-82e5-39293608025f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp"
Jul 21 01:14:55.021551 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:14:55.021384    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65d535d0-665c-4bd5-82e5-39293608025f-openshift-service-ca\") pod \"maas-api-e2e-mt-6eed7610-df459b667-l8pcp\" (UID: \"65d535d0-665c-4bd5-82e5-39293608025f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp"
Jul 21 01:14:55.021551 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:14:55.021412    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdsbs\" (UniqueName: \"kubernetes.io/projected/65d535d0-665c-4bd5-82e5-39293608025f-kube-api-access-tdsbs\") pod \"maas-api-e2e-mt-6eed7610-df459b667-l8pcp\" (UID: \"65d535d0-665c-4bd5-82e5-39293608025f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp"
Jul 21 01:14:55.122124 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:14:55.122037    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65d535d0-665c-4bd5-82e5-39293608025f-maas-api-tls\") pod \"maas-api-e2e-mt-6eed7610-df459b667-l8pcp\" (UID: \"65d535d0-665c-4bd5-82e5-39293608025f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp"
Jul 21 01:14:55.122124 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:14:55.122087    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65d535d0-665c-4bd5-82e5-39293608025f-openshift-service-ca\") pod \"maas-api-e2e-mt-6eed7610-df459b667-l8pcp\" (UID: \"65d535d0-665c-4bd5-82e5-39293608025f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp"
Jul 21 01:14:55.122124 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:14:55.122122    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdsbs\" (UniqueName: \"kubernetes.io/projected/65d535d0-665c-4bd5-82e5-39293608025f-kube-api-access-tdsbs\") pod \"maas-api-e2e-mt-6eed7610-df459b667-l8pcp\" (UID: \"65d535d0-665c-4bd5-82e5-39293608025f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp"
Jul 21 01:14:55.122764 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:14:55.122730    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65d535d0-665c-4bd5-82e5-39293608025f-openshift-service-ca\") pod \"maas-api-e2e-mt-6eed7610-df459b667-l8pcp\" (UID: \"65d535d0-665c-4bd5-82e5-39293608025f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp"
Jul 21 01:14:55.124453 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:14:55.124424    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65d535d0-665c-4bd5-82e5-39293608025f-maas-api-tls\") pod \"maas-api-e2e-mt-6eed7610-df459b667-l8pcp\" (UID: \"65d535d0-665c-4bd5-82e5-39293608025f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp"
Jul 21 01:14:55.130188 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:14:55.130161    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdsbs\" (UniqueName: \"kubernetes.io/projected/65d535d0-665c-4bd5-82e5-39293608025f-kube-api-access-tdsbs\") pod \"maas-api-e2e-mt-6eed7610-df459b667-l8pcp\" (UID: \"65d535d0-665c-4bd5-82e5-39293608025f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp"
Jul 21 01:14:55.174064 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:14:55.174026    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp"
Jul 21 01:14:55.319488 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:14:55.319457    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp"]
Jul 21 01:14:55.321003 ip-10-0-133-75 kubenswrapper[2582]: W0721 01:14:55.320978    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65d535d0_665c_4bd5_82e5_39293608025f.slice/crio-074a19c4eaf4a0b5e7a026a01b0300b6d97d8d2058a6692741d5a889afc8ac0f WatchSource:0}: Error finding container 074a19c4eaf4a0b5e7a026a01b0300b6d97d8d2058a6692741d5a889afc8ac0f: Status 404 returned error can't find the container with id 074a19c4eaf4a0b5e7a026a01b0300b6d97d8d2058a6692741d5a889afc8ac0f
Jul 21 01:14:55.322341 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:14:55.322321    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 01:14:56.078613 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:14:56.078579    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp" event={"ID":"65d535d0-665c-4bd5-82e5-39293608025f","Type":"ContainerStarted","Data":"bf6e8c46f993aad9936e48e928f1709cbbac075c5012da4ba6832d9b919eabc0"}
Jul 21 01:14:56.079090 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:14:56.078626    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp" event={"ID":"65d535d0-665c-4bd5-82e5-39293608025f","Type":"ContainerStarted","Data":"074a19c4eaf4a0b5e7a026a01b0300b6d97d8d2058a6692741d5a889afc8ac0f"}
Jul 21 01:14:56.079090 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:14:56.078810    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp"
Jul 21 01:14:56.096626 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:14:56.096572    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp" podStartSLOduration=1.4516133660000001 podStartE2EDuration="2.096553429s" totalImagesPullingTime="644.940063ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:14:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:14:56.095759492 +0000 UTC m=+2026.395455915" watchObservedRunningTime="2026-07-21 01:14:56.096553429 +0000 UTC m=+2026.396249852"
Jul 21 01:15:01.698285 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:01.698248    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:15:02.089894 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:02.089816    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp"
Jul 21 01:15:07.395390 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.395350    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"]
Jul 21 01:15:07.399239 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.399221    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"
Jul 21 01:15:07.400905 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.400882    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-6eed7610\"/\"openshift-service-ca.crt\""
Jul 21 01:15:07.401066 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.401051    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-6eed7610\"/\"kube-root-ca.crt\""
Jul 21 01:15:07.401531 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.401516    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-6eed7610\"/\"default-dockercfg-7mbpm\""
Jul 21 01:15:07.401600 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.401581    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-6eed7610\"/\"e2e-lifecycle-model-6eed7610-kserve-self-signed-certs\""
Jul 21 01:15:07.406962 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.406935    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"]
Jul 21 01:15:07.538426 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.538387    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-dshm\") pod \"e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d\" (UID: \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\") " pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"
Jul 21 01:15:07.538426 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.538428    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzstq\" (UniqueName: \"kubernetes.io/projected/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-kube-api-access-nzstq\") pod \"e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d\" (UID: \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\") " pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"
Jul 21 01:15:07.538708 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.538501    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-home\") pod \"e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d\" (UID: \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\") " pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"
Jul 21 01:15:07.538708 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.538537    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-tls-certs\") pod \"e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d\" (UID: \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\") " pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"
Jul 21 01:15:07.538708 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.538589    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-model-cache\") pod \"e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d\" (UID: \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\") " pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"
Jul 21 01:15:07.538708 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.538697    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-tmp-dir\") pod \"e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d\" (UID: \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\") " pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"
Jul 21 01:15:07.639331 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.639289    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-tmp-dir\") pod \"e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d\" (UID: \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\") " pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"
Jul 21 01:15:07.639532 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.639391    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-dshm\") pod \"e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d\" (UID: \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\") " pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"
Jul 21 01:15:07.639532 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.639424    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzstq\" (UniqueName: \"kubernetes.io/projected/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-kube-api-access-nzstq\") pod \"e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d\" (UID: \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\") " pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"
Jul 21 01:15:07.639532 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.639457    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-home\") pod \"e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d\" (UID: \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\") " pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"
Jul 21 01:15:07.639532 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.639489    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-tls-certs\") pod \"e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d\" (UID: \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\") " pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"
Jul 21 01:15:07.639809 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.639557    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-model-cache\") pod \"e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d\" (UID: \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\") " pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"
Jul 21 01:15:07.639809 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.639770    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-tmp-dir\") pod \"e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d\" (UID: \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\") " pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"
Jul 21 01:15:07.639919 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.639864    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-home\") pod \"e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d\" (UID: \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\") " pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"
Jul 21 01:15:07.639973 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.639952    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-model-cache\") pod \"e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d\" (UID: \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\") " pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"
Jul 21 01:15:07.641699 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.641671    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-dshm\") pod \"e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d\" (UID: \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\") " pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"
Jul 21 01:15:07.642062 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.642045    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-tls-certs\") pod \"e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d\" (UID: \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\") " pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"
Jul 21 01:15:07.647060 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.647002    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzstq\" (UniqueName: \"kubernetes.io/projected/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-kube-api-access-nzstq\") pod \"e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d\" (UID: \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\") " pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"
Jul 21 01:15:07.710903 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.710845    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"
Jul 21 01:15:07.855908 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:07.855885    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"]
Jul 21 01:15:07.858401 ip-10-0-133-75 kubenswrapper[2582]: W0721 01:15:07.858340    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf274c46_8a79_4ec9_bc74_19dc7ee4b7f3.slice/crio-493073ddd1b2e1f9b65181703aed629655dfd298c8c3e81750e48fd4275cb1a1 WatchSource:0}: Error finding container 493073ddd1b2e1f9b65181703aed629655dfd298c8c3e81750e48fd4275cb1a1: Status 404 returned error can't find the container with id 493073ddd1b2e1f9b65181703aed629655dfd298c8c3e81750e48fd4275cb1a1
Jul 21 01:15:08.145287 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:08.145254    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d" event={"ID":"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3","Type":"ContainerStarted","Data":"b96ef882711062ff83ace3a342a535504ec7e67861a2459597c236d0b297baf5"}
Jul 21 01:15:08.145287 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:08.145293    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d" event={"ID":"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3","Type":"ContainerStarted","Data":"493073ddd1b2e1f9b65181703aed629655dfd298c8c3e81750e48fd4275cb1a1"}
Jul 21 01:15:08.162528 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:08.162429    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d" podStartSLOduration=1.162412351 podStartE2EDuration="1.162412351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:15:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:15:08.160088355 +0000 UTC m=+2038.459784775" watchObservedRunningTime="2026-07-21 01:15:08.162412351 +0000 UTC m=+2038.462108771"
Jul 21 01:15:10.010313 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:10.010278    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:15:17.711524 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:17.711487    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"
Jul 21 01:15:17.712018 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:17.711539    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"
Jul 21 01:15:17.723662 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:17.723620    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"
Jul 21 01:15:18.213258 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:18.213225    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"
Jul 21 01:15:26.116641 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:26.116599    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:15:46.614322 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:46.614245    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:15:48.311720 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:48.311631    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp"]
Jul 21 01:15:48.312162 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:48.311895    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp" podUID="65d535d0-665c-4bd5-82e5-39293608025f" containerName="maas-api" containerID="cri-o://bf6e8c46f993aad9936e48e928f1709cbbac075c5012da4ba6832d9b919eabc0" gracePeriod=30
Jul 21 01:15:48.568588 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:48.568528    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp"
Jul 21 01:15:48.627236 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:48.627205    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdsbs\" (UniqueName: \"kubernetes.io/projected/65d535d0-665c-4bd5-82e5-39293608025f-kube-api-access-tdsbs\") pod \"65d535d0-665c-4bd5-82e5-39293608025f\" (UID: \"65d535d0-665c-4bd5-82e5-39293608025f\") "
Jul 21 01:15:48.627411 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:48.627258    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65d535d0-665c-4bd5-82e5-39293608025f-maas-api-tls\") pod \"65d535d0-665c-4bd5-82e5-39293608025f\" (UID: \"65d535d0-665c-4bd5-82e5-39293608025f\") "
Jul 21 01:15:48.629385 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:48.629359    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65d535d0-665c-4bd5-82e5-39293608025f-kube-api-access-tdsbs" (OuterVolumeSpecName: "kube-api-access-tdsbs") pod "65d535d0-665c-4bd5-82e5-39293608025f" (UID: "65d535d0-665c-4bd5-82e5-39293608025f"). InnerVolumeSpecName "kube-api-access-tdsbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:15:48.629464 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:48.629358    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65d535d0-665c-4bd5-82e5-39293608025f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "65d535d0-665c-4bd5-82e5-39293608025f" (UID: "65d535d0-665c-4bd5-82e5-39293608025f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:15:48.728032 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:48.727998    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65d535d0-665c-4bd5-82e5-39293608025f-openshift-service-ca\") pod \"65d535d0-665c-4bd5-82e5-39293608025f\" (UID: \"65d535d0-665c-4bd5-82e5-39293608025f\") "
Jul 21 01:15:48.728239 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:48.728227    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65d535d0-665c-4bd5-82e5-39293608025f-maas-api-tls\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:15:48.728302 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:48.728241    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdsbs\" (UniqueName: \"kubernetes.io/projected/65d535d0-665c-4bd5-82e5-39293608025f-kube-api-access-tdsbs\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:15:48.728355 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:48.728332    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65d535d0-665c-4bd5-82e5-39293608025f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "65d535d0-665c-4bd5-82e5-39293608025f" (UID: "65d535d0-665c-4bd5-82e5-39293608025f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:15:48.828778 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:48.828692    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65d535d0-665c-4bd5-82e5-39293608025f-openshift-service-ca\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:15:49.381391 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:49.381357    2582 generic.go:356] "Generic (PLEG): container finished" podID="65d535d0-665c-4bd5-82e5-39293608025f" containerID="bf6e8c46f993aad9936e48e928f1709cbbac075c5012da4ba6832d9b919eabc0" exitCode=0
Jul 21 01:15:49.381848 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:49.381404    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp"
Jul 21 01:15:49.381848 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:49.381444    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp" event={"ID":"65d535d0-665c-4bd5-82e5-39293608025f","Type":"ContainerDied","Data":"bf6e8c46f993aad9936e48e928f1709cbbac075c5012da4ba6832d9b919eabc0"}
Jul 21 01:15:49.381848 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:49.381498    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp" event={"ID":"65d535d0-665c-4bd5-82e5-39293608025f","Type":"ContainerDied","Data":"074a19c4eaf4a0b5e7a026a01b0300b6d97d8d2058a6692741d5a889afc8ac0f"}
Jul 21 01:15:49.381848 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:49.381520    2582 scope.go:117] "RemoveContainer" containerID="bf6e8c46f993aad9936e48e928f1709cbbac075c5012da4ba6832d9b919eabc0"
Jul 21 01:15:49.391164 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:49.391142    2582 scope.go:117] "RemoveContainer" containerID="bf6e8c46f993aad9936e48e928f1709cbbac075c5012da4ba6832d9b919eabc0"
Jul 21 01:15:49.391444 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:15:49.391426    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf6e8c46f993aad9936e48e928f1709cbbac075c5012da4ba6832d9b919eabc0\": container with ID starting with bf6e8c46f993aad9936e48e928f1709cbbac075c5012da4ba6832d9b919eabc0 not found: ID does not exist" containerID="bf6e8c46f993aad9936e48e928f1709cbbac075c5012da4ba6832d9b919eabc0"
Jul 21 01:15:49.391483 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:49.391452    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf6e8c46f993aad9936e48e928f1709cbbac075c5012da4ba6832d9b919eabc0"} err="failed to get container status \"bf6e8c46f993aad9936e48e928f1709cbbac075c5012da4ba6832d9b919eabc0\": rpc error: code = NotFound desc = could not find container \"bf6e8c46f993aad9936e48e928f1709cbbac075c5012da4ba6832d9b919eabc0\": container with ID starting with bf6e8c46f993aad9936e48e928f1709cbbac075c5012da4ba6832d9b919eabc0 not found: ID does not exist"
Jul 21 01:15:49.402521 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:49.402494    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp"]
Jul 21 01:15:49.406041 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:49.406019    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6eed7610-df459b667-l8pcp"]
Jul 21 01:15:50.344927 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:50.344892    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65d535d0-665c-4bd5-82e5-39293608025f" path="/var/lib/kubelet/pods/65d535d0-665c-4bd5-82e5-39293608025f/volumes"
Jul 21 01:15:56.801023 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:15:56.800985    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:16:00.052407 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:00.052366    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"]
Jul 21 01:16:15.073329 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.073285    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d" podUID="af274c46-8a79-4ec9-bc74-19dc7ee4b7f3" containerName="main" containerID="cri-o://b96ef882711062ff83ace3a342a535504ec7e67861a2459597c236d0b297baf5" gracePeriod=45
Jul 21 01:16:15.324869 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.324804    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"
Jul 21 01:16:15.486008 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.485972    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-tls-certs\") pod \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\" (UID: \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\") "
Jul 21 01:16:15.486008 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.486010    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-tmp-dir\") pod \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\" (UID: \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\") "
Jul 21 01:16:15.486240 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.486081    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzstq\" (UniqueName: \"kubernetes.io/projected/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-kube-api-access-nzstq\") pod \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\" (UID: \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\") "
Jul 21 01:16:15.486240 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.486140    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-model-cache\") pod \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\" (UID: \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\") "
Jul 21 01:16:15.486240 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.486171    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-home\") pod \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\" (UID: \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\") "
Jul 21 01:16:15.486240 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.486210    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-dshm\") pod \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\" (UID: \"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3\") "
Jul 21 01:16:15.486460 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.486338    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "af274c46-8a79-4ec9-bc74-19dc7ee4b7f3" (UID: "af274c46-8a79-4ec9-bc74-19dc7ee4b7f3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:16:15.486460 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.486380    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-model-cache" (OuterVolumeSpecName: "model-cache") pod "af274c46-8a79-4ec9-bc74-19dc7ee4b7f3" (UID: "af274c46-8a79-4ec9-bc74-19dc7ee4b7f3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:16:15.486567 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.486494    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-home" (OuterVolumeSpecName: "home") pod "af274c46-8a79-4ec9-bc74-19dc7ee4b7f3" (UID: "af274c46-8a79-4ec9-bc74-19dc7ee4b7f3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:16:15.486703 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.486685    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-model-cache\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:16:15.486793 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.486709    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-home\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:16:15.486793 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.486723    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-tmp-dir\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:16:15.488407 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.488379    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "af274c46-8a79-4ec9-bc74-19dc7ee4b7f3" (UID: "af274c46-8a79-4ec9-bc74-19dc7ee4b7f3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:16:15.488502 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.488451    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-dshm" (OuterVolumeSpecName: "dshm") pod "af274c46-8a79-4ec9-bc74-19dc7ee4b7f3" (UID: "af274c46-8a79-4ec9-bc74-19dc7ee4b7f3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:16:15.488502 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.488478    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-kube-api-access-nzstq" (OuterVolumeSpecName: "kube-api-access-nzstq") pod "af274c46-8a79-4ec9-bc74-19dc7ee4b7f3" (UID: "af274c46-8a79-4ec9-bc74-19dc7ee4b7f3"). InnerVolumeSpecName "kube-api-access-nzstq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:16:15.536501 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.536464    2582 generic.go:356] "Generic (PLEG): container finished" podID="af274c46-8a79-4ec9-bc74-19dc7ee4b7f3" containerID="b96ef882711062ff83ace3a342a535504ec7e67861a2459597c236d0b297baf5" exitCode=0
Jul 21 01:16:15.536501 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.536499    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"
Jul 21 01:16:15.536739 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.536548    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d" event={"ID":"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3","Type":"ContainerDied","Data":"b96ef882711062ff83ace3a342a535504ec7e67861a2459597c236d0b297baf5"}
Jul 21 01:16:15.536739 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.536591    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d" event={"ID":"af274c46-8a79-4ec9-bc74-19dc7ee4b7f3","Type":"ContainerDied","Data":"493073ddd1b2e1f9b65181703aed629655dfd298c8c3e81750e48fd4275cb1a1"}
Jul 21 01:16:15.536739 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.536609    2582 scope.go:117] "RemoveContainer" containerID="b96ef882711062ff83ace3a342a535504ec7e67861a2459597c236d0b297baf5"
Jul 21 01:16:15.547030 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.547002    2582 scope.go:117] "RemoveContainer" containerID="b96ef882711062ff83ace3a342a535504ec7e67861a2459597c236d0b297baf5"
Jul 21 01:16:15.547339 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:16:15.547316    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b96ef882711062ff83ace3a342a535504ec7e67861a2459597c236d0b297baf5\": container with ID starting with b96ef882711062ff83ace3a342a535504ec7e67861a2459597c236d0b297baf5 not found: ID does not exist" containerID="b96ef882711062ff83ace3a342a535504ec7e67861a2459597c236d0b297baf5"
Jul 21 01:16:15.547384 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.547352    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b96ef882711062ff83ace3a342a535504ec7e67861a2459597c236d0b297baf5"} err="failed to get container status \"b96ef882711062ff83ace3a342a535504ec7e67861a2459597c236d0b297baf5\": rpc error: code = NotFound desc = could not find container \"b96ef882711062ff83ace3a342a535504ec7e67861a2459597c236d0b297baf5\": container with ID starting with b96ef882711062ff83ace3a342a535504ec7e67861a2459597c236d0b297baf5 not found: ID does not exist"
Jul 21 01:16:15.560191 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.560156    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"]
Jul 21 01:16:15.564842 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.564812    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-6eed7610/e2e-lifecycle-model-6eed7610-kserve-5d86f6d48c-gwn2d"]
Jul 21 01:16:15.587549 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.587466    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-tls-certs\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:16:15.587549 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.587505    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzstq\" (UniqueName: \"kubernetes.io/projected/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-kube-api-access-nzstq\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:16:15.587549 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:15.587517    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3-dshm\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:16:16.344301 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:16.344270    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af274c46-8a79-4ec9-bc74-19dc7ee4b7f3" path="/var/lib/kubelet/pods/af274c46-8a79-4ec9-bc74-19dc7ee4b7f3/volumes"
Jul 21 01:16:54.718536 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:16:54.718497    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:17:03.010111 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:03.010023    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:17:43.656753 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:43.656719    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2"]
Jul 21 01:17:43.657253 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:43.657151    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af274c46-8a79-4ec9-bc74-19dc7ee4b7f3" containerName="main"
Jul 21 01:17:43.657253 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:43.657165    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="af274c46-8a79-4ec9-bc74-19dc7ee4b7f3" containerName="main"
Jul 21 01:17:43.657253 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:43.657181    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65d535d0-665c-4bd5-82e5-39293608025f" containerName="maas-api"
Jul 21 01:17:43.657253 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:43.657189    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="65d535d0-665c-4bd5-82e5-39293608025f" containerName="maas-api"
Jul 21 01:17:43.657403 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:43.657284    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="af274c46-8a79-4ec9-bc74-19dc7ee4b7f3" containerName="main"
Jul 21 01:17:43.657403 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:43.657303    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="65d535d0-665c-4bd5-82e5-39293608025f" containerName="maas-api"
Jul 21 01:17:43.660364 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:43.660344    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2"
Jul 21 01:17:43.662431 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:43.662409    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 01:17:43.662548 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:43.662431    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-2eeec3-serving-cert\""
Jul 21 01:17:43.663084 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:43.663066    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8b65c\""
Jul 21 01:17:43.663150 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:43.663090    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 01:17:43.672353 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:43.672327    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2"]
Jul 21 01:17:43.778909 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:43.778869    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03e01a68-4da8-4af6-b8f4-4fe4d989c395-maas-api-tls\") pod \"maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2\" (UID: \"03e01a68-4da8-4af6-b8f4-4fe4d989c395\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2"
Jul 21 01:17:43.779103 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:43.778944    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03e01a68-4da8-4af6-b8f4-4fe4d989c395-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2\" (UID: \"03e01a68-4da8-4af6-b8f4-4fe4d989c395\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2"
Jul 21 01:17:43.779103 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:43.778961    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtgvr\" (UniqueName: \"kubernetes.io/projected/03e01a68-4da8-4af6-b8f4-4fe4d989c395-kube-api-access-gtgvr\") pod \"maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2\" (UID: \"03e01a68-4da8-4af6-b8f4-4fe4d989c395\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2"
Jul 21 01:17:43.880272 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:43.880230    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03e01a68-4da8-4af6-b8f4-4fe4d989c395-maas-api-tls\") pod \"maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2\" (UID: \"03e01a68-4da8-4af6-b8f4-4fe4d989c395\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2"
Jul 21 01:17:43.880540 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:43.880325    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03e01a68-4da8-4af6-b8f4-4fe4d989c395-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2\" (UID: \"03e01a68-4da8-4af6-b8f4-4fe4d989c395\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2"
Jul 21 01:17:43.880540 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:43.880351    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtgvr\" (UniqueName: \"kubernetes.io/projected/03e01a68-4da8-4af6-b8f4-4fe4d989c395-kube-api-access-gtgvr\") pod \"maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2\" (UID: \"03e01a68-4da8-4af6-b8f4-4fe4d989c395\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2"
Jul 21 01:17:43.880540 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:17:43.880413    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-serving-cert: secret "maas-api-e2e-inf-a-2eeec3-serving-cert" not found
Jul 21 01:17:43.880540 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:17:43.880498    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03e01a68-4da8-4af6-b8f4-4fe4d989c395-maas-api-tls podName:03e01a68-4da8-4af6-b8f4-4fe4d989c395 nodeName:}" failed. No retries permitted until 2026-07-21 01:17:44.380476326 +0000 UTC m=+2194.680172726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/03e01a68-4da8-4af6-b8f4-4fe4d989c395-maas-api-tls") pod "maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2" (UID: "03e01a68-4da8-4af6-b8f4-4fe4d989c395") : secret "maas-api-e2e-inf-a-2eeec3-serving-cert" not found
Jul 21 01:17:43.881161 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:43.881140    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03e01a68-4da8-4af6-b8f4-4fe4d989c395-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2\" (UID: \"03e01a68-4da8-4af6-b8f4-4fe4d989c395\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2"
Jul 21 01:17:43.899249 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:43.899209    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtgvr\" (UniqueName: \"kubernetes.io/projected/03e01a68-4da8-4af6-b8f4-4fe4d989c395-kube-api-access-gtgvr\") pod \"maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2\" (UID: \"03e01a68-4da8-4af6-b8f4-4fe4d989c395\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2"
Jul 21 01:17:44.385140 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:44.385103    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03e01a68-4da8-4af6-b8f4-4fe4d989c395-maas-api-tls\") pod \"maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2\" (UID: \"03e01a68-4da8-4af6-b8f4-4fe4d989c395\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2"
Jul 21 01:17:44.387617 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:44.387595    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03e01a68-4da8-4af6-b8f4-4fe4d989c395-maas-api-tls\") pod \"maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2\" (UID: \"03e01a68-4da8-4af6-b8f4-4fe4d989c395\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2"
Jul 21 01:17:44.572177 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:44.572138    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2"
Jul 21 01:17:44.712882 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:44.712857    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2"]
Jul 21 01:17:44.714897 ip-10-0-133-75 kubenswrapper[2582]: W0721 01:17:44.714870    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e01a68_4da8_4af6_b8f4_4fe4d989c395.slice/crio-ebcc72ae4f6ccadb2669f5899c005422eae99398acb06a31cffcfdc668214687 WatchSource:0}: Error finding container ebcc72ae4f6ccadb2669f5899c005422eae99398acb06a31cffcfdc668214687: Status 404 returned error can't find the container with id ebcc72ae4f6ccadb2669f5899c005422eae99398acb06a31cffcfdc668214687
Jul 21 01:17:45.028785 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:45.028748    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2" event={"ID":"03e01a68-4da8-4af6-b8f4-4fe4d989c395","Type":"ContainerStarted","Data":"ebcc72ae4f6ccadb2669f5899c005422eae99398acb06a31cffcfdc668214687"}
Jul 21 01:17:46.035881 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:46.035839    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2" event={"ID":"03e01a68-4da8-4af6-b8f4-4fe4d989c395","Type":"ContainerStarted","Data":"f8bedf7cce5c4321609f9f3a24154541718158ecf73fb9884d2cee2eb791ff60"}
Jul 21 01:17:46.036306 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:46.035905    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2"
Jul 21 01:17:46.054038 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:46.053965    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2" podStartSLOduration=2.541846854 podStartE2EDuration="3.053942586s" totalImagesPullingTime="512.095732ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:17:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:17:46.05354196 +0000 UTC m=+2196.353238383" watchObservedRunningTime="2026-07-21 01:17:46.053942586 +0000 UTC m=+2196.353639014"
Jul 21 01:17:51.617077 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:51.617039    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:17:51.869488 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:51.869395    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx"]
Jul 21 01:17:51.873547 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:51.873518    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx"
Jul 21 01:17:51.877021 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:51.876998    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-6bfe4a-serving-cert\""
Jul 21 01:17:51.899305 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:51.899267    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx"]
Jul 21 01:17:51.955217 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:51.955171    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5c20dd0-77a7-49d8-843e-34f58fd3ac55-maas-api-tls\") pod \"maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx\" (UID: \"d5c20dd0-77a7-49d8-843e-34f58fd3ac55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx"
Jul 21 01:17:51.955406 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:51.955348    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5c20dd0-77a7-49d8-843e-34f58fd3ac55-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx\" (UID: \"d5c20dd0-77a7-49d8-843e-34f58fd3ac55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx"
Jul 21 01:17:51.955406 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:51.955388    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzd5l\" (UniqueName: \"kubernetes.io/projected/d5c20dd0-77a7-49d8-843e-34f58fd3ac55-kube-api-access-jzd5l\") pod \"maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx\" (UID: \"d5c20dd0-77a7-49d8-843e-34f58fd3ac55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx"
Jul 21 01:17:52.047195 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:52.047167    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2"
Jul 21 01:17:52.056783 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:52.056748    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5c20dd0-77a7-49d8-843e-34f58fd3ac55-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx\" (UID: \"d5c20dd0-77a7-49d8-843e-34f58fd3ac55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx"
Jul 21 01:17:52.056783 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:52.056786    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzd5l\" (UniqueName: \"kubernetes.io/projected/d5c20dd0-77a7-49d8-843e-34f58fd3ac55-kube-api-access-jzd5l\") pod \"maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx\" (UID: \"d5c20dd0-77a7-49d8-843e-34f58fd3ac55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx"
Jul 21 01:17:52.056977 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:52.056809    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5c20dd0-77a7-49d8-843e-34f58fd3ac55-maas-api-tls\") pod \"maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx\" (UID: \"d5c20dd0-77a7-49d8-843e-34f58fd3ac55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx"
Jul 21 01:17:52.056977 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:17:52.056911    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-serving-cert: secret "maas-api-e2e-inf-b-6bfe4a-serving-cert" not found
Jul 21 01:17:52.057067 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:17:52.056981    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5c20dd0-77a7-49d8-843e-34f58fd3ac55-maas-api-tls podName:d5c20dd0-77a7-49d8-843e-34f58fd3ac55 nodeName:}" failed. No retries permitted until 2026-07-21 01:17:52.556962283 +0000 UTC m=+2202.856658683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d5c20dd0-77a7-49d8-843e-34f58fd3ac55-maas-api-tls") pod "maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx" (UID: "d5c20dd0-77a7-49d8-843e-34f58fd3ac55") : secret "maas-api-e2e-inf-b-6bfe4a-serving-cert" not found
Jul 21 01:17:52.057364 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:52.057343    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5c20dd0-77a7-49d8-843e-34f58fd3ac55-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx\" (UID: \"d5c20dd0-77a7-49d8-843e-34f58fd3ac55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx"
Jul 21 01:17:52.066026 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:52.066003    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzd5l\" (UniqueName: \"kubernetes.io/projected/d5c20dd0-77a7-49d8-843e-34f58fd3ac55-kube-api-access-jzd5l\") pod \"maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx\" (UID: \"d5c20dd0-77a7-49d8-843e-34f58fd3ac55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx"
Jul 21 01:17:52.561532 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:52.561496    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5c20dd0-77a7-49d8-843e-34f58fd3ac55-maas-api-tls\") pod \"maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx\" (UID: \"d5c20dd0-77a7-49d8-843e-34f58fd3ac55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx"
Jul 21 01:17:52.561813 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:17:52.561700    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-serving-cert: secret "maas-api-e2e-inf-b-6bfe4a-serving-cert" not found
Jul 21 01:17:52.561813 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:17:52.561778    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5c20dd0-77a7-49d8-843e-34f58fd3ac55-maas-api-tls podName:d5c20dd0-77a7-49d8-843e-34f58fd3ac55 nodeName:}" failed. No retries permitted until 2026-07-21 01:17:53.56175734 +0000 UTC m=+2203.861453752 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d5c20dd0-77a7-49d8-843e-34f58fd3ac55-maas-api-tls") pod "maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx" (UID: "d5c20dd0-77a7-49d8-843e-34f58fd3ac55") : secret "maas-api-e2e-inf-b-6bfe4a-serving-cert" not found
Jul 21 01:17:53.571983 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:53.571943    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5c20dd0-77a7-49d8-843e-34f58fd3ac55-maas-api-tls\") pod \"maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx\" (UID: \"d5c20dd0-77a7-49d8-843e-34f58fd3ac55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx"
Jul 21 01:17:53.574519 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:53.574493    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5c20dd0-77a7-49d8-843e-34f58fd3ac55-maas-api-tls\") pod \"maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx\" (UID: \"d5c20dd0-77a7-49d8-843e-34f58fd3ac55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx"
Jul 21 01:17:53.684763 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:53.684726    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx"
Jul 21 01:17:53.837861 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:53.837832    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx"]
Jul 21 01:17:53.839331 ip-10-0-133-75 kubenswrapper[2582]: W0721 01:17:53.839304    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5c20dd0_77a7_49d8_843e_34f58fd3ac55.slice/crio-f4f389eafd0965e5fb366ad998f7ac4745583733739a38fcf0dee28c0f0b57ba WatchSource:0}: Error finding container f4f389eafd0965e5fb366ad998f7ac4745583733739a38fcf0dee28c0f0b57ba: Status 404 returned error can't find the container with id f4f389eafd0965e5fb366ad998f7ac4745583733739a38fcf0dee28c0f0b57ba
Jul 21 01:17:54.083481 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:54.083443    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx" event={"ID":"d5c20dd0-77a7-49d8-843e-34f58fd3ac55","Type":"ContainerStarted","Data":"f4f389eafd0965e5fb366ad998f7ac4745583733739a38fcf0dee28c0f0b57ba"}
Jul 21 01:17:55.091214 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:55.091179    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx" event={"ID":"d5c20dd0-77a7-49d8-843e-34f58fd3ac55","Type":"ContainerStarted","Data":"c0d9e9e44b6815c97e9337f09dbcf411200a2b346cd06c4ae2b1dc49d283f4f7"}
Jul 21 01:17:55.091698 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:55.091237    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx"
Jul 21 01:17:55.121286 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:17:55.121231    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx" podStartSLOduration=3.755591911 podStartE2EDuration="4.121213862s" totalImagesPullingTime="365.621951ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:17:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:17:55.120144259 +0000 UTC m=+2205.419840694" watchObservedRunningTime="2026-07-21 01:17:55.121213862 +0000 UTC m=+2205.420910314"
Jul 21 01:18:01.102123 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.102093    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx"
Jul 21 01:18:01.206007 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.205964    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"]
Jul 21 01:18:01.209749 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.209727    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"
Jul 21 01:18:01.212574 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.212550    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2eeec3\"/\"default-dockercfg-549n2\""
Jul 21 01:18:01.212732 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.212643    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2eeec3\"/\"test-model-2eeec3-kserve-self-signed-certs\""
Jul 21 01:18:01.212732 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.212614    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2eeec3\"/\"openshift-service-ca.crt\""
Jul 21 01:18:01.212980 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.212965    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2eeec3\"/\"kube-root-ca.crt\""
Jul 21 01:18:01.223705 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.223680    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"]
Jul 21 01:18:01.342902 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.342866    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm7nl\" (UniqueName: \"kubernetes.io/projected/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-kube-api-access-qm7nl\") pod \"test-model-2eeec3-kserve-9fd8ff5d7-w89zh\" (UID: \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\") " pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"
Jul 21 01:18:01.343086 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.342913    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-home\") pod \"test-model-2eeec3-kserve-9fd8ff5d7-w89zh\" (UID: \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\") " pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"
Jul 21 01:18:01.343086 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.342989    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-tmp-dir\") pod \"test-model-2eeec3-kserve-9fd8ff5d7-w89zh\" (UID: \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\") " pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"
Jul 21 01:18:01.343086 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.343049    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-model-cache\") pod \"test-model-2eeec3-kserve-9fd8ff5d7-w89zh\" (UID: \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\") " pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"
Jul 21 01:18:01.343086 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.343075    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-tls-certs\") pod \"test-model-2eeec3-kserve-9fd8ff5d7-w89zh\" (UID: \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\") " pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"
Jul 21 01:18:01.343251 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.343108    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-dshm\") pod \"test-model-2eeec3-kserve-9fd8ff5d7-w89zh\" (UID: \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\") " pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"
Jul 21 01:18:01.444382 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.444354    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm7nl\" (UniqueName: \"kubernetes.io/projected/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-kube-api-access-qm7nl\") pod \"test-model-2eeec3-kserve-9fd8ff5d7-w89zh\" (UID: \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\") " pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"
Jul 21 01:18:01.444556 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.444401    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-home\") pod \"test-model-2eeec3-kserve-9fd8ff5d7-w89zh\" (UID: \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\") " pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"
Jul 21 01:18:01.444556 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.444526    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-tmp-dir\") pod \"test-model-2eeec3-kserve-9fd8ff5d7-w89zh\" (UID: \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\") " pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"
Jul 21 01:18:01.444661 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.444600    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-model-cache\") pod \"test-model-2eeec3-kserve-9fd8ff5d7-w89zh\" (UID: \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\") " pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"
Jul 21 01:18:01.444661 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.444632    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-tls-certs\") pod \"test-model-2eeec3-kserve-9fd8ff5d7-w89zh\" (UID: \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\") " pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"
Jul 21 01:18:01.444742 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.444723    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-dshm\") pod \"test-model-2eeec3-kserve-9fd8ff5d7-w89zh\" (UID: \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\") " pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"
Jul 21 01:18:01.444850 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.444831    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-home\") pod \"test-model-2eeec3-kserve-9fd8ff5d7-w89zh\" (UID: \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\") " pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"
Jul 21 01:18:01.444920 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.444900    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-tmp-dir\") pod \"test-model-2eeec3-kserve-9fd8ff5d7-w89zh\" (UID: \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\") " pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"
Jul 21 01:18:01.444977 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.444955    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-model-cache\") pod \"test-model-2eeec3-kserve-9fd8ff5d7-w89zh\" (UID: \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\") " pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"
Jul 21 01:18:01.446857 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.446836    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-dshm\") pod \"test-model-2eeec3-kserve-9fd8ff5d7-w89zh\" (UID: \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\") " pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"
Jul 21 01:18:01.447189 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.447169    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-tls-certs\") pod \"test-model-2eeec3-kserve-9fd8ff5d7-w89zh\" (UID: \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\") " pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"
Jul 21 01:18:01.453216 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.453192    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm7nl\" (UniqueName: \"kubernetes.io/projected/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-kube-api-access-qm7nl\") pod \"test-model-2eeec3-kserve-9fd8ff5d7-w89zh\" (UID: \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\") " pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"
Jul 21 01:18:01.519975 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.519931    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"
Jul 21 01:18:01.671357 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:01.671332    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"]
Jul 21 01:18:01.672889 ip-10-0-133-75 kubenswrapper[2582]: W0721 01:18:01.672850    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73673ad7_964d_4db6_9e12_7ef9bd1e27e8.slice/crio-177ec1d3946732694adcc1a4865240a84adea8564329073fc0fbf2d0cdeec4a9 WatchSource:0}: Error finding container 177ec1d3946732694adcc1a4865240a84adea8564329073fc0fbf2d0cdeec4a9: Status 404 returned error can't find the container with id 177ec1d3946732694adcc1a4865240a84adea8564329073fc0fbf2d0cdeec4a9
Jul 21 01:18:02.130377 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:02.130276    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh" event={"ID":"73673ad7-964d-4db6-9e12-7ef9bd1e27e8","Type":"ContainerStarted","Data":"f20c0a77a13f3fe21d6465caee3417c9f30b6f2ab3094b685410756bfb7358d4"}
Jul 21 01:18:02.130377 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:02.130318    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh" event={"ID":"73673ad7-964d-4db6-9e12-7ef9bd1e27e8","Type":"ContainerStarted","Data":"177ec1d3946732694adcc1a4865240a84adea8564329073fc0fbf2d0cdeec4a9"}
Jul 21 01:18:02.147451 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:02.147391    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh" podStartSLOduration=1.14737211 podStartE2EDuration="1.14737211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:18:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:18:02.145934536 +0000 UTC m=+2212.445630957" watchObservedRunningTime="2026-07-21 01:18:02.14737211 +0000 UTC m=+2212.447068533"
Jul 21 01:18:03.918477 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:03.918442    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:18:11.520121 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:11.520078    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"
Jul 21 01:18:11.522628 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:11.520144    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"
Jul 21 01:18:11.532976 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:11.532952    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"
Jul 21 01:18:12.197901 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:12.197868    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"
Jul 21 01:18:18.107701 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:18.107666    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:18:45.403183 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:45.403095    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:18:59.711486 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:18:59.711452    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:19:31.785965 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:31.785927    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"]
Jul 21 01:19:38.903864 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:38.903829    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:19:43.563132 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:43.563094    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2"]
Jul 21 01:19:43.563606 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:43.563357    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2" podUID="03e01a68-4da8-4af6-b8f4-4fe4d989c395" containerName="maas-api" containerID="cri-o://f8bedf7cce5c4321609f9f3a24154541718158ecf73fb9884d2cee2eb791ff60" gracePeriod=30
Jul 21 01:19:44.013218 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:44.013193    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2"
Jul 21 01:19:44.150129 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:44.150031    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtgvr\" (UniqueName: \"kubernetes.io/projected/03e01a68-4da8-4af6-b8f4-4fe4d989c395-kube-api-access-gtgvr\") pod \"03e01a68-4da8-4af6-b8f4-4fe4d989c395\" (UID: \"03e01a68-4da8-4af6-b8f4-4fe4d989c395\") "
Jul 21 01:19:44.150129 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:44.150105    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03e01a68-4da8-4af6-b8f4-4fe4d989c395-openshift-service-ca\") pod \"03e01a68-4da8-4af6-b8f4-4fe4d989c395\" (UID: \"03e01a68-4da8-4af6-b8f4-4fe4d989c395\") "
Jul 21 01:19:44.150329 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:44.150132    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03e01a68-4da8-4af6-b8f4-4fe4d989c395-maas-api-tls\") pod \"03e01a68-4da8-4af6-b8f4-4fe4d989c395\" (UID: \"03e01a68-4da8-4af6-b8f4-4fe4d989c395\") "
Jul 21 01:19:44.150570 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:44.150538    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03e01a68-4da8-4af6-b8f4-4fe4d989c395-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "03e01a68-4da8-4af6-b8f4-4fe4d989c395" (UID: "03e01a68-4da8-4af6-b8f4-4fe4d989c395"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:19:44.152253 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:44.152224    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03e01a68-4da8-4af6-b8f4-4fe4d989c395-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "03e01a68-4da8-4af6-b8f4-4fe4d989c395" (UID: "03e01a68-4da8-4af6-b8f4-4fe4d989c395"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:19:44.152348 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:44.152248    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03e01a68-4da8-4af6-b8f4-4fe4d989c395-kube-api-access-gtgvr" (OuterVolumeSpecName: "kube-api-access-gtgvr") pod "03e01a68-4da8-4af6-b8f4-4fe4d989c395" (UID: "03e01a68-4da8-4af6-b8f4-4fe4d989c395"). InnerVolumeSpecName "kube-api-access-gtgvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:19:44.251630 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:44.251592    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtgvr\" (UniqueName: \"kubernetes.io/projected/03e01a68-4da8-4af6-b8f4-4fe4d989c395-kube-api-access-gtgvr\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:19:44.251630 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:44.251624    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03e01a68-4da8-4af6-b8f4-4fe4d989c395-openshift-service-ca\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:19:44.251630 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:44.251634    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03e01a68-4da8-4af6-b8f4-4fe4d989c395-maas-api-tls\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:19:44.691414 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:44.691380    2582 generic.go:356] "Generic (PLEG): container finished" podID="03e01a68-4da8-4af6-b8f4-4fe4d989c395" containerID="f8bedf7cce5c4321609f9f3a24154541718158ecf73fb9884d2cee2eb791ff60" exitCode=0
Jul 21 01:19:44.691859 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:44.691423    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2"
Jul 21 01:19:44.691859 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:44.691466    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2" event={"ID":"03e01a68-4da8-4af6-b8f4-4fe4d989c395","Type":"ContainerDied","Data":"f8bedf7cce5c4321609f9f3a24154541718158ecf73fb9884d2cee2eb791ff60"}
Jul 21 01:19:44.691859 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:44.691525    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2" event={"ID":"03e01a68-4da8-4af6-b8f4-4fe4d989c395","Type":"ContainerDied","Data":"ebcc72ae4f6ccadb2669f5899c005422eae99398acb06a31cffcfdc668214687"}
Jul 21 01:19:44.691859 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:44.691553    2582 scope.go:117] "RemoveContainer" containerID="f8bedf7cce5c4321609f9f3a24154541718158ecf73fb9884d2cee2eb791ff60"
Jul 21 01:19:44.704431 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:44.704404    2582 scope.go:117] "RemoveContainer" containerID="f8bedf7cce5c4321609f9f3a24154541718158ecf73fb9884d2cee2eb791ff60"
Jul 21 01:19:44.704737 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:19:44.704718    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8bedf7cce5c4321609f9f3a24154541718158ecf73fb9884d2cee2eb791ff60\": container with ID starting with f8bedf7cce5c4321609f9f3a24154541718158ecf73fb9884d2cee2eb791ff60 not found: ID does not exist" containerID="f8bedf7cce5c4321609f9f3a24154541718158ecf73fb9884d2cee2eb791ff60"
Jul 21 01:19:44.704800 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:44.704750    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8bedf7cce5c4321609f9f3a24154541718158ecf73fb9884d2cee2eb791ff60"} err="failed to get container status \"f8bedf7cce5c4321609f9f3a24154541718158ecf73fb9884d2cee2eb791ff60\": rpc error: code = NotFound desc = could not find container \"f8bedf7cce5c4321609f9f3a24154541718158ecf73fb9884d2cee2eb791ff60\": container with ID starting with f8bedf7cce5c4321609f9f3a24154541718158ecf73fb9884d2cee2eb791ff60 not found: ID does not exist"
Jul 21 01:19:44.708272 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:44.708247    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2"]
Jul 21 01:19:44.711450 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:44.711428    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2eeec3-6c88685b64-9hxt2"]
Jul 21 01:19:46.344206 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:46.344169    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03e01a68-4da8-4af6-b8f4-4fe4d989c395" path="/var/lib/kubelet/pods/03e01a68-4da8-4af6-b8f4-4fe4d989c395/volumes"
Jul 21 01:19:46.807583 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:46.807547    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh" podUID="73673ad7-964d-4db6-9e12-7ef9bd1e27e8" containerName="main" containerID="cri-o://f20c0a77a13f3fe21d6465caee3417c9f30b6f2ab3094b685410756bfb7358d4" gracePeriod=45
Jul 21 01:19:47.059604 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.059543    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"
Jul 21 01:19:47.179439 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.179402    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qm7nl\" (UniqueName: \"kubernetes.io/projected/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-kube-api-access-qm7nl\") pod \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\" (UID: \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\") "
Jul 21 01:19:47.179439 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.179450    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-home\") pod \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\" (UID: \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\") "
Jul 21 01:19:47.179721 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.179489    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-tls-certs\") pod \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\" (UID: \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\") "
Jul 21 01:19:47.179721 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.179534    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-dshm\") pod \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\" (UID: \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\") "
Jul 21 01:19:47.179721 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.179563    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-tmp-dir\") pod \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\" (UID: \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\") "
Jul 21 01:19:47.179721 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.179623    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-model-cache\") pod \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\" (UID: \"73673ad7-964d-4db6-9e12-7ef9bd1e27e8\") "
Jul 21 01:19:47.179938 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.179788    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-home" (OuterVolumeSpecName: "home") pod "73673ad7-964d-4db6-9e12-7ef9bd1e27e8" (UID: "73673ad7-964d-4db6-9e12-7ef9bd1e27e8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:19:47.180001 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.179934    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-model-cache" (OuterVolumeSpecName: "model-cache") pod "73673ad7-964d-4db6-9e12-7ef9bd1e27e8" (UID: "73673ad7-964d-4db6-9e12-7ef9bd1e27e8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:19:47.180001 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.179948    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "73673ad7-964d-4db6-9e12-7ef9bd1e27e8" (UID: "73673ad7-964d-4db6-9e12-7ef9bd1e27e8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:19:47.180114 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.180049    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-home\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:19:47.180114 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.180068    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-tmp-dir\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:19:47.180114 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.180081    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-model-cache\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:19:47.181893 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.181865    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-dshm" (OuterVolumeSpecName: "dshm") pod "73673ad7-964d-4db6-9e12-7ef9bd1e27e8" (UID: "73673ad7-964d-4db6-9e12-7ef9bd1e27e8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:19:47.181893 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.181886    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "73673ad7-964d-4db6-9e12-7ef9bd1e27e8" (UID: "73673ad7-964d-4db6-9e12-7ef9bd1e27e8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:19:47.182065 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.181903    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-kube-api-access-qm7nl" (OuterVolumeSpecName: "kube-api-access-qm7nl") pod "73673ad7-964d-4db6-9e12-7ef9bd1e27e8" (UID: "73673ad7-964d-4db6-9e12-7ef9bd1e27e8"). InnerVolumeSpecName "kube-api-access-qm7nl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:19:47.280741 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.280704    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm7nl\" (UniqueName: \"kubernetes.io/projected/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-kube-api-access-qm7nl\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:19:47.280741 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.280733    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-tls-certs\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:19:47.280741 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.280742    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73673ad7-964d-4db6-9e12-7ef9bd1e27e8-dshm\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:19:47.710439 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.710401    2582 generic.go:356] "Generic (PLEG): container finished" podID="73673ad7-964d-4db6-9e12-7ef9bd1e27e8" containerID="f20c0a77a13f3fe21d6465caee3417c9f30b6f2ab3094b685410756bfb7358d4" exitCode=0
Jul 21 01:19:47.710968 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.710454    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh" event={"ID":"73673ad7-964d-4db6-9e12-7ef9bd1e27e8","Type":"ContainerDied","Data":"f20c0a77a13f3fe21d6465caee3417c9f30b6f2ab3094b685410756bfb7358d4"}
Jul 21 01:19:47.710968 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.710472    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"
Jul 21 01:19:47.710968 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.710486    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh" event={"ID":"73673ad7-964d-4db6-9e12-7ef9bd1e27e8","Type":"ContainerDied","Data":"177ec1d3946732694adcc1a4865240a84adea8564329073fc0fbf2d0cdeec4a9"}
Jul 21 01:19:47.710968 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.710503    2582 scope.go:117] "RemoveContainer" containerID="f20c0a77a13f3fe21d6465caee3417c9f30b6f2ab3094b685410756bfb7358d4"
Jul 21 01:19:47.719946 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.719923    2582 scope.go:117] "RemoveContainer" containerID="f20c0a77a13f3fe21d6465caee3417c9f30b6f2ab3094b685410756bfb7358d4"
Jul 21 01:19:47.720233 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:19:47.720213    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f20c0a77a13f3fe21d6465caee3417c9f30b6f2ab3094b685410756bfb7358d4\": container with ID starting with f20c0a77a13f3fe21d6465caee3417c9f30b6f2ab3094b685410756bfb7358d4 not found: ID does not exist" containerID="f20c0a77a13f3fe21d6465caee3417c9f30b6f2ab3094b685410756bfb7358d4"
Jul 21 01:19:47.720288 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.720245    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f20c0a77a13f3fe21d6465caee3417c9f30b6f2ab3094b685410756bfb7358d4"} err="failed to get container status \"f20c0a77a13f3fe21d6465caee3417c9f30b6f2ab3094b685410756bfb7358d4\": rpc error: code = NotFound desc = could not find container \"f20c0a77a13f3fe21d6465caee3417c9f30b6f2ab3094b685410756bfb7358d4\": container with ID starting with f20c0a77a13f3fe21d6465caee3417c9f30b6f2ab3094b685410756bfb7358d4 not found: ID does not exist"
Jul 21 01:19:47.731129 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.731092    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"]
Jul 21 01:19:47.736786 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:47.736758    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-2eeec3/test-model-2eeec3-kserve-9fd8ff5d7-w89zh"]
Jul 21 01:19:48.345396 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:48.345363    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73673ad7-964d-4db6-9e12-7ef9bd1e27e8" path="/var/lib/kubelet/pods/73673ad7-964d-4db6-9e12-7ef9bd1e27e8/volumes"
Jul 21 01:19:48.415252 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:19:48.415218    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:20:05.206136 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:05.206096    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx"]
Jul 21 01:20:05.206624 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:05.206326    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx" podUID="d5c20dd0-77a7-49d8-843e-34f58fd3ac55" containerName="maas-api" containerID="cri-o://c0d9e9e44b6815c97e9337f09dbcf411200a2b346cd06c4ae2b1dc49d283f4f7" gracePeriod=30
Jul 21 01:20:05.460423 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:05.460363    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx"
Jul 21 01:20:05.533486 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:05.533447    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5c20dd0-77a7-49d8-843e-34f58fd3ac55-maas-api-tls\") pod \"d5c20dd0-77a7-49d8-843e-34f58fd3ac55\" (UID: \"d5c20dd0-77a7-49d8-843e-34f58fd3ac55\") "
Jul 21 01:20:05.533486 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:05.533485    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5c20dd0-77a7-49d8-843e-34f58fd3ac55-openshift-service-ca\") pod \"d5c20dd0-77a7-49d8-843e-34f58fd3ac55\" (UID: \"d5c20dd0-77a7-49d8-843e-34f58fd3ac55\") "
Jul 21 01:20:05.533805 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:05.533510    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzd5l\" (UniqueName: \"kubernetes.io/projected/d5c20dd0-77a7-49d8-843e-34f58fd3ac55-kube-api-access-jzd5l\") pod \"d5c20dd0-77a7-49d8-843e-34f58fd3ac55\" (UID: \"d5c20dd0-77a7-49d8-843e-34f58fd3ac55\") "
Jul 21 01:20:05.533927 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:05.533902    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5c20dd0-77a7-49d8-843e-34f58fd3ac55-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d5c20dd0-77a7-49d8-843e-34f58fd3ac55" (UID: "d5c20dd0-77a7-49d8-843e-34f58fd3ac55"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:20:05.535663 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:05.535634    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5c20dd0-77a7-49d8-843e-34f58fd3ac55-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d5c20dd0-77a7-49d8-843e-34f58fd3ac55" (UID: "d5c20dd0-77a7-49d8-843e-34f58fd3ac55"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:20:05.535754 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:05.535736    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5c20dd0-77a7-49d8-843e-34f58fd3ac55-kube-api-access-jzd5l" (OuterVolumeSpecName: "kube-api-access-jzd5l") pod "d5c20dd0-77a7-49d8-843e-34f58fd3ac55" (UID: "d5c20dd0-77a7-49d8-843e-34f58fd3ac55"). InnerVolumeSpecName "kube-api-access-jzd5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:20:05.634405 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:05.634352    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5c20dd0-77a7-49d8-843e-34f58fd3ac55-maas-api-tls\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:20:05.634405 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:05.634398    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5c20dd0-77a7-49d8-843e-34f58fd3ac55-openshift-service-ca\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:20:05.634405 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:05.634409    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzd5l\" (UniqueName: \"kubernetes.io/projected/d5c20dd0-77a7-49d8-843e-34f58fd3ac55-kube-api-access-jzd5l\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:20:05.816444 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:05.816353    2582 generic.go:356] "Generic (PLEG): container finished" podID="d5c20dd0-77a7-49d8-843e-34f58fd3ac55" containerID="c0d9e9e44b6815c97e9337f09dbcf411200a2b346cd06c4ae2b1dc49d283f4f7" exitCode=0
Jul 21 01:20:05.816444 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:05.816403    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx"
Jul 21 01:20:05.816444 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:05.816423    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx" event={"ID":"d5c20dd0-77a7-49d8-843e-34f58fd3ac55","Type":"ContainerDied","Data":"c0d9e9e44b6815c97e9337f09dbcf411200a2b346cd06c4ae2b1dc49d283f4f7"}
Jul 21 01:20:05.816754 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:05.816478    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx" event={"ID":"d5c20dd0-77a7-49d8-843e-34f58fd3ac55","Type":"ContainerDied","Data":"f4f389eafd0965e5fb366ad998f7ac4745583733739a38fcf0dee28c0f0b57ba"}
Jul 21 01:20:05.816754 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:05.816506    2582 scope.go:117] "RemoveContainer" containerID="c0d9e9e44b6815c97e9337f09dbcf411200a2b346cd06c4ae2b1dc49d283f4f7"
Jul 21 01:20:05.826429 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:05.826411    2582 scope.go:117] "RemoveContainer" containerID="c0d9e9e44b6815c97e9337f09dbcf411200a2b346cd06c4ae2b1dc49d283f4f7"
Jul 21 01:20:05.826716 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:20:05.826695    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0d9e9e44b6815c97e9337f09dbcf411200a2b346cd06c4ae2b1dc49d283f4f7\": container with ID starting with c0d9e9e44b6815c97e9337f09dbcf411200a2b346cd06c4ae2b1dc49d283f4f7 not found: ID does not exist" containerID="c0d9e9e44b6815c97e9337f09dbcf411200a2b346cd06c4ae2b1dc49d283f4f7"
Jul 21 01:20:05.826771 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:05.826726    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0d9e9e44b6815c97e9337f09dbcf411200a2b346cd06c4ae2b1dc49d283f4f7"} err="failed to get container status \"c0d9e9e44b6815c97e9337f09dbcf411200a2b346cd06c4ae2b1dc49d283f4f7\": rpc error: code = NotFound desc = could not find container \"c0d9e9e44b6815c97e9337f09dbcf411200a2b346cd06c4ae2b1dc49d283f4f7\": container with ID starting with c0d9e9e44b6815c97e9337f09dbcf411200a2b346cd06c4ae2b1dc49d283f4f7 not found: ID does not exist"
Jul 21 01:20:05.837459 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:05.837432    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx"]
Jul 21 01:20:05.841111 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:05.841088    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6bfe4a-5fcd6dbf68-567wx"]
Jul 21 01:20:06.349950 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:06.349912    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5c20dd0-77a7-49d8-843e-34f58fd3ac55" path="/var/lib/kubelet/pods/d5c20dd0-77a7-49d8-843e-34f58fd3ac55/volumes"
Jul 21 01:20:07.903585 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:07.903548    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:20:20.390852 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.390819    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2"]
Jul 21 01:20:20.391274 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.391181    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5c20dd0-77a7-49d8-843e-34f58fd3ac55" containerName="maas-api"
Jul 21 01:20:20.391274 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.391192    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5c20dd0-77a7-49d8-843e-34f58fd3ac55" containerName="maas-api"
Jul 21 01:20:20.391274 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.391215    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73673ad7-964d-4db6-9e12-7ef9bd1e27e8" containerName="main"
Jul 21 01:20:20.391274 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.391220    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="73673ad7-964d-4db6-9e12-7ef9bd1e27e8" containerName="main"
Jul 21 01:20:20.391274 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.391231    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03e01a68-4da8-4af6-b8f4-4fe4d989c395" containerName="maas-api"
Jul 21 01:20:20.391274 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.391237    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="03e01a68-4da8-4af6-b8f4-4fe4d989c395" containerName="maas-api"
Jul 21 01:20:20.391464 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.391291    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="73673ad7-964d-4db6-9e12-7ef9bd1e27e8" containerName="main"
Jul 21 01:20:20.391464 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.391298    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="03e01a68-4da8-4af6-b8f4-4fe4d989c395" containerName="maas-api"
Jul 21 01:20:20.391464 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.391306    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5c20dd0-77a7-49d8-843e-34f58fd3ac55" containerName="maas-api"
Jul 21 01:20:20.394290 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.394274    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2"
Jul 21 01:20:20.396886 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.396866    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8b65c\""
Jul 21 01:20:20.397366 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.397347    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-1ec8c6-serving-cert\""
Jul 21 01:20:20.397465 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.397375    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 01:20:20.398820 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.398802    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 01:20:20.416139 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.416107    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2"]
Jul 21 01:20:20.478829 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.478792    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1-openshift-service-ca\") pod \"maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2\" (UID: \"8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2"
Jul 21 01:20:20.479006 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.478853    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6jhv\" (UniqueName: \"kubernetes.io/projected/8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1-kube-api-access-m6jhv\") pod \"maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2\" (UID: \"8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2"
Jul 21 01:20:20.479006 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.478912    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1-maas-api-tls\") pod \"maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2\" (UID: \"8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2"
Jul 21 01:20:20.579532 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.579493    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6jhv\" (UniqueName: \"kubernetes.io/projected/8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1-kube-api-access-m6jhv\") pod \"maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2\" (UID: \"8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2"
Jul 21 01:20:20.579765 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.579576    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1-maas-api-tls\") pod \"maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2\" (UID: \"8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2"
Jul 21 01:20:20.579765 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.579604    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1-openshift-service-ca\") pod \"maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2\" (UID: \"8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2"
Jul 21 01:20:20.580289 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.580269    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1-openshift-service-ca\") pod \"maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2\" (UID: \"8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2"
Jul 21 01:20:20.582036 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.582016    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1-maas-api-tls\") pod \"maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2\" (UID: \"8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2"
Jul 21 01:20:20.588249 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.588226    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6jhv\" (UniqueName: \"kubernetes.io/projected/8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1-kube-api-access-m6jhv\") pod \"maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2\" (UID: \"8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2"
Jul 21 01:20:20.704479 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.704428    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2"
Jul 21 01:20:20.843607 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.843581    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2"]
Jul 21 01:20:20.845888 ip-10-0-133-75 kubenswrapper[2582]: W0721 01:20:20.845859    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed95f5a_61a9_4fe9_bd85_e7a19393b7c1.slice/crio-32fa2810ae0994ea98484681d3a4786e3b3a84c38991e019939adf9f4e1a961c WatchSource:0}: Error finding container 32fa2810ae0994ea98484681d3a4786e3b3a84c38991e019939adf9f4e1a961c: Status 404 returned error can't find the container with id 32fa2810ae0994ea98484681d3a4786e3b3a84c38991e019939adf9f4e1a961c
Jul 21 01:20:20.847540 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.847520    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 01:20:20.903764 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:20.903708    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2" event={"ID":"8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1","Type":"ContainerStarted","Data":"32fa2810ae0994ea98484681d3a4786e3b3a84c38991e019939adf9f4e1a961c"}
Jul 21 01:20:21.910850 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:21.910815    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2" event={"ID":"8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1","Type":"ContainerStarted","Data":"a10d614f44ddf521d05347f21e1f1c82c4ff845250eccde63f28d3ff7be72710"}
Jul 21 01:20:21.911251 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:21.910927    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2"
Jul 21 01:20:21.927370 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:21.927315    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2" podStartSLOduration=1.512415269 podStartE2EDuration="1.927298051s" totalImagesPullingTime="414.882782ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:20:21.925620587 +0000 UTC m=+2352.225317008" watchObservedRunningTime="2026-07-21 01:20:21.927298051 +0000 UTC m=+2352.226994474"
Jul 21 01:20:27.921426 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:27.921391    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2"
Jul 21 01:20:28.414217 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:28.414187    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd"]
Jul 21 01:20:28.423123 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:28.423099    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd"
Jul 21 01:20:28.426088 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:28.426063    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-92d4e9-serving-cert\""
Jul 21 01:20:28.437115 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:28.437092    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd"]
Jul 21 01:20:28.554564 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:28.554523    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:20:28.556234 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:28.556212    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f16c58ae-c8c2-49ac-a01d-67eff9d64db4-maas-api-tls\") pod \"maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd\" (UID: \"f16c58ae-c8c2-49ac-a01d-67eff9d64db4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd"
Jul 21 01:20:28.556302 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:28.556251    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkgj9\" (UniqueName: \"kubernetes.io/projected/f16c58ae-c8c2-49ac-a01d-67eff9d64db4-kube-api-access-pkgj9\") pod \"maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd\" (UID: \"f16c58ae-c8c2-49ac-a01d-67eff9d64db4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd"
Jul 21 01:20:28.556302 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:28.556292    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f16c58ae-c8c2-49ac-a01d-67eff9d64db4-openshift-service-ca\") pod \"maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd\" (UID: \"f16c58ae-c8c2-49ac-a01d-67eff9d64db4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd"
Jul 21 01:20:28.657517 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:28.657476    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f16c58ae-c8c2-49ac-a01d-67eff9d64db4-maas-api-tls\") pod \"maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd\" (UID: \"f16c58ae-c8c2-49ac-a01d-67eff9d64db4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd"
Jul 21 01:20:28.657744 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:28.657527    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkgj9\" (UniqueName: \"kubernetes.io/projected/f16c58ae-c8c2-49ac-a01d-67eff9d64db4-kube-api-access-pkgj9\") pod \"maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd\" (UID: \"f16c58ae-c8c2-49ac-a01d-67eff9d64db4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd"
Jul 21 01:20:28.657744 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:28.657568    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f16c58ae-c8c2-49ac-a01d-67eff9d64db4-openshift-service-ca\") pod \"maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd\" (UID: \"f16c58ae-c8c2-49ac-a01d-67eff9d64db4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd"
Jul 21 01:20:28.658338 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:28.658310    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f16c58ae-c8c2-49ac-a01d-67eff9d64db4-openshift-service-ca\") pod \"maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd\" (UID: \"f16c58ae-c8c2-49ac-a01d-67eff9d64db4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd"
Jul 21 01:20:28.660117 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:28.660095    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f16c58ae-c8c2-49ac-a01d-67eff9d64db4-maas-api-tls\") pod \"maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd\" (UID: \"f16c58ae-c8c2-49ac-a01d-67eff9d64db4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd"
Jul 21 01:20:28.676004 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:28.675935    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkgj9\" (UniqueName: \"kubernetes.io/projected/f16c58ae-c8c2-49ac-a01d-67eff9d64db4-kube-api-access-pkgj9\") pod \"maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd\" (UID: \"f16c58ae-c8c2-49ac-a01d-67eff9d64db4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd"
Jul 21 01:20:28.737508 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:28.737472    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd"
Jul 21 01:20:28.873904 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:28.873875    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd"]
Jul 21 01:20:28.875996 ip-10-0-133-75 kubenswrapper[2582]: W0721 01:20:28.875967    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf16c58ae_c8c2_49ac_a01d_67eff9d64db4.slice/crio-82f1a5f1ff2a61841c5246bd45c06e7d7821563c44997aff6c618406f9c98b03 WatchSource:0}: Error finding container 82f1a5f1ff2a61841c5246bd45c06e7d7821563c44997aff6c618406f9c98b03: Status 404 returned error can't find the container with id 82f1a5f1ff2a61841c5246bd45c06e7d7821563c44997aff6c618406f9c98b03
Jul 21 01:20:28.952244 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:28.952199    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd" event={"ID":"f16c58ae-c8c2-49ac-a01d-67eff9d64db4","Type":"ContainerStarted","Data":"82f1a5f1ff2a61841c5246bd45c06e7d7821563c44997aff6c618406f9c98b03"}
Jul 21 01:20:29.959474 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:29.959436    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd" event={"ID":"f16c58ae-c8c2-49ac-a01d-67eff9d64db4","Type":"ContainerStarted","Data":"72ba3bc0a9b830f5bc8904e501ab1b1b733307d8af8de271e760329c14d9121d"}
Jul 21 01:20:29.959965 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:29.959530    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd"
Jul 21 01:20:29.977573 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:29.977514    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd" podStartSLOduration=1.656560349 podStartE2EDuration="1.977497789s" totalImagesPullingTime="320.93744ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:20:29.975809503 +0000 UTC m=+2360.275505926" watchObservedRunningTime="2026-07-21 01:20:29.977497789 +0000 UTC m=+2360.277194210"
Jul 21 01:20:35.971941 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:35.971908    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd"
Jul 21 01:20:43.503109 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:43.503070    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:20:56.627588 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:56.627554    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2"]
Jul 21 01:20:56.628075 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:56.627773    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2" podUID="8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1" containerName="maas-api" containerID="cri-o://a10d614f44ddf521d05347f21e1f1c82c4ff845250eccde63f28d3ff7be72710" gracePeriod=30
Jul 21 01:20:56.868637 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:56.868613    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2"
Jul 21 01:20:57.015311 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:57.015275    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1-openshift-service-ca\") pod \"8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1\" (UID: \"8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1\") "
Jul 21 01:20:57.015519 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:57.015327    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1-maas-api-tls\") pod \"8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1\" (UID: \"8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1\") "
Jul 21 01:20:57.015519 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:57.015401    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6jhv\" (UniqueName: \"kubernetes.io/projected/8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1-kube-api-access-m6jhv\") pod \"8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1\" (UID: \"8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1\") "
Jul 21 01:20:57.015765 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:57.015742    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1" (UID: "8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:20:57.017535 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:57.017508    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1" (UID: "8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:20:57.017629 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:57.017551    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1-kube-api-access-m6jhv" (OuterVolumeSpecName: "kube-api-access-m6jhv") pod "8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1" (UID: "8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1"). InnerVolumeSpecName "kube-api-access-m6jhv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:20:57.108672 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:57.108612    2582 generic.go:356] "Generic (PLEG): container finished" podID="8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1" containerID="a10d614f44ddf521d05347f21e1f1c82c4ff845250eccde63f28d3ff7be72710" exitCode=0
Jul 21 01:20:57.108672 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:57.108677    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2"
Jul 21 01:20:57.108872 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:57.108692    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2" event={"ID":"8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1","Type":"ContainerDied","Data":"a10d614f44ddf521d05347f21e1f1c82c4ff845250eccde63f28d3ff7be72710"}
Jul 21 01:20:57.108872 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:57.108747    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2" event={"ID":"8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1","Type":"ContainerDied","Data":"32fa2810ae0994ea98484681d3a4786e3b3a84c38991e019939adf9f4e1a961c"}
Jul 21 01:20:57.108872 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:57.108770    2582 scope.go:117] "RemoveContainer" containerID="a10d614f44ddf521d05347f21e1f1c82c4ff845250eccde63f28d3ff7be72710"
Jul 21 01:20:57.118267 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:57.118246    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6jhv\" (UniqueName: \"kubernetes.io/projected/8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1-kube-api-access-m6jhv\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:20:57.118368 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:57.118272    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1-openshift-service-ca\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:20:57.118368 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:57.118285    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1-maas-api-tls\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:20:57.120617 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:57.120569    2582 scope.go:117] "RemoveContainer" containerID="a10d614f44ddf521d05347f21e1f1c82c4ff845250eccde63f28d3ff7be72710"
Jul 21 01:20:57.120959 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:20:57.120939    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a10d614f44ddf521d05347f21e1f1c82c4ff845250eccde63f28d3ff7be72710\": container with ID starting with a10d614f44ddf521d05347f21e1f1c82c4ff845250eccde63f28d3ff7be72710 not found: ID does not exist" containerID="a10d614f44ddf521d05347f21e1f1c82c4ff845250eccde63f28d3ff7be72710"
Jul 21 01:20:57.121025 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:57.120998    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a10d614f44ddf521d05347f21e1f1c82c4ff845250eccde63f28d3ff7be72710"} err="failed to get container status \"a10d614f44ddf521d05347f21e1f1c82c4ff845250eccde63f28d3ff7be72710\": rpc error: code = NotFound desc = could not find container \"a10d614f44ddf521d05347f21e1f1c82c4ff845250eccde63f28d3ff7be72710\": container with ID starting with a10d614f44ddf521d05347f21e1f1c82c4ff845250eccde63f28d3ff7be72710 not found: ID does not exist"
Jul 21 01:20:57.130507 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:57.130479    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2"]
Jul 21 01:20:57.134801 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:57.134766    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1ec8c6-8559cc7d9b-qflj2"]
Jul 21 01:20:58.345095 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:20:58.345064    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1" path="/var/lib/kubelet/pods/8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1/volumes"
Jul 21 01:21:00.395780 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:00.395749    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:21:23.175495 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:23.175461    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd"]
Jul 21 01:21:23.176110 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:23.175692    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd" podUID="f16c58ae-c8c2-49ac-a01d-67eff9d64db4" containerName="maas-api" containerID="cri-o://72ba3bc0a9b830f5bc8904e501ab1b1b733307d8af8de271e760329c14d9121d" gracePeriod=30
Jul 21 01:21:23.420568 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:23.420542    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd"
Jul 21 01:21:23.451630 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:23.451597    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkgj9\" (UniqueName: \"kubernetes.io/projected/f16c58ae-c8c2-49ac-a01d-67eff9d64db4-kube-api-access-pkgj9\") pod \"f16c58ae-c8c2-49ac-a01d-67eff9d64db4\" (UID: \"f16c58ae-c8c2-49ac-a01d-67eff9d64db4\") "
Jul 21 01:21:23.451824 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:23.451637    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f16c58ae-c8c2-49ac-a01d-67eff9d64db4-maas-api-tls\") pod \"f16c58ae-c8c2-49ac-a01d-67eff9d64db4\" (UID: \"f16c58ae-c8c2-49ac-a01d-67eff9d64db4\") "
Jul 21 01:21:23.451824 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:23.451757    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f16c58ae-c8c2-49ac-a01d-67eff9d64db4-openshift-service-ca\") pod \"f16c58ae-c8c2-49ac-a01d-67eff9d64db4\" (UID: \"f16c58ae-c8c2-49ac-a01d-67eff9d64db4\") "
Jul 21 01:21:23.452192 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:23.452164    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f16c58ae-c8c2-49ac-a01d-67eff9d64db4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f16c58ae-c8c2-49ac-a01d-67eff9d64db4" (UID: "f16c58ae-c8c2-49ac-a01d-67eff9d64db4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:21:23.453762 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:23.453735    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f16c58ae-c8c2-49ac-a01d-67eff9d64db4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f16c58ae-c8c2-49ac-a01d-67eff9d64db4" (UID: "f16c58ae-c8c2-49ac-a01d-67eff9d64db4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:21:23.453871 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:23.453818    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f16c58ae-c8c2-49ac-a01d-67eff9d64db4-kube-api-access-pkgj9" (OuterVolumeSpecName: "kube-api-access-pkgj9") pod "f16c58ae-c8c2-49ac-a01d-67eff9d64db4" (UID: "f16c58ae-c8c2-49ac-a01d-67eff9d64db4"). InnerVolumeSpecName "kube-api-access-pkgj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:21:23.552811 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:23.552776    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f16c58ae-c8c2-49ac-a01d-67eff9d64db4-openshift-service-ca\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:21:23.552811 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:23.552806    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkgj9\" (UniqueName: \"kubernetes.io/projected/f16c58ae-c8c2-49ac-a01d-67eff9d64db4-kube-api-access-pkgj9\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:21:23.552811 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:23.552815    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f16c58ae-c8c2-49ac-a01d-67eff9d64db4-maas-api-tls\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:21:24.255756 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:24.255719    2582 generic.go:356] "Generic (PLEG): container finished" podID="f16c58ae-c8c2-49ac-a01d-67eff9d64db4" containerID="72ba3bc0a9b830f5bc8904e501ab1b1b733307d8af8de271e760329c14d9121d" exitCode=0
Jul 21 01:21:24.256263 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:24.255779    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd"
Jul 21 01:21:24.256263 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:24.255809    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd" event={"ID":"f16c58ae-c8c2-49ac-a01d-67eff9d64db4","Type":"ContainerDied","Data":"72ba3bc0a9b830f5bc8904e501ab1b1b733307d8af8de271e760329c14d9121d"}
Jul 21 01:21:24.256263 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:24.255903    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd" event={"ID":"f16c58ae-c8c2-49ac-a01d-67eff9d64db4","Type":"ContainerDied","Data":"82f1a5f1ff2a61841c5246bd45c06e7d7821563c44997aff6c618406f9c98b03"}
Jul 21 01:21:24.256263 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:24.255936    2582 scope.go:117] "RemoveContainer" containerID="72ba3bc0a9b830f5bc8904e501ab1b1b733307d8af8de271e760329c14d9121d"
Jul 21 01:21:24.265492 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:24.265474    2582 scope.go:117] "RemoveContainer" containerID="72ba3bc0a9b830f5bc8904e501ab1b1b733307d8af8de271e760329c14d9121d"
Jul 21 01:21:24.265790 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:21:24.265772    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72ba3bc0a9b830f5bc8904e501ab1b1b733307d8af8de271e760329c14d9121d\": container with ID starting with 72ba3bc0a9b830f5bc8904e501ab1b1b733307d8af8de271e760329c14d9121d not found: ID does not exist" containerID="72ba3bc0a9b830f5bc8904e501ab1b1b733307d8af8de271e760329c14d9121d"
Jul 21 01:21:24.265853 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:24.265796    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72ba3bc0a9b830f5bc8904e501ab1b1b733307d8af8de271e760329c14d9121d"} err="failed to get container status \"72ba3bc0a9b830f5bc8904e501ab1b1b733307d8af8de271e760329c14d9121d\": rpc error: code = NotFound desc = could not find container \"72ba3bc0a9b830f5bc8904e501ab1b1b733307d8af8de271e760329c14d9121d\": container with ID starting with 72ba3bc0a9b830f5bc8904e501ab1b1b733307d8af8de271e760329c14d9121d not found: ID does not exist"
Jul 21 01:21:24.277037 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:24.277008    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd"]
Jul 21 01:21:24.279080 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:24.279059    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-92d4e9-7b6559b85d-fh4rd"]
Jul 21 01:21:24.345302 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:24.345272    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f16c58ae-c8c2-49ac-a01d-67eff9d64db4" path="/var/lib/kubelet/pods/f16c58ae-c8c2-49ac-a01d-67eff9d64db4/volumes"
Jul 21 01:21:28.007247 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:28.007208    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:21:37.768250 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:37.768175    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m"]
Jul 21 01:21:37.768591 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:37.768522    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1" containerName="maas-api"
Jul 21 01:21:37.768591 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:37.768532    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1" containerName="maas-api"
Jul 21 01:21:37.768591 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:37.768547    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f16c58ae-c8c2-49ac-a01d-67eff9d64db4" containerName="maas-api"
Jul 21 01:21:37.768591 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:37.768552    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f16c58ae-c8c2-49ac-a01d-67eff9d64db4" containerName="maas-api"
Jul 21 01:21:37.768773 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:37.768617    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f16c58ae-c8c2-49ac-a01d-67eff9d64db4" containerName="maas-api"
Jul 21 01:21:37.768773 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:37.768626    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ed95f5a-61a9-4fe9-bd85-e7a19393b7c1" containerName="maas-api"
Jul 21 01:21:37.772818 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:37.772802    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m"
Jul 21 01:21:37.774929 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:37.774905    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8b65c\""
Jul 21 01:21:37.775068 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:37.774905    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 01:21:37.775326 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:37.775309    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-a7997d-serving-cert\""
Jul 21 01:21:37.775415 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:37.775355    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 01:21:37.781241 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:37.781217    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m"]
Jul 21 01:21:37.878747 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:37.878700    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74ccf282-ee16-43d0-b6ee-6059bc592f28-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m\" (UID: \"74ccf282-ee16-43d0-b6ee-6059bc592f28\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m"
Jul 21 01:21:37.878974 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:37.878777    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74ccf282-ee16-43d0-b6ee-6059bc592f28-maas-api-tls\") pod \"maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m\" (UID: \"74ccf282-ee16-43d0-b6ee-6059bc592f28\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m"
Jul 21 01:21:37.878974 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:37.878842    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7jk4\" (UniqueName: \"kubernetes.io/projected/74ccf282-ee16-43d0-b6ee-6059bc592f28-kube-api-access-d7jk4\") pod \"maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m\" (UID: \"74ccf282-ee16-43d0-b6ee-6059bc592f28\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m"
Jul 21 01:21:37.979940 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:37.979889    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74ccf282-ee16-43d0-b6ee-6059bc592f28-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m\" (UID: \"74ccf282-ee16-43d0-b6ee-6059bc592f28\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m"
Jul 21 01:21:37.980141 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:37.979970    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74ccf282-ee16-43d0-b6ee-6059bc592f28-maas-api-tls\") pod \"maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m\" (UID: \"74ccf282-ee16-43d0-b6ee-6059bc592f28\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m"
Jul 21 01:21:37.980141 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:37.979991    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7jk4\" (UniqueName: \"kubernetes.io/projected/74ccf282-ee16-43d0-b6ee-6059bc592f28-kube-api-access-d7jk4\") pod \"maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m\" (UID: \"74ccf282-ee16-43d0-b6ee-6059bc592f28\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m"
Jul 21 01:21:37.980141 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:21:37.980116    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-serving-cert: secret "maas-api-e2e-shared-a-a7997d-serving-cert" not found
Jul 21 01:21:37.980256 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:21:37.980190    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74ccf282-ee16-43d0-b6ee-6059bc592f28-maas-api-tls podName:74ccf282-ee16-43d0-b6ee-6059bc592f28 nodeName:}" failed. No retries permitted until 2026-07-21 01:21:38.480172664 +0000 UTC m=+2428.779869067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/74ccf282-ee16-43d0-b6ee-6059bc592f28-maas-api-tls") pod "maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m" (UID: "74ccf282-ee16-43d0-b6ee-6059bc592f28") : secret "maas-api-e2e-shared-a-a7997d-serving-cert" not found
Jul 21 01:21:37.980542 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:37.980505    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74ccf282-ee16-43d0-b6ee-6059bc592f28-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m\" (UID: \"74ccf282-ee16-43d0-b6ee-6059bc592f28\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m"
Jul 21 01:21:38.004041 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:38.003999    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7jk4\" (UniqueName: \"kubernetes.io/projected/74ccf282-ee16-43d0-b6ee-6059bc592f28-kube-api-access-d7jk4\") pod \"maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m\" (UID: \"74ccf282-ee16-43d0-b6ee-6059bc592f28\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m"
Jul 21 01:21:38.485290 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:38.485251    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74ccf282-ee16-43d0-b6ee-6059bc592f28-maas-api-tls\") pod \"maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m\" (UID: \"74ccf282-ee16-43d0-b6ee-6059bc592f28\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m"
Jul 21 01:21:38.487678 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:38.487642    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74ccf282-ee16-43d0-b6ee-6059bc592f28-maas-api-tls\") pod \"maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m\" (UID: \"74ccf282-ee16-43d0-b6ee-6059bc592f28\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m"
Jul 21 01:21:38.684832 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:38.684787    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m"
Jul 21 01:21:38.821018 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:38.820993    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m"]
Jul 21 01:21:38.823443 ip-10-0-133-75 kubenswrapper[2582]: W0721 01:21:38.823415    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74ccf282_ee16_43d0_b6ee_6059bc592f28.slice/crio-8c3323d91b5d42a1135ea6f607248410d7403198d84c36f68b12a3ad7ac28dc6 WatchSource:0}: Error finding container 8c3323d91b5d42a1135ea6f607248410d7403198d84c36f68b12a3ad7ac28dc6: Status 404 returned error can't find the container with id 8c3323d91b5d42a1135ea6f607248410d7403198d84c36f68b12a3ad7ac28dc6
Jul 21 01:21:39.341665 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:39.341611    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m" event={"ID":"74ccf282-ee16-43d0-b6ee-6059bc592f28","Type":"ContainerStarted","Data":"74786dc1e95af816d2b6485aaf1f6c02a4de35dcf432ca0dcedaf03fa4dd8e47"}
Jul 21 01:21:39.341836 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:39.341676    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m" event={"ID":"74ccf282-ee16-43d0-b6ee-6059bc592f28","Type":"ContainerStarted","Data":"8c3323d91b5d42a1135ea6f607248410d7403198d84c36f68b12a3ad7ac28dc6"}
Jul 21 01:21:39.341836 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:39.341697    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m"
Jul 21 01:21:39.357904 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:39.357840    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m" podStartSLOduration=1.956871705 podStartE2EDuration="2.357819409s" totalImagesPullingTime="400.947704ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:21:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:21:39.357239019 +0000 UTC m=+2429.656935430" watchObservedRunningTime="2026-07-21 01:21:39.357819409 +0000 UTC m=+2429.657515891"
Jul 21 01:21:45.353602 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:45.353571    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m"
Jul 21 01:21:45.836225 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:45.836193    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr"]
Jul 21 01:21:45.839588 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:45.839566    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr"
Jul 21 01:21:45.844036 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:45.844016    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-03c5cb-serving-cert\""
Jul 21 01:21:45.861541 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:45.861513    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr"]
Jul 21 01:21:45.873367 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:45.873321    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:21:45.960363 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:45.960322    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22eb6228-e341-47a4-8417-4907c1397033-openshift-service-ca\") pod \"maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr\" (UID: \"22eb6228-e341-47a4-8417-4907c1397033\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr"
Jul 21 01:21:45.960363 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:45.960363    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55chp\" (UniqueName: \"kubernetes.io/projected/22eb6228-e341-47a4-8417-4907c1397033-kube-api-access-55chp\") pod \"maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr\" (UID: \"22eb6228-e341-47a4-8417-4907c1397033\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr"
Jul 21 01:21:45.960633 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:45.960407    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22eb6228-e341-47a4-8417-4907c1397033-maas-api-tls\") pod \"maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr\" (UID: \"22eb6228-e341-47a4-8417-4907c1397033\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr"
Jul 21 01:21:46.061203 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:46.061159    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22eb6228-e341-47a4-8417-4907c1397033-maas-api-tls\") pod \"maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr\" (UID: \"22eb6228-e341-47a4-8417-4907c1397033\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr"
Jul 21 01:21:46.061390 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:46.061257    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22eb6228-e341-47a4-8417-4907c1397033-openshift-service-ca\") pod \"maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr\" (UID: \"22eb6228-e341-47a4-8417-4907c1397033\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr"
Jul 21 01:21:46.061390 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:46.061275    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55chp\" (UniqueName: \"kubernetes.io/projected/22eb6228-e341-47a4-8417-4907c1397033-kube-api-access-55chp\") pod \"maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr\" (UID: \"22eb6228-e341-47a4-8417-4907c1397033\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr"
Jul 21 01:21:46.061390 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:21:46.061326    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-serving-cert: secret "maas-api-e2e-shared-b-03c5cb-serving-cert" not found
Jul 21 01:21:46.061512 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:21:46.061395    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22eb6228-e341-47a4-8417-4907c1397033-maas-api-tls podName:22eb6228-e341-47a4-8417-4907c1397033 nodeName:}" failed. No retries permitted until 2026-07-21 01:21:46.561376235 +0000 UTC m=+2436.861072635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/22eb6228-e341-47a4-8417-4907c1397033-maas-api-tls") pod "maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr" (UID: "22eb6228-e341-47a4-8417-4907c1397033") : secret "maas-api-e2e-shared-b-03c5cb-serving-cert" not found
Jul 21 01:21:46.061956 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:46.061936    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22eb6228-e341-47a4-8417-4907c1397033-openshift-service-ca\") pod \"maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr\" (UID: \"22eb6228-e341-47a4-8417-4907c1397033\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr"
Jul 21 01:21:46.069337 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:46.069311    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55chp\" (UniqueName: \"kubernetes.io/projected/22eb6228-e341-47a4-8417-4907c1397033-kube-api-access-55chp\") pod \"maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr\" (UID: \"22eb6228-e341-47a4-8417-4907c1397033\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr"
Jul 21 01:21:46.566353 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:46.566317    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22eb6228-e341-47a4-8417-4907c1397033-maas-api-tls\") pod \"maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr\" (UID: \"22eb6228-e341-47a4-8417-4907c1397033\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr"
Jul 21 01:21:46.568747 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:46.568725    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22eb6228-e341-47a4-8417-4907c1397033-maas-api-tls\") pod \"maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr\" (UID: \"22eb6228-e341-47a4-8417-4907c1397033\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr"
Jul 21 01:21:46.749414 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:46.749378    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr"
Jul 21 01:21:46.889160 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:46.889133    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr"]
Jul 21 01:21:46.891241 ip-10-0-133-75 kubenswrapper[2582]: W0721 01:21:46.891210    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22eb6228_e341_47a4_8417_4907c1397033.slice/crio-413f61f61eb58d7756aacbd86faf81b985733ba426fc29b3768d0fe051976268 WatchSource:0}: Error finding container 413f61f61eb58d7756aacbd86faf81b985733ba426fc29b3768d0fe051976268: Status 404 returned error can't find the container with id 413f61f61eb58d7756aacbd86faf81b985733ba426fc29b3768d0fe051976268
Jul 21 01:21:47.388249 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:47.388210    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr" event={"ID":"22eb6228-e341-47a4-8417-4907c1397033","Type":"ContainerStarted","Data":"413f61f61eb58d7756aacbd86faf81b985733ba426fc29b3768d0fe051976268"}
Jul 21 01:21:48.394809 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:48.394762    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr" event={"ID":"22eb6228-e341-47a4-8417-4907c1397033","Type":"ContainerStarted","Data":"9695fea0b805e0e10127687ccd7fd3b3e3f56f642ed8d1a9748891fbfc21dab8"}
Jul 21 01:21:48.395207 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:48.395028    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr"
Jul 21 01:21:48.412257 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:48.412201    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr" podStartSLOduration=2.9036599020000002 podStartE2EDuration="3.412184104s" totalImagesPullingTime="508.524202ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:21:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:21:48.410614788 +0000 UTC m=+2438.710311207" watchObservedRunningTime="2026-07-21 01:21:48.412184104 +0000 UTC m=+2438.711880525"
Jul 21 01:21:54.407957 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:54.407925    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr"
Jul 21 01:21:57.104811 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:21:57.104763    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:22:04.702509 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:04.702475    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"]
Jul 21 01:22:04.706449 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:04.706429    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"
Jul 21 01:22:04.709531 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:04.709511    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a7997d\"/\"default-dockercfg-xkvtv\""
Jul 21 01:22:04.709626 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:04.709551    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a7997d\"/\"auth-test-model-a7997d-kserve-self-signed-certs\""
Jul 21 01:22:04.710217 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:04.710197    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a7997d\"/\"openshift-service-ca.crt\""
Jul 21 01:22:04.710323 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:04.710234    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a7997d\"/\"kube-root-ca.crt\""
Jul 21 01:22:04.716338 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:04.716316    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"]
Jul 21 01:22:04.844191 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:04.844154    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-dshm\") pod \"auth-test-model-a7997d-kserve-78cbc54bdc-dqw94\" (UID: \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\") " pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"
Jul 21 01:22:04.844406 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:04.844215    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-tls-certs\") pod \"auth-test-model-a7997d-kserve-78cbc54bdc-dqw94\" (UID: \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\") " pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"
Jul 21 01:22:04.844406 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:04.844288    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgx2s\" (UniqueName: \"kubernetes.io/projected/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-kube-api-access-tgx2s\") pod \"auth-test-model-a7997d-kserve-78cbc54bdc-dqw94\" (UID: \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\") " pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"
Jul 21 01:22:04.844406 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:04.844337    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-model-cache\") pod \"auth-test-model-a7997d-kserve-78cbc54bdc-dqw94\" (UID: \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\") " pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"
Jul 21 01:22:04.844406 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:04.844356    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-tmp-dir\") pod \"auth-test-model-a7997d-kserve-78cbc54bdc-dqw94\" (UID: \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\") " pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"
Jul 21 01:22:04.844565 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:04.844418    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-home\") pod \"auth-test-model-a7997d-kserve-78cbc54bdc-dqw94\" (UID: \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\") " pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"
Jul 21 01:22:04.945667 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:04.945613    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-home\") pod \"auth-test-model-a7997d-kserve-78cbc54bdc-dqw94\" (UID: \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\") " pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"
Jul 21 01:22:04.945875 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:04.945742    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-dshm\") pod \"auth-test-model-a7997d-kserve-78cbc54bdc-dqw94\" (UID: \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\") " pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"
Jul 21 01:22:04.945875 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:04.945799    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-tls-certs\") pod \"auth-test-model-a7997d-kserve-78cbc54bdc-dqw94\" (UID: \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\") " pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"
Jul 21 01:22:04.945875 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:04.945835    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgx2s\" (UniqueName: \"kubernetes.io/projected/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-kube-api-access-tgx2s\") pod \"auth-test-model-a7997d-kserve-78cbc54bdc-dqw94\" (UID: \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\") " pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"
Jul 21 01:22:04.946037 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:04.945877    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-model-cache\") pod \"auth-test-model-a7997d-kserve-78cbc54bdc-dqw94\" (UID: \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\") " pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"
Jul 21 01:22:04.946037 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:04.945897    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-tmp-dir\") pod \"auth-test-model-a7997d-kserve-78cbc54bdc-dqw94\" (UID: \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\") " pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"
Jul 21 01:22:04.946037 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:04.946013    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-home\") pod \"auth-test-model-a7997d-kserve-78cbc54bdc-dqw94\" (UID: \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\") " pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"
Jul 21 01:22:04.946209 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:04.946192    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-model-cache\") pod \"auth-test-model-a7997d-kserve-78cbc54bdc-dqw94\" (UID: \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\") " pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"
Jul 21 01:22:04.946277 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:04.946234    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-tmp-dir\") pod \"auth-test-model-a7997d-kserve-78cbc54bdc-dqw94\" (UID: \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\") " pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"
Jul 21 01:22:04.948084 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:04.948061    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-dshm\") pod \"auth-test-model-a7997d-kserve-78cbc54bdc-dqw94\" (UID: \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\") " pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"
Jul 21 01:22:04.948257 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:04.948240    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-tls-certs\") pod \"auth-test-model-a7997d-kserve-78cbc54bdc-dqw94\" (UID: \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\") " pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"
Jul 21 01:22:04.953410 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:04.953348    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgx2s\" (UniqueName: \"kubernetes.io/projected/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-kube-api-access-tgx2s\") pod \"auth-test-model-a7997d-kserve-78cbc54bdc-dqw94\" (UID: \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\") " pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"
Jul 21 01:22:05.016474 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:05.016436    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"
Jul 21 01:22:05.153842 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:05.153685    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"]
Jul 21 01:22:05.156163 ip-10-0-133-75 kubenswrapper[2582]: W0721 01:22:05.156134    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4be3c9f4_b241_42a9_a29a_eeaad3c2b83c.slice/crio-16431665b935558064d95496369388dbc359d681817fca226783ac33cf1c70b6 WatchSource:0}: Error finding container 16431665b935558064d95496369388dbc359d681817fca226783ac33cf1c70b6: Status 404 returned error can't find the container with id 16431665b935558064d95496369388dbc359d681817fca226783ac33cf1c70b6
Jul 21 01:22:05.489533 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:05.489439    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94" event={"ID":"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c","Type":"ContainerStarted","Data":"9a073e75cbf54de59062c08fdce8e1c93f21238ff31b246be9cd4d8567c68cc7"}
Jul 21 01:22:05.489533 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:05.489479    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94" event={"ID":"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c","Type":"ContainerStarted","Data":"16431665b935558064d95496369388dbc359d681817fca226783ac33cf1c70b6"}
Jul 21 01:22:05.505860 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:05.505813    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94" podStartSLOduration=1.505795317 podStartE2EDuration="1.505795317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:05.504279255 +0000 UTC m=+2455.803975676" watchObservedRunningTime="2026-07-21 01:22:05.505795317 +0000 UTC m=+2455.805491737"
Jul 21 01:22:08.607701 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:08.607659    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:22:15.016833 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:15.016786    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"
Jul 21 01:22:15.017266 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:15.016901    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"
Jul 21 01:22:15.029791 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:15.029763    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"
Jul 21 01:22:15.560259 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:15.560231    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"
Jul 21 01:22:36.407666 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:22:36.407615    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:23:00.206140 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:23:00.206101    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:23:17.801448 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:23:17.801411    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:23:36.003534 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:23:36.003499    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:23:52.401316 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:23:52.401281    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:24:11.113858 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:11.113824    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:24:25.806079 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:25.806040    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:24:40.883279 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:40.883052    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"]
Jul 21 01:24:43.907640 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:43.907602    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:24:55.905247 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:55.905184    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94" podUID="4be3c9f4-b241-42a9-a29a-eeaad3c2b83c" containerName="main" containerID="cri-o://9a073e75cbf54de59062c08fdce8e1c93f21238ff31b246be9cd4d8567c68cc7" gracePeriod=45
Jul 21 01:24:56.166072 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.166005    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"
Jul 21 01:24:56.269127 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.269088    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgx2s\" (UniqueName: \"kubernetes.io/projected/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-kube-api-access-tgx2s\") pod \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\" (UID: \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\") "
Jul 21 01:24:56.269332 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.269184    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-dshm\") pod \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\" (UID: \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\") "
Jul 21 01:24:56.269332 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.269218    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-home\") pod \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\" (UID: \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\") "
Jul 21 01:24:56.269332 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.269264    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-tmp-dir\") pod \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\" (UID: \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\") "
Jul 21 01:24:56.269332 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.269301    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-tls-certs\") pod \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\" (UID: \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\") "
Jul 21 01:24:56.269332 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.269325    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-model-cache\") pod \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\" (UID: \"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c\") "
Jul 21 01:24:56.269608 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.269527    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-home" (OuterVolumeSpecName: "home") pod "4be3c9f4-b241-42a9-a29a-eeaad3c2b83c" (UID: "4be3c9f4-b241-42a9-a29a-eeaad3c2b83c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:24:56.269608 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.269547    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4be3c9f4-b241-42a9-a29a-eeaad3c2b83c" (UID: "4be3c9f4-b241-42a9-a29a-eeaad3c2b83c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:24:56.269757 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.269638    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-model-cache" (OuterVolumeSpecName: "model-cache") pod "4be3c9f4-b241-42a9-a29a-eeaad3c2b83c" (UID: "4be3c9f4-b241-42a9-a29a-eeaad3c2b83c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:24:56.269757 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.269700    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-home\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:24:56.269757 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.269726    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-tmp-dir\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:24:56.271579 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.271549    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-dshm" (OuterVolumeSpecName: "dshm") pod "4be3c9f4-b241-42a9-a29a-eeaad3c2b83c" (UID: "4be3c9f4-b241-42a9-a29a-eeaad3c2b83c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:24:56.271754 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.271619    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4be3c9f4-b241-42a9-a29a-eeaad3c2b83c" (UID: "4be3c9f4-b241-42a9-a29a-eeaad3c2b83c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:24:56.271754 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.271631    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-kube-api-access-tgx2s" (OuterVolumeSpecName: "kube-api-access-tgx2s") pod "4be3c9f4-b241-42a9-a29a-eeaad3c2b83c" (UID: "4be3c9f4-b241-42a9-a29a-eeaad3c2b83c"). InnerVolumeSpecName "kube-api-access-tgx2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:24:56.371154 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.371114    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-tls-certs\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:24:56.371154 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.371149    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-model-cache\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:24:56.371154 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.371160    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgx2s\" (UniqueName: \"kubernetes.io/projected/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-kube-api-access-tgx2s\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:24:56.371390 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.371169    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c-dshm\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:24:56.455849 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.455814    2582 generic.go:356] "Generic (PLEG): container finished" podID="4be3c9f4-b241-42a9-a29a-eeaad3c2b83c" containerID="9a073e75cbf54de59062c08fdce8e1c93f21238ff31b246be9cd4d8567c68cc7" exitCode=0
Jul 21 01:24:56.455849 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.455855    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"
Jul 21 01:24:56.456134 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.455877    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94" event={"ID":"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c","Type":"ContainerDied","Data":"9a073e75cbf54de59062c08fdce8e1c93f21238ff31b246be9cd4d8567c68cc7"}
Jul 21 01:24:56.456134 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.455926    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94" event={"ID":"4be3c9f4-b241-42a9-a29a-eeaad3c2b83c","Type":"ContainerDied","Data":"16431665b935558064d95496369388dbc359d681817fca226783ac33cf1c70b6"}
Jul 21 01:24:56.456134 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.455948    2582 scope.go:117] "RemoveContainer" containerID="9a073e75cbf54de59062c08fdce8e1c93f21238ff31b246be9cd4d8567c68cc7"
Jul 21 01:24:56.465279 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.465261    2582 scope.go:117] "RemoveContainer" containerID="9a073e75cbf54de59062c08fdce8e1c93f21238ff31b246be9cd4d8567c68cc7"
Jul 21 01:24:56.465594 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:24:56.465574    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a073e75cbf54de59062c08fdce8e1c93f21238ff31b246be9cd4d8567c68cc7\": container with ID starting with 9a073e75cbf54de59062c08fdce8e1c93f21238ff31b246be9cd4d8567c68cc7 not found: ID does not exist" containerID="9a073e75cbf54de59062c08fdce8e1c93f21238ff31b246be9cd4d8567c68cc7"
Jul 21 01:24:56.465677 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.465605    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a073e75cbf54de59062c08fdce8e1c93f21238ff31b246be9cd4d8567c68cc7"} err="failed to get container status \"9a073e75cbf54de59062c08fdce8e1c93f21238ff31b246be9cd4d8567c68cc7\": rpc error: code = NotFound desc = could not find container \"9a073e75cbf54de59062c08fdce8e1c93f21238ff31b246be9cd4d8567c68cc7\": container with ID starting with 9a073e75cbf54de59062c08fdce8e1c93f21238ff31b246be9cd4d8567c68cc7 not found: ID does not exist"
Jul 21 01:24:56.471710 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.471676    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"]
Jul 21 01:24:56.475799 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:56.475769    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a7997d/auth-test-model-a7997d-kserve-78cbc54bdc-dqw94"]
Jul 21 01:24:57.607341 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:57.607304    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:24:58.345332 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:24:58.345295    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4be3c9f4-b241-42a9-a29a-eeaad3c2b83c" path="/var/lib/kubelet/pods/4be3c9f4-b241-42a9-a29a-eeaad3c2b83c/volumes"
Jul 21 01:25:00.609192 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.609155    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"]
Jul 21 01:25:00.609634 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.609605    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4be3c9f4-b241-42a9-a29a-eeaad3c2b83c" containerName="main"
Jul 21 01:25:00.609634 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.609619    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4be3c9f4-b241-42a9-a29a-eeaad3c2b83c" containerName="main"
Jul 21 01:25:00.609735 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.609716    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4be3c9f4-b241-42a9-a29a-eeaad3c2b83c" containerName="main"
Jul 21 01:25:00.614186 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.614164    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"
Jul 21 01:25:00.616642 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.616615    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a7997d\"/\"openshift-service-ca.crt\""
Jul 21 01:25:00.616808 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.616698    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a7997d\"/\"kube-root-ca.crt\""
Jul 21 01:25:00.616808 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.616614    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a7997d\"/\"sub-test-model-a7997d-kserve-self-signed-certs\""
Jul 21 01:25:00.617514 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.616922    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a7997d\"/\"default-dockercfg-xkvtv\""
Jul 21 01:25:00.624193 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.623996    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"]
Jul 21 01:25:00.711915 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.711876    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-tmp-dir\") pod \"sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz\" (UID: \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\") " pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"
Jul 21 01:25:00.711915 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.711920    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-home\") pod \"sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz\" (UID: \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\") " pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"
Jul 21 01:25:00.712268 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.711943    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8rvt\" (UniqueName: \"kubernetes.io/projected/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-kube-api-access-d8rvt\") pod \"sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz\" (UID: \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\") " pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"
Jul 21 01:25:00.712268 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.711962    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-dshm\") pod \"sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz\" (UID: \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\") " pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"
Jul 21 01:25:00.712268 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.712006    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-model-cache\") pod \"sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz\" (UID: \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\") " pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"
Jul 21 01:25:00.712268 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.712096    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-tls-certs\") pod \"sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz\" (UID: \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\") " pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"
Jul 21 01:25:00.812906 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.812869    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-tmp-dir\") pod \"sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz\" (UID: \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\") " pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"
Jul 21 01:25:00.812906 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.812917    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-home\") pod \"sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz\" (UID: \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\") " pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"
Jul 21 01:25:00.813189 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.812947    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8rvt\" (UniqueName: \"kubernetes.io/projected/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-kube-api-access-d8rvt\") pod \"sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz\" (UID: \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\") " pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"
Jul 21 01:25:00.813189 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.812968    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-dshm\") pod \"sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz\" (UID: \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\") " pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"
Jul 21 01:25:00.813189 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.812985    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-model-cache\") pod \"sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz\" (UID: \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\") " pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"
Jul 21 01:25:00.813189 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.813064    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-tls-certs\") pod \"sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz\" (UID: \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\") " pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"
Jul 21 01:25:00.813414 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.813386    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-home\") pod \"sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz\" (UID: \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\") " pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"
Jul 21 01:25:00.813414 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.813395    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-tmp-dir\") pod \"sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz\" (UID: \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\") " pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"
Jul 21 01:25:00.813492 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.813465    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-model-cache\") pod \"sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz\" (UID: \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\") " pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"
Jul 21 01:25:00.815422 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.815399    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-dshm\") pod \"sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz\" (UID: \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\") " pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"
Jul 21 01:25:00.815730 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.815711    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-tls-certs\") pod \"sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz\" (UID: \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\") " pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"
Jul 21 01:25:00.821273 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.821218    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8rvt\" (UniqueName: \"kubernetes.io/projected/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-kube-api-access-d8rvt\") pod \"sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz\" (UID: \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\") " pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"
Jul 21 01:25:00.926443 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:00.926338    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"
Jul 21 01:25:01.074520 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:01.074488    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"]
Jul 21 01:25:01.076629 ip-10-0-133-75 kubenswrapper[2582]: W0721 01:25:01.076593    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67a226cf_0b12_4b7f_a4de_7fce8bbdca33.slice/crio-211218b85e191244541a04902542382f537a30b128727b0a783e9c5d1b92423f WatchSource:0}: Error finding container 211218b85e191244541a04902542382f537a30b128727b0a783e9c5d1b92423f: Status 404 returned error can't find the container with id 211218b85e191244541a04902542382f537a30b128727b0a783e9c5d1b92423f
Jul 21 01:25:01.486442 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:01.486399    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz" event={"ID":"67a226cf-0b12-4b7f-a4de-7fce8bbdca33","Type":"ContainerStarted","Data":"eb0ae662f9d9a44801e835f68ba930328841b1ceaccb73de7581619e5f6d8a7a"}
Jul 21 01:25:01.486442 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:01.486449    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz" event={"ID":"67a226cf-0b12-4b7f-a4de-7fce8bbdca33","Type":"ContainerStarted","Data":"211218b85e191244541a04902542382f537a30b128727b0a783e9c5d1b92423f"}
Jul 21 01:25:01.514685 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:01.514610    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz" podStartSLOduration=1.514592814 podStartE2EDuration="1.514592814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:25:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:25:01.512478495 +0000 UTC m=+2631.812174917" watchObservedRunningTime="2026-07-21 01:25:01.514592814 +0000 UTC m=+2631.814289235"
Jul 21 01:25:05.019672 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:05.019614    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:25:10.926696 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:10.926551    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"
Jul 21 01:25:10.927077 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:10.926704    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"
Jul 21 01:25:10.939523 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:10.939494    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"
Jul 21 01:25:11.560664 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:11.560626    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"
Jul 21 01:25:39.687590 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:39.687553    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"]
Jul 21 01:25:39.691342 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:39.691321    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"
Jul 21 01:25:39.693767 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:39.693744    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-03c5cb\"/\"openshift-service-ca.crt\""
Jul 21 01:25:39.693893 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:39.693746    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-03c5cb\"/\"sub-test-model-03c5cb-kserve-self-signed-certs\""
Jul 21 01:25:39.693893 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:39.693784    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-03c5cb\"/\"kube-root-ca.crt\""
Jul 21 01:25:39.693893 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:39.693797    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-03c5cb\"/\"default-dockercfg-24n4x\""
Jul 21 01:25:39.701902 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:39.701870    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"]
Jul 21 01:25:39.786419 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:39.786378    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2plwm\" (UniqueName: \"kubernetes.io/projected/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-kube-api-access-2plwm\") pod \"sub-test-model-03c5cb-kserve-9f966fd79-bgnwf\" (UID: \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\") " pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"
Jul 21 01:25:39.786609 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:39.786434    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-dshm\") pod \"sub-test-model-03c5cb-kserve-9f966fd79-bgnwf\" (UID: \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\") " pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"
Jul 21 01:25:39.786609 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:39.786500    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-model-cache\") pod \"sub-test-model-03c5cb-kserve-9f966fd79-bgnwf\" (UID: \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\") " pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"
Jul 21 01:25:39.786609 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:39.786521    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-tmp-dir\") pod \"sub-test-model-03c5cb-kserve-9f966fd79-bgnwf\" (UID: \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\") " pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"
Jul 21 01:25:39.786747 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:39.786629    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-tls-certs\") pod \"sub-test-model-03c5cb-kserve-9f966fd79-bgnwf\" (UID: \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\") " pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"
Jul 21 01:25:39.786747 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:39.786685    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-home\") pod \"sub-test-model-03c5cb-kserve-9f966fd79-bgnwf\" (UID: \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\") " pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"
Jul 21 01:25:39.887749 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:39.887704    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2plwm\" (UniqueName: \"kubernetes.io/projected/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-kube-api-access-2plwm\") pod \"sub-test-model-03c5cb-kserve-9f966fd79-bgnwf\" (UID: \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\") " pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"
Jul 21 01:25:39.887963 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:39.887769    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-dshm\") pod \"sub-test-model-03c5cb-kserve-9f966fd79-bgnwf\" (UID: \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\") " pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"
Jul 21 01:25:39.887963 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:39.887824    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-model-cache\") pod \"sub-test-model-03c5cb-kserve-9f966fd79-bgnwf\" (UID: \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\") " pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"
Jul 21 01:25:39.887963 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:39.887847    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-tmp-dir\") pod \"sub-test-model-03c5cb-kserve-9f966fd79-bgnwf\" (UID: \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\") " pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"
Jul 21 01:25:39.887963 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:39.887914    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-tls-certs\") pod \"sub-test-model-03c5cb-kserve-9f966fd79-bgnwf\" (UID: \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\") " pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"
Jul 21 01:25:39.887963 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:39.887957    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-home\") pod \"sub-test-model-03c5cb-kserve-9f966fd79-bgnwf\" (UID: \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\") " pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"
Jul 21 01:25:39.888274 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:39.888255    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-tmp-dir\") pod \"sub-test-model-03c5cb-kserve-9f966fd79-bgnwf\" (UID: \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\") " pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"
Jul 21 01:25:39.888336 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:39.888300    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-model-cache\") pod \"sub-test-model-03c5cb-kserve-9f966fd79-bgnwf\" (UID: \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\") " pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"
Jul 21 01:25:39.888387 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:39.888333    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-home\") pod \"sub-test-model-03c5cb-kserve-9f966fd79-bgnwf\" (UID: \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\") " pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"
Jul 21 01:25:39.890066 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:39.890043    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-dshm\") pod \"sub-test-model-03c5cb-kserve-9f966fd79-bgnwf\" (UID: \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\") " pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"
Jul 21 01:25:39.890467 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:39.890446    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-tls-certs\") pod \"sub-test-model-03c5cb-kserve-9f966fd79-bgnwf\" (UID: \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\") " pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"
Jul 21 01:25:39.895245 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:39.895224    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2plwm\" (UniqueName: \"kubernetes.io/projected/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-kube-api-access-2plwm\") pod \"sub-test-model-03c5cb-kserve-9f966fd79-bgnwf\" (UID: \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\") " pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"
Jul 21 01:25:40.001178 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:40.001084    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"
Jul 21 01:25:40.137074 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:40.137046    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"]
Jul 21 01:25:40.138634 ip-10-0-133-75 kubenswrapper[2582]: W0721 01:25:40.138610    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4172f85f_7e59_48d7_960c_0fd5b7ed09d0.slice/crio-cab35c38f6a04b3bde76b4615a0e36ac3d03b8ee4eafb82353afc42e93cabb4b WatchSource:0}: Error finding container cab35c38f6a04b3bde76b4615a0e36ac3d03b8ee4eafb82353afc42e93cabb4b: Status 404 returned error can't find the container with id cab35c38f6a04b3bde76b4615a0e36ac3d03b8ee4eafb82353afc42e93cabb4b
Jul 21 01:25:40.722836 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:40.722787    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf" event={"ID":"4172f85f-7e59-48d7-960c-0fd5b7ed09d0","Type":"ContainerStarted","Data":"f4915855ebaddb3a6b30557aaacd2c3f2b9d8b2633e50b45a50048b0594fa5cd"}
Jul 21 01:25:40.722836 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:40.722839    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf" event={"ID":"4172f85f-7e59-48d7-960c-0fd5b7ed09d0","Type":"ContainerStarted","Data":"cab35c38f6a04b3bde76b4615a0e36ac3d03b8ee4eafb82353afc42e93cabb4b"}
Jul 21 01:25:40.739731 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:40.739682    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf" podStartSLOduration=1.739665827 podStartE2EDuration="1.739665827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:25:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:25:40.738638794 +0000 UTC m=+2671.038335218" watchObservedRunningTime="2026-07-21 01:25:40.739665827 +0000 UTC m=+2671.039362243"
Jul 21 01:25:43.195921 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:43.195887    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:25:50.002217 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:50.002177    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"
Jul 21 01:25:50.002217 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:50.002227    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"
Jul 21 01:25:50.015112 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:50.015081    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"
Jul 21 01:25:50.788887 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:25:50.788852    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"
Jul 21 01:26:02.813721 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:02.813615    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:26:19.915976 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:19.915936    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:26:27.907314 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:27.907277    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"]
Jul 21 01:26:28.693589 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:28.693556    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"]
Jul 21 01:26:39.800595 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:39.800549    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:26:42.927733 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:42.927694    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz" podUID="67a226cf-0b12-4b7f-a4de-7fce8bbdca33" containerName="main" containerID="cri-o://eb0ae662f9d9a44801e835f68ba930328841b1ceaccb73de7581619e5f6d8a7a" gracePeriod=45
Jul 21 01:26:43.074471 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:43.074438    2582 generic.go:356] "Generic (PLEG): container finished" podID="67a226cf-0b12-4b7f-a4de-7fce8bbdca33" containerID="eb0ae662f9d9a44801e835f68ba930328841b1ceaccb73de7581619e5f6d8a7a" exitCode=0
Jul 21 01:26:43.074658 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:43.074519    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz" event={"ID":"67a226cf-0b12-4b7f-a4de-7fce8bbdca33","Type":"ContainerDied","Data":"eb0ae662f9d9a44801e835f68ba930328841b1ceaccb73de7581619e5f6d8a7a"}
Jul 21 01:26:43.187033 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:43.186957    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"
Jul 21 01:26:43.316433 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:43.316397    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-dshm\") pod \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\" (UID: \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\") "
Jul 21 01:26:43.316627 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:43.316471    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-home\") pod \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\" (UID: \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\") "
Jul 21 01:26:43.316627 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:43.316514    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8rvt\" (UniqueName: \"kubernetes.io/projected/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-kube-api-access-d8rvt\") pod \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\" (UID: \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\") "
Jul 21 01:26:43.316627 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:43.316542    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-tmp-dir\") pod \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\" (UID: \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\") "
Jul 21 01:26:43.316627 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:43.316568    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-model-cache\") pod \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\" (UID: \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\") "
Jul 21 01:26:43.316627 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:43.316626    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-tls-certs\") pod \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\" (UID: \"67a226cf-0b12-4b7f-a4de-7fce8bbdca33\") "
Jul 21 01:26:43.316891 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:43.316791    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-home" (OuterVolumeSpecName: "home") pod "67a226cf-0b12-4b7f-a4de-7fce8bbdca33" (UID: "67a226cf-0b12-4b7f-a4de-7fce8bbdca33"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:26:43.316891 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:43.316871    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "67a226cf-0b12-4b7f-a4de-7fce8bbdca33" (UID: "67a226cf-0b12-4b7f-a4de-7fce8bbdca33"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:26:43.317003 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:43.316952    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-tmp-dir\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:26:43.317003 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:43.316965    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-home\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:26:43.317003 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:43.316946    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-model-cache" (OuterVolumeSpecName: "model-cache") pod "67a226cf-0b12-4b7f-a4de-7fce8bbdca33" (UID: "67a226cf-0b12-4b7f-a4de-7fce8bbdca33"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:26:43.318757 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:43.318731    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "67a226cf-0b12-4b7f-a4de-7fce8bbdca33" (UID: "67a226cf-0b12-4b7f-a4de-7fce8bbdca33"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:26:43.318861 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:43.318781    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-kube-api-access-d8rvt" (OuterVolumeSpecName: "kube-api-access-d8rvt") pod "67a226cf-0b12-4b7f-a4de-7fce8bbdca33" (UID: "67a226cf-0b12-4b7f-a4de-7fce8bbdca33"). InnerVolumeSpecName "kube-api-access-d8rvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:26:43.318861 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:43.318784    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-dshm" (OuterVolumeSpecName: "dshm") pod "67a226cf-0b12-4b7f-a4de-7fce8bbdca33" (UID: "67a226cf-0b12-4b7f-a4de-7fce8bbdca33"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:26:43.417632 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:43.417585    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8rvt\" (UniqueName: \"kubernetes.io/projected/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-kube-api-access-d8rvt\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:26:43.417632 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:43.417624    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-model-cache\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:26:43.417632 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:43.417638    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-tls-certs\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:26:43.417632 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:43.417663    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67a226cf-0b12-4b7f-a4de-7fce8bbdca33-dshm\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:26:43.715063 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:43.714987    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf" podUID="4172f85f-7e59-48d7-960c-0fd5b7ed09d0" containerName="main" containerID="cri-o://f4915855ebaddb3a6b30557aaacd2c3f2b9d8b2633e50b45a50048b0594fa5cd" gracePeriod=45
Jul 21 01:26:43.980799 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:43.980719    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"
Jul 21 01:26:44.082043 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.082010    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"
Jul 21 01:26:44.082233 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.082010    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz" event={"ID":"67a226cf-0b12-4b7f-a4de-7fce8bbdca33","Type":"ContainerDied","Data":"211218b85e191244541a04902542382f537a30b128727b0a783e9c5d1b92423f"}
Jul 21 01:26:44.082233 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.082143    2582 scope.go:117] "RemoveContainer" containerID="eb0ae662f9d9a44801e835f68ba930328841b1ceaccb73de7581619e5f6d8a7a"
Jul 21 01:26:44.083503 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.083477    2582 generic.go:356] "Generic (PLEG): container finished" podID="4172f85f-7e59-48d7-960c-0fd5b7ed09d0" containerID="f4915855ebaddb3a6b30557aaacd2c3f2b9d8b2633e50b45a50048b0594fa5cd" exitCode=0
Jul 21 01:26:44.083606 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.083513    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"
Jul 21 01:26:44.083606 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.083550    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf" event={"ID":"4172f85f-7e59-48d7-960c-0fd5b7ed09d0","Type":"ContainerDied","Data":"f4915855ebaddb3a6b30557aaacd2c3f2b9d8b2633e50b45a50048b0594fa5cd"}
Jul 21 01:26:44.083606 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.083583    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf" event={"ID":"4172f85f-7e59-48d7-960c-0fd5b7ed09d0","Type":"ContainerDied","Data":"cab35c38f6a04b3bde76b4615a0e36ac3d03b8ee4eafb82353afc42e93cabb4b"}
Jul 21 01:26:44.094982 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.094920    2582 scope.go:117] "RemoveContainer" containerID="f4915855ebaddb3a6b30557aaacd2c3f2b9d8b2633e50b45a50048b0594fa5cd"
Jul 21 01:26:44.103712 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.103636    2582 scope.go:117] "RemoveContainer" containerID="f4915855ebaddb3a6b30557aaacd2c3f2b9d8b2633e50b45a50048b0594fa5cd"
Jul 21 01:26:44.103969 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:26:44.103949    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4915855ebaddb3a6b30557aaacd2c3f2b9d8b2633e50b45a50048b0594fa5cd\": container with ID starting with f4915855ebaddb3a6b30557aaacd2c3f2b9d8b2633e50b45a50048b0594fa5cd not found: ID does not exist" containerID="f4915855ebaddb3a6b30557aaacd2c3f2b9d8b2633e50b45a50048b0594fa5cd"
Jul 21 01:26:44.104041 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.103978    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4915855ebaddb3a6b30557aaacd2c3f2b9d8b2633e50b45a50048b0594fa5cd"} err="failed to get container status \"f4915855ebaddb3a6b30557aaacd2c3f2b9d8b2633e50b45a50048b0594fa5cd\": rpc error: code = NotFound desc = could not find container \"f4915855ebaddb3a6b30557aaacd2c3f2b9d8b2633e50b45a50048b0594fa5cd\": container with ID starting with f4915855ebaddb3a6b30557aaacd2c3f2b9d8b2633e50b45a50048b0594fa5cd not found: ID does not exist"
Jul 21 01:26:44.105587 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.105562    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"]
Jul 21 01:26:44.108765 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.108745    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a7997d/sub-test-model-a7997d-kserve-5b6c7fc4f-jcsgz"]
Jul 21 01:26:44.124333 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.124310    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2plwm\" (UniqueName: \"kubernetes.io/projected/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-kube-api-access-2plwm\") pod \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\" (UID: \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\") "
Jul 21 01:26:44.124413 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.124345    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-tmp-dir\") pod \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\" (UID: \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\") "
Jul 21 01:26:44.124413 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.124395    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-dshm\") pod \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\" (UID: \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\") "
Jul 21 01:26:44.124494 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.124469    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-model-cache\") pod \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\" (UID: \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\") "
Jul 21 01:26:44.124529 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.124519    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-tls-certs\") pod \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\" (UID: \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\") "
Jul 21 01:26:44.124563 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.124543    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-home\") pod \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\" (UID: \"4172f85f-7e59-48d7-960c-0fd5b7ed09d0\") "
Jul 21 01:26:44.124722 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.124693    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4172f85f-7e59-48d7-960c-0fd5b7ed09d0" (UID: "4172f85f-7e59-48d7-960c-0fd5b7ed09d0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:26:44.124895 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.124870    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-model-cache" (OuterVolumeSpecName: "model-cache") pod "4172f85f-7e59-48d7-960c-0fd5b7ed09d0" (UID: "4172f85f-7e59-48d7-960c-0fd5b7ed09d0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:26:44.124895 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.124882    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-home" (OuterVolumeSpecName: "home") pod "4172f85f-7e59-48d7-960c-0fd5b7ed09d0" (UID: "4172f85f-7e59-48d7-960c-0fd5b7ed09d0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:26:44.125021 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.124925    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-tmp-dir\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:26:44.126683 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.126641    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4172f85f-7e59-48d7-960c-0fd5b7ed09d0" (UID: "4172f85f-7e59-48d7-960c-0fd5b7ed09d0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:26:44.126773 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.126680    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-kube-api-access-2plwm" (OuterVolumeSpecName: "kube-api-access-2plwm") pod "4172f85f-7e59-48d7-960c-0fd5b7ed09d0" (UID: "4172f85f-7e59-48d7-960c-0fd5b7ed09d0"). InnerVolumeSpecName "kube-api-access-2plwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:26:44.126773 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.126740    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-dshm" (OuterVolumeSpecName: "dshm") pod "4172f85f-7e59-48d7-960c-0fd5b7ed09d0" (UID: "4172f85f-7e59-48d7-960c-0fd5b7ed09d0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:26:44.226136 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.226094    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-dshm\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:26:44.226136 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.226126    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-model-cache\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:26:44.226136 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.226137    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-tls-certs\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:26:44.226136 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.226144    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-home\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:26:44.226421 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.226153    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2plwm\" (UniqueName: \"kubernetes.io/projected/4172f85f-7e59-48d7-960c-0fd5b7ed09d0-kube-api-access-2plwm\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:26:44.345141 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.345058    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67a226cf-0b12-4b7f-a4de-7fce8bbdca33" path="/var/lib/kubelet/pods/67a226cf-0b12-4b7f-a4de-7fce8bbdca33/volumes"
Jul 21 01:26:44.398942 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.398903    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"]
Jul 21 01:26:44.402961 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:44.402933    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-03c5cb/sub-test-model-03c5cb-kserve-9f966fd79-bgnwf"]
Jul 21 01:26:46.345817 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:46.345780    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4172f85f-7e59-48d7-960c-0fd5b7ed09d0" path="/var/lib/kubelet/pods/4172f85f-7e59-48d7-960c-0fd5b7ed09d0/volumes"
Jul 21 01:26:51.916783 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:51.916745    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"]
Jul 21 01:26:51.917209 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:51.917164    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4172f85f-7e59-48d7-960c-0fd5b7ed09d0" containerName="main"
Jul 21 01:26:51.917209 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:51.917177    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4172f85f-7e59-48d7-960c-0fd5b7ed09d0" containerName="main"
Jul 21 01:26:51.917209 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:51.917194    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67a226cf-0b12-4b7f-a4de-7fce8bbdca33" containerName="main"
Jul 21 01:26:51.917209 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:51.917199    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="67a226cf-0b12-4b7f-a4de-7fce8bbdca33" containerName="main"
Jul 21 01:26:51.917341 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:51.917266    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="67a226cf-0b12-4b7f-a4de-7fce8bbdca33" containerName="main"
Jul 21 01:26:51.917341 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:51.917275    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4172f85f-7e59-48d7-960c-0fd5b7ed09d0" containerName="main"
Jul 21 01:26:51.920533 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:51.920516    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"
Jul 21 01:26:51.922456 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:51.922432    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a7997d\"/\"kube-root-ca.crt\""
Jul 21 01:26:51.922888 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:51.922870    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a7997d\"/\"openshift-service-ca.crt\""
Jul 21 01:26:51.922948 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:51.922896    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a7997d\"/\"default-dockercfg-xkvtv\""
Jul 21 01:26:51.922948 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:51.922910    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a7997d\"/\"rate-test-model-a7997d-kserve-self-signed-certs\""
Jul 21 01:26:51.930272 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:51.930251    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"]
Jul 21 01:26:52.006583 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:52.006541    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95c15831-93d0-4047-9dbb-72193dc61464-home\") pod \"rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6\" (UID: \"95c15831-93d0-4047-9dbb-72193dc61464\") " pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"
Jul 21 01:26:52.006583 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:52.006593    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rpph\" (UniqueName: \"kubernetes.io/projected/95c15831-93d0-4047-9dbb-72193dc61464-kube-api-access-6rpph\") pod \"rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6\" (UID: \"95c15831-93d0-4047-9dbb-72193dc61464\") " pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"
Jul 21 01:26:52.006876 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:52.006627    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95c15831-93d0-4047-9dbb-72193dc61464-tls-certs\") pod \"rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6\" (UID: \"95c15831-93d0-4047-9dbb-72193dc61464\") " pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"
Jul 21 01:26:52.006876 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:52.006718    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95c15831-93d0-4047-9dbb-72193dc61464-dshm\") pod \"rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6\" (UID: \"95c15831-93d0-4047-9dbb-72193dc61464\") " pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"
Jul 21 01:26:52.006876 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:52.006744    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95c15831-93d0-4047-9dbb-72193dc61464-model-cache\") pod \"rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6\" (UID: \"95c15831-93d0-4047-9dbb-72193dc61464\") " pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"
Jul 21 01:26:52.006876 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:52.006842    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95c15831-93d0-4047-9dbb-72193dc61464-tmp-dir\") pod \"rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6\" (UID: \"95c15831-93d0-4047-9dbb-72193dc61464\") " pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"
Jul 21 01:26:52.108274 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:52.108240    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95c15831-93d0-4047-9dbb-72193dc61464-tmp-dir\") pod \"rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6\" (UID: \"95c15831-93d0-4047-9dbb-72193dc61464\") " pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"
Jul 21 01:26:52.108445 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:52.108296    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95c15831-93d0-4047-9dbb-72193dc61464-home\") pod \"rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6\" (UID: \"95c15831-93d0-4047-9dbb-72193dc61464\") " pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"
Jul 21 01:26:52.108445 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:52.108331    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rpph\" (UniqueName: \"kubernetes.io/projected/95c15831-93d0-4047-9dbb-72193dc61464-kube-api-access-6rpph\") pod \"rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6\" (UID: \"95c15831-93d0-4047-9dbb-72193dc61464\") " pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"
Jul 21 01:26:52.108445 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:52.108360    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95c15831-93d0-4047-9dbb-72193dc61464-tls-certs\") pod \"rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6\" (UID: \"95c15831-93d0-4047-9dbb-72193dc61464\") " pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"
Jul 21 01:26:52.108445 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:52.108392    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95c15831-93d0-4047-9dbb-72193dc61464-dshm\") pod \"rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6\" (UID: \"95c15831-93d0-4047-9dbb-72193dc61464\") " pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"
Jul 21 01:26:52.108445 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:52.108428    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95c15831-93d0-4047-9dbb-72193dc61464-model-cache\") pod \"rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6\" (UID: \"95c15831-93d0-4047-9dbb-72193dc61464\") " pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"
Jul 21 01:26:52.108752 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:52.108725    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95c15831-93d0-4047-9dbb-72193dc61464-tmp-dir\") pod \"rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6\" (UID: \"95c15831-93d0-4047-9dbb-72193dc61464\") " pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"
Jul 21 01:26:52.108819 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:52.108797    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95c15831-93d0-4047-9dbb-72193dc61464-home\") pod \"rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6\" (UID: \"95c15831-93d0-4047-9dbb-72193dc61464\") " pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"
Jul 21 01:26:52.108875 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:52.108814    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95c15831-93d0-4047-9dbb-72193dc61464-model-cache\") pod \"rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6\" (UID: \"95c15831-93d0-4047-9dbb-72193dc61464\") " pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"
Jul 21 01:26:52.110708 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:52.110686    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95c15831-93d0-4047-9dbb-72193dc61464-dshm\") pod \"rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6\" (UID: \"95c15831-93d0-4047-9dbb-72193dc61464\") " pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"
Jul 21 01:26:52.110892 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:52.110876    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95c15831-93d0-4047-9dbb-72193dc61464-tls-certs\") pod \"rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6\" (UID: \"95c15831-93d0-4047-9dbb-72193dc61464\") " pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"
Jul 21 01:26:52.116459 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:52.116432    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rpph\" (UniqueName: \"kubernetes.io/projected/95c15831-93d0-4047-9dbb-72193dc61464-kube-api-access-6rpph\") pod \"rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6\" (UID: \"95c15831-93d0-4047-9dbb-72193dc61464\") " pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"
Jul 21 01:26:52.231335 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:52.231299    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"
Jul 21 01:26:52.371627 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:52.371599    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"]
Jul 21 01:26:52.373842 ip-10-0-133-75 kubenswrapper[2582]: W0721 01:26:52.373814    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95c15831_93d0_4047_9dbb_72193dc61464.slice/crio-9b12592a2e84de538ae4a7f3a742ad9802ba4946e5979d5c045d8a1951abe25f WatchSource:0}: Error finding container 9b12592a2e84de538ae4a7f3a742ad9802ba4946e5979d5c045d8a1951abe25f: Status 404 returned error can't find the container with id 9b12592a2e84de538ae4a7f3a742ad9802ba4946e5979d5c045d8a1951abe25f
Jul 21 01:26:53.137098 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:53.137060    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6" event={"ID":"95c15831-93d0-4047-9dbb-72193dc61464","Type":"ContainerStarted","Data":"5af5a38c8e22082ab22e3e39ae7855f834b71b15504c94ecb17762e81eca521a"}
Jul 21 01:26:53.137098 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:53.137103    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6" event={"ID":"95c15831-93d0-4047-9dbb-72193dc61464","Type":"ContainerStarted","Data":"9b12592a2e84de538ae4a7f3a742ad9802ba4946e5979d5c045d8a1951abe25f"}
Jul 21 01:26:53.159141 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:53.159090    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6" podStartSLOduration=2.159073658 podStartE2EDuration="2.159073658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:26:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:26:53.156491115 +0000 UTC m=+2743.456187540" watchObservedRunningTime="2026-07-21 01:26:53.159073658 +0000 UTC m=+2743.458770080"
Jul 21 01:26:55.014540 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:26:55.014502    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:27:02.232451 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:02.232410    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"
Jul 21 01:27:02.232932 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:02.232477    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"
Jul 21 01:27:02.245243 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:02.245213    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"
Jul 21 01:27:03.203046 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:03.203013    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"
Jul 21 01:27:09.902316 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:09.902279    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"]
Jul 21 01:27:09.906085 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:09.906066    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"
Jul 21 01:27:09.908182 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:09.908153    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-03c5cb\"/\"kube-root-ca.crt\""
Jul 21 01:27:09.908312 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:09.908185    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-03c5cb\"/\"rate-test-model-03c5cb-kserve-self-signed-certs\""
Jul 21 01:27:09.908690 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:09.908642    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-03c5cb\"/\"default-dockercfg-24n4x\""
Jul 21 01:27:09.908872 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:09.908727    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-03c5cb\"/\"openshift-service-ca.crt\""
Jul 21 01:27:09.915352 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:09.915327    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"]
Jul 21 01:27:09.981501 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:09.981462    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89e406a8-c718-4961-939d-3d99fc3fff48-tmp-dir\") pod \"rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt\" (UID: \"89e406a8-c718-4961-939d-3d99fc3fff48\") " pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"
Jul 21 01:27:09.981501 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:09.981504    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89e406a8-c718-4961-939d-3d99fc3fff48-home\") pod \"rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt\" (UID: \"89e406a8-c718-4961-939d-3d99fc3fff48\") " pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"
Jul 21 01:27:09.981773 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:09.981608    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89e406a8-c718-4961-939d-3d99fc3fff48-model-cache\") pod \"rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt\" (UID: \"89e406a8-c718-4961-939d-3d99fc3fff48\") " pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"
Jul 21 01:27:09.981773 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:09.981682    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp5p5\" (UniqueName: \"kubernetes.io/projected/89e406a8-c718-4961-939d-3d99fc3fff48-kube-api-access-dp5p5\") pod \"rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt\" (UID: \"89e406a8-c718-4961-939d-3d99fc3fff48\") " pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"
Jul 21 01:27:09.981773 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:09.981724    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89e406a8-c718-4961-939d-3d99fc3fff48-dshm\") pod \"rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt\" (UID: \"89e406a8-c718-4961-939d-3d99fc3fff48\") " pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"
Jul 21 01:27:09.981876 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:09.981770    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89e406a8-c718-4961-939d-3d99fc3fff48-tls-certs\") pod \"rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt\" (UID: \"89e406a8-c718-4961-939d-3d99fc3fff48\") " pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"
Jul 21 01:27:10.083012 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:10.082969    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89e406a8-c718-4961-939d-3d99fc3fff48-tmp-dir\") pod \"rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt\" (UID: \"89e406a8-c718-4961-939d-3d99fc3fff48\") " pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"
Jul 21 01:27:10.083012 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:10.083016    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89e406a8-c718-4961-939d-3d99fc3fff48-home\") pod \"rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt\" (UID: \"89e406a8-c718-4961-939d-3d99fc3fff48\") " pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"
Jul 21 01:27:10.083283 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:10.083061    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89e406a8-c718-4961-939d-3d99fc3fff48-model-cache\") pod \"rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt\" (UID: \"89e406a8-c718-4961-939d-3d99fc3fff48\") " pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"
Jul 21 01:27:10.083283 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:10.083086    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp5p5\" (UniqueName: \"kubernetes.io/projected/89e406a8-c718-4961-939d-3d99fc3fff48-kube-api-access-dp5p5\") pod \"rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt\" (UID: \"89e406a8-c718-4961-939d-3d99fc3fff48\") " pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"
Jul 21 01:27:10.083283 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:10.083114    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89e406a8-c718-4961-939d-3d99fc3fff48-dshm\") pod \"rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt\" (UID: \"89e406a8-c718-4961-939d-3d99fc3fff48\") " pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"
Jul 21 01:27:10.083283 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:10.083134    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89e406a8-c718-4961-939d-3d99fc3fff48-tls-certs\") pod \"rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt\" (UID: \"89e406a8-c718-4961-939d-3d99fc3fff48\") " pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"
Jul 21 01:27:10.083498 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:10.083434    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89e406a8-c718-4961-939d-3d99fc3fff48-tmp-dir\") pod \"rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt\" (UID: \"89e406a8-c718-4961-939d-3d99fc3fff48\") " pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"
Jul 21 01:27:10.083555 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:10.083490    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89e406a8-c718-4961-939d-3d99fc3fff48-home\") pod \"rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt\" (UID: \"89e406a8-c718-4961-939d-3d99fc3fff48\") " pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"
Jul 21 01:27:10.083555 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:10.083540    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89e406a8-c718-4961-939d-3d99fc3fff48-model-cache\") pod \"rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt\" (UID: \"89e406a8-c718-4961-939d-3d99fc3fff48\") " pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"
Jul 21 01:27:10.085449 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:10.085430    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89e406a8-c718-4961-939d-3d99fc3fff48-dshm\") pod \"rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt\" (UID: \"89e406a8-c718-4961-939d-3d99fc3fff48\") " pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"
Jul 21 01:27:10.085750 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:10.085734    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89e406a8-c718-4961-939d-3d99fc3fff48-tls-certs\") pod \"rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt\" (UID: \"89e406a8-c718-4961-939d-3d99fc3fff48\") " pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"
Jul 21 01:27:10.092146 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:10.092122    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp5p5\" (UniqueName: \"kubernetes.io/projected/89e406a8-c718-4961-939d-3d99fc3fff48-kube-api-access-dp5p5\") pod \"rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt\" (UID: \"89e406a8-c718-4961-939d-3d99fc3fff48\") " pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"
Jul 21 01:27:10.219010 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:10.218981    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-03c5cb\"/\"default-dockercfg-24n4x\""
Jul 21 01:27:10.227699 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:10.227669    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"
Jul 21 01:27:10.370741 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:10.370713    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"]
Jul 21 01:27:10.373122 ip-10-0-133-75 kubenswrapper[2582]: W0721 01:27:10.373078    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89e406a8_c718_4961_939d_3d99fc3fff48.slice/crio-8d6b1c44139386318cb92a9d42d706a8e1268d633b993fe74cf0a7045c81e9d0 WatchSource:0}: Error finding container 8d6b1c44139386318cb92a9d42d706a8e1268d633b993fe74cf0a7045c81e9d0: Status 404 returned error can't find the container with id 8d6b1c44139386318cb92a9d42d706a8e1268d633b993fe74cf0a7045c81e9d0
Jul 21 01:27:11.246840 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:11.246802    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt" event={"ID":"89e406a8-c718-4961-939d-3d99fc3fff48","Type":"ContainerStarted","Data":"3045ae4579bfbe92de4fc86bbf4cb97789162b1fba6fdebdfaf1e9aa9a521512"}
Jul 21 01:27:11.247267 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:11.246855    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt" event={"ID":"89e406a8-c718-4961-939d-3d99fc3fff48","Type":"ContainerStarted","Data":"8d6b1c44139386318cb92a9d42d706a8e1268d633b993fe74cf0a7045c81e9d0"}
Jul 21 01:27:11.263280 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:11.263224    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt" podStartSLOduration=2.263204739 podStartE2EDuration="2.263204739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:27:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:27:11.26221307 +0000 UTC m=+2761.561909492" watchObservedRunningTime="2026-07-21 01:27:11.263204739 +0000 UTC m=+2761.562901212"
Jul 21 01:27:13.801066 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:13.801028    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:27:20.228286 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:20.228236    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"
Jul 21 01:27:20.228732 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:20.228302    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"
Jul 21 01:27:20.240932 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:20.240902    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"
Jul 21 01:27:20.305402 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:20.305368    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"
Jul 21 01:27:27.509153 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:27.509116    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:27:41.912327 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:41.912242    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:27:48.255394 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:48.255357    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"]
Jul 21 01:27:49.409430 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:49.409382    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"]
Jul 21 01:27:59.597507 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:27:59.597469    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:28:03.276597 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.276534    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6" podUID="95c15831-93d0-4047-9dbb-72193dc61464" containerName="main" containerID="cri-o://5af5a38c8e22082ab22e3e39ae7855f834b71b15504c94ecb17762e81eca521a" gracePeriod=45
Jul 21 01:28:03.533165 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.533093    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"
Jul 21 01:28:03.535246 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.535218    2582 generic.go:356] "Generic (PLEG): container finished" podID="95c15831-93d0-4047-9dbb-72193dc61464" containerID="5af5a38c8e22082ab22e3e39ae7855f834b71b15504c94ecb17762e81eca521a" exitCode=0
Jul 21 01:28:03.535420 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.535264    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"
Jul 21 01:28:03.535420 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.535271    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6" event={"ID":"95c15831-93d0-4047-9dbb-72193dc61464","Type":"ContainerDied","Data":"5af5a38c8e22082ab22e3e39ae7855f834b71b15504c94ecb17762e81eca521a"}
Jul 21 01:28:03.535420 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.535304    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6" event={"ID":"95c15831-93d0-4047-9dbb-72193dc61464","Type":"ContainerDied","Data":"9b12592a2e84de538ae4a7f3a742ad9802ba4946e5979d5c045d8a1951abe25f"}
Jul 21 01:28:03.535420 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.535322    2582 scope.go:117] "RemoveContainer" containerID="5af5a38c8e22082ab22e3e39ae7855f834b71b15504c94ecb17762e81eca521a"
Jul 21 01:28:03.546638 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.546608    2582 scope.go:117] "RemoveContainer" containerID="5af5a38c8e22082ab22e3e39ae7855f834b71b15504c94ecb17762e81eca521a"
Jul 21 01:28:03.547074 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:28:03.547046    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5af5a38c8e22082ab22e3e39ae7855f834b71b15504c94ecb17762e81eca521a\": container with ID starting with 5af5a38c8e22082ab22e3e39ae7855f834b71b15504c94ecb17762e81eca521a not found: ID does not exist" containerID="5af5a38c8e22082ab22e3e39ae7855f834b71b15504c94ecb17762e81eca521a"
Jul 21 01:28:03.547203 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.547080    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5af5a38c8e22082ab22e3e39ae7855f834b71b15504c94ecb17762e81eca521a"} err="failed to get container status \"5af5a38c8e22082ab22e3e39ae7855f834b71b15504c94ecb17762e81eca521a\": rpc error: code = NotFound desc = could not find container \"5af5a38c8e22082ab22e3e39ae7855f834b71b15504c94ecb17762e81eca521a\": container with ID starting with 5af5a38c8e22082ab22e3e39ae7855f834b71b15504c94ecb17762e81eca521a not found: ID does not exist"
Jul 21 01:28:03.593843 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.593809    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95c15831-93d0-4047-9dbb-72193dc61464-tmp-dir\") pod \"95c15831-93d0-4047-9dbb-72193dc61464\" (UID: \"95c15831-93d0-4047-9dbb-72193dc61464\") "
Jul 21 01:28:03.594023 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.593884    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95c15831-93d0-4047-9dbb-72193dc61464-dshm\") pod \"95c15831-93d0-4047-9dbb-72193dc61464\" (UID: \"95c15831-93d0-4047-9dbb-72193dc61464\") "
Jul 21 01:28:03.594023 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.593908    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rpph\" (UniqueName: \"kubernetes.io/projected/95c15831-93d0-4047-9dbb-72193dc61464-kube-api-access-6rpph\") pod \"95c15831-93d0-4047-9dbb-72193dc61464\" (UID: \"95c15831-93d0-4047-9dbb-72193dc61464\") "
Jul 21 01:28:03.594023 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.593951    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95c15831-93d0-4047-9dbb-72193dc61464-model-cache\") pod \"95c15831-93d0-4047-9dbb-72193dc61464\" (UID: \"95c15831-93d0-4047-9dbb-72193dc61464\") "
Jul 21 01:28:03.594158 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.594084    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95c15831-93d0-4047-9dbb-72193dc61464-tls-certs\") pod \"95c15831-93d0-4047-9dbb-72193dc61464\" (UID: \"95c15831-93d0-4047-9dbb-72193dc61464\") "
Jul 21 01:28:03.594158 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.594148    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95c15831-93d0-4047-9dbb-72193dc61464-home\") pod \"95c15831-93d0-4047-9dbb-72193dc61464\" (UID: \"95c15831-93d0-4047-9dbb-72193dc61464\") "
Jul 21 01:28:03.594264 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.594158    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95c15831-93d0-4047-9dbb-72193dc61464-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "95c15831-93d0-4047-9dbb-72193dc61464" (UID: "95c15831-93d0-4047-9dbb-72193dc61464"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:28:03.594264 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.594193    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95c15831-93d0-4047-9dbb-72193dc61464-model-cache" (OuterVolumeSpecName: "model-cache") pod "95c15831-93d0-4047-9dbb-72193dc61464" (UID: "95c15831-93d0-4047-9dbb-72193dc61464"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:28:03.594419 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.594397    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95c15831-93d0-4047-9dbb-72193dc61464-home" (OuterVolumeSpecName: "home") pod "95c15831-93d0-4047-9dbb-72193dc61464" (UID: "95c15831-93d0-4047-9dbb-72193dc61464"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:28:03.594534 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.594515    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95c15831-93d0-4047-9dbb-72193dc61464-home\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:28:03.594605 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.594535    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95c15831-93d0-4047-9dbb-72193dc61464-tmp-dir\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:28:03.594605 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.594544    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95c15831-93d0-4047-9dbb-72193dc61464-model-cache\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:28:03.596152 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.596130    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95c15831-93d0-4047-9dbb-72193dc61464-dshm" (OuterVolumeSpecName: "dshm") pod "95c15831-93d0-4047-9dbb-72193dc61464" (UID: "95c15831-93d0-4047-9dbb-72193dc61464"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:28:03.596256 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.596179    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95c15831-93d0-4047-9dbb-72193dc61464-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "95c15831-93d0-4047-9dbb-72193dc61464" (UID: "95c15831-93d0-4047-9dbb-72193dc61464"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:28:03.596256 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.596190    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95c15831-93d0-4047-9dbb-72193dc61464-kube-api-access-6rpph" (OuterVolumeSpecName: "kube-api-access-6rpph") pod "95c15831-93d0-4047-9dbb-72193dc61464" (UID: "95c15831-93d0-4047-9dbb-72193dc61464"). InnerVolumeSpecName "kube-api-access-6rpph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:28:03.695882 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.695836    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95c15831-93d0-4047-9dbb-72193dc61464-dshm\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:28:03.695882 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.695872    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rpph\" (UniqueName: \"kubernetes.io/projected/95c15831-93d0-4047-9dbb-72193dc61464-kube-api-access-6rpph\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:28:03.695882 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.695883    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95c15831-93d0-4047-9dbb-72193dc61464-tls-certs\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:28:03.857162 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.857125    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"]
Jul 21 01:28:03.863527 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:03.863497    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a7997d/rate-test-model-a7997d-kserve-7df9b7c6dc-x8gz6"]
Jul 21 01:28:04.345300 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:04.345263    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95c15831-93d0-4047-9dbb-72193dc61464" path="/var/lib/kubelet/pods/95c15831-93d0-4047-9dbb-72193dc61464/volumes"
Jul 21 01:28:04.430470 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:04.430429    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt" podUID="89e406a8-c718-4961-939d-3d99fc3fff48" containerName="main" containerID="cri-o://3045ae4579bfbe92de4fc86bbf4cb97789162b1fba6fdebdfaf1e9aa9a521512" gracePeriod=45
Jul 21 01:28:04.699079 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:04.699053    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"
Jul 21 01:28:04.807074 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:04.807032    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89e406a8-c718-4961-939d-3d99fc3fff48-home\") pod \"89e406a8-c718-4961-939d-3d99fc3fff48\" (UID: \"89e406a8-c718-4961-939d-3d99fc3fff48\") "
Jul 21 01:28:04.807275 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:04.807088    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89e406a8-c718-4961-939d-3d99fc3fff48-tmp-dir\") pod \"89e406a8-c718-4961-939d-3d99fc3fff48\" (UID: \"89e406a8-c718-4961-939d-3d99fc3fff48\") "
Jul 21 01:28:04.807275 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:04.807114    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89e406a8-c718-4961-939d-3d99fc3fff48-dshm\") pod \"89e406a8-c718-4961-939d-3d99fc3fff48\" (UID: \"89e406a8-c718-4961-939d-3d99fc3fff48\") "
Jul 21 01:28:04.807275 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:04.807173    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dp5p5\" (UniqueName: \"kubernetes.io/projected/89e406a8-c718-4961-939d-3d99fc3fff48-kube-api-access-dp5p5\") pod \"89e406a8-c718-4961-939d-3d99fc3fff48\" (UID: \"89e406a8-c718-4961-939d-3d99fc3fff48\") "
Jul 21 01:28:04.807275 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:04.807224    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89e406a8-c718-4961-939d-3d99fc3fff48-model-cache\") pod \"89e406a8-c718-4961-939d-3d99fc3fff48\" (UID: \"89e406a8-c718-4961-939d-3d99fc3fff48\") "
Jul 21 01:28:04.807509 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:04.807306    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89e406a8-c718-4961-939d-3d99fc3fff48-tls-certs\") pod \"89e406a8-c718-4961-939d-3d99fc3fff48\" (UID: \"89e406a8-c718-4961-939d-3d99fc3fff48\") "
Jul 21 01:28:04.807509 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:04.807362    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89e406a8-c718-4961-939d-3d99fc3fff48-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "89e406a8-c718-4961-939d-3d99fc3fff48" (UID: "89e406a8-c718-4961-939d-3d99fc3fff48"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:28:04.807509 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:04.807379    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89e406a8-c718-4961-939d-3d99fc3fff48-home" (OuterVolumeSpecName: "home") pod "89e406a8-c718-4961-939d-3d99fc3fff48" (UID: "89e406a8-c718-4961-939d-3d99fc3fff48"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:28:04.807639 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:04.807586    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89e406a8-c718-4961-939d-3d99fc3fff48-home\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:28:04.807639 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:04.807608    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89e406a8-c718-4961-939d-3d99fc3fff48-tmp-dir\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:28:04.807639 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:04.807587    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89e406a8-c718-4961-939d-3d99fc3fff48-model-cache" (OuterVolumeSpecName: "model-cache") pod "89e406a8-c718-4961-939d-3d99fc3fff48" (UID: "89e406a8-c718-4961-939d-3d99fc3fff48"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:28:04.809462 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:04.809440    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89e406a8-c718-4961-939d-3d99fc3fff48-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "89e406a8-c718-4961-939d-3d99fc3fff48" (UID: "89e406a8-c718-4961-939d-3d99fc3fff48"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:28:04.809462 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:04.809447    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89e406a8-c718-4961-939d-3d99fc3fff48-kube-api-access-dp5p5" (OuterVolumeSpecName: "kube-api-access-dp5p5") pod "89e406a8-c718-4961-939d-3d99fc3fff48" (UID: "89e406a8-c718-4961-939d-3d99fc3fff48"). InnerVolumeSpecName "kube-api-access-dp5p5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:28:04.809580 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:04.809487    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89e406a8-c718-4961-939d-3d99fc3fff48-dshm" (OuterVolumeSpecName: "dshm") pod "89e406a8-c718-4961-939d-3d99fc3fff48" (UID: "89e406a8-c718-4961-939d-3d99fc3fff48"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:28:04.909024 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:04.908930    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89e406a8-c718-4961-939d-3d99fc3fff48-tls-certs\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:28:04.909024 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:04.908966    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89e406a8-c718-4961-939d-3d99fc3fff48-dshm\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:28:04.909024 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:04.908975    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dp5p5\" (UniqueName: \"kubernetes.io/projected/89e406a8-c718-4961-939d-3d99fc3fff48-kube-api-access-dp5p5\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:28:04.909024 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:04.908984    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89e406a8-c718-4961-939d-3d99fc3fff48-model-cache\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:28:05.548508 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:05.548475    2582 generic.go:356] "Generic (PLEG): container finished" podID="89e406a8-c718-4961-939d-3d99fc3fff48" containerID="3045ae4579bfbe92de4fc86bbf4cb97789162b1fba6fdebdfaf1e9aa9a521512" exitCode=0
Jul 21 01:28:05.549020 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:05.548517    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"
Jul 21 01:28:05.549020 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:05.548570    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt" event={"ID":"89e406a8-c718-4961-939d-3d99fc3fff48","Type":"ContainerDied","Data":"3045ae4579bfbe92de4fc86bbf4cb97789162b1fba6fdebdfaf1e9aa9a521512"}
Jul 21 01:28:05.549020 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:05.548619    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt" event={"ID":"89e406a8-c718-4961-939d-3d99fc3fff48","Type":"ContainerDied","Data":"8d6b1c44139386318cb92a9d42d706a8e1268d633b993fe74cf0a7045c81e9d0"}
Jul 21 01:28:05.549020 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:05.548644    2582 scope.go:117] "RemoveContainer" containerID="3045ae4579bfbe92de4fc86bbf4cb97789162b1fba6fdebdfaf1e9aa9a521512"
Jul 21 01:28:05.558638 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:05.558621    2582 scope.go:117] "RemoveContainer" containerID="3045ae4579bfbe92de4fc86bbf4cb97789162b1fba6fdebdfaf1e9aa9a521512"
Jul 21 01:28:05.558999 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:28:05.558974    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3045ae4579bfbe92de4fc86bbf4cb97789162b1fba6fdebdfaf1e9aa9a521512\": container with ID starting with 3045ae4579bfbe92de4fc86bbf4cb97789162b1fba6fdebdfaf1e9aa9a521512 not found: ID does not exist" containerID="3045ae4579bfbe92de4fc86bbf4cb97789162b1fba6fdebdfaf1e9aa9a521512"
Jul 21 01:28:05.559127 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:05.559004    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3045ae4579bfbe92de4fc86bbf4cb97789162b1fba6fdebdfaf1e9aa9a521512"} err="failed to get container status \"3045ae4579bfbe92de4fc86bbf4cb97789162b1fba6fdebdfaf1e9aa9a521512\": rpc error: code = NotFound desc = could not find container \"3045ae4579bfbe92de4fc86bbf4cb97789162b1fba6fdebdfaf1e9aa9a521512\": container with ID starting with 3045ae4579bfbe92de4fc86bbf4cb97789162b1fba6fdebdfaf1e9aa9a521512 not found: ID does not exist"
Jul 21 01:28:05.568542 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:05.568512    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"]
Jul 21 01:28:05.570765 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:05.570743    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-03c5cb/rate-test-model-03c5cb-kserve-74c7b5c9cf-zjdkt"]
Jul 21 01:28:05.633215 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:05.633177    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7496-140655676108064"]
Jul 21 01:28:05.633608 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:05.633595    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89e406a8-c718-4961-939d-3d99fc3fff48" containerName="main"
Jul 21 01:28:05.633671 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:05.633610    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="89e406a8-c718-4961-939d-3d99fc3fff48" containerName="main"
Jul 21 01:28:05.633671 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:05.633627    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95c15831-93d0-4047-9dbb-72193dc61464" containerName="main"
Jul 21 01:28:05.633671 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:05.633633    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="95c15831-93d0-4047-9dbb-72193dc61464" containerName="main"
Jul 21 01:28:05.633778 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:05.633745    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="95c15831-93d0-4047-9dbb-72193dc61464" containerName="main"
Jul 21 01:28:05.633778 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:05.633753    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="89e406a8-c718-4961-939d-3d99fc3fff48" containerName="main"
Jul 21 01:28:05.638193 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:05.638170    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7496-140655676108064"
Jul 21 01:28:05.639889 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:05.639862    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-h46kn\""
Jul 21 01:28:05.640694 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:05.640671    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7496-140655676108064"]
Jul 21 01:28:05.715189 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:05.715154    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6vfq\" (UniqueName: \"kubernetes.io/projected/e8e813dd-a3b4-48a8-ba23-647909c4f1fa-kube-api-access-p6vfq\") pod \"test-curl-7496-140655676108064\" (UID: \"e8e813dd-a3b4-48a8-ba23-647909c4f1fa\") " pod="opendatahub/test-curl-7496-140655676108064"
Jul 21 01:28:05.816581 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:05.816473    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6vfq\" (UniqueName: \"kubernetes.io/projected/e8e813dd-a3b4-48a8-ba23-647909c4f1fa-kube-api-access-p6vfq\") pod \"test-curl-7496-140655676108064\" (UID: \"e8e813dd-a3b4-48a8-ba23-647909c4f1fa\") " pod="opendatahub/test-curl-7496-140655676108064"
Jul 21 01:28:05.824143 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:05.824114    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6vfq\" (UniqueName: \"kubernetes.io/projected/e8e813dd-a3b4-48a8-ba23-647909c4f1fa-kube-api-access-p6vfq\") pod \"test-curl-7496-140655676108064\" (UID: \"e8e813dd-a3b4-48a8-ba23-647909c4f1fa\") " pod="opendatahub/test-curl-7496-140655676108064"
Jul 21 01:28:05.949176 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:05.949131    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7496-140655676108064"
Jul 21 01:28:06.292738 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:06.292707    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7496-140655676108064"]
Jul 21 01:28:06.295066 ip-10-0-133-75 kubenswrapper[2582]: W0721 01:28:06.295032    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8e813dd_a3b4_48a8_ba23_647909c4f1fa.slice/crio-e9ee7ea93a45c3475b8f8ed1d5dfe5e5d13cd008eb4ef10aa90b5e43ab68ea29 WatchSource:0}: Error finding container e9ee7ea93a45c3475b8f8ed1d5dfe5e5d13cd008eb4ef10aa90b5e43ab68ea29: Status 404 returned error can't find the container with id e9ee7ea93a45c3475b8f8ed1d5dfe5e5d13cd008eb4ef10aa90b5e43ab68ea29
Jul 21 01:28:06.296400 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:06.296378    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 01:28:06.345160 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:06.345128    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89e406a8-c718-4961-939d-3d99fc3fff48" path="/var/lib/kubelet/pods/89e406a8-c718-4961-939d-3d99fc3fff48/volumes"
Jul 21 01:28:06.556103 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:06.555965    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7496-140655676108064" event={"ID":"e8e813dd-a3b4-48a8-ba23-647909c4f1fa","Type":"ContainerStarted","Data":"e9ee7ea93a45c3475b8f8ed1d5dfe5e5d13cd008eb4ef10aa90b5e43ab68ea29"}
Jul 21 01:28:07.563458 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:07.563422    2582 generic.go:356] "Generic (PLEG): container finished" podID="e8e813dd-a3b4-48a8-ba23-647909c4f1fa" containerID="8d865f30b571844b20c4ceab71c7f085a4371bc09e107232ee6de807b00d3b9f" exitCode=0
Jul 21 01:28:07.563927 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:07.563513    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7496-140655676108064" event={"ID":"e8e813dd-a3b4-48a8-ba23-647909c4f1fa","Type":"ContainerDied","Data":"8d865f30b571844b20c4ceab71c7f085a4371bc09e107232ee6de807b00d3b9f"}
Jul 21 01:28:08.715674 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:08.715631    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7496-140655676108064"
Jul 21 01:28:08.753256 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:08.753212    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7496-140655676108064_e8e813dd-a3b4-48a8-ba23-647909c4f1fa/test-curl-7496-140655676108064/0.log"
Jul 21 01:28:08.782166 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:08.782127    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7496-140655676108064"]
Jul 21 01:28:08.785605 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:08.785575    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7496-140655676108064"]
Jul 21 01:28:08.843149 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:08.843041    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6vfq\" (UniqueName: \"kubernetes.io/projected/e8e813dd-a3b4-48a8-ba23-647909c4f1fa-kube-api-access-p6vfq\") pod \"e8e813dd-a3b4-48a8-ba23-647909c4f1fa\" (UID: \"e8e813dd-a3b4-48a8-ba23-647909c4f1fa\") "
Jul 21 01:28:08.845446 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:08.845417    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8e813dd-a3b4-48a8-ba23-647909c4f1fa-kube-api-access-p6vfq" (OuterVolumeSpecName: "kube-api-access-p6vfq") pod "e8e813dd-a3b4-48a8-ba23-647909c4f1fa" (UID: "e8e813dd-a3b4-48a8-ba23-647909c4f1fa"). InnerVolumeSpecName "kube-api-access-p6vfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:28:08.944287 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:08.944255    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6vfq\" (UniqueName: \"kubernetes.io/projected/e8e813dd-a3b4-48a8-ba23-647909c4f1fa-kube-api-access-p6vfq\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:28:09.576008 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:09.575978    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7496-140655676108064"
Jul 21 01:28:09.576008 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:09.576005    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9ee7ea93a45c3475b8f8ed1d5dfe5e5d13cd008eb4ef10aa90b5e43ab68ea29"
Jul 21 01:28:09.586194 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:28:09.586163    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7496-140655676108064\" is forbidden: User \"system:node:ip-10-0-133-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-75.ec2.internal' and this object" podUID="e8e813dd-a3b4-48a8-ba23-647909c4f1fa" pod="opendatahub/test-curl-7496-140655676108064"
Jul 21 01:28:10.344145 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:28:10.344101    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7496-140655676108064\" is forbidden: User \"system:node:ip-10-0-133-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-75.ec2.internal' and this object" podUID="e8e813dd-a3b4-48a8-ba23-647909c4f1fa" pod="opendatahub/test-curl-7496-140655676108064"
Jul 21 01:28:10.345582 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:10.345555    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8e813dd-a3b4-48a8-ba23-647909c4f1fa" path="/var/lib/kubelet/pods/e8e813dd-a3b4-48a8-ba23-647909c4f1fa/volumes"
Jul 21 01:28:19.375840 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:19.375807    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m"]
Jul 21 01:28:19.378236 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:19.376034    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m" podUID="74ccf282-ee16-43d0-b6ee-6059bc592f28" containerName="maas-api" containerID="cri-o://74786dc1e95af816d2b6485aaf1f6c02a4de35dcf432ca0dcedaf03fa4dd8e47" gracePeriod=30
Jul 21 01:28:19.829301 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:19.829271    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m"
Jul 21 01:28:19.954535 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:19.954502    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74ccf282-ee16-43d0-b6ee-6059bc592f28-openshift-service-ca\") pod \"74ccf282-ee16-43d0-b6ee-6059bc592f28\" (UID: \"74ccf282-ee16-43d0-b6ee-6059bc592f28\") "
Jul 21 01:28:19.954752 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:19.954573    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7jk4\" (UniqueName: \"kubernetes.io/projected/74ccf282-ee16-43d0-b6ee-6059bc592f28-kube-api-access-d7jk4\") pod \"74ccf282-ee16-43d0-b6ee-6059bc592f28\" (UID: \"74ccf282-ee16-43d0-b6ee-6059bc592f28\") "
Jul 21 01:28:19.954752 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:19.954711    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74ccf282-ee16-43d0-b6ee-6059bc592f28-maas-api-tls\") pod \"74ccf282-ee16-43d0-b6ee-6059bc592f28\" (UID: \"74ccf282-ee16-43d0-b6ee-6059bc592f28\") "
Jul 21 01:28:19.954941 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:19.954915    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74ccf282-ee16-43d0-b6ee-6059bc592f28-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "74ccf282-ee16-43d0-b6ee-6059bc592f28" (UID: "74ccf282-ee16-43d0-b6ee-6059bc592f28"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:28:19.956906 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:19.956880    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74ccf282-ee16-43d0-b6ee-6059bc592f28-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "74ccf282-ee16-43d0-b6ee-6059bc592f28" (UID: "74ccf282-ee16-43d0-b6ee-6059bc592f28"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:28:19.957010 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:19.956927    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74ccf282-ee16-43d0-b6ee-6059bc592f28-kube-api-access-d7jk4" (OuterVolumeSpecName: "kube-api-access-d7jk4") pod "74ccf282-ee16-43d0-b6ee-6059bc592f28" (UID: "74ccf282-ee16-43d0-b6ee-6059bc592f28"). InnerVolumeSpecName "kube-api-access-d7jk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:28:20.055731 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:20.055696    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74ccf282-ee16-43d0-b6ee-6059bc592f28-maas-api-tls\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:28:20.055731 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:20.055729    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74ccf282-ee16-43d0-b6ee-6059bc592f28-openshift-service-ca\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:28:20.055731 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:20.055740    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7jk4\" (UniqueName: \"kubernetes.io/projected/74ccf282-ee16-43d0-b6ee-6059bc592f28-kube-api-access-d7jk4\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:28:20.639238 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:20.639139    2582 generic.go:356] "Generic (PLEG): container finished" podID="74ccf282-ee16-43d0-b6ee-6059bc592f28" containerID="74786dc1e95af816d2b6485aaf1f6c02a4de35dcf432ca0dcedaf03fa4dd8e47" exitCode=0
Jul 21 01:28:20.639238 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:20.639208    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m" event={"ID":"74ccf282-ee16-43d0-b6ee-6059bc592f28","Type":"ContainerDied","Data":"74786dc1e95af816d2b6485aaf1f6c02a4de35dcf432ca0dcedaf03fa4dd8e47"}
Jul 21 01:28:20.639238 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:20.639214    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m"
Jul 21 01:28:20.639861 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:20.639278    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m" event={"ID":"74ccf282-ee16-43d0-b6ee-6059bc592f28","Type":"ContainerDied","Data":"8c3323d91b5d42a1135ea6f607248410d7403198d84c36f68b12a3ad7ac28dc6"}
Jul 21 01:28:20.639861 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:20.639300    2582 scope.go:117] "RemoveContainer" containerID="74786dc1e95af816d2b6485aaf1f6c02a4de35dcf432ca0dcedaf03fa4dd8e47"
Jul 21 01:28:20.648546 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:20.648525    2582 scope.go:117] "RemoveContainer" containerID="74786dc1e95af816d2b6485aaf1f6c02a4de35dcf432ca0dcedaf03fa4dd8e47"
Jul 21 01:28:20.648955 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:28:20.648933    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74786dc1e95af816d2b6485aaf1f6c02a4de35dcf432ca0dcedaf03fa4dd8e47\": container with ID starting with 74786dc1e95af816d2b6485aaf1f6c02a4de35dcf432ca0dcedaf03fa4dd8e47 not found: ID does not exist" containerID="74786dc1e95af816d2b6485aaf1f6c02a4de35dcf432ca0dcedaf03fa4dd8e47"
Jul 21 01:28:20.649037 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:20.648963    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74786dc1e95af816d2b6485aaf1f6c02a4de35dcf432ca0dcedaf03fa4dd8e47"} err="failed to get container status \"74786dc1e95af816d2b6485aaf1f6c02a4de35dcf432ca0dcedaf03fa4dd8e47\": rpc error: code = NotFound desc = could not find container \"74786dc1e95af816d2b6485aaf1f6c02a4de35dcf432ca0dcedaf03fa4dd8e47\": container with ID starting with 74786dc1e95af816d2b6485aaf1f6c02a4de35dcf432ca0dcedaf03fa4dd8e47 not found: ID does not exist"
Jul 21 01:28:20.654520 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:20.654493    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m"]
Jul 21 01:28:20.660069 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:20.660043    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a7997d-7cc98887c6-dn45m"]
Jul 21 01:28:22.195902 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:22.195865    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:28:22.344991 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:22.344953    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74ccf282-ee16-43d0-b6ee-6059bc592f28" path="/var/lib/kubelet/pods/74ccf282-ee16-43d0-b6ee-6059bc592f28/volumes"
Jul 21 01:28:42.029777 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:42.029740    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr"]
Jul 21 01:28:42.030364 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:42.030009    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr" podUID="22eb6228-e341-47a4-8417-4907c1397033" containerName="maas-api" containerID="cri-o://9695fea0b805e0e10127687ccd7fd3b3e3f56f642ed8d1a9748891fbfc21dab8" gracePeriod=30
Jul 21 01:28:42.486833 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:42.486806    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr"
Jul 21 01:28:42.560927 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:42.560882    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22eb6228-e341-47a4-8417-4907c1397033-openshift-service-ca\") pod \"22eb6228-e341-47a4-8417-4907c1397033\" (UID: \"22eb6228-e341-47a4-8417-4907c1397033\") "
Jul 21 01:28:42.561148 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:42.560950    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55chp\" (UniqueName: \"kubernetes.io/projected/22eb6228-e341-47a4-8417-4907c1397033-kube-api-access-55chp\") pod \"22eb6228-e341-47a4-8417-4907c1397033\" (UID: \"22eb6228-e341-47a4-8417-4907c1397033\") "
Jul 21 01:28:42.561148 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:42.560976    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22eb6228-e341-47a4-8417-4907c1397033-maas-api-tls\") pod \"22eb6228-e341-47a4-8417-4907c1397033\" (UID: \"22eb6228-e341-47a4-8417-4907c1397033\") "
Jul 21 01:28:42.561391 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:42.561333    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22eb6228-e341-47a4-8417-4907c1397033-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "22eb6228-e341-47a4-8417-4907c1397033" (UID: "22eb6228-e341-47a4-8417-4907c1397033"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:28:42.563203 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:42.563168    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22eb6228-e341-47a4-8417-4907c1397033-kube-api-access-55chp" (OuterVolumeSpecName: "kube-api-access-55chp") pod "22eb6228-e341-47a4-8417-4907c1397033" (UID: "22eb6228-e341-47a4-8417-4907c1397033"). InnerVolumeSpecName "kube-api-access-55chp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:28:42.563203 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:42.563179    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22eb6228-e341-47a4-8417-4907c1397033-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "22eb6228-e341-47a4-8417-4907c1397033" (UID: "22eb6228-e341-47a4-8417-4907c1397033"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:28:42.662021 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:42.661988    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55chp\" (UniqueName: \"kubernetes.io/projected/22eb6228-e341-47a4-8417-4907c1397033-kube-api-access-55chp\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:28:42.662021 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:42.662016    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22eb6228-e341-47a4-8417-4907c1397033-maas-api-tls\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:28:42.662021 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:42.662027    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22eb6228-e341-47a4-8417-4907c1397033-openshift-service-ca\") on node \"ip-10-0-133-75.ec2.internal\" DevicePath \"\""
Jul 21 01:28:42.768005 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:42.767968    2582 generic.go:356] "Generic (PLEG): container finished" podID="22eb6228-e341-47a4-8417-4907c1397033" containerID="9695fea0b805e0e10127687ccd7fd3b3e3f56f642ed8d1a9748891fbfc21dab8" exitCode=0
Jul 21 01:28:42.768005 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:42.768007    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr" event={"ID":"22eb6228-e341-47a4-8417-4907c1397033","Type":"ContainerDied","Data":"9695fea0b805e0e10127687ccd7fd3b3e3f56f642ed8d1a9748891fbfc21dab8"}
Jul 21 01:28:42.768276 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:42.768022    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr"
Jul 21 01:28:42.768276 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:42.768050    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr" event={"ID":"22eb6228-e341-47a4-8417-4907c1397033","Type":"ContainerDied","Data":"413f61f61eb58d7756aacbd86faf81b985733ba426fc29b3768d0fe051976268"}
Jul 21 01:28:42.768276 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:42.768072    2582 scope.go:117] "RemoveContainer" containerID="9695fea0b805e0e10127687ccd7fd3b3e3f56f642ed8d1a9748891fbfc21dab8"
Jul 21 01:28:42.777442 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:42.777420    2582 scope.go:117] "RemoveContainer" containerID="9695fea0b805e0e10127687ccd7fd3b3e3f56f642ed8d1a9748891fbfc21dab8"
Jul 21 01:28:42.777775 ip-10-0-133-75 kubenswrapper[2582]: E0721 01:28:42.777754    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9695fea0b805e0e10127687ccd7fd3b3e3f56f642ed8d1a9748891fbfc21dab8\": container with ID starting with 9695fea0b805e0e10127687ccd7fd3b3e3f56f642ed8d1a9748891fbfc21dab8 not found: ID does not exist" containerID="9695fea0b805e0e10127687ccd7fd3b3e3f56f642ed8d1a9748891fbfc21dab8"
Jul 21 01:28:42.777847 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:42.777785    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9695fea0b805e0e10127687ccd7fd3b3e3f56f642ed8d1a9748891fbfc21dab8"} err="failed to get container status \"9695fea0b805e0e10127687ccd7fd3b3e3f56f642ed8d1a9748891fbfc21dab8\": rpc error: code = NotFound desc = could not find container \"9695fea0b805e0e10127687ccd7fd3b3e3f56f642ed8d1a9748891fbfc21dab8\": container with ID starting with 9695fea0b805e0e10127687ccd7fd3b3e3f56f642ed8d1a9748891fbfc21dab8 not found: ID does not exist"
Jul 21 01:28:42.788727 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:42.788696    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr"]
Jul 21 01:28:42.794030 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:42.794004    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-03c5cb-d69556bbb-465dr"]
Jul 21 01:28:44.346703 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:44.346668    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22eb6228-e341-47a4-8417-4907c1397033" path="/var/lib/kubelet/pods/22eb6228-e341-47a4-8417-4907c1397033/volumes"
Jul 21 01:28:44.707588 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:44.707550    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xmfbr"]
Jul 21 01:28:59.904138 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:59.904108    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f889c5d8-plgrn_af57b7ae-99ca-422b-95f5-d7093d336210/copy-manifests/0.log"
Jul 21 01:28:59.912762 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:28:59.912724    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f889c5d8-plgrn_af57b7ae-99ca-422b-95f5-d7093d336210/manager/0.log"
Jul 21 01:29:01.706362 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:01.706289    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7_52966269-46ec-4e0a-97f7-c1a86b1150df/util/0.log"
Jul 21 01:29:01.714388 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:01.714352    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7_52966269-46ec-4e0a-97f7-c1a86b1150df/pull/0.log"
Jul 21 01:29:01.721506 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:01.721480    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7_52966269-46ec-4e0a-97f7-c1a86b1150df/extract/0.log"
Jul 21 01:29:01.843894 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:01.843866    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2_2f440cbf-b6c6-45e8-875b-2941a5ac4926/util/0.log"
Jul 21 01:29:01.851126 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:01.851099    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2_2f440cbf-b6c6-45e8-875b-2941a5ac4926/pull/0.log"
Jul 21 01:29:01.858332 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:01.858306    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2_2f440cbf-b6c6-45e8-875b-2941a5ac4926/extract/0.log"
Jul 21 01:29:01.978388 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:01.978305    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz_57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c/util/0.log"
Jul 21 01:29:01.986216 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:01.986048    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz_57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c/pull/0.log"
Jul 21 01:29:01.993287 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:01.993256    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz_57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c/extract/0.log"
Jul 21 01:29:02.111757 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:02.111722    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7_36726fd8-5232-4b41-8c78-8b62e388c70b/util/0.log"
Jul 21 01:29:02.119512 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:02.119489    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7_36726fd8-5232-4b41-8c78-8b62e388c70b/pull/0.log"
Jul 21 01:29:02.126546 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:02.126487    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7_36726fd8-5232-4b41-8c78-8b62e388c70b/extract/0.log"
Jul 21 01:29:02.673324 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:02.673295    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-99jj6_f9657560-a5a3-4847-89d0-986f199507b7/kuadrant-console-plugin/0.log"
Jul 21 01:29:03.065679 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:03.065624    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-xmfbr_ced3e099-5ce1-49b1-961a-c55ffc861ca0/limitador/0.log"
Jul 21 01:29:03.922581 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:03.922548    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c7494f749-z626n_71da8102-aeb1-4acc-a5d7-ed346dc8eecc/kube-auth-proxy/0.log"
Jul 21 01:29:05.195559 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:05.195528    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzsxwv_fce3ed18-961a-414f-8ac9-23dabf3e9f73/main/0.log"
Jul 21 01:29:05.432163 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:05.432131    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-j6qbz_ca28beb9-b9b1-44f6-929d-afc104e4ff9d/main/0.log"
Jul 21 01:29:11.170140 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:11.170101    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6qs98/must-gather-tvlrj"]
Jul 21 01:29:11.170613 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:11.170481    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e813dd-a3b4-48a8-ba23-647909c4f1fa" containerName="test-curl-7496-140655676108064"
Jul 21 01:29:11.170613 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:11.170492    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e813dd-a3b4-48a8-ba23-647909c4f1fa" containerName="test-curl-7496-140655676108064"
Jul 21 01:29:11.170613 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:11.170502    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74ccf282-ee16-43d0-b6ee-6059bc592f28" containerName="maas-api"
Jul 21 01:29:11.170613 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:11.170508    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="74ccf282-ee16-43d0-b6ee-6059bc592f28" containerName="maas-api"
Jul 21 01:29:11.170613 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:11.170524    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22eb6228-e341-47a4-8417-4907c1397033" containerName="maas-api"
Jul 21 01:29:11.170613 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:11.170530    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="22eb6228-e341-47a4-8417-4907c1397033" containerName="maas-api"
Jul 21 01:29:11.170613 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:11.170600    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8e813dd-a3b4-48a8-ba23-647909c4f1fa" containerName="test-curl-7496-140655676108064"
Jul 21 01:29:11.170613 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:11.170609    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="74ccf282-ee16-43d0-b6ee-6059bc592f28" containerName="maas-api"
Jul 21 01:29:11.170613 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:11.170615    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="22eb6228-e341-47a4-8417-4907c1397033" containerName="maas-api"
Jul 21 01:29:11.175328 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:11.175305    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6qs98/must-gather-tvlrj"
Jul 21 01:29:11.177366 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:11.177345    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6qs98\"/\"kube-root-ca.crt\""
Jul 21 01:29:11.177699 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:11.177681    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6qs98\"/\"openshift-service-ca.crt\""
Jul 21 01:29:11.177803 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:11.177709    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6qs98\"/\"default-dockercfg-78gjl\""
Jul 21 01:29:11.184091 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:11.184061    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6qs98/must-gather-tvlrj"]
Jul 21 01:29:11.334376 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:11.334338    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cf2n\" (UniqueName: \"kubernetes.io/projected/883cf26a-9bcd-4c4d-8e96-9132a6245c97-kube-api-access-6cf2n\") pod \"must-gather-tvlrj\" (UID: \"883cf26a-9bcd-4c4d-8e96-9132a6245c97\") " pod="openshift-must-gather-6qs98/must-gather-tvlrj"
Jul 21 01:29:11.334583 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:11.334399    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/883cf26a-9bcd-4c4d-8e96-9132a6245c97-must-gather-output\") pod \"must-gather-tvlrj\" (UID: \"883cf26a-9bcd-4c4d-8e96-9132a6245c97\") " pod="openshift-must-gather-6qs98/must-gather-tvlrj"
Jul 21 01:29:11.435422 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:11.435385    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/883cf26a-9bcd-4c4d-8e96-9132a6245c97-must-gather-output\") pod \"must-gather-tvlrj\" (UID: \"883cf26a-9bcd-4c4d-8e96-9132a6245c97\") " pod="openshift-must-gather-6qs98/must-gather-tvlrj"
Jul 21 01:29:11.435592 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:11.435523    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cf2n\" (UniqueName: \"kubernetes.io/projected/883cf26a-9bcd-4c4d-8e96-9132a6245c97-kube-api-access-6cf2n\") pod \"must-gather-tvlrj\" (UID: \"883cf26a-9bcd-4c4d-8e96-9132a6245c97\") " pod="openshift-must-gather-6qs98/must-gather-tvlrj"
Jul 21 01:29:11.435802 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:11.435786    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/883cf26a-9bcd-4c4d-8e96-9132a6245c97-must-gather-output\") pod \"must-gather-tvlrj\" (UID: \"883cf26a-9bcd-4c4d-8e96-9132a6245c97\") " pod="openshift-must-gather-6qs98/must-gather-tvlrj"
Jul 21 01:29:11.446619 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:11.446583    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cf2n\" (UniqueName: \"kubernetes.io/projected/883cf26a-9bcd-4c4d-8e96-9132a6245c97-kube-api-access-6cf2n\") pod \"must-gather-tvlrj\" (UID: \"883cf26a-9bcd-4c4d-8e96-9132a6245c97\") " pod="openshift-must-gather-6qs98/must-gather-tvlrj"
Jul 21 01:29:11.486811 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:11.486761    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6qs98/must-gather-tvlrj"
Jul 21 01:29:11.631495 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:11.631463    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6qs98/must-gather-tvlrj"]
Jul 21 01:29:11.633117 ip-10-0-133-75 kubenswrapper[2582]: W0721 01:29:11.633085    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod883cf26a_9bcd_4c4d_8e96_9132a6245c97.slice/crio-edb0c8ec6324c8d847e93674d2e121caf0c82d67634a70244eb080ddefe895ad WatchSource:0}: Error finding container edb0c8ec6324c8d847e93674d2e121caf0c82d67634a70244eb080ddefe895ad: Status 404 returned error can't find the container with id edb0c8ec6324c8d847e93674d2e121caf0c82d67634a70244eb080ddefe895ad
Jul 21 01:29:11.929209 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:11.929165    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6qs98/must-gather-tvlrj" event={"ID":"883cf26a-9bcd-4c4d-8e96-9132a6245c97","Type":"ContainerStarted","Data":"edb0c8ec6324c8d847e93674d2e121caf0c82d67634a70244eb080ddefe895ad"}
Jul 21 01:29:12.938024 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:12.937980    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6qs98/must-gather-tvlrj" event={"ID":"883cf26a-9bcd-4c4d-8e96-9132a6245c97","Type":"ContainerStarted","Data":"04f0c7c64ff407e6b83d942c6c0eab9795cebf107a607be81b523cb5a153f918"}
Jul 21 01:29:12.938428 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:12.938038    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6qs98/must-gather-tvlrj" event={"ID":"883cf26a-9bcd-4c4d-8e96-9132a6245c97","Type":"ContainerStarted","Data":"9b88920d0d18f8eb02170a3867422e324ca8d62564905146cdf5b6fcb8ddb538"}
Jul 21 01:29:12.956009 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:12.955822    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6qs98/must-gather-tvlrj" podStartSLOduration=0.896115408 podStartE2EDuration="1.95580018s" totalImagesPullingTime="1.059684772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:29:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:29:12.955083648 +0000 UTC m=+2883.254780065" watchObservedRunningTime="2026-07-21 01:29:12.95580018 +0000 UTC m=+2883.255496585"
Jul 21 01:29:14.709607 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:14.709555    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-88txv_0da7e607-7001-47f1-a96d-1c366f2dd3ef/global-pull-secret-syncer/0.log"
Jul 21 01:29:14.928399 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:14.928359    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wkprw_136a9e74-4da5-4788-a64b-0d9db3001160/konnectivity-agent/0.log"
Jul 21 01:29:15.026398 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:15.026304    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-75.ec2.internal_8a511dbb64386472f7853b93500b3424/haproxy/0.log"
Jul 21 01:29:19.418201 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:19.418169    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7_52966269-46ec-4e0a-97f7-c1a86b1150df/extract/0.log"
Jul 21 01:29:19.444733 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:19.444699    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7_52966269-46ec-4e0a-97f7-c1a86b1150df/util/0.log"
Jul 21 01:29:19.477298 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:19.477260    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759brsz7_52966269-46ec-4e0a-97f7-c1a86b1150df/pull/0.log"
Jul 21 01:29:19.527391 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:19.527350    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2_2f440cbf-b6c6-45e8-875b-2941a5ac4926/extract/0.log"
Jul 21 01:29:19.555695 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:19.555642    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2_2f440cbf-b6c6-45e8-875b-2941a5ac4926/util/0.log"
Jul 21 01:29:19.635964 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:19.635855    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2q2_2f440cbf-b6c6-45e8-875b-2941a5ac4926/pull/0.log"
Jul 21 01:29:19.704392 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:19.704336    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz_57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c/extract/0.log"
Jul 21 01:29:19.727928 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:19.727738    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz_57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c/util/0.log"
Jul 21 01:29:19.752010 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:19.751930    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lr4wz_57a6b6b1-aee9-4de5-b3e9-19a26ac94a5c/pull/0.log"
Jul 21 01:29:19.784424 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:19.784383    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7_36726fd8-5232-4b41-8c78-8b62e388c70b/extract/0.log"
Jul 21 01:29:19.811609 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:19.811538    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7_36726fd8-5232-4b41-8c78-8b62e388c70b/util/0.log"
Jul 21 01:29:19.842233 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:19.842204    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cpfg7_36726fd8-5232-4b41-8c78-8b62e388c70b/pull/0.log"
Jul 21 01:29:20.265567 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:20.265528    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-99jj6_f9657560-a5a3-4847-89d0-986f199507b7/kuadrant-console-plugin/0.log"
Jul 21 01:29:20.510261 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:20.510227    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-xmfbr_ced3e099-5ce1-49b1-961a-c55ffc861ca0/limitador/0.log"
Jul 21 01:29:22.296164 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:22.296136    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce50dda1-c329-4f02-8f20-6342ea1a7166/alertmanager/0.log"
Jul 21 01:29:22.319881 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:22.319833    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce50dda1-c329-4f02-8f20-6342ea1a7166/config-reloader/0.log"
Jul 21 01:29:22.350199 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:22.350166    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce50dda1-c329-4f02-8f20-6342ea1a7166/kube-rbac-proxy-web/0.log"
Jul 21 01:29:22.372945 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:22.372893    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce50dda1-c329-4f02-8f20-6342ea1a7166/kube-rbac-proxy/0.log"
Jul 21 01:29:22.397064 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:22.397025    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce50dda1-c329-4f02-8f20-6342ea1a7166/kube-rbac-proxy-metric/0.log"
Jul 21 01:29:22.424468 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:22.424435    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce50dda1-c329-4f02-8f20-6342ea1a7166/prom-label-proxy/0.log"
Jul 21 01:29:22.450240 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:22.450206    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce50dda1-c329-4f02-8f20-6342ea1a7166/init-config-reloader/0.log"
Jul 21 01:29:22.517504 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:22.517471    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-nshfn_19b12008-5ee1-4251-aaba-d2cf00362411/kube-state-metrics/0.log"
Jul 21 01:29:22.539315 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:22.539266    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-nshfn_19b12008-5ee1-4251-aaba-d2cf00362411/kube-rbac-proxy-main/0.log"
Jul 21 01:29:22.565002 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:22.564919    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-nshfn_19b12008-5ee1-4251-aaba-d2cf00362411/kube-rbac-proxy-self/0.log"
Jul 21 01:29:22.593727 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:22.593700    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5fc6dbfbbd-g747b_53897821-6243-42d3-9d9e-1b513e27014b/metrics-server/0.log"
Jul 21 01:29:22.622020 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:22.621987    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-hnbzd_a1ee52cf-b0d5-4fa2-84c6-6af6bac0f744/monitoring-plugin/0.log"
Jul 21 01:29:22.655711 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:22.655678    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-88j8d_0ae3c48a-e489-4afa-b528-d07d86532b1f/node-exporter/0.log"
Jul 21 01:29:22.680601 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:22.680574    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-88j8d_0ae3c48a-e489-4afa-b528-d07d86532b1f/kube-rbac-proxy/0.log"
Jul 21 01:29:22.704065 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:22.704034    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-88j8d_0ae3c48a-e489-4afa-b528-d07d86532b1f/init-textfile/0.log"
Jul 21 01:29:22.890718 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:22.890607    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-8wlxd_70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9/kube-rbac-proxy-main/0.log"
Jul 21 01:29:22.925149 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:22.925121    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-8wlxd_70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9/kube-rbac-proxy-self/0.log"
Jul 21 01:29:22.949625 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:22.949560    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-8wlxd_70dcbe7a-e7f6-4cca-bd7a-76cb3952b6d9/openshift-state-metrics/0.log"
Jul 21 01:29:23.194413 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:23.194375    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-jj7ps_88507101-e972-4a54-bc6a-0642ae5c1003/prometheus-operator/0.log"
Jul 21 01:29:23.217322 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:23.217291    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-jj7ps_88507101-e972-4a54-bc6a-0642ae5c1003/kube-rbac-proxy/0.log"
Jul 21 01:29:23.245103 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:23.245039    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-hkdzr_a4fff145-f10a-4e7c-a564-5f825d1dbf71/prometheus-operator-admission-webhook/0.log"
Jul 21 01:29:23.275025 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:23.274991    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-597466cf78-5l86g_2fac5109-abae-41dc-bc11-68795a57382c/telemeter-client/0.log"
Jul 21 01:29:23.299065 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:23.299034    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-597466cf78-5l86g_2fac5109-abae-41dc-bc11-68795a57382c/reload/0.log"
Jul 21 01:29:23.322841 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:23.322804    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-597466cf78-5l86g_2fac5109-abae-41dc-bc11-68795a57382c/kube-rbac-proxy/0.log"
Jul 21 01:29:23.352724 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:23.352682    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c8d7f6846-z8q8r_42ee621e-ff7e-4769-bc10-bda1a7e574e4/thanos-query/0.log"
Jul 21 01:29:23.375548 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:23.375521    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c8d7f6846-z8q8r_42ee621e-ff7e-4769-bc10-bda1a7e574e4/kube-rbac-proxy-web/0.log"
Jul 21 01:29:23.398706 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:23.398676    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c8d7f6846-z8q8r_42ee621e-ff7e-4769-bc10-bda1a7e574e4/kube-rbac-proxy/0.log"
Jul 21 01:29:23.429473 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:23.429444    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c8d7f6846-z8q8r_42ee621e-ff7e-4769-bc10-bda1a7e574e4/prom-label-proxy/0.log"
Jul 21 01:29:23.454288 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:23.454258    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c8d7f6846-z8q8r_42ee621e-ff7e-4769-bc10-bda1a7e574e4/kube-rbac-proxy-rules/0.log"
Jul 21 01:29:23.478594 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:23.478563    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c8d7f6846-z8q8r_42ee621e-ff7e-4769-bc10-bda1a7e574e4/kube-rbac-proxy-metrics/0.log"
Jul 21 01:29:24.697866 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:24.697825    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6qs98/perf-node-gather-daemonset-msds2"]
Jul 21 01:29:24.708605 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:24.708564    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6qs98/perf-node-gather-daemonset-msds2"]
Jul 21 01:29:24.708828 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:24.708726    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-msds2"
Jul 21 01:29:24.785717 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:24.785680    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9-proc\") pod \"perf-node-gather-daemonset-msds2\" (UID: \"2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-msds2"
Jul 21 01:29:24.786075 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:24.786046    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9-podres\") pod \"perf-node-gather-daemonset-msds2\" (UID: \"2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-msds2"
Jul 21 01:29:24.786237 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:24.786220    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9-lib-modules\") pod \"perf-node-gather-daemonset-msds2\" (UID: \"2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-msds2"
Jul 21 01:29:24.786479 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:24.786463    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9-sys\") pod \"perf-node-gather-daemonset-msds2\" (UID: \"2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-msds2"
Jul 21 01:29:24.786563 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:24.786522    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j2cf\" (UniqueName: \"kubernetes.io/projected/2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9-kube-api-access-7j2cf\") pod \"perf-node-gather-daemonset-msds2\" (UID: \"2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-msds2"
Jul 21 01:29:24.887449 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:24.887408    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9-proc\") pod \"perf-node-gather-daemonset-msds2\" (UID: \"2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-msds2"
Jul 21 01:29:24.887674 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:24.887475    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9-podres\") pod \"perf-node-gather-daemonset-msds2\" (UID: \"2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-msds2"
Jul 21 01:29:24.887674 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:24.887507    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9-lib-modules\") pod \"perf-node-gather-daemonset-msds2\" (UID: \"2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-msds2"
Jul 21 01:29:24.887674 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:24.887518    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9-proc\") pod \"perf-node-gather-daemonset-msds2\" (UID: \"2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-msds2"
Jul 21 01:29:24.887674 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:24.887622    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9-sys\") pod \"perf-node-gather-daemonset-msds2\" (UID: \"2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-msds2"
Jul 21 01:29:24.887674 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:24.887667    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9-lib-modules\") pod \"perf-node-gather-daemonset-msds2\" (UID: \"2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-msds2"
Jul 21 01:29:24.887674 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:24.887671    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j2cf\" (UniqueName: \"kubernetes.io/projected/2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9-kube-api-access-7j2cf\") pod \"perf-node-gather-daemonset-msds2\" (UID: \"2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-msds2"
Jul 21 01:29:24.887972 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:24.887677    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9-podres\") pod \"perf-node-gather-daemonset-msds2\" (UID: \"2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-msds2"
Jul 21 01:29:24.887972 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:24.887857    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9-sys\") pod \"perf-node-gather-daemonset-msds2\" (UID: \"2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-msds2"
Jul 21 01:29:24.895559 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:24.895522    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j2cf\" (UniqueName: \"kubernetes.io/projected/2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9-kube-api-access-7j2cf\") pod \"perf-node-gather-daemonset-msds2\" (UID: \"2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-msds2"
Jul 21 01:29:25.024199 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:25.024106    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-msds2"
Jul 21 01:29:25.237297 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:25.237245    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6qs98/perf-node-gather-daemonset-msds2"]
Jul 21 01:29:25.242320 ip-10-0-133-75 kubenswrapper[2582]: W0721 01:29:25.242292    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2fa7f72e_2d0f_42f6_92d0_a4bd7b093ef9.slice/crio-aa19de260bf8cf8ba7fae14aa1a4d1ef5a9489e505c6c9d23b30df69d633b4b5 WatchSource:0}: Error finding container aa19de260bf8cf8ba7fae14aa1a4d1ef5a9489e505c6c9d23b30df69d633b4b5: Status 404 returned error can't find the container with id aa19de260bf8cf8ba7fae14aa1a4d1ef5a9489e505c6c9d23b30df69d633b4b5
Jul 21 01:29:25.875517 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:25.875475    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-644d7647f4-zw8nw_23adb4b9-0acb-4d5f-a606-a1e25c56e337/console/0.log"
Jul 21 01:29:26.053319 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:26.053276    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-msds2" event={"ID":"2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9","Type":"ContainerStarted","Data":"df436d5972f02adffe30f3d11f3df85da6644584a07bc698a00e35a6be50ba7b"}
Jul 21 01:29:26.053539 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:26.053349    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-msds2" event={"ID":"2fa7f72e-2d0f-42f6-92d0-a4bd7b093ef9","Type":"ContainerStarted","Data":"aa19de260bf8cf8ba7fae14aa1a4d1ef5a9489e505c6c9d23b30df69d633b4b5"}
Jul 21 01:29:26.053539 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:26.053397    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-msds2"
Jul 21 01:29:26.071756 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:26.071685    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-msds2" podStartSLOduration=2.071665036 podStartE2EDuration="2.071665036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:29:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:29:26.068937186 +0000 UTC m=+2896.368633604" watchObservedRunningTime="2026-07-21 01:29:26.071665036 +0000 UTC m=+2896.371361450"
Jul 21 01:29:27.532004 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:27.531978    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mrz6p_f8410a2b-748e-4495-b67d-e7782149b0ad/dns/0.log"
Jul 21 01:29:27.554193 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:27.554132    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mrz6p_f8410a2b-748e-4495-b67d-e7782149b0ad/kube-rbac-proxy/0.log"
Jul 21 01:29:27.726933 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:27.726909    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9tbvx_f94d1cc3-b8ae-45e5-a26e-e1207b41fab1/dns-node-resolver/0.log"
Jul 21 01:29:28.369952 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:28.369913    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x9vfr_0ba67891-af9c-4a91-a956-bff562695d4c/node-ca/0.log"
Jul 21 01:29:29.451093 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:29.451065    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c7494f749-z626n_71da8102-aeb1-4acc-a5d7-ed346dc8eecc/kube-auth-proxy/0.log"
Jul 21 01:29:30.334388 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:30.334358    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sznsc_b99cf4a0-3a18-4ac3-966e-ae98d24b50d5/serve-healthcheck-canary/0.log"
Jul 21 01:29:30.979844 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:30.979809    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tfh26_12a92fbc-402e-4a05-88ff-ab3b48da8fed/kube-rbac-proxy/0.log"
Jul 21 01:29:31.002604 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:31.002559    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tfh26_12a92fbc-402e-4a05-88ff-ab3b48da8fed/exporter/0.log"
Jul 21 01:29:31.026731 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:31.026696    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tfh26_12a92fbc-402e-4a05-88ff-ab3b48da8fed/extractor/0.log"
Jul 21 01:29:32.074276 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:32.074245    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-msds2"
Jul 21 01:29:33.577726 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:33.577689    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f889c5d8-plgrn_af57b7ae-99ca-422b-95f5-d7093d336210/manager/0.log"
Jul 21 01:29:33.600484 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:33.600387    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f889c5d8-plgrn_af57b7ae-99ca-422b-95f5-d7093d336210/copy-manifests/0.log"
Jul 21 01:29:35.202800 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:35.202751    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-656b686d8c-2t69n_820d3ed3-5dea-4176-b41e-aeb1a9b47f69/manager/0.log"
Jul 21 01:29:35.257043 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:35.257014    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-tcwpb_2475b781-6569-461a-ae48-3973d95fe19c/openshift-lws-operator/0.log"
Jul 21 01:29:36.272438 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:36.272409    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c7494f749-z626n_71da8102-aeb1-4acc-a5d7-ed346dc8eecc/kube-auth-proxy/0.log"
Jul 21 01:29:37.744280 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:37.744247    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c7494f749-z626n_71da8102-aeb1-4acc-a5d7-ed346dc8eecc/kube-auth-proxy/0.log"
Jul 21 01:29:41.765051 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:41.765012    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2n82r_14433a10-65ef-416b-9284-e38ae76b9f6a/kube-multus/0.log"
Jul 21 01:29:42.119613 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:42.119538    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kfclp_9da83bc3-8b2d-4191-ad4f-3070cf84d2ac/kube-multus-additional-cni-plugins/0.log"
Jul 21 01:29:42.141568 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:42.141540    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kfclp_9da83bc3-8b2d-4191-ad4f-3070cf84d2ac/egress-router-binary-copy/0.log"
Jul 21 01:29:42.163484 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:42.163438    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kfclp_9da83bc3-8b2d-4191-ad4f-3070cf84d2ac/cni-plugins/0.log"
Jul 21 01:29:42.184915 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:42.184888    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kfclp_9da83bc3-8b2d-4191-ad4f-3070cf84d2ac/bond-cni-plugin/0.log"
Jul 21 01:29:42.206449 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:42.206421    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kfclp_9da83bc3-8b2d-4191-ad4f-3070cf84d2ac/routeoverride-cni/0.log"
Jul 21 01:29:42.227721 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:42.227644    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kfclp_9da83bc3-8b2d-4191-ad4f-3070cf84d2ac/whereabouts-cni-bincopy/0.log"
Jul 21 01:29:42.251475 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:42.251449    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kfclp_9da83bc3-8b2d-4191-ad4f-3070cf84d2ac/whereabouts-cni/0.log"
Jul 21 01:29:42.433485 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:42.433447    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bhkcc_d61aa2f7-0359-4f25-b575-dd995021228e/network-metrics-daemon/0.log"
Jul 21 01:29:42.453031 ip-10-0-133-75 kubenswrapper[2582]: I0721 01:29:42.452999    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bhkcc_d61aa2f7-0359-4f25-b575-dd995021228e/kube-rbac-proxy/0.log"