Jul 09 22:32:25.189172 ip-10-0-142-84 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 22:32:25.600270 ip-10-0-142-84 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 22:32:25.600270 ip-10-0-142-84 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 22:32:25.600270 ip-10-0-142-84 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 22:32:25.600270 ip-10-0-142-84 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 22:32:25.600270 ip-10-0-142-84 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 22:32:25.601406 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.601297    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 22:32:25.608188 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608174    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 22:32:25.608188 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608188    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 22:32:25.608250 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608192    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 22:32:25.608250 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608195    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 22:32:25.608250 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608197    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 22:32:25.608250 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608200    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 22:32:25.608250 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608202    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 22:32:25.608250 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608205    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 22:32:25.608250 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608211    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 22:32:25.608250 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608215    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 22:32:25.608250 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608219    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 22:32:25.608250 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608221    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 22:32:25.608250 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608238    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 22:32:25.608250 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608242    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 22:32:25.608250 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608244    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 22:32:25.608250 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608247    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 22:32:25.608250 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608249    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 22:32:25.608250 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608252    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 22:32:25.608250 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608255    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 22:32:25.608250 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608258    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 22:32:25.608668 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608261    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 22:32:25.608668 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608264    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 22:32:25.608668 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608267    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 22:32:25.608668 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608269    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 22:32:25.608668 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608272    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 22:32:25.608668 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608274    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 22:32:25.608668 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608277    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 22:32:25.608668 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608279    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 22:32:25.608668 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608282    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 22:32:25.608668 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608285    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 22:32:25.608668 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608288    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 22:32:25.608668 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608291    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 22:32:25.608668 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608294    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 22:32:25.608668 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608296    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 22:32:25.608668 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608299    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 22:32:25.608668 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608301    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 22:32:25.608668 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608304    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 22:32:25.608668 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608306    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 22:32:25.608668 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608308    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 22:32:25.609179 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608311    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 22:32:25.609179 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608313    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 22:32:25.609179 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608316    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 22:32:25.609179 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608318    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 22:32:25.609179 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608320    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 22:32:25.609179 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608323    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 22:32:25.609179 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608331    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 22:32:25.609179 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608333    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 22:32:25.609179 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608335    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 22:32:25.609179 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608338    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 22:32:25.609179 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608340    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 22:32:25.609179 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608343    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 22:32:25.609179 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608345    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 22:32:25.609179 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608347    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 22:32:25.609179 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608351    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 22:32:25.609179 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608354    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 22:32:25.609179 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608356    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 22:32:25.609179 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608359    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 22:32:25.609179 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608361    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 22:32:25.609179 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608364    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 22:32:25.609941 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608366    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 22:32:25.609941 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608369    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 22:32:25.609941 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608371    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 22:32:25.609941 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608374    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 22:32:25.609941 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608376    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 22:32:25.609941 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608379    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 22:32:25.609941 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608381    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 22:32:25.609941 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608384    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 22:32:25.609941 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608386    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 22:32:25.609941 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608388    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 22:32:25.609941 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608391    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 22:32:25.609941 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608394    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 22:32:25.609941 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608397    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 22:32:25.609941 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608399    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 22:32:25.609941 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608402    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 22:32:25.609941 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608404    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 22:32:25.609941 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608407    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 22:32:25.609941 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608409    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 22:32:25.609941 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608411    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 22:32:25.609941 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608419    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 22:32:25.610590 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608423    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 22:32:25.610590 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608427    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 22:32:25.610590 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608429    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 22:32:25.610590 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608432    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 22:32:25.610590 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608435    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 22:32:25.610590 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608439    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 22:32:25.610590 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608443    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 22:32:25.610590 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608446    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 22:32:25.610590 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608449    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 22:32:25.610590 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608452    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 22:32:25.610590 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608454    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 22:32:25.610590 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608457    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 22:32:25.610590 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608460    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 22:32:25.610590 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608462    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 22:32:25.610590 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608465    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 22:32:25.610590 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608468    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 22:32:25.610590 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608472    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 22:32:25.610590 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608475    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 22:32:25.610590 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608478    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 22:32:25.611408 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.608480    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 22:32:25.611408 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610806    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 22:32:25.611408 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610827    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 22:32:25.611408 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610833    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 22:32:25.611408 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610838    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 22:32:25.611408 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610843    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 22:32:25.611408 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610847    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 22:32:25.611408 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610852    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 22:32:25.611408 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610856    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 22:32:25.611408 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610860    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 22:32:25.611408 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610865    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 22:32:25.611408 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610888    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 22:32:25.611408 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610892    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 22:32:25.611408 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610897    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 22:32:25.611408 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610901    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 22:32:25.611408 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610905    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 22:32:25.611408 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610909    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 22:32:25.611408 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610913    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 22:32:25.611408 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610917    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 22:32:25.611408 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610921    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 22:32:25.612360 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610925    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 22:32:25.612360 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610929    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 22:32:25.612360 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610933    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 22:32:25.612360 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610938    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 22:32:25.612360 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610941    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 22:32:25.612360 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610946    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 22:32:25.612360 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610950    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 22:32:25.612360 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610954    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 22:32:25.612360 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610958    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 22:32:25.612360 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610962    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 22:32:25.612360 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610966    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 22:32:25.612360 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610970    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 22:32:25.612360 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610982    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 22:32:25.612360 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.610997    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 22:32:25.612360 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611003    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 22:32:25.612360 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611008    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 22:32:25.612360 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611012    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 22:32:25.612360 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611017    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 22:32:25.612360 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611022    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 22:32:25.612360 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611026    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 22:32:25.613234 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611030    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 22:32:25.613234 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611034    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 22:32:25.613234 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611038    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 22:32:25.613234 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611043    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 22:32:25.613234 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611047    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 22:32:25.613234 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611051    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 22:32:25.613234 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611055    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 22:32:25.613234 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611060    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 22:32:25.613234 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611064    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 22:32:25.613234 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611068    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 22:32:25.613234 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611075    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 22:32:25.613234 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611079    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 22:32:25.613234 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611083    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 22:32:25.613234 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611088    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 22:32:25.613234 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611099    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 22:32:25.613234 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611104    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 22:32:25.613234 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611109    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 22:32:25.613234 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611113    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 22:32:25.613234 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611117    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 22:32:25.613234 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611122    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 22:32:25.614112 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611126    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 22:32:25.614112 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611130    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 22:32:25.614112 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611134    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 22:32:25.614112 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611138    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 22:32:25.614112 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611144    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 22:32:25.614112 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611148    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 22:32:25.614112 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611153    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 22:32:25.614112 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611158    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 22:32:25.614112 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611162    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 22:32:25.614112 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611167    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 22:32:25.614112 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611171    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 22:32:25.614112 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611178    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 22:32:25.614112 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611183    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 22:32:25.614112 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611189    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 22:32:25.614112 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611194    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 22:32:25.614112 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611198    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 22:32:25.614112 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611204    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 22:32:25.614112 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611209    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 22:32:25.614112 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611214    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 22:32:25.614573 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611218    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 22:32:25.614573 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611222    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 22:32:25.614573 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611227    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 22:32:25.614573 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611233    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 22:32:25.614573 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611237    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 22:32:25.614573 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611251    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 22:32:25.614573 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611255    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 22:32:25.614573 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611259    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 22:32:25.614573 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611264    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 22:32:25.614573 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611268    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 22:32:25.614573 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611272    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 22:32:25.614573 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611277    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 22:32:25.614573 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611281    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 22:32:25.614573 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611287    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 22:32:25.614573 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611293    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 22:32:25.614573 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611297    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 22:32:25.614573 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611302    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 22:32:25.614573 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611306    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 22:32:25.614573 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611310    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 22:32:25.615137 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611314    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 22:32:25.615137 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611319    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 22:32:25.615137 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611954    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 22:32:25.615137 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611965    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 22:32:25.615137 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611970    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 22:32:25.615137 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611974    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 22:32:25.615137 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611978    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 22:32:25.615137 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611982    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 22:32:25.615137 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611987    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 22:32:25.615137 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611991    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 22:32:25.615137 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611995    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 22:32:25.615137 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.611999    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 22:32:25.615137 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612003    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 22:32:25.615137 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612008    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 22:32:25.615137 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612012    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 22:32:25.615137 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612016    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 22:32:25.615137 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612021    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 22:32:25.615137 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612025    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 22:32:25.615137 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612038    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 22:32:25.615593 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612042    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 22:32:25.615593 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612046    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 22:32:25.615593 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612051    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 22:32:25.615593 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612057    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 22:32:25.615593 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612061    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 22:32:25.615593 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612066    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 22:32:25.615593 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612070    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 22:32:25.615593 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612074    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 22:32:25.615593 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612078    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 22:32:25.615593 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612083    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 22:32:25.615593 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612087    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 22:32:25.615593 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612091    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 22:32:25.615593 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612095    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 22:32:25.615593 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612099    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 22:32:25.615593 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612103    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 22:32:25.615593 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612108    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 22:32:25.615593 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612112    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 22:32:25.615593 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612116    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 22:32:25.615593 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612120    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 22:32:25.616284 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612128    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 22:32:25.616284 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612134    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 22:32:25.616284 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612138    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 22:32:25.616284 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612143    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 22:32:25.616284 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612147    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 22:32:25.616284 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612152    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 22:32:25.616284 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612157    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 22:32:25.616284 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612162    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 22:32:25.616284 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612166    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 22:32:25.616284 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612171    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 22:32:25.616284 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612175    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 22:32:25.616284 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612182    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 22:32:25.616284 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612188    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 22:32:25.616284 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612205    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 22:32:25.616284 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612209    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 22:32:25.616284 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612214    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 22:32:25.616284 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612220    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 22:32:25.616284 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612224    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 22:32:25.616284 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612228    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 22:32:25.616832 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612234    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 22:32:25.616832 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612240    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 22:32:25.616832 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612244    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 22:32:25.616832 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612249    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 22:32:25.616832 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612255    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 22:32:25.616832 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612259    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 22:32:25.616832 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612264    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 22:32:25.616832 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612269    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 22:32:25.616832 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612273    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 22:32:25.616832 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612278    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 22:32:25.616832 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612283    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 22:32:25.616832 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612288    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 22:32:25.616832 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612292    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 22:32:25.616832 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612296    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 22:32:25.616832 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612301    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 22:32:25.616832 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612305    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 22:32:25.616832 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612310    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 22:32:25.616832 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612314    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 22:32:25.616832 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612318    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 22:32:25.616832 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612322    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 22:32:25.617335 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612326    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 22:32:25.617335 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612330    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 22:32:25.617335 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612335    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 22:32:25.617335 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612339    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 22:32:25.617335 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612343    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 22:32:25.617335 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612347    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 22:32:25.617335 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612351    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 22:32:25.617335 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612365    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 22:32:25.617335 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612369    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 22:32:25.617335 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612375    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 22:32:25.617335 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612379    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 22:32:25.617335 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612383    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 22:32:25.617335 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612387    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 22:32:25.617335 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612391    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 22:32:25.617335 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612395    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 22:32:25.617335 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612400    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 22:32:25.617335 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612404    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 22:32:25.617335 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612408    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 22:32:25.617335 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612412    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 22:32:25.617335 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612417    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 22:32:25.617937 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612421    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 22:32:25.617937 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612425    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 22:32:25.617937 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612430    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 22:32:25.617937 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.612433    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 22:32:25.617937 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612526    2564 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 22:32:25.617937 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612537    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 22:32:25.617937 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612549    2564 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 22:32:25.617937 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612556    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 22:32:25.617937 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612563    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 22:32:25.617937 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612568    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 22:32:25.617937 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612580    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 22:32:25.617937 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612587    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 22:32:25.617937 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612592    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 22:32:25.617937 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612597    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 22:32:25.617937 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612602    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 22:32:25.617937 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612608    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 22:32:25.617937 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612613    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 22:32:25.617937 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612617    2564 flags.go:64] FLAG: --cgroup-root=""
Jul 09 22:32:25.617937 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612622    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 22:32:25.617937 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612626    2564 flags.go:64] FLAG: --client-ca-file=""
Jul 09 22:32:25.617937 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612639    2564 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 22:32:25.617937 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612645    2564 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 22:32:25.617937 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612655    2564 flags.go:64] FLAG: --cluster-domain=""
Jul 09 22:32:25.617937 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612660    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 22:32:25.618552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612665    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 22:32:25.618552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612669    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 22:32:25.618552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612675    2564 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 22:32:25.618552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612684    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 22:32:25.618552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612689    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 22:32:25.618552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612694    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 22:32:25.618552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612699    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 22:32:25.618552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612703    2564 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 22:32:25.618552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612708    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 22:32:25.618552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612713    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 22:32:25.618552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612717    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 22:32:25.618552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612722    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 22:32:25.618552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612728    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 22:32:25.618552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612732    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 22:32:25.618552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612737    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 22:32:25.618552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612742    2564 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 22:32:25.618552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612746    2564 flags.go:64] FLAG: --enable-server="true"
Jul 09 22:32:25.618552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612751    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 22:32:25.618552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612763    2564 flags.go:64] FLAG: --event-burst="100"
Jul 09 22:32:25.618552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612768    2564 flags.go:64] FLAG: --event-qps="50"
Jul 09 22:32:25.618552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612772    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 22:32:25.618552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612777    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 22:32:25.618552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612784    2564 flags.go:64] FLAG: --eviction-hard=""
Jul 09 22:32:25.618552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612790    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 22:32:25.619169 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612795    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 22:32:25.619169 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612799    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 22:32:25.619169 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612804    2564 flags.go:64] FLAG: --eviction-soft=""
Jul 09 22:32:25.619169 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612808    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 22:32:25.619169 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612813    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 22:32:25.619169 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612826    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 22:32:25.619169 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612832    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 22:32:25.619169 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612836    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 22:32:25.619169 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612841    2564 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 22:32:25.619169 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612845    2564 flags.go:64] FLAG: --feature-gates=""
Jul 09 22:32:25.619169 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612851    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 22:32:25.619169 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612856    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 22:32:25.619169 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612861    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 22:32:25.619169 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612882    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 22:32:25.619169 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612888    2564 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 22:32:25.619169 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612893    2564 flags.go:64] FLAG: --help="false"
Jul 09 22:32:25.619169 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612897    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-142-84.ec2.internal"
Jul 09 22:32:25.619169 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612902    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 22:32:25.619169 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612907    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 22:32:25.619169 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612911    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 22:32:25.619169 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612917    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 22:32:25.619169 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612923    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 22:32:25.619169 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612927    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 22:32:25.619169 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612932    2564 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 22:32:25.619759 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612937    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 22:32:25.619759 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612942    2564 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 22:32:25.619759 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612946    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 22:32:25.619759 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612951    2564 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 22:32:25.619759 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612956    2564 flags.go:64] FLAG: --kube-reserved=""
Jul 09 22:32:25.619759 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612961    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 22:32:25.619759 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612967    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 22:32:25.619759 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612973    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 22:32:25.619759 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612977    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 22:32:25.619759 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612982    2564 flags.go:64] FLAG: --lock-file=""
Jul 09 22:32:25.619759 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612987    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 22:32:25.619759 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612991    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 22:32:25.619759 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.612996    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 22:32:25.619759 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613005    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 22:32:25.619759 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613017    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 22:32:25.619759 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613022    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 22:32:25.619759 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613027    2564 flags.go:64] FLAG: --logging-format="text"
Jul 09 22:32:25.619759 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613031    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 22:32:25.619759 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613037    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 22:32:25.619759 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613041    2564 flags.go:64] FLAG: --manifest-url=""
Jul 09 22:32:25.619759 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613046    2564 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 22:32:25.619759 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613053    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 22:32:25.619759 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613058    2564 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 22:32:25.619759 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613064    2564 flags.go:64] FLAG: --max-pods="110"
Jul 09 22:32:25.619759 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613069    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 22:32:25.620423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613073    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 22:32:25.620423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613078    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 22:32:25.620423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613083    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 22:32:25.620423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613088    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 22:32:25.620423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613093    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 22:32:25.620423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613097    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 22:32:25.620423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613108    2564 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 22:32:25.620423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613113    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 22:32:25.620423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613118    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 22:32:25.620423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613122    2564 flags.go:64] FLAG: --pod-cidr=""
Jul 09 22:32:25.620423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613127    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 09 22:32:25.620423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613136    2564 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 22:32:25.620423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613140    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 22:32:25.620423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613146    2564 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 22:32:25.620423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613152    2564 flags.go:64] FLAG: --port="10250"
Jul 09 22:32:25.620423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613157    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 22:32:25.620423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613162    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b30c65ecb5012743"
Jul 09 22:32:25.620423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613167    2564 flags.go:64] FLAG: --qos-reserved=""
Jul 09 22:32:25.620423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613172    2564 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 22:32:25.620423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613177    2564 flags.go:64] FLAG: --register-node="true"
Jul 09 22:32:25.620423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613181    2564 flags.go:64] FLAG: --register-with-taints=""
Jul 09 22:32:25.620423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613187    2564 flags.go:64] FLAG: --registry-burst="10"
Jul 09 22:32:25.620423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613200    2564 flags.go:64] FLAG: --registry-qps="5"
Jul 09 22:32:25.620423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613205    2564 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 22:32:25.621132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613210    2564 flags.go:64] FLAG: --reserved-memory=""
Jul 09 22:32:25.621132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613216    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 22:32:25.621132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613221    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 22:32:25.621132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613226    2564 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 22:32:25.621132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613230    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 22:32:25.621132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613234    2564 flags.go:64] FLAG: --runonce="false"
Jul 09 22:32:25.621132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613239    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 22:32:25.621132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613243    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 22:32:25.621132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613247    2564 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 22:32:25.621132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613252    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 22:32:25.621132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613256    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 22:32:25.621132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613261    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 22:32:25.621132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613265    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 22:32:25.621132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613270    2564 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 22:32:25.621132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613275    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 22:32:25.621132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613279    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 22:32:25.621132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613284    2564 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 22:32:25.621132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613288    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 22:32:25.621132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613293    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 22:32:25.621132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613298    2564 flags.go:64] FLAG: --system-cgroups=""
Jul 09 22:32:25.621132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613302    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 22:32:25.621132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613311    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 22:32:25.621132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613318    2564 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 22:32:25.621132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613323    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 22:32:25.621132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613332    2564 flags.go:64] FLAG: --tls-min-version=""
Jul 09 22:32:25.621780 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613336    2564 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 22:32:25.621780 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613341    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 22:32:25.621780 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613345    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 22:32:25.621780 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613352    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 22:32:25.621780 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613357    2564 flags.go:64] FLAG: --v="2"
Jul 09 22:32:25.621780 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613363    2564 flags.go:64] FLAG: --version="false"
Jul 09 22:32:25.621780 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613370    2564 flags.go:64] FLAG: --vmodule=""
Jul 09 22:32:25.621780 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613376    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 22:32:25.621780 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.613382    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 22:32:25.621780 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613561    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 22:32:25.621780 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613568    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 22:32:25.621780 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613573    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 22:32:25.621780 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613578    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 22:32:25.621780 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613582    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 22:32:25.621780 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613587    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 22:32:25.621780 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613591    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 22:32:25.621780 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613595    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 22:32:25.621780 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613599    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 22:32:25.621780 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613603    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 22:32:25.621780 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613607    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 22:32:25.621780 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613612    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 22:32:25.621780 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613616    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 22:32:25.622339 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613620    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 22:32:25.622339 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613625    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 22:32:25.622339 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613629    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 22:32:25.622339 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613633    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 22:32:25.622339 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613637    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 22:32:25.622339 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613641    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 22:32:25.622339 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613645    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 22:32:25.622339 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613651    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 22:32:25.622339 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613655    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 22:32:25.622339 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613659    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 22:32:25.622339 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613663    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 22:32:25.622339 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613668    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 22:32:25.622339 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613672    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 22:32:25.622339 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613678    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 22:32:25.622339 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613682    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 22:32:25.622339 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613686    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 22:32:25.622339 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613690    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 22:32:25.622339 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613695    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 22:32:25.622339 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613700    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 22:32:25.622339 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613704    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 22:32:25.622845 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613709    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 22:32:25.622845 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613713    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 22:32:25.622845 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613717    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 22:32:25.622845 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613721    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 22:32:25.622845 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613725    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 22:32:25.622845 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613729    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 22:32:25.622845 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613733    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 22:32:25.622845 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613737    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 22:32:25.622845 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613741    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 22:32:25.622845 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613747    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 22:32:25.622845 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613751    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 22:32:25.622845 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613755    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 22:32:25.622845 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613759    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 22:32:25.622845 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613763    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 22:32:25.622845 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613770    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 22:32:25.622845 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613776    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 22:32:25.622845 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613780    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 22:32:25.622845 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613784    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 22:32:25.622845 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613788    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 22:32:25.623327 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613795    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 22:32:25.623327 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613799    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 22:32:25.623327 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613803    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 22:32:25.623327 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613807    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 22:32:25.623327 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613811    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 22:32:25.623327 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613815    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 22:32:25.623327 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613821    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 22:32:25.623327 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613825    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 22:32:25.623327 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613829    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 22:32:25.623327 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613833    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 22:32:25.623327 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613837    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 22:32:25.623327 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613843    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 22:32:25.623327 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613847    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 22:32:25.623327 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613853    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 22:32:25.623327 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613859    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 22:32:25.623327 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613863    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 22:32:25.623327 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613883    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 22:32:25.623327 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613888    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 22:32:25.623327 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613894    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 22:32:25.623799 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613898    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 22:32:25.623799 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613903    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 22:32:25.623799 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613907    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 22:32:25.623799 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613912    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 22:32:25.623799 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613916    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 22:32:25.623799 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613921    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 22:32:25.623799 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613925    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 22:32:25.623799 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613929    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 22:32:25.623799 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613933    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 22:32:25.623799 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613937    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 22:32:25.623799 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613941    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 22:32:25.623799 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613945    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 22:32:25.623799 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613949    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 22:32:25.623799 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613955    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 22:32:25.623799 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613959    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 22:32:25.623799 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613964    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 22:32:25.623799 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613968    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 22:32:25.623799 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613972    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 22:32:25.623799 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613976    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 22:32:25.624334 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613983    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 22:32:25.624334 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613987    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 22:32:25.624334 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613991    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 22:32:25.624334 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.613996    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 22:32:25.624334 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.614000    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 22:32:25.624334 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.614004    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 22:32:25.624334 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.614009    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 22:32:25.624334 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.614014    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 22:32:25.624334 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.614018    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 22:32:25.624334 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.614801    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 22:32:25.624334 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.622497    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 09 22:32:25.624334 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.622511    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 22:32:25.624334 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.623334    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 22:32:25.624334 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.623345    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 22:32:25.624334 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623400    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 22:32:25.624701 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623405    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 22:32:25.624701 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623408    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 22:32:25.624701 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623411    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 22:32:25.624701 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623415    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 22:32:25.624701 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623418    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 22:32:25.624701 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623420    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 22:32:25.624701 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623423    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 22:32:25.624701 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623426    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 22:32:25.624701 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623428    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 22:32:25.624701 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623431    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 22:32:25.624701 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623434    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 22:32:25.624701 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623436    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 22:32:25.624701 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623439    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 22:32:25.624701 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623442    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 22:32:25.624701 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623444    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 22:32:25.624701 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623447    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 22:32:25.624701 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623449    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 22:32:25.624701 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623452    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 22:32:25.624701 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623454    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 22:32:25.624701 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623457    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 22:32:25.625204 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623460    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 22:32:25.625204 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623462    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 22:32:25.625204 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623465    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 22:32:25.625204 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623468    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 22:32:25.625204 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623470    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 22:32:25.625204 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623473    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 22:32:25.625204 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623475    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 22:32:25.625204 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623480    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 22:32:25.625204 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623484    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 22:32:25.625204 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623488    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 22:32:25.625204 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623491    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 22:32:25.625204 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623493    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 22:32:25.625204 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623496    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 22:32:25.625204 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623498    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 22:32:25.625204 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623501    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 22:32:25.625204 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623504    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 22:32:25.625204 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623506    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 22:32:25.625204 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623509    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 22:32:25.625204 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623511    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 22:32:25.625204 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623513    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 22:32:25.625697 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623516    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 22:32:25.625697 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623519    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 22:32:25.625697 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623521    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 22:32:25.625697 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623525    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 22:32:25.625697 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623529    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 22:32:25.625697 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623532    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 22:32:25.625697 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623534    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 22:32:25.625697 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623537    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 22:32:25.625697 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623541    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 22:32:25.625697 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623545    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 22:32:25.625697 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623548    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 22:32:25.625697 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623550    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 22:32:25.625697 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623553    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 22:32:25.625697 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623556    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 22:32:25.625697 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623558    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 22:32:25.625697 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623561    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 22:32:25.625697 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623564    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 22:32:25.625697 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623567    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 22:32:25.626143 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623570    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 22:32:25.626143 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623573    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 22:32:25.626143 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623576    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 22:32:25.626143 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623584    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 22:32:25.626143 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623587    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 22:32:25.626143 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623590    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 22:32:25.626143 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623593    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 22:32:25.626143 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623595    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 22:32:25.626143 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623598    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 22:32:25.626143 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623601    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 22:32:25.626143 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623603    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 22:32:25.626143 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623606    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 22:32:25.626143 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623608    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 22:32:25.626143 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623611    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 22:32:25.626143 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623614    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 22:32:25.626143 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623616    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 22:32:25.626143 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623619    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 22:32:25.626143 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623622    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 22:32:25.626143 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623624    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 22:32:25.626143 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623627    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 22:32:25.626638 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623629    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 22:32:25.626638 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623633    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 22:32:25.626638 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623635    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 22:32:25.626638 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623638    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 22:32:25.626638 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623641    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 22:32:25.626638 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623643    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 22:32:25.626638 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623646    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 22:32:25.626638 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623649    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 22:32:25.626638 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623651    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 22:32:25.626638 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623654    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 22:32:25.626638 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623656    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 22:32:25.626638 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623659    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 22:32:25.626638 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623662    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 22:32:25.626638 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623665    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 22:32:25.626638 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623668    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 22:32:25.626638 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623670    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 22:32:25.626638 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623674    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 22:32:25.626638 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623677    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 22:32:25.626638 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623679    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 22:32:25.626638 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623682    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 22:32:25.627155 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.623687    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 22:32:25.627155 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623798    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 22:32:25.627155 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623803    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 22:32:25.627155 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623807    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 22:32:25.627155 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623810    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 22:32:25.627155 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623812    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 22:32:25.627155 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623815    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 22:32:25.627155 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623818    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 22:32:25.627155 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623820    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 22:32:25.627155 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623823    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 22:32:25.627155 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623826    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 22:32:25.627155 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623828    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 22:32:25.627155 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623831    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 22:32:25.627155 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623833    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 22:32:25.627155 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623836    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 22:32:25.627543 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623839    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 22:32:25.627543 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623841    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 22:32:25.627543 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623843    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 22:32:25.627543 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623846    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 22:32:25.627543 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623848    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 22:32:25.627543 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623851    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 22:32:25.627543 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623853    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 22:32:25.627543 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623856    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 22:32:25.627543 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623858    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 22:32:25.627543 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623861    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 22:32:25.627543 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623864    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 22:32:25.627543 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623879    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 22:32:25.627543 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623882    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 22:32:25.627543 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623885    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 22:32:25.627543 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623888    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 22:32:25.627543 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623891    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 22:32:25.627543 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623893    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 22:32:25.627543 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623896    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 22:32:25.627543 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623899    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 22:32:25.627543 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623901    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 22:32:25.628041 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623904    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 22:32:25.628041 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623906    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 22:32:25.628041 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623909    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 22:32:25.628041 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623912    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 22:32:25.628041 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623914    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 22:32:25.628041 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623917    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 22:32:25.628041 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623921    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 22:32:25.628041 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623924    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 22:32:25.628041 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623927    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 22:32:25.628041 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623930    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 22:32:25.628041 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623933    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 22:32:25.628041 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623935    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 22:32:25.628041 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623938    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 22:32:25.628041 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623941    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 22:32:25.628041 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623943    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 22:32:25.628041 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623946    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 22:32:25.628041 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623948    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 22:32:25.628041 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623950    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 22:32:25.628041 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623953    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 22:32:25.628495 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623956    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 22:32:25.628495 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623958    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 22:32:25.628495 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623961    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 22:32:25.628495 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623964    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 22:32:25.628495 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623967    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 22:32:25.628495 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623969    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 22:32:25.628495 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623972    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 22:32:25.628495 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623975    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 22:32:25.628495 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623978    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 22:32:25.628495 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623981    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 22:32:25.628495 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623983    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 22:32:25.628495 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623986    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 22:32:25.628495 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623989    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 22:32:25.628495 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623991    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 22:32:25.628495 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623994    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 22:32:25.628495 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.623998    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 22:32:25.628495 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624001    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 22:32:25.628495 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624003    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 22:32:25.628495 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624006    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 22:32:25.629045 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624009    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 22:32:25.629045 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624011    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 22:32:25.629045 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624014    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 22:32:25.629045 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624016    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 22:32:25.629045 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624019    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 22:32:25.629045 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624021    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 22:32:25.629045 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624024    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 22:32:25.629045 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624026    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 22:32:25.629045 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624029    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 22:32:25.629045 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624031    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 22:32:25.629045 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624034    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 22:32:25.629045 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624036    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 22:32:25.629045 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624039    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 22:32:25.629045 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624041    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 22:32:25.629045 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624045    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 22:32:25.629045 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624048    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 22:32:25.629045 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624051    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 22:32:25.629045 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624055    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 22:32:25.629045 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624057    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 22:32:25.629045 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624060    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 22:32:25.629538 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624063    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 22:32:25.629538 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624066    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 22:32:25.629538 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624069    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 22:32:25.629538 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624071    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 22:32:25.629538 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624074    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 22:32:25.629538 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624076    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 22:32:25.629538 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:25.624079    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 22:32:25.629538 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.624084    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 22:32:25.629538 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.624189    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 22:32:25.629538 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.626661    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 22:32:25.629538 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.628483    2564 server.go:1019] "Starting client certificate rotation"
Jul 09 22:32:25.629538 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.628581    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 22:32:25.629538 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.628615    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 22:32:25.631193 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.631180    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 22:32:25.637416 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.637397    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 22:32:25.645210 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.645189    2564 log.go:25] "Validated CRI v1 runtime API"
Jul 09 22:32:25.647669 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.647655    2564 log.go:25] "Validated CRI v1 image API"
Jul 09 22:32:25.648451 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.648436    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 22:32:25.652404 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.652385    2564 fs.go:135] Filesystem UUIDs: map[016262e6-16e8-4fea-9e72-b106e74b5baf:/dev/nvme0n1p4 7401bf68-9ed9-45ef-ae1a-17057623a506:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 09 22:32:25.652469 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.652402    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 22:32:25.658405 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.658295    2564 manager.go:216] Machine: {Timestamp:2026-07-09 22:32:25.656928118 +0000 UTC m=+0.364823695 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105638 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec253a73ca1ed1d7070e2ce5c8e0f239 SystemUUID:ec253a73-ca1e-d1d7-070e-2ce5c8e0f239 BootID:b2b28b70-5239-446d-8463-f750b3f7f4bf Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fe:aa:98:60:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fe:aa:98:60:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:8f:04:12:8c:0e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 22:32:25.658405 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.658398    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 22:32:25.658507 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.658475    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 22:32:25.662039 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.662000    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 22:32:25.662176 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.662041    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-84.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 22:32:25.662814 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.662805    2564 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 22:32:25.662846 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.662817    2564 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 22:32:25.662846 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.662824    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 22:32:25.663450 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.663439    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 22:32:25.664731 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.664714    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 22:32:25.665356 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.665346    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 22:32:25.670727 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.670715    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 22:32:25.670883 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.670863    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 22:32:25.670927 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.670906    2564 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 22:32:25.670927 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.670924    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 22:32:25.670989 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.670934    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 22:32:25.670989 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.670943    2564 kubelet.go:398] "Adding apiserver pod source"
Jul 09 22:32:25.670989 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.670952    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 22:32:25.671279 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.671268    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 22:32:25.671309 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.671289    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 22:32:25.673688 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.673672    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 09 22:32:25.676079 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.676065    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 22:32:25.676132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.676096    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 22:32:25.677559 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.677541    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 22:32:25.677646 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.677571    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 22:32:25.677646 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.677583    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 22:32:25.677646 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.677594    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 22:32:25.677646 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.677611    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 22:32:25.677646 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.677643    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 22:32:25.677798 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.677660    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 22:32:25.677798 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.677670    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 22:32:25.677798 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.677684    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 22:32:25.677798 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.677695    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 22:32:25.677798 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.677725    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 22:32:25.677798 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.677736    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 22:32:25.678693 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.678681    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 22:32:25.678693 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.678692    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 22:32:25.681995 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.681982    2564 server.go:1268] "Started kubelet"
Jul 09 22:32:25.682068 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.682035    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 22:32:25.682797 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.682730    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 22:32:25.682905 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.682822    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 22:32:25.686415 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.686387    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-84.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 22:32:25.686513 ip-10-0-142-84 systemd[1]: Started Kubernetes Kubelet.
Jul 09 22:32:25.688100 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.688087    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 22:32:25.688232 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:25.687144    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 22:32:25.688295 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:25.688148    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-84.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 22:32:25.688295 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:25.687316    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 22:32:25.691312 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.691298    2564 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 22:32:25.697795 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.697777    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 22:32:25.697795 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.697790    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 22:32:25.697941 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:25.697908    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-84.ec2.internal\" not found"
Jul 09 22:32:25.698500 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.698486    2564 factory.go:55] Registering systemd factory
Jul 09 22:32:25.698500 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.698500    2564 factory.go:223] Registration of the systemd container factory successfully
Jul 09 22:32:25.698714 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.698704    2564 factory.go:153] Registering CRI-O factory
Jul 09 22:32:25.698714 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.698713    2564 factory.go:223] Registration of the crio container factory successfully
Jul 09 22:32:25.698827 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:25.697575    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-84.ec2.internal.18c0bfce68d94dce  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-84.ec2.internal,UID:ip-10-0-142-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-84.ec2.internal,},FirstTimestamp:2026-07-09 22:32:25.681956302 +0000 UTC m=+0.389851879,LastTimestamp:2026-07-09 22:32:25.681956302 +0000 UTC m=+0.389851879,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-84.ec2.internal,}"
Jul 09 22:32:25.698827 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.698756    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 22:32:25.698827 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.698775    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 22:32:25.698827 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.698776    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 22:32:25.698827 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.698798    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 22:32:25.699067 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.698781    2564 factory.go:103] Registering Raw factory
Jul 09 22:32:25.699067 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.698889    2564 manager.go:1196] Started watching for new ooms in manager
Jul 09 22:32:25.699067 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.698935    2564 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 22:32:25.699067 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.698945    2564 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 22:32:25.699478 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.699463    2564 manager.go:349] Starting recovery of all containers
Jul 09 22:32:25.708838 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:25.708805    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-84.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 09 22:32:25.708950 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:25.708849    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 09 22:32:25.710708 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.710690    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m45lk"
Jul 09 22:32:25.713522 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.713415    2564 manager.go:354] Recovery completed
Jul 09 22:32:25.716025 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.716006    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m45lk"
Jul 09 22:32:25.718066 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.718052    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:32:25.720059 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.720042    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:32:25.720145 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.720069    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:32:25.720145 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.720079    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:32:25.720611 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.720591    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 22:32:25.720611 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.720606    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:32:25.720717 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.720607    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 22:32:25.720717 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.720679    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 22:32:25.721613 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.721594    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:32:25.721697 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.721633    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:32:25.721697 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.721662    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:32:25.722785 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.722765    2564 policy_none.go:49] "None policy: Start"
Jul 09 22:32:25.722857 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.722806    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 22:32:25.722857 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.722822    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 22:32:25.724987 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.724972    2564 policy_none.go:47] "Start"
Jul 09 22:32:25.770866 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.770855    2564 manager.go:337] "Starting Device Plugin manager"
Jul 09 22:32:25.770960 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:25.770900    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 22:32:25.770960 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.770913    2564 server.go:87] "Starting device plugin registration server"
Jul 09 22:32:25.771139 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.771127    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 22:32:25.771194 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.771141    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 22:32:25.771248 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.771222    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 22:32:25.771306 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.771292    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 22:32:25.771306 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.771301    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 22:32:25.771851 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:25.771818    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 22:32:25.771943 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:25.771884    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-84.ec2.internal\" not found"
Jul 09 22:32:25.805335 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.805316    2564 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2597 into the system container \"/system.slice\": <nil>"
Jul 09 22:32:25.872091 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.872059    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:32:25.887695 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.873081    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:32:25.887695 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.873106    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:32:25.887695 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.873115    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:32:25.887695 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.873140    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-84.ec2.internal"
Jul 09 22:32:25.887695 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.881969    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-84.ec2.internal"
Jul 09 22:32:25.887695 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:25.881986    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-84.ec2.internal\": node \"ip-10-0-142-84.ec2.internal\" not found"
Jul 09 22:32:25.908160 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:25.908146    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-84.ec2.internal\" not found"
Jul 09 22:32:25.957925 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.957897    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 22:32:25.959097 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.959075    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 22:32:25.959165 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.959117    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 22:32:25.959165 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.959139    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 22:32:25.959258 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:25.959175    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 22:32:25.961481 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:25.961463    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 22:32:26.008748 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:26.008730    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-84.ec2.internal\" not found"
Jul 09 22:32:26.059912 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.059892    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-84.ec2.internal"]
Jul 09 22:32:26.059957 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.059948    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:32:26.063393 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.063380    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:32:26.063454 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.063407    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:32:26.063454 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.063416    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:32:26.065479 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.065467    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:32:26.065603 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.065584    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal"
Jul 09 22:32:26.065637 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.065626    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:32:26.066162 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.066144    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:32:26.066162 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.066155    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:32:26.066291 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.066169    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:32:26.066291 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.066175    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:32:26.066291 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.066179    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:32:26.066291 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.066185    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:32:26.068409 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.068395    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-84.ec2.internal"
Jul 09 22:32:26.068462 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.068420    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:32:26.069038 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.069022    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:32:26.069110 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.069045    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:32:26.069110 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.069054    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:32:26.081451 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:26.081433    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-84.ec2.internal\" not found" node="ip-10-0-142-84.ec2.internal"
Jul 09 22:32:26.084849 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:26.084835    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-84.ec2.internal\" not found" node="ip-10-0-142-84.ec2.internal"
Jul 09 22:32:26.100959 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.100940    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/72ab890cca4207a62d6e551584e9677e-config\") pod \"kube-apiserver-proxy-ip-10-0-142-84.ec2.internal\" (UID: \"72ab890cca4207a62d6e551584e9677e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-84.ec2.internal"
Jul 09 22:32:26.101013 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.100962    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc302248faa47831341d8e57c35f776d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal\" (UID: \"fc302248faa47831341d8e57c35f776d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal"
Jul 09 22:32:26.101013 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.100981    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc302248faa47831341d8e57c35f776d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal\" (UID: \"fc302248faa47831341d8e57c35f776d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal"
Jul 09 22:32:26.109405 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:26.109392    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-84.ec2.internal\" not found"
Jul 09 22:32:26.202097 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.202040    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc302248faa47831341d8e57c35f776d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal\" (UID: \"fc302248faa47831341d8e57c35f776d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal"
Jul 09 22:32:26.202097 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.202071    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc302248faa47831341d8e57c35f776d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal\" (UID: \"fc302248faa47831341d8e57c35f776d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal"
Jul 09 22:32:26.202097 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.202086    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/72ab890cca4207a62d6e551584e9677e-config\") pod \"kube-apiserver-proxy-ip-10-0-142-84.ec2.internal\" (UID: \"72ab890cca4207a62d6e551584e9677e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-84.ec2.internal"
Jul 09 22:32:26.202228 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.202102    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc302248faa47831341d8e57c35f776d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal\" (UID: \"fc302248faa47831341d8e57c35f776d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal"
Jul 09 22:32:26.202228 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.202131    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/72ab890cca4207a62d6e551584e9677e-config\") pod \"kube-apiserver-proxy-ip-10-0-142-84.ec2.internal\" (UID: \"72ab890cca4207a62d6e551584e9677e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-84.ec2.internal"
Jul 09 22:32:26.202228 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.202139    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc302248faa47831341d8e57c35f776d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal\" (UID: \"fc302248faa47831341d8e57c35f776d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal"
Jul 09 22:32:26.210187 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:26.210157    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-84.ec2.internal\" not found"
Jul 09 22:32:26.310760 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:26.310716    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-84.ec2.internal\" not found"
Jul 09 22:32:26.384954 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.384907    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal"
Jul 09 22:32:26.388338 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.388319    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-84.ec2.internal"
Jul 09 22:32:26.411309 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:26.411286    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-84.ec2.internal\" not found"
Jul 09 22:32:26.511903 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:26.511832    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-84.ec2.internal\" not found"
Jul 09 22:32:26.612343 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:26.612314    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-84.ec2.internal\" not found"
Jul 09 22:32:26.627175 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.627146    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 22:32:26.627311 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.627293    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 22:32:26.652390 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.652367    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 22:32:26.671915 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.671893    2564 apiserver.go:52] "Watching apiserver"
Jul 09 22:32:26.682397 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.682374    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 22:32:26.684499 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.683259    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-8prz6","openshift-multus/multus-additional-cni-plugins-ftqnt","openshift-multus/network-metrics-daemon-8r82v","openshift-network-diagnostics/network-check-target-27942","openshift-ovn-kubernetes/ovnkube-node-hjmvb","kube-system/konnectivity-agent-bdts6","openshift-image-registry/node-ca-kvxs4","openshift-multus/multus-8xdm8","openshift-network-operator/iptables-alerter-s6zpq","kube-system/global-pull-secret-syncer-g9tnl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j","openshift-cluster-node-tuning-operator/tuned-m4t7g"]
Jul 09 22:32:26.685969 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.685947    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8prz6"
Jul 09 22:32:26.688136 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.688116    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ftqnt"
Jul 09 22:32:26.690337 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.690311    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:26.690416 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:26.690390    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r82v" podUID="d94a7d72-cc1e-4193-99df-08721091f47e"
Jul 09 22:32:26.692509 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.692491    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:32:26.692600 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:26.692580    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27942" podUID="bbe027e4-d591-4abb-8773-a7424b322f54"
Jul 09 22:32:26.693676 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.693656    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 22:32:26.693844 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.693832    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jjpkp\""
Jul 09 22:32:26.694837 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.694817    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.696028 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.696009    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 22:32:26.696126 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.696097    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 22:32:26.696736 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.696720    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 22:32:26.696866 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.696849    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-h7zb4\""
Jul 09 22:32:26.696932 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.696916    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 22:32:26.697320 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.697303    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bdts6"
Jul 09 22:32:26.698005 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.697991    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal"
Jul 09 22:32:26.698084 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.698008    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 22:32:26.699615 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.699598    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kvxs4"
Jul 09 22:32:26.701964 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.701945    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.702811 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.702794    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 22:32:26.702933 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.702911    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 22:32:26.703025 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.702938    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 22:32:26.703025 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.703019    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5h5bm\""
Jul 09 22:32:26.704257 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.704242    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s6zpq"
Jul 09 22:32:26.704347 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.704282    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-systemd-units\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.704347 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.704335    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-ovnkube-config\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.704484 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.704364    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/58f72045-9e77-46a8-a0c5-26d90d2de9bc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ftqnt\" (UID: \"58f72045-9e77-46a8-a0c5-26d90d2de9bc\") " pod="openshift-multus/multus-additional-cni-plugins-ftqnt"
Jul 09 22:32:26.704484 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.704391    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-node-log\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.704484 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.704430    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-log-socket\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.704484 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.704456    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-host-cni-bin\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.704684 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.704481    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m65kr\" (UniqueName: \"kubernetes.io/projected/545740d3-4dfd-4016-a536-19e114d01fd2-kube-api-access-m65kr\") pod \"node-resolver-8prz6\" (UID: \"545740d3-4dfd-4016-a536-19e114d01fd2\") " pod="openshift-dns/node-resolver-8prz6"
Jul 09 22:32:26.704684 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.704508    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/58f72045-9e77-46a8-a0c5-26d90d2de9bc-os-release\") pod \"multus-additional-cni-plugins-ftqnt\" (UID: \"58f72045-9e77-46a8-a0c5-26d90d2de9bc\") " pod="openshift-multus/multus-additional-cni-plugins-ftqnt"
Jul 09 22:32:26.704684 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.704536    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/58f72045-9e77-46a8-a0c5-26d90d2de9bc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ftqnt\" (UID: \"58f72045-9e77-46a8-a0c5-26d90d2de9bc\") " pod="openshift-multus/multus-additional-cni-plugins-ftqnt"
Jul 09 22:32:26.704684 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.704610    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f583e68f-51a9-41f6-93e6-e614945e189a-agent-certs\") pod \"konnectivity-agent-bdts6\" (UID: \"f583e68f-51a9-41f6-93e6-e614945e189a\") " pod="kube-system/konnectivity-agent-bdts6"
Jul 09 22:32:26.704684 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.704646    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvmd8\" (UniqueName: \"kubernetes.io/projected/b814909b-6f08-45e4-87fc-f598576068b0-kube-api-access-jvmd8\") pod \"node-ca-kvxs4\" (UID: \"b814909b-6f08-45e4-87fc-f598576068b0\") " pod="openshift-image-registry/node-ca-kvxs4"
Jul 09 22:32:26.704684 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.704673    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 22:32:26.705046 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.704709    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/545740d3-4dfd-4016-a536-19e114d01fd2-tmp-dir\") pod \"node-resolver-8prz6\" (UID: \"545740d3-4dfd-4016-a536-19e114d01fd2\") " pod="openshift-dns/node-resolver-8prz6"
Jul 09 22:32:26.705046 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.704756    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/58f72045-9e77-46a8-a0c5-26d90d2de9bc-cni-binary-copy\") pod \"multus-additional-cni-plugins-ftqnt\" (UID: \"58f72045-9e77-46a8-a0c5-26d90d2de9bc\") " pod="openshift-multus/multus-additional-cni-plugins-ftqnt"
Jul 09 22:32:26.705046 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.704783    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-host-run-netns\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.705046 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.704800    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-var-lib-openvswitch\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.705046 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.704815    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-env-overrides\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.705046 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.704833    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f583e68f-51a9-41f6-93e6-e614945e189a-konnectivity-ca\") pod \"konnectivity-agent-bdts6\" (UID: \"f583e68f-51a9-41f6-93e6-e614945e189a\") " pod="kube-system/konnectivity-agent-bdts6"
Jul 09 22:32:26.705046 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.704876    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/545740d3-4dfd-4016-a536-19e114d01fd2-hosts-file\") pod \"node-resolver-8prz6\" (UID: \"545740d3-4dfd-4016-a536-19e114d01fd2\") " pod="openshift-dns/node-resolver-8prz6"
Jul 09 22:32:26.705046 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.704920    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/58f72045-9e77-46a8-a0c5-26d90d2de9bc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ftqnt\" (UID: \"58f72045-9e77-46a8-a0c5-26d90d2de9bc\") " pod="openshift-multus/multus-additional-cni-plugins-ftqnt"
Jul 09 22:32:26.705046 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.704960    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-run-systemd\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.705046 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.704996    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-etc-openvswitch\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.705046 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.705027    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-run-openvswitch\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.705046 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.705054    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-ovnkube-script-lib\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.705046 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.705081    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b814909b-6f08-45e4-87fc-f598576068b0-host\") pod \"node-ca-kvxs4\" (UID: \"b814909b-6f08-45e4-87fc-f598576068b0\") " pod="openshift-image-registry/node-ca-kvxs4"
Jul 09 22:32:26.706282 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.705105    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b814909b-6f08-45e4-87fc-f598576068b0-serviceca\") pod \"node-ca-kvxs4\" (UID: \"b814909b-6f08-45e4-87fc-f598576068b0\") " pod="openshift-image-registry/node-ca-kvxs4"
Jul 09 22:32:26.706282 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.705126    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 22:32:26.706282 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.705196    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 22:32:26.706282 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.705131    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs\") pod \"network-metrics-daemon-8r82v\" (UID: \"d94a7d72-cc1e-4193-99df-08721091f47e\") " pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:26.706282 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.705333    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-host-kubelet\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.706282 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.705361    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/58f72045-9e77-46a8-a0c5-26d90d2de9bc-system-cni-dir\") pod \"multus-additional-cni-plugins-ftqnt\" (UID: \"58f72045-9e77-46a8-a0c5-26d90d2de9bc\") " pod="openshift-multus/multus-additional-cni-plugins-ftqnt"
Jul 09 22:32:26.706282 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.705385    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/58f72045-9e77-46a8-a0c5-26d90d2de9bc-cnibin\") pod \"multus-additional-cni-plugins-ftqnt\" (UID: \"58f72045-9e77-46a8-a0c5-26d90d2de9bc\") " pod="openshift-multus/multus-additional-cni-plugins-ftqnt"
Jul 09 22:32:26.706282 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.705411    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28wzb\" (UniqueName: \"kubernetes.io/projected/d94a7d72-cc1e-4193-99df-08721091f47e-kube-api-access-28wzb\") pod \"network-metrics-daemon-8r82v\" (UID: \"d94a7d72-cc1e-4193-99df-08721091f47e\") " pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:26.706282 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.705438    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-host-slash\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.706282 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.705462    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-host-run-ovn-kubernetes\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.706282 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.705486    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.706282 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.705513    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-ovn-node-metrics-cert\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.706282 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.705551    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzsx2\" (UniqueName: \"kubernetes.io/projected/58f72045-9e77-46a8-a0c5-26d90d2de9bc-kube-api-access-hzsx2\") pod \"multus-additional-cni-plugins-ftqnt\" (UID: \"58f72045-9e77-46a8-a0c5-26d90d2de9bc\") " pod="openshift-multus/multus-additional-cni-plugins-ftqnt"
Jul 09 22:32:26.706282 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.705572    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 22:32:26.706282 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.705580    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-run-ovn\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.706282 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.705605    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-host-cni-netd\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.706282 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.705629    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8h7t\" (UniqueName: \"kubernetes.io/projected/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-kube-api-access-h8h7t\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.706282 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.705658    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg85q\" (UniqueName: \"kubernetes.io/projected/bbe027e4-d591-4abb-8773-a7424b322f54-kube-api-access-tg85q\") pod \"network-check-target-27942\" (UID: \"bbe027e4-d591-4abb-8773-a7424b322f54\") " pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:32:26.706958 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.705765    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 22:32:26.706958 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.705777    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 22:32:26.706958 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.705791    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 22:32:26.706958 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.705798    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 22:32:26.706958 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.705933    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 22:32:26.706958 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.706021    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7fglt\""
Jul 09 22:32:26.706958 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.706163    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 22:32:26.706958 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.706223    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2tnxd\""
Jul 09 22:32:26.706958 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.706234    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 22:32:26.706958 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.706243    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-srd44\""
Jul 09 22:32:26.707571 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.707556    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:26.707653 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:26.707630    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9tnl" podUID="f95a3161-5787-4d60-b2ea-7c6222a168c7"
Jul 09 22:32:26.710043 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.710017    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j"
Jul 09 22:32:26.711460 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.711445    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 22:32:26.712065 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.712049    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 22:32:26.712139 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.712096    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 22:32:26.712139 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.712134    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-q6vwn\""
Jul 09 22:32:26.712383 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.712369    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.712499 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.712375    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 22:32:26.714703 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.714683    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qzr4z\""
Jul 09 22:32:26.715426 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.715407    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 22:32:26.715520 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.715490    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 22:32:26.715661 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.715648    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xlptm\""
Jul 09 22:32:26.715791 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.715780    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 22:32:26.715832 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.715802    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 22:32:26.718627 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.718595    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 22:27:26 +0000 UTC" deadline="2027-12-04 21:59:35.528231194 +0000 UTC"
Jul 09 22:32:26.718675 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.718627    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12311h27m8.809605901s"
Jul 09 22:32:26.739648 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.739627    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal"]
Jul 09 22:32:26.741621 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.741605    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 22:32:26.741690 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.741649    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 22:32:26.741690 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.741672    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-84.ec2.internal"
Jul 09 22:32:26.750073 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.750052    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 22:32:26.757969 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.757939    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-84.ec2.internal"]
Jul 09 22:32:26.758065 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.757947    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 22:32:26.765429 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.765383    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6p5pr"
Jul 09 22:32:26.772385 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.772371    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6p5pr"
Jul 09 22:32:26.799673 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.799654    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 22:32:26.806132 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806112    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-systemd-units\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.806188 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806140    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-ovnkube-config\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.806188 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806160    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f95a3161-5787-4d60-b2ea-7c6222a168c7-original-pull-secret\") pod \"global-pull-secret-syncer-g9tnl\" (UID: \"f95a3161-5787-4d60-b2ea-7c6222a168c7\") " pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:26.806188 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806179    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-etc-sysctl-d\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.806319 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806204    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/58f72045-9e77-46a8-a0c5-26d90d2de9bc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ftqnt\" (UID: \"58f72045-9e77-46a8-a0c5-26d90d2de9bc\") " pod="openshift-multus/multus-additional-cni-plugins-ftqnt"
Jul 09 22:32:26.806319 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806218    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-systemd-units\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.806319 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806237    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-host-cni-bin\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.806319 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806291    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-host-run-multus-certs\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.806488 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806319    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-host-cni-bin\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.806488 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806347    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/61444372-fc8f-4fe4-a6a8-9c4b3785c7b0-device-dir\") pod \"aws-ebs-csi-driver-node-zdg6j\" (UID: \"61444372-fc8f-4fe4-a6a8-9c4b3785c7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j"
Jul 09 22:32:26.806488 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806377    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/58f72045-9e77-46a8-a0c5-26d90d2de9bc-os-release\") pod \"multus-additional-cni-plugins-ftqnt\" (UID: \"58f72045-9e77-46a8-a0c5-26d90d2de9bc\") " pod="openshift-multus/multus-additional-cni-plugins-ftqnt"
Jul 09 22:32:26.806488 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806417    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/58f72045-9e77-46a8-a0c5-26d90d2de9bc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ftqnt\" (UID: \"58f72045-9e77-46a8-a0c5-26d90d2de9bc\") " pod="openshift-multus/multus-additional-cni-plugins-ftqnt"
Jul 09 22:32:26.806488 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806431    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f583e68f-51a9-41f6-93e6-e614945e189a-agent-certs\") pod \"konnectivity-agent-bdts6\" (UID: \"f583e68f-51a9-41f6-93e6-e614945e189a\") " pod="kube-system/konnectivity-agent-bdts6"
Jul 09 22:32:26.806488 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806446    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvmd8\" (UniqueName: \"kubernetes.io/projected/b814909b-6f08-45e4-87fc-f598576068b0-kube-api-access-jvmd8\") pod \"node-ca-kvxs4\" (UID: \"b814909b-6f08-45e4-87fc-f598576068b0\") " pod="openshift-image-registry/node-ca-kvxs4"
Jul 09 22:32:26.806488 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806460    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/58f72045-9e77-46a8-a0c5-26d90d2de9bc-os-release\") pod \"multus-additional-cni-plugins-ftqnt\" (UID: \"58f72045-9e77-46a8-a0c5-26d90d2de9bc\") " pod="openshift-multus/multus-additional-cni-plugins-ftqnt"
Jul 09 22:32:26.806835 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806556    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-host\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.806835 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806561    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/58f72045-9e77-46a8-a0c5-26d90d2de9bc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ftqnt\" (UID: \"58f72045-9e77-46a8-a0c5-26d90d2de9bc\") " pod="openshift-multus/multus-additional-cni-plugins-ftqnt"
Jul 09 22:32:26.806835 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806582    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/545740d3-4dfd-4016-a536-19e114d01fd2-tmp-dir\") pod \"node-resolver-8prz6\" (UID: \"545740d3-4dfd-4016-a536-19e114d01fd2\") " pod="openshift-dns/node-resolver-8prz6"
Jul 09 22:32:26.806835 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806607    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-host-run-netns\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.806835 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806635    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-host-run-netns\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.806835 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806676    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-var-lib-openvswitch\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.806835 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806712    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-var-lib-openvswitch\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.806835 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806737    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-run\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.806835 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806754    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-system-cni-dir\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.806835 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806779    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-os-release\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.806835 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806825    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/545740d3-4dfd-4016-a536-19e114d01fd2-tmp-dir\") pod \"node-resolver-8prz6\" (UID: \"545740d3-4dfd-4016-a536-19e114d01fd2\") " pod="openshift-dns/node-resolver-8prz6"
Jul 09 22:32:26.806835 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806822    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 22:32:26.807321 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806828    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/61444372-fc8f-4fe4-a6a8-9c4b3785c7b0-socket-dir\") pod \"aws-ebs-csi-driver-node-zdg6j\" (UID: \"61444372-fc8f-4fe4-a6a8-9c4b3785c7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j"
Jul 09 22:32:26.807321 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806870    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-run-openvswitch\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.807321 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806886    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b814909b-6f08-45e4-87fc-f598576068b0-serviceca\") pod \"node-ca-kvxs4\" (UID: \"b814909b-6f08-45e4-87fc-f598576068b0\") " pod="openshift-image-registry/node-ca-kvxs4"
Jul 09 22:32:26.807321 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806918    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-run-openvswitch\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.807321 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806926    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-multus-cni-dir\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.807321 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806945    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/61444372-fc8f-4fe4-a6a8-9c4b3785c7b0-registration-dir\") pod \"aws-ebs-csi-driver-node-zdg6j\" (UID: \"61444372-fc8f-4fe4-a6a8-9c4b3785c7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j"
Jul 09 22:32:26.807321 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806968    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/58f72045-9e77-46a8-a0c5-26d90d2de9bc-system-cni-dir\") pod \"multus-additional-cni-plugins-ftqnt\" (UID: \"58f72045-9e77-46a8-a0c5-26d90d2de9bc\") " pod="openshift-multus/multus-additional-cni-plugins-ftqnt"
Jul 09 22:32:26.807321 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.806984    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/58f72045-9e77-46a8-a0c5-26d90d2de9bc-cnibin\") pod \"multus-additional-cni-plugins-ftqnt\" (UID: \"58f72045-9e77-46a8-a0c5-26d90d2de9bc\") " pod="openshift-multus/multus-additional-cni-plugins-ftqnt"
Jul 09 22:32:26.807321 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807000    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28wzb\" (UniqueName: \"kubernetes.io/projected/d94a7d72-cc1e-4193-99df-08721091f47e-kube-api-access-28wzb\") pod \"network-metrics-daemon-8r82v\" (UID: \"d94a7d72-cc1e-4193-99df-08721091f47e\") " pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:26.807321 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807008    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/58f72045-9e77-46a8-a0c5-26d90d2de9bc-system-cni-dir\") pod \"multus-additional-cni-plugins-ftqnt\" (UID: \"58f72045-9e77-46a8-a0c5-26d90d2de9bc\") " pod="openshift-multus/multus-additional-cni-plugins-ftqnt"
Jul 09 22:32:26.807321 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807017    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-ovn-node-metrics-cert\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.807321 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807041    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-etc-kubernetes\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.807321 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807065    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-host-run-netns\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.807321 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807113    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-run-ovn\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.807321 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807139    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8h7t\" (UniqueName: \"kubernetes.io/projected/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-kube-api-access-h8h7t\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.807321 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807065    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/58f72045-9e77-46a8-a0c5-26d90d2de9bc-cnibin\") pod \"multus-additional-cni-plugins-ftqnt\" (UID: \"58f72045-9e77-46a8-a0c5-26d90d2de9bc\") " pod="openshift-multus/multus-additional-cni-plugins-ftqnt"
Jul 09 22:32:26.807321 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807186    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f95a3161-5787-4d60-b2ea-7c6222a168c7-dbus\") pod \"global-pull-secret-syncer-g9tnl\" (UID: \"f95a3161-5787-4d60-b2ea-7c6222a168c7\") " pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:26.808144 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807206    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-host-var-lib-cni-bin\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.808144 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807224    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-host-var-lib-cni-multus\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.808144 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807241    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jf5s\" (UniqueName: \"kubernetes.io/projected/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-kube-api-access-4jf5s\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.808144 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807260    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg85q\" (UniqueName: \"kubernetes.io/projected/bbe027e4-d591-4abb-8773-a7424b322f54-kube-api-access-tg85q\") pod \"network-check-target-27942\" (UID: \"bbe027e4-d591-4abb-8773-a7424b322f54\") " pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:32:26.808144 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807276    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-etc-sysconfig\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.808144 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807295    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-cnibin\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.808144 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807312    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-host-var-lib-kubelet\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.808144 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807327    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b814909b-6f08-45e4-87fc-f598576068b0-serviceca\") pod \"node-ca-kvxs4\" (UID: \"b814909b-6f08-45e4-87fc-f598576068b0\") " pod="openshift-image-registry/node-ca-kvxs4"
Jul 09 22:32:26.808144 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807331    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-etc-kubernetes\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.808144 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807410    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-node-log\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.808144 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807446    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-log-socket\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.808144 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807456    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-run-ovn\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.808144 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807474    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-node-log\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.808144 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807497    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7gd2\" (UniqueName: \"kubernetes.io/projected/6d073fe5-c181-4f75-935f-df0d5472deca-kube-api-access-w7gd2\") pod \"iptables-alerter-s6zpq\" (UID: \"6d073fe5-c181-4f75-935f-df0d5472deca\") " pod="openshift-network-operator/iptables-alerter-s6zpq"
Jul 09 22:32:26.808144 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807521    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-log-socket\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.808144 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807555    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/61444372-fc8f-4fe4-a6a8-9c4b3785c7b0-sys-fs\") pod \"aws-ebs-csi-driver-node-zdg6j\" (UID: \"61444372-fc8f-4fe4-a6a8-9c4b3785c7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j"
Jul 09 22:32:26.808144 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807594    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m65kr\" (UniqueName: \"kubernetes.io/projected/545740d3-4dfd-4016-a536-19e114d01fd2-kube-api-access-m65kr\") pod \"node-resolver-8prz6\" (UID: \"545740d3-4dfd-4016-a536-19e114d01fd2\") " pod="openshift-dns/node-resolver-8prz6"
Jul 09 22:32:26.809023 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807686    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/61444372-fc8f-4fe4-a6a8-9c4b3785c7b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zdg6j\" (UID: \"61444372-fc8f-4fe4-a6a8-9c4b3785c7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j"
Jul 09 22:32:26.809023 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807695    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/58f72045-9e77-46a8-a0c5-26d90d2de9bc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ftqnt\" (UID: \"58f72045-9e77-46a8-a0c5-26d90d2de9bc\") " pod="openshift-multus/multus-additional-cni-plugins-ftqnt"
Jul 09 22:32:26.809023 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807722    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj5qm\" (UniqueName: \"kubernetes.io/projected/61444372-fc8f-4fe4-a6a8-9c4b3785c7b0-kube-api-access-zj5qm\") pod \"aws-ebs-csi-driver-node-zdg6j\" (UID: \"61444372-fc8f-4fe4-a6a8-9c4b3785c7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j"
Jul 09 22:32:26.809023 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807753    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/58f72045-9e77-46a8-a0c5-26d90d2de9bc-cni-binary-copy\") pod \"multus-additional-cni-plugins-ftqnt\" (UID: \"58f72045-9e77-46a8-a0c5-26d90d2de9bc\") " pod="openshift-multus/multus-additional-cni-plugins-ftqnt"
Jul 09 22:32:26.809023 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807785    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-env-overrides\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.809023 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807811    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f583e68f-51a9-41f6-93e6-e614945e189a-konnectivity-ca\") pod \"konnectivity-agent-bdts6\" (UID: \"f583e68f-51a9-41f6-93e6-e614945e189a\") " pod="kube-system/konnectivity-agent-bdts6"
Jul 09 22:32:26.809023 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807834    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-ovnkube-config\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.809023 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807836    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d073fe5-c181-4f75-935f-df0d5472deca-host-slash\") pod \"iptables-alerter-s6zpq\" (UID: \"6d073fe5-c181-4f75-935f-df0d5472deca\") " pod="openshift-network-operator/iptables-alerter-s6zpq"
Jul 09 22:32:26.809023 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807882    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-lib-modules\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.809023 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807908    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9534b1d-3751-417d-825d-d0e59d7db95e-tmp\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.809023 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807933    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7x22\" (UniqueName: \"kubernetes.io/projected/f9534b1d-3751-417d-825d-d0e59d7db95e-kube-api-access-g7x22\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.809023 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.807975    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-multus-socket-dir-parent\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.809023 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808027    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/545740d3-4dfd-4016-a536-19e114d01fd2-hosts-file\") pod \"node-resolver-8prz6\" (UID: \"545740d3-4dfd-4016-a536-19e114d01fd2\") " pod="openshift-dns/node-resolver-8prz6"
Jul 09 22:32:26.809023 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808068    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/58f72045-9e77-46a8-a0c5-26d90d2de9bc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ftqnt\" (UID: \"58f72045-9e77-46a8-a0c5-26d90d2de9bc\") " pod="openshift-multus/multus-additional-cni-plugins-ftqnt"
Jul 09 22:32:26.809023 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808163    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/545740d3-4dfd-4016-a536-19e114d01fd2-hosts-file\") pod \"node-resolver-8prz6\" (UID: \"545740d3-4dfd-4016-a536-19e114d01fd2\") " pod="openshift-dns/node-resolver-8prz6"
Jul 09 22:32:26.809023 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808198    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-run-systemd\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.809023 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808244    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-run-systemd\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.809634 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808273    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-etc-openvswitch\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.809634 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808314    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-etc-openvswitch\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.809634 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808340    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/58f72045-9e77-46a8-a0c5-26d90d2de9bc-cni-binary-copy\") pod \"multus-additional-cni-plugins-ftqnt\" (UID: \"58f72045-9e77-46a8-a0c5-26d90d2de9bc\") " pod="openshift-multus/multus-additional-cni-plugins-ftqnt"
Jul 09 22:32:26.809634 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808344    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-ovnkube-script-lib\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.809634 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808396    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b814909b-6f08-45e4-87fc-f598576068b0-host\") pod \"node-ca-kvxs4\" (UID: \"b814909b-6f08-45e4-87fc-f598576068b0\") " pod="openshift-image-registry/node-ca-kvxs4"
Jul 09 22:32:26.809634 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808426    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f95a3161-5787-4d60-b2ea-7c6222a168c7-kubelet-config\") pod \"global-pull-secret-syncer-g9tnl\" (UID: \"f95a3161-5787-4d60-b2ea-7c6222a168c7\") " pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:26.809634 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808453    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-env-overrides\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.809634 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808474    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b814909b-6f08-45e4-87fc-f598576068b0-host\") pod \"node-ca-kvxs4\" (UID: \"b814909b-6f08-45e4-87fc-f598576068b0\") " pod="openshift-image-registry/node-ca-kvxs4"
Jul 09 22:32:26.809634 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808521    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-etc-systemd\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.809634 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808554    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs\") pod \"network-metrics-daemon-8r82v\" (UID: \"d94a7d72-cc1e-4193-99df-08721091f47e\") " pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:26.809634 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808576    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f583e68f-51a9-41f6-93e6-e614945e189a-konnectivity-ca\") pod \"konnectivity-agent-bdts6\" (UID: \"f583e68f-51a9-41f6-93e6-e614945e189a\") " pod="kube-system/konnectivity-agent-bdts6"
Jul 09 22:32:26.809634 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808582    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-host-kubelet\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.809634 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808610    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6d073fe5-c181-4f75-935f-df0d5472deca-iptables-alerter-script\") pod \"iptables-alerter-s6zpq\" (UID: \"6d073fe5-c181-4f75-935f-df0d5472deca\") " pod="openshift-network-operator/iptables-alerter-s6zpq"
Jul 09 22:32:26.809634 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808639    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-etc-sysctl-conf\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.809634 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808656    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-host-kubelet\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.809634 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:26.808667    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:32:26.809634 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808676    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-var-lib-kubelet\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.809634 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808702    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f9534b1d-3751-417d-825d-d0e59d7db95e-etc-tuned\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.810355 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:26.808738    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs podName:d94a7d72-cc1e-4193-99df-08721091f47e nodeName:}" failed. No retries permitted until 2026-07-09 22:32:27.308717077 +0000 UTC m=+2.016612667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs") pod "network-metrics-daemon-8r82v" (UID: "d94a7d72-cc1e-4193-99df-08721091f47e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:32:26.810355 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808748    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/58f72045-9e77-46a8-a0c5-26d90d2de9bc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ftqnt\" (UID: \"58f72045-9e77-46a8-a0c5-26d90d2de9bc\") " pod="openshift-multus/multus-additional-cni-plugins-ftqnt"
Jul 09 22:32:26.810355 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808756    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-hostroot\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.810355 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808781    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-multus-daemon-config\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.810355 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808813    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-host-slash\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.810355 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808857    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-host-slash\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.810355 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808897    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-ovnkube-script-lib\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.810355 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808890    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-host-run-ovn-kubernetes\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.810355 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808930    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-host-run-ovn-kubernetes\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.810355 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808936    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.810355 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808969    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-sys\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.810355 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808972    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.810355 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.808997    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-cni-binary-copy\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.810355 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.809023    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-host-run-k8s-cni-cncf-io\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.810355 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.809050    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-multus-conf-dir\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.810355 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.809098    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzsx2\" (UniqueName: \"kubernetes.io/projected/58f72045-9e77-46a8-a0c5-26d90d2de9bc-kube-api-access-hzsx2\") pod \"multus-additional-cni-plugins-ftqnt\" (UID: \"58f72045-9e77-46a8-a0c5-26d90d2de9bc\") " pod="openshift-multus/multus-additional-cni-plugins-ftqnt"
Jul 09 22:32:26.811005 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.809123    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-host-cni-netd\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.811005 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.809145    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-etc-modprobe-d\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.811005 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.809168    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/61444372-fc8f-4fe4-a6a8-9c4b3785c7b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-zdg6j\" (UID: \"61444372-fc8f-4fe4-a6a8-9c4b3785c7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j"
Jul 09 22:32:26.811005 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.809177    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-host-cni-netd\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.811005 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.810376    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-ovn-node-metrics-cert\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.811005 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.810560    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f583e68f-51a9-41f6-93e6-e614945e189a-agent-certs\") pod \"konnectivity-agent-bdts6\" (UID: \"f583e68f-51a9-41f6-93e6-e614945e189a\") " pod="kube-system/konnectivity-agent-bdts6"
Jul 09 22:32:26.812822 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:26.812804    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:32:26.812906 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:26.812826    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:32:26.812906 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:26.812840    2564 projected.go:196] Error preparing data for projected volume kube-api-access-tg85q for pod openshift-network-diagnostics/network-check-target-27942: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:32:26.812906 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:26.812902    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbe027e4-d591-4abb-8773-a7424b322f54-kube-api-access-tg85q podName:bbe027e4-d591-4abb-8773-a7424b322f54 nodeName:}" failed. No retries permitted until 2026-07-09 22:32:27.31287456 +0000 UTC m=+2.020770127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tg85q" (UniqueName: "kubernetes.io/projected/bbe027e4-d591-4abb-8773-a7424b322f54-kube-api-access-tg85q") pod "network-check-target-27942" (UID: "bbe027e4-d591-4abb-8773-a7424b322f54") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:32:26.815623 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.815604    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28wzb\" (UniqueName: \"kubernetes.io/projected/d94a7d72-cc1e-4193-99df-08721091f47e-kube-api-access-28wzb\") pod \"network-metrics-daemon-8r82v\" (UID: \"d94a7d72-cc1e-4193-99df-08721091f47e\") " pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:26.815743 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.815656    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvmd8\" (UniqueName: \"kubernetes.io/projected/b814909b-6f08-45e4-87fc-f598576068b0-kube-api-access-jvmd8\") pod \"node-ca-kvxs4\" (UID: \"b814909b-6f08-45e4-87fc-f598576068b0\") " pod="openshift-image-registry/node-ca-kvxs4"
Jul 09 22:32:26.816141 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.816105    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8h7t\" (UniqueName: \"kubernetes.io/projected/0ff3ae08-bc54-4e2c-b565-9afe185f15fa-kube-api-access-h8h7t\") pod \"ovnkube-node-hjmvb\" (UID: \"0ff3ae08-bc54-4e2c-b565-9afe185f15fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:26.816528 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.816507    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m65kr\" (UniqueName: \"kubernetes.io/projected/545740d3-4dfd-4016-a536-19e114d01fd2-kube-api-access-m65kr\") pod \"node-resolver-8prz6\" (UID: \"545740d3-4dfd-4016-a536-19e114d01fd2\") " pod="openshift-dns/node-resolver-8prz6"
Jul 09 22:32:26.817168 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.817144    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzsx2\" (UniqueName: \"kubernetes.io/projected/58f72045-9e77-46a8-a0c5-26d90d2de9bc-kube-api-access-hzsx2\") pod \"multus-additional-cni-plugins-ftqnt\" (UID: \"58f72045-9e77-46a8-a0c5-26d90d2de9bc\") " pod="openshift-multus/multus-additional-cni-plugins-ftqnt"
Jul 09 22:32:26.909894 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.909862    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f95a3161-5787-4d60-b2ea-7c6222a168c7-kubelet-config\") pod \"global-pull-secret-syncer-g9tnl\" (UID: \"f95a3161-5787-4d60-b2ea-7c6222a168c7\") " pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:26.910031 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.909913    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-etc-systemd\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.910031 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.909955    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6d073fe5-c181-4f75-935f-df0d5472deca-iptables-alerter-script\") pod \"iptables-alerter-s6zpq\" (UID: \"6d073fe5-c181-4f75-935f-df0d5472deca\") " pod="openshift-network-operator/iptables-alerter-s6zpq"
Jul 09 22:32:26.910031 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.909979    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-etc-sysctl-conf\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.910031 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.909984    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f95a3161-5787-4d60-b2ea-7c6222a168c7-kubelet-config\") pod \"global-pull-secret-syncer-g9tnl\" (UID: \"f95a3161-5787-4d60-b2ea-7c6222a168c7\") " pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:26.910031 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910001    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-var-lib-kubelet\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.910031 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910024    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f9534b1d-3751-417d-825d-d0e59d7db95e-etc-tuned\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.910376 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910048    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-etc-systemd\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.910376 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910085    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-hostroot\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.910376 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910098    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-var-lib-kubelet\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.910376 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910128    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-etc-sysctl-conf\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.910376 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910141    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-multus-daemon-config\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.910376 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910143    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-hostroot\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.910376 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910176    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-sys\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.910376 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910194    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-cni-binary-copy\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.910376 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910219    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-host-run-k8s-cni-cncf-io\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.910376 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910243    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-multus-conf-dir\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.910376 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910251    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-sys\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.910376 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910268    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-etc-modprobe-d\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.910376 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910277    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-host-run-k8s-cni-cncf-io\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.910376 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910292    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/61444372-fc8f-4fe4-a6a8-9c4b3785c7b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-zdg6j\" (UID: \"61444372-fc8f-4fe4-a6a8-9c4b3785c7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j"
Jul 09 22:32:26.910376 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910300    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-multus-conf-dir\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.910376 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910332    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f95a3161-5787-4d60-b2ea-7c6222a168c7-original-pull-secret\") pod \"global-pull-secret-syncer-g9tnl\" (UID: \"f95a3161-5787-4d60-b2ea-7c6222a168c7\") " pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:26.910376 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910360    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-etc-sysctl-d\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.910376 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910378    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/61444372-fc8f-4fe4-a6a8-9c4b3785c7b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-zdg6j\" (UID: \"61444372-fc8f-4fe4-a6a8-9c4b3785c7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j"
Jul 09 22:32:26.911412 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910389    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-host-run-multus-certs\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.911412 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910418    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/61444372-fc8f-4fe4-a6a8-9c4b3785c7b0-device-dir\") pod \"aws-ebs-csi-driver-node-zdg6j\" (UID: \"61444372-fc8f-4fe4-a6a8-9c4b3785c7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j"
Jul 09 22:32:26.911412 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910426    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-host-run-multus-certs\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.911412 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910448    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-host\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.911412 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:26.910468    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:32:26.911412 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910476    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-run\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.911412 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910499    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-system-cni-dir\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.911412 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910518    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-etc-sysctl-d\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.911412 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910524    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-os-release\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.911412 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910392    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-etc-modprobe-d\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.911412 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:26.910556    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f95a3161-5787-4d60-b2ea-7c6222a168c7-original-pull-secret podName:f95a3161-5787-4d60-b2ea-7c6222a168c7 nodeName:}" failed. No retries permitted until 2026-07-09 22:32:27.410535601 +0000 UTC m=+2.118431182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f95a3161-5787-4d60-b2ea-7c6222a168c7-original-pull-secret") pod "global-pull-secret-syncer-g9tnl" (UID: "f95a3161-5787-4d60-b2ea-7c6222a168c7") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:32:26.911412 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910577    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/61444372-fc8f-4fe4-a6a8-9c4b3785c7b0-socket-dir\") pod \"aws-ebs-csi-driver-node-zdg6j\" (UID: \"61444372-fc8f-4fe4-a6a8-9c4b3785c7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j"
Jul 09 22:32:26.911412 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910591    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/61444372-fc8f-4fe4-a6a8-9c4b3785c7b0-device-dir\") pod \"aws-ebs-csi-driver-node-zdg6j\" (UID: \"61444372-fc8f-4fe4-a6a8-9c4b3785c7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j"
Jul 09 22:32:26.911412 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910608    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-multus-cni-dir\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.911412 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910623    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-host\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.911412 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910633    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/61444372-fc8f-4fe4-a6a8-9c4b3785c7b0-registration-dir\") pod \"aws-ebs-csi-driver-node-zdg6j\" (UID: \"61444372-fc8f-4fe4-a6a8-9c4b3785c7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j"
Jul 09 22:32:26.911412 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910652    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-os-release\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.912358 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910679    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-run\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.912358 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910664    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-etc-kubernetes\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.912358 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910699    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-multus-daemon-config\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.912358 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910718    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/61444372-fc8f-4fe4-a6a8-9c4b3785c7b0-registration-dir\") pod \"aws-ebs-csi-driver-node-zdg6j\" (UID: \"61444372-fc8f-4fe4-a6a8-9c4b3785c7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j"
Jul 09 22:32:26.912358 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910723    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-host-run-netns\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.912358 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910575    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6d073fe5-c181-4f75-935f-df0d5472deca-iptables-alerter-script\") pod \"iptables-alerter-s6zpq\" (UID: \"6d073fe5-c181-4f75-935f-df0d5472deca\") " pod="openshift-network-operator/iptables-alerter-s6zpq"
Jul 09 22:32:26.912358 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910722    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-multus-cni-dir\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.912358 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910757    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f95a3161-5787-4d60-b2ea-7c6222a168c7-dbus\") pod \"global-pull-secret-syncer-g9tnl\" (UID: \"f95a3161-5787-4d60-b2ea-7c6222a168c7\") " pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:26.912358 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910768    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/61444372-fc8f-4fe4-a6a8-9c4b3785c7b0-socket-dir\") pod \"aws-ebs-csi-driver-node-zdg6j\" (UID: \"61444372-fc8f-4fe4-a6a8-9c4b3785c7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j"
Jul 09 22:32:26.912358 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910773    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-host-run-netns\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.912358 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910768    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-cni-binary-copy\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.912358 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910794    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-system-cni-dir\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.912358 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910759    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-etc-kubernetes\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.912358 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910785    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-host-var-lib-cni-bin\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.912358 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910814    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-host-var-lib-cni-bin\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.912358 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910832    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-host-var-lib-cni-multus\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.912358 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910874    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jf5s\" (UniqueName: \"kubernetes.io/projected/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-kube-api-access-4jf5s\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.912358 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910900    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f95a3161-5787-4d60-b2ea-7c6222a168c7-dbus\") pod \"global-pull-secret-syncer-g9tnl\" (UID: \"f95a3161-5787-4d60-b2ea-7c6222a168c7\") " pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:26.912935 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910910    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-host-var-lib-cni-multus\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.912935 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910911    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-etc-sysconfig\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.912935 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910953    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-cnibin\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.912935 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910969    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-host-var-lib-kubelet\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.912935 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.910987    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-etc-kubernetes\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.912935 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.911011    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-etc-sysconfig\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.912935 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.911015    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7gd2\" (UniqueName: \"kubernetes.io/projected/6d073fe5-c181-4f75-935f-df0d5472deca-kube-api-access-w7gd2\") pod \"iptables-alerter-s6zpq\" (UID: \"6d073fe5-c181-4f75-935f-df0d5472deca\") " pod="openshift-network-operator/iptables-alerter-s6zpq"
Jul 09 22:32:26.912935 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.911043    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-cnibin\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.912935 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.911048    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-host-var-lib-kubelet\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.912935 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.911048    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/61444372-fc8f-4fe4-a6a8-9c4b3785c7b0-sys-fs\") pod \"aws-ebs-csi-driver-node-zdg6j\" (UID: \"61444372-fc8f-4fe4-a6a8-9c4b3785c7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j"
Jul 09 22:32:26.912935 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.911097    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/61444372-fc8f-4fe4-a6a8-9c4b3785c7b0-sys-fs\") pod \"aws-ebs-csi-driver-node-zdg6j\" (UID: \"61444372-fc8f-4fe4-a6a8-9c4b3785c7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j"
Jul 09 22:32:26.912935 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.911103    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/61444372-fc8f-4fe4-a6a8-9c4b3785c7b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zdg6j\" (UID: \"61444372-fc8f-4fe4-a6a8-9c4b3785c7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j"
Jul 09 22:32:26.912935 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.911061    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-etc-kubernetes\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.912935 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.911133    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj5qm\" (UniqueName: \"kubernetes.io/projected/61444372-fc8f-4fe4-a6a8-9c4b3785c7b0-kube-api-access-zj5qm\") pod \"aws-ebs-csi-driver-node-zdg6j\" (UID: \"61444372-fc8f-4fe4-a6a8-9c4b3785c7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j"
Jul 09 22:32:26.912935 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.911175    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d073fe5-c181-4f75-935f-df0d5472deca-host-slash\") pod \"iptables-alerter-s6zpq\" (UID: \"6d073fe5-c181-4f75-935f-df0d5472deca\") " pod="openshift-network-operator/iptables-alerter-s6zpq"
Jul 09 22:32:26.912935 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.911192    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-lib-modules\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.912935 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.911207    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9534b1d-3751-417d-825d-d0e59d7db95e-tmp\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.912935 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.911231    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7x22\" (UniqueName: \"kubernetes.io/projected/f9534b1d-3751-417d-825d-d0e59d7db95e-kube-api-access-g7x22\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.913544 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.911239    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d073fe5-c181-4f75-935f-df0d5472deca-host-slash\") pod \"iptables-alerter-s6zpq\" (UID: \"6d073fe5-c181-4f75-935f-df0d5472deca\") " pod="openshift-network-operator/iptables-alerter-s6zpq"
Jul 09 22:32:26.913544 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.911257    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-multus-socket-dir-parent\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.913544 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.911136    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/61444372-fc8f-4fe4-a6a8-9c4b3785c7b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zdg6j\" (UID: \"61444372-fc8f-4fe4-a6a8-9c4b3785c7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j"
Jul 09 22:32:26.913544 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.911301    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9534b1d-3751-417d-825d-d0e59d7db95e-lib-modules\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.913544 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.911335    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-multus-socket-dir-parent\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:26.913544 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.912597    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f9534b1d-3751-417d-825d-d0e59d7db95e-etc-tuned\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.913544 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.913283    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9534b1d-3751-417d-825d-d0e59d7db95e-tmp\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.924080 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.924054    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj5qm\" (UniqueName: \"kubernetes.io/projected/61444372-fc8f-4fe4-a6a8-9c4b3785c7b0-kube-api-access-zj5qm\") pod \"aws-ebs-csi-driver-node-zdg6j\" (UID: \"61444372-fc8f-4fe4-a6a8-9c4b3785c7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j"
Jul 09 22:32:26.924272 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.924254    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7x22\" (UniqueName: \"kubernetes.io/projected/f9534b1d-3751-417d-825d-d0e59d7db95e-kube-api-access-g7x22\") pod \"tuned-m4t7g\" (UID: \"f9534b1d-3751-417d-825d-d0e59d7db95e\") " pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:26.924604 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.924588    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7gd2\" (UniqueName: \"kubernetes.io/projected/6d073fe5-c181-4f75-935f-df0d5472deca-kube-api-access-w7gd2\") pod \"iptables-alerter-s6zpq\" (UID: \"6d073fe5-c181-4f75-935f-df0d5472deca\") " pod="openshift-network-operator/iptables-alerter-s6zpq"
Jul 09 22:32:26.924745 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:26.924730    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jf5s\" (UniqueName: \"kubernetes.io/projected/28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b-kube-api-access-4jf5s\") pod \"multus-8xdm8\" (UID: \"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b\") " pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:27.010956 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:27.010919    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8prz6"
Jul 09 22:32:27.018225 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:27.018157    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 22:32:27.043922 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:27.043904    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ftqnt"
Jul 09 22:32:27.060745 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:27.060721    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:27.076232 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:27.076200    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ff3ae08_bc54_4e2c_b565_9afe185f15fa.slice/crio-0ef416044f7257b84605a8aea75da06110a3d1f129cb02651a7fea479b538f65 WatchSource:0}: Error finding container 0ef416044f7257b84605a8aea75da06110a3d1f129cb02651a7fea479b538f65: Status 404 returned error can't find the container with id 0ef416044f7257b84605a8aea75da06110a3d1f129cb02651a7fea479b538f65
Jul 09 22:32:27.077037 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:27.077021    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58f72045_9e77_46a8_a0c5_26d90d2de9bc.slice/crio-b9b64d2660056a4c868da54aa376b4fa30788475aa7e1ef11e4374800c6976c7 WatchSource:0}: Error finding container b9b64d2660056a4c868da54aa376b4fa30788475aa7e1ef11e4374800c6976c7: Status 404 returned error can't find the container with id b9b64d2660056a4c868da54aa376b4fa30788475aa7e1ef11e4374800c6976c7
Jul 09 22:32:27.077983 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:27.077963    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc302248faa47831341d8e57c35f776d.slice/crio-a386b58b9f258d048f904873d6df607a97f271ed65955d155191a99b2c07aaca WatchSource:0}: Error finding container a386b58b9f258d048f904873d6df607a97f271ed65955d155191a99b2c07aaca: Status 404 returned error can't find the container with id a386b58b9f258d048f904873d6df607a97f271ed65955d155191a99b2c07aaca
Jul 09 22:32:27.079655 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:27.079631    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72ab890cca4207a62d6e551584e9677e.slice/crio-b365fda570ce83c61ff6223e21a617a1875b5bb33d2c27004888bc4c6e75dcfd WatchSource:0}: Error finding container b365fda570ce83c61ff6223e21a617a1875b5bb33d2c27004888bc4c6e75dcfd: Status 404 returned error can't find the container with id b365fda570ce83c61ff6223e21a617a1875b5bb33d2c27004888bc4c6e75dcfd
Jul 09 22:32:27.080586 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:27.080529    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bdts6"
Jul 09 22:32:27.084179 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:27.084160    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 22:32:27.090142 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:27.090122    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf583e68f_51a9_41f6_93e6_e614945e189a.slice/crio-920bf8d4a422fa5cbd408b52c591e9f743ca237900c11e33f44f640d15365eae WatchSource:0}: Error finding container 920bf8d4a422fa5cbd408b52c591e9f743ca237900c11e33f44f640d15365eae: Status 404 returned error can't find the container with id 920bf8d4a422fa5cbd408b52c591e9f743ca237900c11e33f44f640d15365eae
Jul 09 22:32:27.099017 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:27.099002    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kvxs4"
Jul 09 22:32:27.107900 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:27.107878    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb814909b_6f08_45e4_87fc_f598576068b0.slice/crio-94578900e6d100e50df7578f4b4cf1b4bc95770b5753c5e08da766560ab01159 WatchSource:0}: Error finding container 94578900e6d100e50df7578f4b4cf1b4bc95770b5753c5e08da766560ab01159: Status 404 returned error can't find the container with id 94578900e6d100e50df7578f4b4cf1b4bc95770b5753c5e08da766560ab01159
Jul 09 22:32:27.125594 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:27.125570    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8xdm8"
Jul 09 22:32:27.133852 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:27.133828    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28a65a7d_a6a4_48e7_a2ce_0a109e64ae6b.slice/crio-0623a9eded5be358b6b8f18fef3e1b9c470bef83f6623f54e8d19f6ad9b8cf01 WatchSource:0}: Error finding container 0623a9eded5be358b6b8f18fef3e1b9c470bef83f6623f54e8d19f6ad9b8cf01: Status 404 returned error can't find the container with id 0623a9eded5be358b6b8f18fef3e1b9c470bef83f6623f54e8d19f6ad9b8cf01
Jul 09 22:32:27.140849 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:27.140834    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s6zpq"
Jul 09 22:32:27.148902 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:27.148870    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d073fe5_c181_4f75_935f_df0d5472deca.slice/crio-f2c3b16c419fd8af5f7164276bc58814b7c89d9d3c43a57048d8a91fcdde8f3a WatchSource:0}: Error finding container f2c3b16c419fd8af5f7164276bc58814b7c89d9d3c43a57048d8a91fcdde8f3a: Status 404 returned error can't find the container with id f2c3b16c419fd8af5f7164276bc58814b7c89d9d3c43a57048d8a91fcdde8f3a
Jul 09 22:32:27.162295 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:27.162278    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j"
Jul 09 22:32:27.167313 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:27.167296    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m4t7g"
Jul 09 22:32:27.171015 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:27.170996    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61444372_fc8f_4fe4_a6a8_9c4b3785c7b0.slice/crio-53f47bd23e44154deff95302687d2fa50d70a6facbd798c2efaf97d099e360c7 WatchSource:0}: Error finding container 53f47bd23e44154deff95302687d2fa50d70a6facbd798c2efaf97d099e360c7: Status 404 returned error can't find the container with id 53f47bd23e44154deff95302687d2fa50d70a6facbd798c2efaf97d099e360c7
Jul 09 22:32:27.176657 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:27.176634    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9534b1d_3751_417d_825d_d0e59d7db95e.slice/crio-4801637e7745f2faa198f67b8347ac0dbbdbf6fecea61a694d8d3cf66ce5dfd7 WatchSource:0}: Error finding container 4801637e7745f2faa198f67b8347ac0dbbdbf6fecea61a694d8d3cf66ce5dfd7: Status 404 returned error can't find the container with id 4801637e7745f2faa198f67b8347ac0dbbdbf6fecea61a694d8d3cf66ce5dfd7
Jul 09 22:32:27.313827 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:27.313746    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg85q\" (UniqueName: \"kubernetes.io/projected/bbe027e4-d591-4abb-8773-a7424b322f54-kube-api-access-tg85q\") pod \"network-check-target-27942\" (UID: \"bbe027e4-d591-4abb-8773-a7424b322f54\") " pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:32:27.313827 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:27.313787    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs\") pod \"network-metrics-daemon-8r82v\" (UID: \"d94a7d72-cc1e-4193-99df-08721091f47e\") " pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:27.314065 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:27.313969    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:32:27.314065 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:27.313995    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:32:27.314065 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:27.314023    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:32:27.314065 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:27.314039    2564 projected.go:196] Error preparing data for projected volume kube-api-access-tg85q for pod openshift-network-diagnostics/network-check-target-27942: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:32:27.314237 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:27.314027    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs podName:d94a7d72-cc1e-4193-99df-08721091f47e nodeName:}" failed. No retries permitted until 2026-07-09 22:32:28.31401199 +0000 UTC m=+3.021907556 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs") pod "network-metrics-daemon-8r82v" (UID: "d94a7d72-cc1e-4193-99df-08721091f47e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:32:27.314237 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:27.314130    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbe027e4-d591-4abb-8773-a7424b322f54-kube-api-access-tg85q podName:bbe027e4-d591-4abb-8773-a7424b322f54 nodeName:}" failed. No retries permitted until 2026-07-09 22:32:28.314087995 +0000 UTC m=+3.021986378 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tg85q" (UniqueName: "kubernetes.io/projected/bbe027e4-d591-4abb-8773-a7424b322f54-kube-api-access-tg85q") pod "network-check-target-27942" (UID: "bbe027e4-d591-4abb-8773-a7424b322f54") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:32:27.414231 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:27.414205    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f95a3161-5787-4d60-b2ea-7c6222a168c7-original-pull-secret\") pod \"global-pull-secret-syncer-g9tnl\" (UID: \"f95a3161-5787-4d60-b2ea-7c6222a168c7\") " pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:27.414368 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:27.414294    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:32:27.414368 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:27.414338    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f95a3161-5787-4d60-b2ea-7c6222a168c7-original-pull-secret podName:f95a3161-5787-4d60-b2ea-7c6222a168c7 nodeName:}" failed. No retries permitted until 2026-07-09 22:32:28.414326886 +0000 UTC m=+3.122222456 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f95a3161-5787-4d60-b2ea-7c6222a168c7-original-pull-secret") pod "global-pull-secret-syncer-g9tnl" (UID: "f95a3161-5787-4d60-b2ea-7c6222a168c7") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:32:27.475611 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:32:27.475582    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod545740d3_4dfd_4016_a536_19e114d01fd2.slice/crio-bc4e365a0dd4f4a46a92b44688b2e5fcb3c007b368a710128d836350e8265204 WatchSource:0}: Error finding container bc4e365a0dd4f4a46a92b44688b2e5fcb3c007b368a710128d836350e8265204: Status 404 returned error can't find the container with id bc4e365a0dd4f4a46a92b44688b2e5fcb3c007b368a710128d836350e8265204
Jul 09 22:32:27.775993 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:27.775866    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 22:27:27 +0000 UTC" deadline="2028-03-15 03:34:48.048641133 +0000 UTC"
Jul 09 22:32:27.775993 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:27.775946    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14741h2m20.272700799s"
Jul 09 22:32:27.960840 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:27.960091    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:27.960840 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:27.960235    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r82v" podUID="d94a7d72-cc1e-4193-99df-08721091f47e"
Jul 09 22:32:27.960840 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:27.960672    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:32:27.960840 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:27.960783    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27942" podUID="bbe027e4-d591-4abb-8773-a7424b322f54"
Jul 09 22:32:27.996087 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:27.996026    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m4t7g" event={"ID":"f9534b1d-3751-417d-825d-d0e59d7db95e","Type":"ContainerStarted","Data":"4801637e7745f2faa198f67b8347ac0dbbdbf6fecea61a694d8d3cf66ce5dfd7"}
Jul 09 22:32:28.012833 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:28.012797    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kvxs4" event={"ID":"b814909b-6f08-45e4-87fc-f598576068b0","Type":"ContainerStarted","Data":"94578900e6d100e50df7578f4b4cf1b4bc95770b5753c5e08da766560ab01159"}
Jul 09 22:32:28.023182 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:28.023089    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bdts6" event={"ID":"f583e68f-51a9-41f6-93e6-e614945e189a","Type":"ContainerStarted","Data":"920bf8d4a422fa5cbd408b52c591e9f743ca237900c11e33f44f640d15365eae"}
Jul 09 22:32:28.029569 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:28.029506    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb" event={"ID":"0ff3ae08-bc54-4e2c-b565-9afe185f15fa","Type":"ContainerStarted","Data":"0ef416044f7257b84605a8aea75da06110a3d1f129cb02651a7fea479b538f65"}
Jul 09 22:32:28.030542 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:28.030521    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 22:32:28.035617 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:28.035479    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-84.ec2.internal" event={"ID":"72ab890cca4207a62d6e551584e9677e","Type":"ContainerStarted","Data":"b365fda570ce83c61ff6223e21a617a1875b5bb33d2c27004888bc4c6e75dcfd"}
Jul 09 22:32:28.047280 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:28.047255    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j" event={"ID":"61444372-fc8f-4fe4-a6a8-9c4b3785c7b0","Type":"ContainerStarted","Data":"53f47bd23e44154deff95302687d2fa50d70a6facbd798c2efaf97d099e360c7"}
Jul 09 22:32:28.049625 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:28.049554    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s6zpq" event={"ID":"6d073fe5-c181-4f75-935f-df0d5472deca","Type":"ContainerStarted","Data":"f2c3b16c419fd8af5f7164276bc58814b7c89d9d3c43a57048d8a91fcdde8f3a"}
Jul 09 22:32:28.066266 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:28.066064    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8xdm8" event={"ID":"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b","Type":"ContainerStarted","Data":"0623a9eded5be358b6b8f18fef3e1b9c470bef83f6623f54e8d19f6ad9b8cf01"}
Jul 09 22:32:28.083310 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:28.083285    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal" event={"ID":"fc302248faa47831341d8e57c35f776d","Type":"ContainerStarted","Data":"a386b58b9f258d048f904873d6df607a97f271ed65955d155191a99b2c07aaca"}
Jul 09 22:32:28.090647 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:28.090615    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftqnt" event={"ID":"58f72045-9e77-46a8-a0c5-26d90d2de9bc","Type":"ContainerStarted","Data":"b9b64d2660056a4c868da54aa376b4fa30788475aa7e1ef11e4374800c6976c7"}
Jul 09 22:32:28.107862 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:28.107835    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8prz6" event={"ID":"545740d3-4dfd-4016-a536-19e114d01fd2","Type":"ContainerStarted","Data":"bc4e365a0dd4f4a46a92b44688b2e5fcb3c007b368a710128d836350e8265204"}
Jul 09 22:32:28.321623 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:28.321534    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg85q\" (UniqueName: \"kubernetes.io/projected/bbe027e4-d591-4abb-8773-a7424b322f54-kube-api-access-tg85q\") pod \"network-check-target-27942\" (UID: \"bbe027e4-d591-4abb-8773-a7424b322f54\") " pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:32:28.321623 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:28.321603    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs\") pod \"network-metrics-daemon-8r82v\" (UID: \"d94a7d72-cc1e-4193-99df-08721091f47e\") " pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:28.321862 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:28.321823    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:32:28.321928 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:28.321903    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs podName:d94a7d72-cc1e-4193-99df-08721091f47e nodeName:}" failed. No retries permitted until 2026-07-09 22:32:30.321881555 +0000 UTC m=+5.029777121 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs") pod "network-metrics-daemon-8r82v" (UID: "d94a7d72-cc1e-4193-99df-08721091f47e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:32:28.322546 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:28.322383    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:32:28.322546 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:28.322405    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:32:28.322546 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:28.322419    2564 projected.go:196] Error preparing data for projected volume kube-api-access-tg85q for pod openshift-network-diagnostics/network-check-target-27942: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:32:28.322546 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:28.322496    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbe027e4-d591-4abb-8773-a7424b322f54-kube-api-access-tg85q podName:bbe027e4-d591-4abb-8773-a7424b322f54 nodeName:}" failed. No retries permitted until 2026-07-09 22:32:30.322451275 +0000 UTC m=+5.030346848 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tg85q" (UniqueName: "kubernetes.io/projected/bbe027e4-d591-4abb-8773-a7424b322f54-kube-api-access-tg85q") pod "network-check-target-27942" (UID: "bbe027e4-d591-4abb-8773-a7424b322f54") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:32:28.422890 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:28.422851    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f95a3161-5787-4d60-b2ea-7c6222a168c7-original-pull-secret\") pod \"global-pull-secret-syncer-g9tnl\" (UID: \"f95a3161-5787-4d60-b2ea-7c6222a168c7\") " pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:28.423084 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:28.423064    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:32:28.423159 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:28.423144    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f95a3161-5787-4d60-b2ea-7c6222a168c7-original-pull-secret podName:f95a3161-5787-4d60-b2ea-7c6222a168c7 nodeName:}" failed. No retries permitted until 2026-07-09 22:32:30.423114832 +0000 UTC m=+5.131010402 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f95a3161-5787-4d60-b2ea-7c6222a168c7-original-pull-secret") pod "global-pull-secret-syncer-g9tnl" (UID: "f95a3161-5787-4d60-b2ea-7c6222a168c7") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:32:28.776793 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:28.776659    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 22:27:27 +0000 UTC" deadline="2028-03-18 21:50:40.645845022 +0000 UTC"
Jul 09 22:32:28.776793 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:28.776730    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14831h18m11.869120063s"
Jul 09 22:32:28.960711 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:28.960115    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:28.960711 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:28.960288    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9tnl" podUID="f95a3161-5787-4d60-b2ea-7c6222a168c7"
Jul 09 22:32:29.961083 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:29.961051    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:29.961569 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:29.961197    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r82v" podUID="d94a7d72-cc1e-4193-99df-08721091f47e"
Jul 09 22:32:29.961704 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:29.961685    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:32:29.961815 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:29.961792    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27942" podUID="bbe027e4-d591-4abb-8773-a7424b322f54"
Jul 09 22:32:30.339765 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:30.338562    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs\") pod \"network-metrics-daemon-8r82v\" (UID: \"d94a7d72-cc1e-4193-99df-08721091f47e\") " pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:30.339765 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:30.338645    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg85q\" (UniqueName: \"kubernetes.io/projected/bbe027e4-d591-4abb-8773-a7424b322f54-kube-api-access-tg85q\") pod \"network-check-target-27942\" (UID: \"bbe027e4-d591-4abb-8773-a7424b322f54\") " pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:32:30.339765 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:30.338811    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:32:30.339765 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:30.338832    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:32:30.339765 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:30.338845    2564 projected.go:196] Error preparing data for projected volume kube-api-access-tg85q for pod openshift-network-diagnostics/network-check-target-27942: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:32:30.339765 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:30.338905    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbe027e4-d591-4abb-8773-a7424b322f54-kube-api-access-tg85q podName:bbe027e4-d591-4abb-8773-a7424b322f54 nodeName:}" failed. No retries permitted until 2026-07-09 22:32:34.338884906 +0000 UTC m=+9.046780475 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tg85q" (UniqueName: "kubernetes.io/projected/bbe027e4-d591-4abb-8773-a7424b322f54-kube-api-access-tg85q") pod "network-check-target-27942" (UID: "bbe027e4-d591-4abb-8773-a7424b322f54") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:32:30.339765 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:30.339350    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:32:30.339765 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:30.339413    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs podName:d94a7d72-cc1e-4193-99df-08721091f47e nodeName:}" failed. No retries permitted until 2026-07-09 22:32:34.339394303 +0000 UTC m=+9.047289872 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs") pod "network-metrics-daemon-8r82v" (UID: "d94a7d72-cc1e-4193-99df-08721091f47e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:32:30.440363 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:30.439622    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f95a3161-5787-4d60-b2ea-7c6222a168c7-original-pull-secret\") pod \"global-pull-secret-syncer-g9tnl\" (UID: \"f95a3161-5787-4d60-b2ea-7c6222a168c7\") " pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:30.440363 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:30.439908    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:32:30.440363 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:30.439994    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f95a3161-5787-4d60-b2ea-7c6222a168c7-original-pull-secret podName:f95a3161-5787-4d60-b2ea-7c6222a168c7 nodeName:}" failed. No retries permitted until 2026-07-09 22:32:34.439973465 +0000 UTC m=+9.147869033 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f95a3161-5787-4d60-b2ea-7c6222a168c7-original-pull-secret") pod "global-pull-secret-syncer-g9tnl" (UID: "f95a3161-5787-4d60-b2ea-7c6222a168c7") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:32:30.960722 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:30.959944    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:30.960722 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:30.960338    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9tnl" podUID="f95a3161-5787-4d60-b2ea-7c6222a168c7"
Jul 09 22:32:31.960062 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:31.959990    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:31.960062 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:31.960016    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:32:31.960618 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:31.960146    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r82v" podUID="d94a7d72-cc1e-4193-99df-08721091f47e"
Jul 09 22:32:31.960618 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:31.960586    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27942" podUID="bbe027e4-d591-4abb-8773-a7424b322f54"
Jul 09 22:32:32.959448 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:32.959416    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:32.959636 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:32.959546    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9tnl" podUID="f95a3161-5787-4d60-b2ea-7c6222a168c7"
Jul 09 22:32:33.959676 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:33.959634    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:33.960129 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:33.959764    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r82v" podUID="d94a7d72-cc1e-4193-99df-08721091f47e"
Jul 09 22:32:33.960129 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:33.959816    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:32:33.960129 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:33.959909    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27942" podUID="bbe027e4-d591-4abb-8773-a7424b322f54"
Jul 09 22:32:34.373899 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:34.373722    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs\") pod \"network-metrics-daemon-8r82v\" (UID: \"d94a7d72-cc1e-4193-99df-08721091f47e\") " pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:34.373899 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:34.373812    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg85q\" (UniqueName: \"kubernetes.io/projected/bbe027e4-d591-4abb-8773-a7424b322f54-kube-api-access-tg85q\") pod \"network-check-target-27942\" (UID: \"bbe027e4-d591-4abb-8773-a7424b322f54\") " pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:32:34.373899 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:34.373835    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:32:34.374172 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:34.373919    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs podName:d94a7d72-cc1e-4193-99df-08721091f47e nodeName:}" failed. No retries permitted until 2026-07-09 22:32:42.373900584 +0000 UTC m=+17.081796153 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs") pod "network-metrics-daemon-8r82v" (UID: "d94a7d72-cc1e-4193-99df-08721091f47e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:32:34.374424 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:34.374303    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:32:34.374424 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:34.374330    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:32:34.374424 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:34.374344    2564 projected.go:196] Error preparing data for projected volume kube-api-access-tg85q for pod openshift-network-diagnostics/network-check-target-27942: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:32:34.374424 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:34.374400    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbe027e4-d591-4abb-8773-a7424b322f54-kube-api-access-tg85q podName:bbe027e4-d591-4abb-8773-a7424b322f54 nodeName:}" failed. No retries permitted until 2026-07-09 22:32:42.374384826 +0000 UTC m=+17.082280407 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tg85q" (UniqueName: "kubernetes.io/projected/bbe027e4-d591-4abb-8773-a7424b322f54-kube-api-access-tg85q") pod "network-check-target-27942" (UID: "bbe027e4-d591-4abb-8773-a7424b322f54") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:32:34.475075 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:34.475048    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f95a3161-5787-4d60-b2ea-7c6222a168c7-original-pull-secret\") pod \"global-pull-secret-syncer-g9tnl\" (UID: \"f95a3161-5787-4d60-b2ea-7c6222a168c7\") " pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:34.475225 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:34.475179    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:32:34.475270 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:34.475239    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f95a3161-5787-4d60-b2ea-7c6222a168c7-original-pull-secret podName:f95a3161-5787-4d60-b2ea-7c6222a168c7 nodeName:}" failed. No retries permitted until 2026-07-09 22:32:42.475223701 +0000 UTC m=+17.183119266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f95a3161-5787-4d60-b2ea-7c6222a168c7-original-pull-secret") pod "global-pull-secret-syncer-g9tnl" (UID: "f95a3161-5787-4d60-b2ea-7c6222a168c7") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:32:34.959496 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:34.959459    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:34.959657 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:34.959590    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9tnl" podUID="f95a3161-5787-4d60-b2ea-7c6222a168c7"
Jul 09 22:32:35.960902 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:35.960831    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:35.961438 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:35.960984    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r82v" podUID="d94a7d72-cc1e-4193-99df-08721091f47e"
Jul 09 22:32:35.961438 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:35.961018    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:32:35.961438 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:35.961147    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27942" podUID="bbe027e4-d591-4abb-8773-a7424b322f54"
Jul 09 22:32:36.959441 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:36.959402    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:36.959629 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:36.959543    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9tnl" podUID="f95a3161-5787-4d60-b2ea-7c6222a168c7"
Jul 09 22:32:37.960383 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:37.960319    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:37.960904 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:37.960319    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:32:37.960904 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:37.960463    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r82v" podUID="d94a7d72-cc1e-4193-99df-08721091f47e"
Jul 09 22:32:37.960904 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:37.960493    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27942" podUID="bbe027e4-d591-4abb-8773-a7424b322f54"
Jul 09 22:32:38.959803 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:38.959763    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:38.959985 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:38.959904    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9tnl" podUID="f95a3161-5787-4d60-b2ea-7c6222a168c7"
Jul 09 22:32:39.959849 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:39.959766    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:39.960305 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:39.959766    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:32:39.960305 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:39.959918    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r82v" podUID="d94a7d72-cc1e-4193-99df-08721091f47e"
Jul 09 22:32:39.960305 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:39.959972    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27942" podUID="bbe027e4-d591-4abb-8773-a7424b322f54"
Jul 09 22:32:40.959767 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:40.959736    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:40.959959 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:40.959847    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9tnl" podUID="f95a3161-5787-4d60-b2ea-7c6222a168c7"
Jul 09 22:32:41.959792 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:41.959721    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:41.959992 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:41.959861    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r82v" podUID="d94a7d72-cc1e-4193-99df-08721091f47e"
Jul 09 22:32:41.959992 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:41.959912    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:32:41.960388 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:41.960016    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27942" podUID="bbe027e4-d591-4abb-8773-a7424b322f54"
Jul 09 22:32:42.437340 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:42.437259    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg85q\" (UniqueName: \"kubernetes.io/projected/bbe027e4-d591-4abb-8773-a7424b322f54-kube-api-access-tg85q\") pod \"network-check-target-27942\" (UID: \"bbe027e4-d591-4abb-8773-a7424b322f54\") " pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:32:42.437340 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:42.437329    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs\") pod \"network-metrics-daemon-8r82v\" (UID: \"d94a7d72-cc1e-4193-99df-08721091f47e\") " pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:42.437555 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:42.437437    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:32:42.437555 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:42.437465    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:32:42.437555 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:42.437477    2564 projected.go:196] Error preparing data for projected volume kube-api-access-tg85q for pod openshift-network-diagnostics/network-check-target-27942: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:32:42.437555 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:42.437523    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbe027e4-d591-4abb-8773-a7424b322f54-kube-api-access-tg85q podName:bbe027e4-d591-4abb-8773-a7424b322f54 nodeName:}" failed. No retries permitted until 2026-07-09 22:32:58.437508275 +0000 UTC m=+33.145403840 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tg85q" (UniqueName: "kubernetes.io/projected/bbe027e4-d591-4abb-8773-a7424b322f54-kube-api-access-tg85q") pod "network-check-target-27942" (UID: "bbe027e4-d591-4abb-8773-a7424b322f54") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:32:42.437555 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:42.437441    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:32:42.437792 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:42.437630    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs podName:d94a7d72-cc1e-4193-99df-08721091f47e nodeName:}" failed. No retries permitted until 2026-07-09 22:32:58.437605224 +0000 UTC m=+33.145500801 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs") pod "network-metrics-daemon-8r82v" (UID: "d94a7d72-cc1e-4193-99df-08721091f47e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:32:42.538531 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:42.538496    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f95a3161-5787-4d60-b2ea-7c6222a168c7-original-pull-secret\") pod \"global-pull-secret-syncer-g9tnl\" (UID: \"f95a3161-5787-4d60-b2ea-7c6222a168c7\") " pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:42.538696 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:42.538675    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:32:42.538769 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:42.538752    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f95a3161-5787-4d60-b2ea-7c6222a168c7-original-pull-secret podName:f95a3161-5787-4d60-b2ea-7c6222a168c7 nodeName:}" failed. No retries permitted until 2026-07-09 22:32:58.538732757 +0000 UTC m=+33.246628344 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f95a3161-5787-4d60-b2ea-7c6222a168c7-original-pull-secret") pod "global-pull-secret-syncer-g9tnl" (UID: "f95a3161-5787-4d60-b2ea-7c6222a168c7") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:32:42.959476 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:42.959449    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:42.959638 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:42.959571    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9tnl" podUID="f95a3161-5787-4d60-b2ea-7c6222a168c7"
Jul 09 22:32:43.960238 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:43.960162    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:43.960662 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:43.960294    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r82v" podUID="d94a7d72-cc1e-4193-99df-08721091f47e"
Jul 09 22:32:43.960662 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:43.960353    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:32:43.960662 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:43.960460    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27942" podUID="bbe027e4-d591-4abb-8773-a7424b322f54"
Jul 09 22:32:44.960022 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:44.959992    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:44.960187 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:44.960112    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9tnl" podUID="f95a3161-5787-4d60-b2ea-7c6222a168c7"
Jul 09 22:32:45.960579 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:45.960542    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:45.961040 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:45.960662    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r82v" podUID="d94a7d72-cc1e-4193-99df-08721091f47e"
Jul 09 22:32:45.961040 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:45.960730    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:32:45.961040 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:45.960848    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27942" podUID="bbe027e4-d591-4abb-8773-a7424b322f54"
Jul 09 22:32:46.960200 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:46.960159    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:46.960369 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:46.960287    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9tnl" podUID="f95a3161-5787-4d60-b2ea-7c6222a168c7"
Jul 09 22:32:47.959788 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:47.959749    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:32:47.960368 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:47.959856    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27942" podUID="bbe027e4-d591-4abb-8773-a7424b322f54"
Jul 09 22:32:47.960368 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:47.959893    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:47.960368 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:47.959986    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r82v" podUID="d94a7d72-cc1e-4193-99df-08721091f47e"
Jul 09 22:32:48.168211 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:48.168175    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m4t7g" event={"ID":"f9534b1d-3751-417d-825d-d0e59d7db95e","Type":"ContainerStarted","Data":"1aebd7283ff3154112055641340a007312b75a1a988640f8f1eee8411f6b4880"}
Jul 09 22:32:48.187515 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:48.187394    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m4t7g" podStartSLOduration=1.380668684 podStartE2EDuration="22.187374248s" totalImagesPullingTime="20.806705564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:32:48.186596097 +0000 UTC m=+22.894491699" watchObservedRunningTime="2026-07-09 22:32:48.187374248 +0000 UTC m=+22.895269836"
Jul 09 22:32:48.194083 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:48.194060    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-84.ec2.internal" event={"ID":"72ab890cca4207a62d6e551584e9677e","Type":"ContainerStarted","Data":"ccc4e9e7dd1fbc225a86c6832b58b9e479643e985a5a3a4fd6c1d4eb7aaec8cb"}
Jul 09 22:32:48.203568 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:48.203541    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8xdm8" event={"ID":"28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b","Type":"ContainerStarted","Data":"7bc3c8a755c7f6435234c352b45a3d1d33e420321748d3710b824475f7e25105"}
Jul 09 22:32:48.232999 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:48.232946    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8xdm8" podStartSLOduration=1.338574751 podStartE2EDuration="22.232923507s" totalImagesPullingTime="20.894348756s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:32:48.232688043 +0000 UTC m=+22.940583620" watchObservedRunningTime="2026-07-09 22:32:48.232923507 +0000 UTC m=+22.940819095"
Jul 09 22:32:48.233496 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:48.233455    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-84.ec2.internal" podStartSLOduration=21.233437325 podStartE2EDuration="21.233437325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:32:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:32:48.210315772 +0000 UTC m=+22.918211361" watchObservedRunningTime="2026-07-09 22:32:48.233437325 +0000 UTC m=+22.941332915"
Jul 09 22:32:48.960039 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:48.959850    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:48.960675 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:48.960106    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9tnl" podUID="f95a3161-5787-4d60-b2ea-7c6222a168c7"
Jul 09 22:32:49.206765 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:49.206737    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kvxs4" event={"ID":"b814909b-6f08-45e4-87fc-f598576068b0","Type":"ContainerStarted","Data":"45d05b2852fceb97a1a6927304bd7da083d5bfea78be183902c960fec1d02ca0"}
Jul 09 22:32:49.208007 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:49.207987    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bdts6" event={"ID":"f583e68f-51a9-41f6-93e6-e614945e189a","Type":"ContainerStarted","Data":"ca3408aaddcfb67f35382368d7e9b0d8938221d859adffb5314f9db37255d97c"}
Jul 09 22:32:49.210719 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:49.210695    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb" event={"ID":"0ff3ae08-bc54-4e2c-b565-9afe185f15fa","Type":"ContainerStarted","Data":"7ace2c387841d5f3604c37fe690d32f55400ed9b903ee376013db84bfa28b54c"}
Jul 09 22:32:49.210804 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:49.210757    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb" event={"ID":"0ff3ae08-bc54-4e2c-b565-9afe185f15fa","Type":"ContainerStarted","Data":"2bf5b1aac0f4dd728b5b8548b4b5b3870af16a21342c1a4a17aed081c842d83a"}
Jul 09 22:32:49.210804 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:49.210790    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb" event={"ID":"0ff3ae08-bc54-4e2c-b565-9afe185f15fa","Type":"ContainerStarted","Data":"2fa09fa8c7a024d4a284efa04bca4a8ce08ff82be258412fc22fe622a8ce4423"}
Jul 09 22:32:49.210903 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:49.210827    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb" event={"ID":"0ff3ae08-bc54-4e2c-b565-9afe185f15fa","Type":"ContainerStarted","Data":"027ff265ce5ecd725306fdb01c2f56dee8b518cce85252068f5a643ea92f9452"}
Jul 09 22:32:49.210903 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:49.210855    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb" event={"ID":"0ff3ae08-bc54-4e2c-b565-9afe185f15fa","Type":"ContainerStarted","Data":"7f2beceabe0ad1ab58411862e681daa7e37575ebda706ede384869ce973afa6c"}
Jul 09 22:32:49.213401 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:49.211274    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb" event={"ID":"0ff3ae08-bc54-4e2c-b565-9afe185f15fa","Type":"ContainerStarted","Data":"67d8e9566c91a4cc712f6c214a117bea69e60c23329585f7c2f9e1fef90a35cc"}
Jul 09 22:32:49.214776 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:49.214754    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j" event={"ID":"61444372-fc8f-4fe4-a6a8-9c4b3785c7b0","Type":"ContainerStarted","Data":"b6e639646c35322f2fbfead653f4ce04d2c0da7698898d918d612ab5be71e984"}
Jul 09 22:32:49.215986 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:49.215961    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s6zpq" event={"ID":"6d073fe5-c181-4f75-935f-df0d5472deca","Type":"ContainerStarted","Data":"4bbda3a8e7b3e3225b8cd3a70768a471685e11a072c29eb50510b53f5a7f72d3"}
Jul 09 22:32:49.217267 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:49.217248    2564 generic.go:356] "Generic (PLEG): container finished" podID="fc302248faa47831341d8e57c35f776d" containerID="efaf1cfff72e087311af53213c34f51a06e68f5d2a92e8e1c1447456bc65318d" exitCode=0
Jul 09 22:32:49.217355 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:49.217305    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal" event={"ID":"fc302248faa47831341d8e57c35f776d","Type":"ContainerDied","Data":"efaf1cfff72e087311af53213c34f51a06e68f5d2a92e8e1c1447456bc65318d"}
Jul 09 22:32:49.218748 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:49.218729    2564 generic.go:356] "Generic (PLEG): container finished" podID="58f72045-9e77-46a8-a0c5-26d90d2de9bc" containerID="70920f050495e52ed4cf87fcffe0c90a8e74ca9dc45d3bf585be4e66b372b391" exitCode=0
Jul 09 22:32:49.218821 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:49.218801    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftqnt" event={"ID":"58f72045-9e77-46a8-a0c5-26d90d2de9bc","Type":"ContainerDied","Data":"70920f050495e52ed4cf87fcffe0c90a8e74ca9dc45d3bf585be4e66b372b391"}
Jul 09 22:32:49.220312 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:49.220291    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8prz6" event={"ID":"545740d3-4dfd-4016-a536-19e114d01fd2","Type":"ContainerStarted","Data":"c1d54e555682db3135216e4a389cf91f03ef60b7a73ac2b368e9a1c8815f06fc"}
Jul 09 22:32:49.221816 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:49.221778    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kvxs4" podStartSLOduration=10.575863038 podStartE2EDuration="23.221765964s" totalImagesPullingTime="12.645902926s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:32:49.221219926 +0000 UTC m=+23.929115527" watchObservedRunningTime="2026-07-09 22:32:49.221765964 +0000 UTC m=+23.929661567"
Jul 09 22:32:49.276089 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:49.276052    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8prz6" podStartSLOduration=2.772053263 podStartE2EDuration="23.276037913s" totalImagesPullingTime="20.50398465s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:32:49.249175075 +0000 UTC m=+23.957070661" watchObservedRunningTime="2026-07-09 22:32:49.276037913 +0000 UTC m=+23.983933509"
Jul 09 22:32:49.290624 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:49.290585    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bdts6" podStartSLOduration=2.397487661 podStartE2EDuration="23.290570397s" totalImagesPullingTime="20.893082736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:32:49.29010785 +0000 UTC m=+23.998003436" watchObservedRunningTime="2026-07-09 22:32:49.290570397 +0000 UTC m=+23.998465984"
Jul 09 22:32:49.899060 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:49.899028    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 22:32:49.960360 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:49.960337    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:32:49.960834 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:49.960371    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:49.960834 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:49.960450    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27942" podUID="bbe027e4-d591-4abb-8773-a7424b322f54"
Jul 09 22:32:49.960834 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:49.960602    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r82v" podUID="d94a7d72-cc1e-4193-99df-08721091f47e"
Jul 09 22:32:50.224943 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:50.224911    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j" event={"ID":"61444372-fc8f-4fe4-a6a8-9c4b3785c7b0","Type":"ContainerStarted","Data":"60563d82d0c2c17157ad486373a5faf9a242e89057874eb152b097b218460dce"}
Jul 09 22:32:50.226909 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:50.226861    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal" event={"ID":"fc302248faa47831341d8e57c35f776d","Type":"ContainerStarted","Data":"ebdd42c792a2d954eed5f43ff15e3ba3c00e9a105d1008759c5a27e9132ac5c9"}
Jul 09 22:32:50.241816 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:50.241772    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s6zpq" podStartSLOduration=3.407614321 podStartE2EDuration="24.241757831s" totalImagesPullingTime="20.83414351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:32:50.24153158 +0000 UTC m=+24.949427168" watchObservedRunningTime="2026-07-09 22:32:50.241757831 +0000 UTC m=+24.949653418"
Jul 09 22:32:50.257265 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:50.257224    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-84.ec2.internal" podStartSLOduration=23.257211871 podStartE2EDuration="23.257211871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:32:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:32:50.256951734 +0000 UTC m=+24.964847335" watchObservedRunningTime="2026-07-09 22:32:50.257211871 +0000 UTC m=+24.965107457"
Jul 09 22:32:50.788638 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:50.788547    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T22:32:49.899056618Z","UUID":"063510e5-a2f5-43d7-b77c-8e96c8608947","Handler":null,"Name":"","Endpoint":""}
Jul 09 22:32:50.790208 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:50.790185    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 22:32:50.790345 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:50.790221    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 22:32:50.959909 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:50.959887    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:50.960004 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:50.959987    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9tnl" podUID="f95a3161-5787-4d60-b2ea-7c6222a168c7"
Jul 09 22:32:51.231716 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:51.231691    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb" event={"ID":"0ff3ae08-bc54-4e2c-b565-9afe185f15fa","Type":"ContainerStarted","Data":"07e10cf73db6755c66cdfe507ca54972fd821efe86ce53255f9da170e938c2ec"}
Jul 09 22:32:51.316228 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:51.316204    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bdts6"
Jul 09 22:32:51.316742 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:51.316723    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bdts6"
Jul 09 22:32:51.959986 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:51.959952    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:32:51.960172 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:51.959958    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:51.960172 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:51.960087    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27942" podUID="bbe027e4-d591-4abb-8773-a7424b322f54"
Jul 09 22:32:51.960289 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:51.960183    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r82v" podUID="d94a7d72-cc1e-4193-99df-08721091f47e"
Jul 09 22:32:52.235358 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:52.235278    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j" event={"ID":"61444372-fc8f-4fe4-a6a8-9c4b3785c7b0","Type":"ContainerStarted","Data":"95bf5ff8f03a489013422f6bfc8f020a7c6aff320a154f3569d5624b85c7f0a9"}
Jul 09 22:32:52.235781 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:52.235648    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bdts6"
Jul 09 22:32:52.236047 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:52.236027    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bdts6"
Jul 09 22:32:52.252212 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:52.252164    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdg6j" podStartSLOduration=2.77324182 podStartE2EDuration="26.252149342s" totalImagesPullingTime="23.478907522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:32:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:32:52.252084195 +0000 UTC m=+26.959979797" watchObservedRunningTime="2026-07-09 22:32:52.252149342 +0000 UTC m=+26.960044931"
Jul 09 22:32:52.960454 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:52.960290    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:52.960602 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:52.960552    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9tnl" podUID="f95a3161-5787-4d60-b2ea-7c6222a168c7"
Jul 09 22:32:53.242515 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:53.242441    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb" event={"ID":"0ff3ae08-bc54-4e2c-b565-9afe185f15fa","Type":"ContainerStarted","Data":"db874bdd5c8bda1d6c481dfca7caa9d802b81ce1a875d31f06fcfa770a070c94"}
Jul 09 22:32:53.243474 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:53.243457    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:53.243556 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:53.243511    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:53.260385 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:53.260363    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:53.261291 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:53.261268    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:53.269510 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:53.269467    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb" podStartSLOduration=6.270033204 podStartE2EDuration="27.269455694s" totalImagesPullingTime="20.99942249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:32:53.269294631 +0000 UTC m=+27.977190219" watchObservedRunningTime="2026-07-09 22:32:53.269455694 +0000 UTC m=+27.977351280"
Jul 09 22:32:53.959642 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:53.959607    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:53.959800 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:53.959615    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:32:53.959800 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:53.959762    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r82v" podUID="d94a7d72-cc1e-4193-99df-08721091f47e"
Jul 09 22:32:53.959895 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:53.959808    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27942" podUID="bbe027e4-d591-4abb-8773-a7424b322f54"
Jul 09 22:32:54.245483 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:54.245220    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 22:32:54.959822 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:54.959786    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:54.959980 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:54.959925    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9tnl" podUID="f95a3161-5787-4d60-b2ea-7c6222a168c7"
Jul 09 22:32:55.090858 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:55.090827    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8r82v"]
Jul 09 22:32:55.091025 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:55.090954    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:55.091112 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:55.091077    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r82v" podUID="d94a7d72-cc1e-4193-99df-08721091f47e"
Jul 09 22:32:55.096307 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:55.096274    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-27942"]
Jul 09 22:32:55.096455 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:55.096362    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:32:55.096508 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:55.096452    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27942" podUID="bbe027e4-d591-4abb-8773-a7424b322f54"
Jul 09 22:32:55.105006 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:55.104982    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g9tnl"]
Jul 09 22:32:55.247646 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:55.247568    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:55.248073 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:55.247686    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9tnl" podUID="f95a3161-5787-4d60-b2ea-7c6222a168c7"
Jul 09 22:32:55.248073 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:55.247842    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 22:32:55.556048 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:55.555987    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:32:56.251771 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:56.251738    2564 generic.go:356] "Generic (PLEG): container finished" podID="58f72045-9e77-46a8-a0c5-26d90d2de9bc" containerID="652792a382854ee8bc9641e198faf3eec35f0f79ef35d240eeeee22cf918207b" exitCode=0
Jul 09 22:32:56.252217 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:56.251817    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftqnt" event={"ID":"58f72045-9e77-46a8-a0c5-26d90d2de9bc","Type":"ContainerDied","Data":"652792a382854ee8bc9641e198faf3eec35f0f79ef35d240eeeee22cf918207b"}
Jul 09 22:32:56.960004 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:56.959967    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:32:56.960157 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:56.959976    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:56.960157 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:56.960106    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27942" podUID="bbe027e4-d591-4abb-8773-a7424b322f54"
Jul 09 22:32:56.960277 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:56.959976    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:56.960277 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:56.960183    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9tnl" podUID="f95a3161-5787-4d60-b2ea-7c6222a168c7"
Jul 09 22:32:56.960370 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:56.960296    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r82v" podUID="d94a7d72-cc1e-4193-99df-08721091f47e"
Jul 09 22:32:58.258017 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:58.257983    2564 generic.go:356] "Generic (PLEG): container finished" podID="58f72045-9e77-46a8-a0c5-26d90d2de9bc" containerID="9aa1f0a96af1f54d4ea1b4e50e2a38f6b2a706519e416d0038245ccc2fe1791c" exitCode=0
Jul 09 22:32:58.258374 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:58.258062    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftqnt" event={"ID":"58f72045-9e77-46a8-a0c5-26d90d2de9bc","Type":"ContainerDied","Data":"9aa1f0a96af1f54d4ea1b4e50e2a38f6b2a706519e416d0038245ccc2fe1791c"}
Jul 09 22:32:58.463610 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:58.463577    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg85q\" (UniqueName: \"kubernetes.io/projected/bbe027e4-d591-4abb-8773-a7424b322f54-kube-api-access-tg85q\") pod \"network-check-target-27942\" (UID: \"bbe027e4-d591-4abb-8773-a7424b322f54\") " pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:32:58.463735 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:58.463619    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs\") pod \"network-metrics-daemon-8r82v\" (UID: \"d94a7d72-cc1e-4193-99df-08721091f47e\") " pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:58.463735 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:58.463703    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:32:58.463735 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:58.463719    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:32:58.463818 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:58.463739    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:32:58.463818 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:58.463749    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs podName:d94a7d72-cc1e-4193-99df-08721091f47e nodeName:}" failed. No retries permitted until 2026-07-09 22:33:30.46373629 +0000 UTC m=+65.171631858 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs") pod "network-metrics-daemon-8r82v" (UID: "d94a7d72-cc1e-4193-99df-08721091f47e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:32:58.463818 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:58.463751    2564 projected.go:196] Error preparing data for projected volume kube-api-access-tg85q for pod openshift-network-diagnostics/network-check-target-27942: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:32:58.463818 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:58.463792    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbe027e4-d591-4abb-8773-a7424b322f54-kube-api-access-tg85q podName:bbe027e4-d591-4abb-8773-a7424b322f54 nodeName:}" failed. No retries permitted until 2026-07-09 22:33:30.463779675 +0000 UTC m=+65.171675240 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tg85q" (UniqueName: "kubernetes.io/projected/bbe027e4-d591-4abb-8773-a7424b322f54-kube-api-access-tg85q") pod "network-check-target-27942" (UID: "bbe027e4-d591-4abb-8773-a7424b322f54") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:32:58.564444 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:58.564378    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f95a3161-5787-4d60-b2ea-7c6222a168c7-original-pull-secret\") pod \"global-pull-secret-syncer-g9tnl\" (UID: \"f95a3161-5787-4d60-b2ea-7c6222a168c7\") " pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:58.564558 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:58.564507    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:32:58.564636 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:58.564560    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f95a3161-5787-4d60-b2ea-7c6222a168c7-original-pull-secret podName:f95a3161-5787-4d60-b2ea-7c6222a168c7 nodeName:}" failed. No retries permitted until 2026-07-09 22:33:30.5645455 +0000 UTC m=+65.272441078 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f95a3161-5787-4d60-b2ea-7c6222a168c7-original-pull-secret") pod "global-pull-secret-syncer-g9tnl" (UID: "f95a3161-5787-4d60-b2ea-7c6222a168c7") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:32:58.960210 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:58.960178    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:32:58.960378 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:58.960178    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:32:58.960378 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:58.960301    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:32:58.960378 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:58.960303    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9tnl" podUID="f95a3161-5787-4d60-b2ea-7c6222a168c7"
Jul 09 22:32:58.960539 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:58.960373    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27942" podUID="bbe027e4-d591-4abb-8773-a7424b322f54"
Jul 09 22:32:58.960539 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:32:58.960462    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r82v" podUID="d94a7d72-cc1e-4193-99df-08721091f47e"
Jul 09 22:32:59.262307 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:59.262092    2564 generic.go:356] "Generic (PLEG): container finished" podID="58f72045-9e77-46a8-a0c5-26d90d2de9bc" containerID="cfd3c7ac17c75013d2e9d1650eeae523a03d1a0b409e0178989473ca3fffee33" exitCode=0
Jul 09 22:32:59.262307 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:32:59.262169    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftqnt" event={"ID":"58f72045-9e77-46a8-a0c5-26d90d2de9bc","Type":"ContainerDied","Data":"cfd3c7ac17c75013d2e9d1650eeae523a03d1a0b409e0178989473ca3fffee33"}
Jul 09 22:33:00.959563 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:00.959531    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:33:00.959563 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:00.959563    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:33:00.959973 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:00.959651    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27942" podUID="bbe027e4-d591-4abb-8773-a7424b322f54"
Jul 09 22:33:00.959973 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:00.959695    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:33:00.959973 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:00.959777    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9tnl" podUID="f95a3161-5787-4d60-b2ea-7c6222a168c7"
Jul 09 22:33:00.959973 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:00.959887    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r82v" podUID="d94a7d72-cc1e-4193-99df-08721091f47e"
Jul 09 22:33:01.025677 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.025649    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-84.ec2.internal" event="NodeReady"
Jul 09 22:33:01.025817 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.025774    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 22:33:01.061244 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.061205    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-696ffdcfbf-rbsjs"]
Jul 09 22:33:01.063727 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.063707    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb"]
Jul 09 22:33:01.063850 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.063835    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:01.065924 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.065896    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 09 22:33:01.065924 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.065915    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 09 22:33:01.066106 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.066030    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 09 22:33:01.066310 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.066289    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6gjz6\""
Jul 09 22:33:01.066405 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.066349    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb"
Jul 09 22:33:01.068982 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.068911    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 09 22:33:01.069376 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.069356    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lt8xn\""
Jul 09 22:33:01.069885 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.069838    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 09 22:33:01.076000 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.075981    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 09 22:33:01.078302 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.078283    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb"]
Jul 09 22:33:01.085951 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.085574    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-696ffdcfbf-rbsjs"]
Jul 09 22:33:01.086367 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.086342    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hx7rz"]
Jul 09 22:33:01.089325 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.089306    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xv6cj"]
Jul 09 22:33:01.089465 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.089452    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:33:01.091565 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.091545    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 22:33:01.091651 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.091607    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 22:33:01.091831 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.091811    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xdqcx\""
Jul 09 22:33:01.092043 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.092024    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xv6cj"
Jul 09 22:33:01.094167 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.094149    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-twh9c\""
Jul 09 22:33:01.094275 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.094174    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 22:33:01.094275 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.094213    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 22:33:01.094361 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.094284    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 22:33:01.097664 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.097641    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xv6cj"]
Jul 09 22:33:01.101702 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.101657    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hx7rz"]
Jul 09 22:33:01.184415 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.184386    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5wtkb\" (UID: \"1d270c40-c725-483f-bf1c-41b9e826f8e2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb"
Jul 09 22:33:01.184589 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.184445    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1d270c40-c725-483f-bf1c-41b9e826f8e2-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-5wtkb\" (UID: \"1d270c40-c725-483f-bf1c-41b9e826f8e2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb"
Jul 09 22:33:01.184589 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.184517    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-bound-sa-token\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:01.184589 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.184569    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d7db35e3-d753-41f8-af7e-6d7a605e89cd-config-volume\") pod \"dns-default-hx7rz\" (UID: \"d7db35e3-d753-41f8-af7e-6d7a605e89cd\") " pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:33:01.184738 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.184596    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqzml\" (UniqueName: \"kubernetes.io/projected/d7db35e3-d753-41f8-af7e-6d7a605e89cd-kube-api-access-mqzml\") pod \"dns-default-hx7rz\" (UID: \"d7db35e3-d753-41f8-af7e-6d7a605e89cd\") " pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:33:01.184738 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.184620    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:01.184738 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.184644    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7vps\" (UniqueName: \"kubernetes.io/projected/4c9c71de-bcb4-43da-ac3f-42631496dbdd-kube-api-access-p7vps\") pod \"ingress-canary-xv6cj\" (UID: \"4c9c71de-bcb4-43da-ac3f-42631496dbdd\") " pod="openshift-ingress-canary/ingress-canary-xv6cj"
Jul 09 22:33:01.184738 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.184671    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c993f43-ee03-498e-b6d0-5e8f413839b1-installation-pull-secrets\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:01.184738 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.184693    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c9c71de-bcb4-43da-ac3f-42631496dbdd-cert\") pod \"ingress-canary-xv6cj\" (UID: \"4c9c71de-bcb4-43da-ac3f-42631496dbdd\") " pod="openshift-ingress-canary/ingress-canary-xv6cj"
Jul 09 22:33:01.184738 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.184725    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c993f43-ee03-498e-b6d0-5e8f413839b1-image-registry-private-configuration\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:01.185023 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.184753    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdmn5\" (UniqueName: \"kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-kube-api-access-kdmn5\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:01.185023 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.184824    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c993f43-ee03-498e-b6d0-5e8f413839b1-ca-trust-extracted\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:01.185023 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.184891    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-certificates\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:01.185023 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.184923    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls\") pod \"dns-default-hx7rz\" (UID: \"d7db35e3-d753-41f8-af7e-6d7a605e89cd\") " pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:33:01.185023 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.184958    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7db35e3-d753-41f8-af7e-6d7a605e89cd-tmp-dir\") pod \"dns-default-hx7rz\" (UID: \"d7db35e3-d753-41f8-af7e-6d7a605e89cd\") " pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:33:01.185023 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.184981    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c993f43-ee03-498e-b6d0-5e8f413839b1-trusted-ca\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:01.243918 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.243816    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdts6_f583e68f-51a9-41f6-93e6-e614945e189a/konnectivity-agent/0.log" limit=1024
Jul 09 22:33:01.285488 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.285459    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1d270c40-c725-483f-bf1c-41b9e826f8e2-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-5wtkb\" (UID: \"1d270c40-c725-483f-bf1c-41b9e826f8e2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb"
Jul 09 22:33:01.285488 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.285492    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-bound-sa-token\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:01.285753 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.285521    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d7db35e3-d753-41f8-af7e-6d7a605e89cd-config-volume\") pod \"dns-default-hx7rz\" (UID: \"d7db35e3-d753-41f8-af7e-6d7a605e89cd\") " pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:33:01.285753 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.285544    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqzml\" (UniqueName: \"kubernetes.io/projected/d7db35e3-d753-41f8-af7e-6d7a605e89cd-kube-api-access-mqzml\") pod \"dns-default-hx7rz\" (UID: \"d7db35e3-d753-41f8-af7e-6d7a605e89cd\") " pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:33:01.285753 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.285568    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:01.285753 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.285589    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7vps\" (UniqueName: \"kubernetes.io/projected/4c9c71de-bcb4-43da-ac3f-42631496dbdd-kube-api-access-p7vps\") pod \"ingress-canary-xv6cj\" (UID: \"4c9c71de-bcb4-43da-ac3f-42631496dbdd\") " pod="openshift-ingress-canary/ingress-canary-xv6cj"
Jul 09 22:33:01.285753 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.285615    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c993f43-ee03-498e-b6d0-5e8f413839b1-installation-pull-secrets\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:01.285753 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.285639    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c9c71de-bcb4-43da-ac3f-42631496dbdd-cert\") pod \"ingress-canary-xv6cj\" (UID: \"4c9c71de-bcb4-43da-ac3f-42631496dbdd\") " pod="openshift-ingress-canary/ingress-canary-xv6cj"
Jul 09 22:33:01.285753 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.285671    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c993f43-ee03-498e-b6d0-5e8f413839b1-image-registry-private-configuration\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:01.285753 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.285704    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdmn5\" (UniqueName: \"kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-kube-api-access-kdmn5\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:01.286735 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.285760    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c993f43-ee03-498e-b6d0-5e8f413839b1-ca-trust-extracted\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:01.286735 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:01.285786    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 22:33:01.286735 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:01.285806    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-696ffdcfbf-rbsjs: secret "image-registry-tls" not found
Jul 09 22:33:01.286735 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:01.285860    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls podName:3c993f43-ee03-498e-b6d0-5e8f413839b1 nodeName:}" failed. No retries permitted until 2026-07-09 22:33:01.785841803 +0000 UTC m=+36.493737380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls") pod "image-registry-696ffdcfbf-rbsjs" (UID: "3c993f43-ee03-498e-b6d0-5e8f413839b1") : secret "image-registry-tls" not found
Jul 09 22:33:01.286735 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.285787    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-certificates\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:01.286735 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.286209    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d7db35e3-d753-41f8-af7e-6d7a605e89cd-config-volume\") pod \"dns-default-hx7rz\" (UID: \"d7db35e3-d753-41f8-af7e-6d7a605e89cd\") " pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:33:01.286735 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.286329    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1d270c40-c725-483f-bf1c-41b9e826f8e2-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-5wtkb\" (UID: \"1d270c40-c725-483f-bf1c-41b9e826f8e2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb"
Jul 09 22:33:01.286735 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.286331    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-certificates\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:01.286735 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.286448    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c993f43-ee03-498e-b6d0-5e8f413839b1-ca-trust-extracted\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:01.286735 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:01.286476    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:33:01.286735 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:01.286540    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls podName:d7db35e3-d753-41f8-af7e-6d7a605e89cd nodeName:}" failed. No retries permitted until 2026-07-09 22:33:01.786524885 +0000 UTC m=+36.494420682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls") pod "dns-default-hx7rz" (UID: "d7db35e3-d753-41f8-af7e-6d7a605e89cd") : secret "dns-default-metrics-tls" not found
Jul 09 22:33:01.286735 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.286612    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls\") pod \"dns-default-hx7rz\" (UID: \"d7db35e3-d753-41f8-af7e-6d7a605e89cd\") " pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:33:01.286735 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.286665    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7db35e3-d753-41f8-af7e-6d7a605e89cd-tmp-dir\") pod \"dns-default-hx7rz\" (UID: \"d7db35e3-d753-41f8-af7e-6d7a605e89cd\") " pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:33:01.286735 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.286692    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c993f43-ee03-498e-b6d0-5e8f413839b1-trusted-ca\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:01.287352 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.286750    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5wtkb\" (UID: \"1d270c40-c725-483f-bf1c-41b9e826f8e2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb"
Jul 09 22:33:01.287352 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:01.286859    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 22:33:01.287352 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.286890    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7db35e3-d753-41f8-af7e-6d7a605e89cd-tmp-dir\") pod \"dns-default-hx7rz\" (UID: \"d7db35e3-d753-41f8-af7e-6d7a605e89cd\") " pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:33:01.287352 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:01.286917    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert podName:1d270c40-c725-483f-bf1c-41b9e826f8e2 nodeName:}" failed. No retries permitted until 2026-07-09 22:33:01.786903859 +0000 UTC m=+36.494799438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5wtkb" (UID: "1d270c40-c725-483f-bf1c-41b9e826f8e2") : secret "networking-console-plugin-cert" not found
Jul 09 22:33:01.287936 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.287916    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c993f43-ee03-498e-b6d0-5e8f413839b1-trusted-ca\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:01.289970 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.289943    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c993f43-ee03-498e-b6d0-5e8f413839b1-image-registry-private-configuration\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:01.289970 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.289963    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c993f43-ee03-498e-b6d0-5e8f413839b1-installation-pull-secrets\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:01.290090 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.289996    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c9c71de-bcb4-43da-ac3f-42631496dbdd-cert\") pod \"ingress-canary-xv6cj\" (UID: \"4c9c71de-bcb4-43da-ac3f-42631496dbdd\") " pod="openshift-ingress-canary/ingress-canary-xv6cj"
Jul 09 22:33:01.297110 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.297086    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-bound-sa-token\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:01.297576 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.297553    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqzml\" (UniqueName: \"kubernetes.io/projected/d7db35e3-d753-41f8-af7e-6d7a605e89cd-kube-api-access-mqzml\") pod \"dns-default-hx7rz\" (UID: \"d7db35e3-d753-41f8-af7e-6d7a605e89cd\") " pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:33:01.297861 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.297846    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdmn5\" (UniqueName: \"kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-kube-api-access-kdmn5\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:01.298215 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.298197    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7vps\" (UniqueName: \"kubernetes.io/projected/4c9c71de-bcb4-43da-ac3f-42631496dbdd-kube-api-access-p7vps\") pod \"ingress-canary-xv6cj\" (UID: \"4c9c71de-bcb4-43da-ac3f-42631496dbdd\") " pod="openshift-ingress-canary/ingress-canary-xv6cj"
Jul 09 22:33:01.350418 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.350373    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdts6_f583e68f-51a9-41f6-93e6-e614945e189a/konnectivity-agent/0.log" limit=1024
Jul 09 22:33:01.407372 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.407340    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xv6cj"
Jul 09 22:33:01.411137 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.411108    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdts6_f583e68f-51a9-41f6-93e6-e614945e189a/konnectivity-agent/0.log" limit=1024
Jul 09 22:33:01.542238 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.542203    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xv6cj"]
Jul 09 22:33:01.546268 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:33:01.546243    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c9c71de_bcb4_43da_ac3f_42631496dbdd.slice/crio-f639802c18afe668381268c45b32b64c6b521b028e8edbdd254b11fca16e0bdc WatchSource:0}: Error finding container f639802c18afe668381268c45b32b64c6b521b028e8edbdd254b11fca16e0bdc: Status 404 returned error can't find the container with id f639802c18afe668381268c45b32b64c6b521b028e8edbdd254b11fca16e0bdc
Jul 09 22:33:01.790882 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.790783    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls\") pod \"dns-default-hx7rz\" (UID: \"d7db35e3-d753-41f8-af7e-6d7a605e89cd\") " pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:33:01.791059 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.790894    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5wtkb\" (UID: \"1d270c40-c725-483f-bf1c-41b9e826f8e2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb"
Jul 09 22:33:01.791059 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:01.790954    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:33:01.791059 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:01.790958    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:01.791059 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:01.791019    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 22:33:01.791059 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:01.791028    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls podName:d7db35e3-d753-41f8-af7e-6d7a605e89cd nodeName:}" failed. No retries permitted until 2026-07-09 22:33:02.791008503 +0000 UTC m=+37.498904071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls") pod "dns-default-hx7rz" (UID: "d7db35e3-d753-41f8-af7e-6d7a605e89cd") : secret "dns-default-metrics-tls" not found
Jul 09 22:33:01.791325 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:01.791072    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert podName:1d270c40-c725-483f-bf1c-41b9e826f8e2 nodeName:}" failed. No retries permitted until 2026-07-09 22:33:02.791060099 +0000 UTC m=+37.498955669 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5wtkb" (UID: "1d270c40-c725-483f-bf1c-41b9e826f8e2") : secret "networking-console-plugin-cert" not found
Jul 09 22:33:01.791325 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:01.791087    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 22:33:01.791325 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:01.791098    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-696ffdcfbf-rbsjs: secret "image-registry-tls" not found
Jul 09 22:33:01.791325 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:01.791144    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls podName:3c993f43-ee03-498e-b6d0-5e8f413839b1 nodeName:}" failed. No retries permitted until 2026-07-09 22:33:02.791128914 +0000 UTC m=+37.499024481 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls") pod "image-registry-696ffdcfbf-rbsjs" (UID: "3c993f43-ee03-498e-b6d0-5e8f413839b1") : secret "image-registry-tls" not found
Jul 09 22:33:02.270615 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:02.270583    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xv6cj" event={"ID":"4c9c71de-bcb4-43da-ac3f-42631496dbdd","Type":"ContainerStarted","Data":"f639802c18afe668381268c45b32b64c6b521b028e8edbdd254b11fca16e0bdc"}
Jul 09 22:33:02.799520 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:02.799426    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls\") pod \"dns-default-hx7rz\" (UID: \"d7db35e3-d753-41f8-af7e-6d7a605e89cd\") " pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:33:02.799520 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:02.799515    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5wtkb\" (UID: \"1d270c40-c725-483f-bf1c-41b9e826f8e2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb"
Jul 09 22:33:02.799787 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:02.799577    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:02.799787 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:02.799585    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:33:02.799787 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:02.799666    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls podName:d7db35e3-d753-41f8-af7e-6d7a605e89cd nodeName:}" failed. No retries permitted until 2026-07-09 22:33:04.799643382 +0000 UTC m=+39.507538951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls") pod "dns-default-hx7rz" (UID: "d7db35e3-d753-41f8-af7e-6d7a605e89cd") : secret "dns-default-metrics-tls" not found
Jul 09 22:33:02.799787 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:02.799707    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 22:33:02.799787 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:02.799720    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-696ffdcfbf-rbsjs: secret "image-registry-tls" not found
Jul 09 22:33:02.799787 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:02.799768    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls podName:3c993f43-ee03-498e-b6d0-5e8f413839b1 nodeName:}" failed. No retries permitted until 2026-07-09 22:33:04.799753001 +0000 UTC m=+39.507648586 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls") pod "image-registry-696ffdcfbf-rbsjs" (UID: "3c993f43-ee03-498e-b6d0-5e8f413839b1") : secret "image-registry-tls" not found
Jul 09 22:33:02.800081 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:02.799835    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 22:33:02.800081 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:02.799885    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert podName:1d270c40-c725-483f-bf1c-41b9e826f8e2 nodeName:}" failed. No retries permitted until 2026-07-09 22:33:04.799857989 +0000 UTC m=+39.507753568 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5wtkb" (UID: "1d270c40-c725-483f-bf1c-41b9e826f8e2") : secret "networking-console-plugin-cert" not found
Jul 09 22:33:02.960247 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:02.960209    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:33:02.960830 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:02.960210    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:33:02.960830 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:02.960210    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:33:02.963145 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:02.962939    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 22:33:02.963240 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:02.963231    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 22:33:02.963311 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:02.963246    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 22:33:02.963725 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:02.963433    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d8l99\""
Jul 09 22:33:02.963725 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:02.963563    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jjswb\""
Jul 09 22:33:02.963725 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:02.963667    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 22:33:04.264154 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:04.263939    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdts6_f583e68f-51a9-41f6-93e6-e614945e189a/konnectivity-agent/0.log" limit=1024
Jul 09 22:33:04.818036 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:04.818004    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:04.818214 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:04.818064    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls\") pod \"dns-default-hx7rz\" (UID: \"d7db35e3-d753-41f8-af7e-6d7a605e89cd\") " pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:33:04.818214 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:04.818126    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5wtkb\" (UID: \"1d270c40-c725-483f-bf1c-41b9e826f8e2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb"
Jul 09 22:33:04.818214 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:04.818204    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 22:33:04.818365 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:04.818226    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-696ffdcfbf-rbsjs: secret "image-registry-tls" not found
Jul 09 22:33:04.818365 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:04.818228    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 22:33:04.818365 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:04.818245    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:33:04.818365 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:04.818286    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert podName:1d270c40-c725-483f-bf1c-41b9e826f8e2 nodeName:}" failed. No retries permitted until 2026-07-09 22:33:08.81826686 +0000 UTC m=+43.526162438 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5wtkb" (UID: "1d270c40-c725-483f-bf1c-41b9e826f8e2") : secret "networking-console-plugin-cert" not found
Jul 09 22:33:04.818365 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:04.818302    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls podName:3c993f43-ee03-498e-b6d0-5e8f413839b1 nodeName:}" failed. No retries permitted until 2026-07-09 22:33:08.81829578 +0000 UTC m=+43.526191344 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls") pod "image-registry-696ffdcfbf-rbsjs" (UID: "3c993f43-ee03-498e-b6d0-5e8f413839b1") : secret "image-registry-tls" not found
Jul 09 22:33:04.818365 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:04.818311    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls podName:d7db35e3-d753-41f8-af7e-6d7a605e89cd nodeName:}" failed. No retries permitted until 2026-07-09 22:33:08.818306605 +0000 UTC m=+43.526202170 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls") pod "dns-default-hx7rz" (UID: "d7db35e3-d753-41f8-af7e-6d7a605e89cd") : secret "dns-default-metrics-tls" not found
Jul 09 22:33:06.399062 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:06.399024    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdts6_f583e68f-51a9-41f6-93e6-e614945e189a/konnectivity-agent/0.log" limit=1024
Jul 09 22:33:06.500702 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:06.500677    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdts6_f583e68f-51a9-41f6-93e6-e614945e189a/konnectivity-agent/0.log" limit=1024
Jul 09 22:33:07.284893 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:07.284837    2564 generic.go:356] "Generic (PLEG): container finished" podID="58f72045-9e77-46a8-a0c5-26d90d2de9bc" containerID="caf008cc746bfbed7f9ed126e08c5dc07e243f6ec160f4d3cbda0dd577a78fa1" exitCode=0
Jul 09 22:33:07.285060 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:07.284908    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftqnt" event={"ID":"58f72045-9e77-46a8-a0c5-26d90d2de9bc","Type":"ContainerDied","Data":"caf008cc746bfbed7f9ed126e08c5dc07e243f6ec160f4d3cbda0dd577a78fa1"}
Jul 09 22:33:07.286333 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:07.286302    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xv6cj" event={"ID":"4c9c71de-bcb4-43da-ac3f-42631496dbdd","Type":"ContainerStarted","Data":"903d1dc9a394abca13cc2c89f70456d44c2bdadb55426458ec4f2ae5cdb36108"}
Jul 09 22:33:07.320742 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:07.320686    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xv6cj" podStartSLOduration=1.486236533 podStartE2EDuration="6.320666811s" totalImagesPullingTime="4.834430278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:33:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:33:07.320159158 +0000 UTC m=+42.028054747" watchObservedRunningTime="2026-07-09 22:33:07.320666811 +0000 UTC m=+42.028562398"
Jul 09 22:33:08.290694 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:08.290664    2564 generic.go:356] "Generic (PLEG): container finished" podID="58f72045-9e77-46a8-a0c5-26d90d2de9bc" containerID="5e1b967bf6ebdce411cb00342358c1e820bd2d594047c96b594ce38ee409d44a" exitCode=0
Jul 09 22:33:08.291125 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:08.290737    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftqnt" event={"ID":"58f72045-9e77-46a8-a0c5-26d90d2de9bc","Type":"ContainerDied","Data":"5e1b967bf6ebdce411cb00342358c1e820bd2d594047c96b594ce38ee409d44a"}
Jul 09 22:33:08.853056 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:08.853022    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5wtkb\" (UID: \"1d270c40-c725-483f-bf1c-41b9e826f8e2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb"
Jul 09 22:33:08.853223 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:08.853090    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:08.853223 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:08.853126    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls\") pod \"dns-default-hx7rz\" (UID: \"d7db35e3-d753-41f8-af7e-6d7a605e89cd\") " pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:33:08.853223 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:08.853169    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 22:33:08.853322 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:08.853226    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 22:33:08.853322 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:08.853242    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-696ffdcfbf-rbsjs: secret "image-registry-tls" not found
Jul 09 22:33:08.853322 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:08.853230    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert podName:1d270c40-c725-483f-bf1c-41b9e826f8e2 nodeName:}" failed. No retries permitted until 2026-07-09 22:33:16.853214501 +0000 UTC m=+51.561110065 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5wtkb" (UID: "1d270c40-c725-483f-bf1c-41b9e826f8e2") : secret "networking-console-plugin-cert" not found
Jul 09 22:33:08.853322 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:08.853280    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:33:08.853322 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:08.853290    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls podName:3c993f43-ee03-498e-b6d0-5e8f413839b1 nodeName:}" failed. No retries permitted until 2026-07-09 22:33:16.853278348 +0000 UTC m=+51.561173913 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls") pod "image-registry-696ffdcfbf-rbsjs" (UID: "3c993f43-ee03-498e-b6d0-5e8f413839b1") : secret "image-registry-tls" not found
Jul 09 22:33:08.853474 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:08.853360    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls podName:d7db35e3-d753-41f8-af7e-6d7a605e89cd nodeName:}" failed. No retries permitted until 2026-07-09 22:33:16.853346257 +0000 UTC m=+51.561241826 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls") pod "dns-default-hx7rz" (UID: "d7db35e3-d753-41f8-af7e-6d7a605e89cd") : secret "dns-default-metrics-tls" not found
Jul 09 22:33:09.299471 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:09.299438    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftqnt" event={"ID":"58f72045-9e77-46a8-a0c5-26d90d2de9bc","Type":"ContainerStarted","Data":"cc7c96ea9c0735f78dfcbc9739e93aeb3bb1124b919858135bd3ede992d44e2b"}
Jul 09 22:33:09.324789 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:09.324743    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ftqnt" podStartSLOduration=15.265101422 podStartE2EDuration="43.324729155s" totalImagesPullingTime="28.059627733s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:32:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:33:09.324036905 +0000 UTC m=+44.031932491" watchObservedRunningTime="2026-07-09 22:33:09.324729155 +0000 UTC m=+44.032624743"
Jul 09 22:33:09.444601 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:09.444572    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdts6_f583e68f-51a9-41f6-93e6-e614945e189a/konnectivity-agent/0.log" limit=1024
Jul 09 22:33:09.514529 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:09.514505    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdts6_f583e68f-51a9-41f6-93e6-e614945e189a/konnectivity-agent/0.log" limit=1024
Jul 09 22:33:10.228452 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:10.228418    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdts6_f583e68f-51a9-41f6-93e6-e614945e189a/konnectivity-agent/0.log" limit=1024
Jul 09 22:33:16.914362 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:16.914331    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5wtkb\" (UID: \"1d270c40-c725-483f-bf1c-41b9e826f8e2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb"
Jul 09 22:33:16.914804 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:16.914384    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:16.914804 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:16.914417    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls\") pod \"dns-default-hx7rz\" (UID: \"d7db35e3-d753-41f8-af7e-6d7a605e89cd\") " pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:33:16.914804 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:16.914504    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:33:16.914804 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:16.914508    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 22:33:16.914804 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:16.914531    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 22:33:16.914804 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:16.914545    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-696ffdcfbf-rbsjs: secret "image-registry-tls" not found
Jul 09 22:33:16.914804 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:16.914554    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls podName:d7db35e3-d753-41f8-af7e-6d7a605e89cd nodeName:}" failed. No retries permitted until 2026-07-09 22:33:32.914539255 +0000 UTC m=+67.622434834 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls") pod "dns-default-hx7rz" (UID: "d7db35e3-d753-41f8-af7e-6d7a605e89cd") : secret "dns-default-metrics-tls" not found
Jul 09 22:33:16.914804 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:16.914584    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert podName:1d270c40-c725-483f-bf1c-41b9e826f8e2 nodeName:}" failed. No retries permitted until 2026-07-09 22:33:32.914565249 +0000 UTC m=+67.622460828 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5wtkb" (UID: "1d270c40-c725-483f-bf1c-41b9e826f8e2") : secret "networking-console-plugin-cert" not found
Jul 09 22:33:16.914804 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:16.914605    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls podName:3c993f43-ee03-498e-b6d0-5e8f413839b1 nodeName:}" failed. No retries permitted until 2026-07-09 22:33:32.914594269 +0000 UTC m=+67.622489837 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls") pod "image-registry-696ffdcfbf-rbsjs" (UID: "3c993f43-ee03-498e-b6d0-5e8f413839b1") : secret "image-registry-tls" not found
Jul 09 22:33:26.269597 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:26.269571    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjmvb"
Jul 09 22:33:30.521077 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:30.521039    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs\") pod \"network-metrics-daemon-8r82v\" (UID: \"d94a7d72-cc1e-4193-99df-08721091f47e\") " pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:33:30.521532 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:30.521151    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg85q\" (UniqueName: \"kubernetes.io/projected/bbe027e4-d591-4abb-8773-a7424b322f54-kube-api-access-tg85q\") pod \"network-check-target-27942\" (UID: \"bbe027e4-d591-4abb-8773-a7424b322f54\") " pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:33:30.524151 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:30.524130    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 22:33:30.524224 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:30.524201    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 22:33:30.532113 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:30.532094    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 22:33:30.532218 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:30.532186    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs podName:d94a7d72-cc1e-4193-99df-08721091f47e nodeName:}" failed. No retries permitted until 2026-07-09 22:34:34.532170294 +0000 UTC m=+129.240065872 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs") pod "network-metrics-daemon-8r82v" (UID: "d94a7d72-cc1e-4193-99df-08721091f47e") : secret "metrics-daemon-secret" not found
Jul 09 22:33:30.533844 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:30.533829    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 22:33:30.545520 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:30.545499    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg85q\" (UniqueName: \"kubernetes.io/projected/bbe027e4-d591-4abb-8773-a7424b322f54-kube-api-access-tg85q\") pod \"network-check-target-27942\" (UID: \"bbe027e4-d591-4abb-8773-a7424b322f54\") " pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:33:30.584452 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:30.584429    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d8l99\""
Jul 09 22:33:30.593257 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:30.593237    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:33:30.622407 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:30.622381    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f95a3161-5787-4d60-b2ea-7c6222a168c7-original-pull-secret\") pod \"global-pull-secret-syncer-g9tnl\" (UID: \"f95a3161-5787-4d60-b2ea-7c6222a168c7\") " pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:33:30.624856 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:30.624835    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 22:33:30.635593 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:30.635570    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f95a3161-5787-4d60-b2ea-7c6222a168c7-original-pull-secret\") pod \"global-pull-secret-syncer-g9tnl\" (UID: \"f95a3161-5787-4d60-b2ea-7c6222a168c7\") " pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:33:30.710008 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:30.709978    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-27942"]
Jul 09 22:33:30.712905 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:33:30.712858    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbe027e4_d591_4abb_8773_a7424b322f54.slice/crio-7ee5070c88f71d4ad5281a3299697c772f96911053ad2ac768770b7b04fd7454 WatchSource:0}: Error finding container 7ee5070c88f71d4ad5281a3299697c772f96911053ad2ac768770b7b04fd7454: Status 404 returned error can't find the container with id 7ee5070c88f71d4ad5281a3299697c772f96911053ad2ac768770b7b04fd7454
Jul 09 22:33:30.875108 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:30.875019    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9tnl"
Jul 09 22:33:30.991588 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:30.991556    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g9tnl"]
Jul 09 22:33:30.995369 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:33:30.995343    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf95a3161_5787_4d60_b2ea_7c6222a168c7.slice/crio-28581af3fe2c60dfbd0439fa9452f5f663e4e82d88c815b83981f4800f0c251c WatchSource:0}: Error finding container 28581af3fe2c60dfbd0439fa9452f5f663e4e82d88c815b83981f4800f0c251c: Status 404 returned error can't find the container with id 28581af3fe2c60dfbd0439fa9452f5f663e4e82d88c815b83981f4800f0c251c
Jul 09 22:33:31.348286 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:31.348250    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-27942" event={"ID":"bbe027e4-d591-4abb-8773-a7424b322f54","Type":"ContainerStarted","Data":"7ee5070c88f71d4ad5281a3299697c772f96911053ad2ac768770b7b04fd7454"}
Jul 09 22:33:31.349238 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:31.349216    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g9tnl" event={"ID":"f95a3161-5787-4d60-b2ea-7c6222a168c7","Type":"ContainerStarted","Data":"28581af3fe2c60dfbd0439fa9452f5f663e4e82d88c815b83981f4800f0c251c"}
Jul 09 22:33:32.939787 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:32.939217    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5wtkb\" (UID: \"1d270c40-c725-483f-bf1c-41b9e826f8e2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb"
Jul 09 22:33:32.939787 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:32.939289    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:33:32.939787 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:32.939336    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls\") pod \"dns-default-hx7rz\" (UID: \"d7db35e3-d753-41f8-af7e-6d7a605e89cd\") " pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:33:32.939787 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:32.939404    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 22:33:32.939787 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:32.939445    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:33:32.939787 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:32.939457    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 22:33:32.939787 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:32.939476    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-696ffdcfbf-rbsjs: secret "image-registry-tls" not found
Jul 09 22:33:32.939787 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:32.939508    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls podName:d7db35e3-d753-41f8-af7e-6d7a605e89cd nodeName:}" failed. No retries permitted until 2026-07-09 22:34:04.939489868 +0000 UTC m=+99.647385435 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls") pod "dns-default-hx7rz" (UID: "d7db35e3-d753-41f8-af7e-6d7a605e89cd") : secret "dns-default-metrics-tls" not found
Jul 09 22:33:32.939787 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:32.939537    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert podName:1d270c40-c725-483f-bf1c-41b9e826f8e2 nodeName:}" failed. No retries permitted until 2026-07-09 22:34:04.939514935 +0000 UTC m=+99.647410517 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5wtkb" (UID: "1d270c40-c725-483f-bf1c-41b9e826f8e2") : secret "networking-console-plugin-cert" not found
Jul 09 22:33:32.939787 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:33:32.939559    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls podName:3c993f43-ee03-498e-b6d0-5e8f413839b1 nodeName:}" failed. No retries permitted until 2026-07-09 22:34:04.939549384 +0000 UTC m=+99.647444952 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls") pod "image-registry-696ffdcfbf-rbsjs" (UID: "3c993f43-ee03-498e-b6d0-5e8f413839b1") : secret "image-registry-tls" not found
Jul 09 22:33:36.363772 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:36.363738    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g9tnl" event={"ID":"f95a3161-5787-4d60-b2ea-7c6222a168c7","Type":"ContainerStarted","Data":"fe980585b199cea251382f82c077b76bd0ebbfd844f20401273eb589b8c8775c"}
Jul 09 22:33:36.365226 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:36.365205    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-27942" event={"ID":"bbe027e4-d591-4abb-8773-a7424b322f54","Type":"ContainerStarted","Data":"bd85ee22afd7733ca07b234dd9d80f15974c9a0361a61920a0bcdbe09f1c3ee4"}
Jul 09 22:33:36.365342 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:36.365324    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:33:36.377883 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:36.377828    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g9tnl" podStartSLOduration=65.534785898 podStartE2EDuration="1m10.377817119s" totalImagesPullingTime="4.843031221s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:33:36.377078536 +0000 UTC m=+71.084974135" watchObservedRunningTime="2026-07-09 22:33:36.377817119 +0000 UTC m=+71.085712705"
Jul 09 22:33:36.390786 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:33:36.390750    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-27942" podStartSLOduration=65.269522495 podStartE2EDuration="1m10.390738273s" totalImagesPullingTime="5.121215778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:33:36.389792812 +0000 UTC m=+71.097688401" watchObservedRunningTime="2026-07-09 22:33:36.390738273 +0000 UTC m=+71.098633837"
Jul 09 22:34:04.977557 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:34:04.977529    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls\") pod \"dns-default-hx7rz\" (UID: \"d7db35e3-d753-41f8-af7e-6d7a605e89cd\") " pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:34:04.977966 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:34:04.977579    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5wtkb\" (UID: \"1d270c40-c725-483f-bf1c-41b9e826f8e2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb"
Jul 09 22:34:04.977966 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:34:04.977662    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 22:34:04.977966 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:34:04.977668    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:34:04.977966 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:34:04.977721    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert podName:1d270c40-c725-483f-bf1c-41b9e826f8e2 nodeName:}" failed. No retries permitted until 2026-07-09 22:35:08.977708685 +0000 UTC m=+163.685604254 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5wtkb" (UID: "1d270c40-c725-483f-bf1c-41b9e826f8e2") : secret "networking-console-plugin-cert" not found
Jul 09 22:34:04.977966 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:34:04.977719    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:34:04.977966 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:34:04.977733    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls podName:d7db35e3-d753-41f8-af7e-6d7a605e89cd nodeName:}" failed. No retries permitted until 2026-07-09 22:35:08.977727406 +0000 UTC m=+163.685622971 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls") pod "dns-default-hx7rz" (UID: "d7db35e3-d753-41f8-af7e-6d7a605e89cd") : secret "dns-default-metrics-tls" not found
Jul 09 22:34:04.977966 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:34:04.977816    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 22:34:04.977966 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:34:04.977828    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-696ffdcfbf-rbsjs: secret "image-registry-tls" not found
Jul 09 22:34:04.977966 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:34:04.977897    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls podName:3c993f43-ee03-498e-b6d0-5e8f413839b1 nodeName:}" failed. No retries permitted until 2026-07-09 22:35:08.977860963 +0000 UTC m=+163.685756546 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls") pod "image-registry-696ffdcfbf-rbsjs" (UID: "3c993f43-ee03-498e-b6d0-5e8f413839b1") : secret "image-registry-tls" not found
Jul 09 22:34:07.370750 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:34:07.370722    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-27942"
Jul 09 22:34:34.582779 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:34:34.582722    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs\") pod \"network-metrics-daemon-8r82v\" (UID: \"d94a7d72-cc1e-4193-99df-08721091f47e\") " pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:34:34.583265 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:34:34.582889    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 22:34:34.583265 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:34:34.582994    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs podName:d94a7d72-cc1e-4193-99df-08721091f47e nodeName:}" failed. No retries permitted until 2026-07-09 22:36:36.582967577 +0000 UTC m=+251.290863142 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs") pod "network-metrics-daemon-8r82v" (UID: "d94a7d72-cc1e-4193-99df-08721091f47e") : secret "metrics-daemon-secret" not found
Jul 09 22:35:04.078686 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:35:04.078639    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs" podUID="3c993f43-ee03-498e-b6d0-5e8f413839b1"
Jul 09 22:35:04.084784 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:35:04.084767    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb" podUID="1d270c40-c725-483f-bf1c-41b9e826f8e2"
Jul 09 22:35:04.101052 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:35:04.101030    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hx7rz" podUID="d7db35e3-d753-41f8-af7e-6d7a605e89cd"
Jul 09 22:35:04.568686 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:35:04.568658    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:35:04.568843 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:35:04.568658    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb"
Jul 09 22:35:04.568843 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:35:04.568662    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:35:05.989141 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:35:05.989104    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8r82v" podUID="d94a7d72-cc1e-4193-99df-08721091f47e"
Jul 09 22:35:09.027037 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:35:09.027003    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:35:09.027391 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:35:09.027048    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls\") pod \"dns-default-hx7rz\" (UID: \"d7db35e3-d753-41f8-af7e-6d7a605e89cd\") " pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:35:09.027391 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:35:09.027084    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5wtkb\" (UID: \"1d270c40-c725-483f-bf1c-41b9e826f8e2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb"
Jul 09 22:35:09.027391 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:35:09.027160    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 22:35:09.027391 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:35:09.027188    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-696ffdcfbf-rbsjs: secret "image-registry-tls" not found
Jul 09 22:35:09.027391 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:35:09.027204    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:35:09.027391 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:35:09.027169    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 22:35:09.027391 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:35:09.027260    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls podName:3c993f43-ee03-498e-b6d0-5e8f413839b1 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:11.027240255 +0000 UTC m=+285.735135838 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls") pod "image-registry-696ffdcfbf-rbsjs" (UID: "3c993f43-ee03-498e-b6d0-5e8f413839b1") : secret "image-registry-tls" not found
Jul 09 22:35:09.027391 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:35:09.027277    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls podName:d7db35e3-d753-41f8-af7e-6d7a605e89cd nodeName:}" failed. No retries permitted until 2026-07-09 22:37:11.027268843 +0000 UTC m=+285.735164413 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls") pod "dns-default-hx7rz" (UID: "d7db35e3-d753-41f8-af7e-6d7a605e89cd") : secret "dns-default-metrics-tls" not found
Jul 09 22:35:09.027391 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:35:09.027288    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert podName:1d270c40-c725-483f-bf1c-41b9e826f8e2 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:11.027283138 +0000 UTC m=+285.735178704 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5wtkb" (UID: "1d270c40-c725-483f-bf1c-41b9e826f8e2") : secret "networking-console-plugin-cert" not found
Jul 09 22:35:20.960002 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:35:20.959928    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:36:36.626298 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:36.626250    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs\") pod \"network-metrics-daemon-8r82v\" (UID: \"d94a7d72-cc1e-4193-99df-08721091f47e\") " pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:36:36.626799 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:36.626403    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 22:36:36.626799 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:36.626471    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs podName:d94a7d72-cc1e-4193-99df-08721091f47e nodeName:}" failed. No retries permitted until 2026-07-09 22:38:38.626455662 +0000 UTC m=+373.334351226 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs") pod "network-metrics-daemon-8r82v" (UID: "d94a7d72-cc1e-4193-99df-08721091f47e") : secret "metrics-daemon-secret" not found
Jul 09 22:36:53.299489 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.299420    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-527t2"]
Jul 09 22:36:53.302109 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.302088    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-527t2"
Jul 09 22:36:53.303379 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.303358    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ml5qk"]
Jul 09 22:36:53.305729 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.305700    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 09 22:36:53.305986 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.305973    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-s6x8w\""
Jul 09 22:36:53.306044 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.305993    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 09 22:36:53.306259 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.306246    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-v29jg"]
Jul 09 22:36:53.306355 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.306344    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ml5qk"
Jul 09 22:36:53.308986 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.308967    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-jk2rs"]
Jul 09 22:36:53.309107 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.309083    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-v29jg"
Jul 09 22:36:53.309843 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.309822    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 22:36:53.309975 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.309822    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 22:36:53.309975 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.309916    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lq7pq\""
Jul 09 22:36:53.310417 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.310400    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 09 22:36:53.310501 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.310406    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 09 22:36:53.310950 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.310934    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-b6v6g\""
Jul 09 22:36:53.311064 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.311044    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 09 22:36:53.311187 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.311173    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 09 22:36:53.311231 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.311206    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 09 22:36:53.311703 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.311687    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 09 22:36:53.311793 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.311710    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-jk2rs"
Jul 09 22:36:53.312777 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.312758    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-527t2"]
Jul 09 22:36:53.316258 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.316224    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-lj4w8\""
Jul 09 22:36:53.316357 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.316290    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 09 22:36:53.316421 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.316360    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 09 22:36:53.316564 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.316548    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 22:36:53.316691 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.316672    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 09 22:36:53.318656 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.318639    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 22:36:53.319453 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.319429    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-v29jg"]
Jul 09 22:36:53.321972 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.321954    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 09 22:36:53.322485 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.322466    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-jk2rs"]
Jul 09 22:36:53.325313 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.325292    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ml5qk"]
Jul 09 22:36:53.395299 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.395277    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-96bwl"]
Jul 09 22:36:53.398169 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.398143    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-96bwl"
Jul 09 22:36:53.399510 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.399493    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-krqdt"]
Jul 09 22:36:53.402351 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.402335    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-krqdt"
Jul 09 22:36:53.402957 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.402861    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-m2cks\""
Jul 09 22:36:53.402957 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.402942    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 09 22:36:53.403121 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.402969    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 09 22:36:53.403350 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.403333    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 09 22:36:53.403424 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.403348    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 09 22:36:53.408746 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.405987    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 09 22:36:53.408746 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.406106    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-w8wws\""
Jul 09 22:36:53.408746 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.406450    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 09 22:36:53.408746 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.406793    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 09 22:36:53.411114 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.411097    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-96bwl"]
Jul 09 22:36:53.417899 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.417880    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-krqdt"]
Jul 09 22:36:53.444936 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.444898    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fa722002-4c5e-4943-a44b-e3cdbcbaf3eb-snapshots\") pod \"insights-operator-5c847dcfc4-jk2rs\" (UID: \"fa722002-4c5e-4943-a44b-e3cdbcbaf3eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-jk2rs"
Jul 09 22:36:53.445042 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.444933    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb564a11-973b-40db-ac7b-a20e2e4bf01d-serving-cert\") pod \"console-operator-68b757fb67-v29jg\" (UID: \"fb564a11-973b-40db-ac7b-a20e2e4bf01d\") " pod="openshift-console-operator/console-operator-68b757fb67-v29jg"
Jul 09 22:36:53.445042 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.444963    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa722002-4c5e-4943-a44b-e3cdbcbaf3eb-tmp\") pod \"insights-operator-5c847dcfc4-jk2rs\" (UID: \"fa722002-4c5e-4943-a44b-e3cdbcbaf3eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-jk2rs"
Jul 09 22:36:53.445042 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.445005    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa722002-4c5e-4943-a44b-e3cdbcbaf3eb-serving-cert\") pod \"insights-operator-5c847dcfc4-jk2rs\" (UID: \"fa722002-4c5e-4943-a44b-e3cdbcbaf3eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-jk2rs"
Jul 09 22:36:53.445042 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.445039    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2gzd\" (UniqueName: \"kubernetes.io/projected/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-kube-api-access-m2gzd\") pod \"cluster-monitoring-operator-64786d9cbb-ml5qk\" (UID: \"1e7ee03d-8eda-4a91-8c2b-4360384fc4ea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ml5qk"
Jul 09 22:36:53.445291 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.445089    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb564a11-973b-40db-ac7b-a20e2e4bf01d-trusted-ca\") pod \"console-operator-68b757fb67-v29jg\" (UID: \"fb564a11-973b-40db-ac7b-a20e2e4bf01d\") " pod="openshift-console-operator/console-operator-68b757fb67-v29jg"
Jul 09 22:36:53.445291 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.445130    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwwwf\" (UniqueName: \"kubernetes.io/projected/fb564a11-973b-40db-ac7b-a20e2e4bf01d-kube-api-access-jwwwf\") pod \"console-operator-68b757fb67-v29jg\" (UID: \"fb564a11-973b-40db-ac7b-a20e2e4bf01d\") " pod="openshift-console-operator/console-operator-68b757fb67-v29jg"
Jul 09 22:36:53.445291 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.445170    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa722002-4c5e-4943-a44b-e3cdbcbaf3eb-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-jk2rs\" (UID: \"fa722002-4c5e-4943-a44b-e3cdbcbaf3eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-jk2rs"
Jul 09 22:36:53.445291 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.445228    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa722002-4c5e-4943-a44b-e3cdbcbaf3eb-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-jk2rs\" (UID: \"fa722002-4c5e-4943-a44b-e3cdbcbaf3eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-jk2rs"
Jul 09 22:36:53.445291 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.445251    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-ml5qk\" (UID: \"1e7ee03d-8eda-4a91-8c2b-4360384fc4ea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ml5qk"
Jul 09 22:36:53.445291 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.445283    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ml5qk\" (UID: \"1e7ee03d-8eda-4a91-8c2b-4360384fc4ea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ml5qk"
Jul 09 22:36:53.445589 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.445366    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbds6\" (UniqueName: \"kubernetes.io/projected/4efdab1d-67c6-4d97-aca8-42aaf7f7ae53-kube-api-access-cbds6\") pod \"volume-data-source-validator-5d456fdbcd-527t2\" (UID: \"4efdab1d-67c6-4d97-aca8-42aaf7f7ae53\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-527t2"
Jul 09 22:36:53.445589 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.445393    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb564a11-973b-40db-ac7b-a20e2e4bf01d-config\") pod \"console-operator-68b757fb67-v29jg\" (UID: \"fb564a11-973b-40db-ac7b-a20e2e4bf01d\") " pod="openshift-console-operator/console-operator-68b757fb67-v29jg"
Jul 09 22:36:53.445589 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.445430    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmftm\" (UniqueName: \"kubernetes.io/projected/fa722002-4c5e-4943-a44b-e3cdbcbaf3eb-kube-api-access-pmftm\") pod \"insights-operator-5c847dcfc4-jk2rs\" (UID: \"fa722002-4c5e-4943-a44b-e3cdbcbaf3eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-jk2rs"
Jul 09 22:36:53.545789 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.545752    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb564a11-973b-40db-ac7b-a20e2e4bf01d-trusted-ca\") pod \"console-operator-68b757fb67-v29jg\" (UID: \"fb564a11-973b-40db-ac7b-a20e2e4bf01d\") " pod="openshift-console-operator/console-operator-68b757fb67-v29jg"
Jul 09 22:36:53.545789 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.545796    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqvvr\" (UniqueName: \"kubernetes.io/projected/3a748629-9bfc-4da5-9343-faaf57711458-kube-api-access-vqvvr\") pod \"cluster-samples-operator-56fcf86bf-krqdt\" (UID: \"3a748629-9bfc-4da5-9343-faaf57711458\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-krqdt"
Jul 09 22:36:53.546029 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.545828    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwwwf\" (UniqueName: \"kubernetes.io/projected/fb564a11-973b-40db-ac7b-a20e2e4bf01d-kube-api-access-jwwwf\") pod \"console-operator-68b757fb67-v29jg\" (UID: \"fb564a11-973b-40db-ac7b-a20e2e4bf01d\") " pod="openshift-console-operator/console-operator-68b757fb67-v29jg"
Jul 09 22:36:53.546029 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.545942    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa722002-4c5e-4943-a44b-e3cdbcbaf3eb-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-jk2rs\" (UID: \"fa722002-4c5e-4943-a44b-e3cdbcbaf3eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-jk2rs"
Jul 09 22:36:53.546136 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.546048    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f98ce5f-46f5-4fc8-a621-b4bf20950d95-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-96bwl\" (UID: \"7f98ce5f-46f5-4fc8-a621-b4bf20950d95\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-96bwl"
Jul 09 22:36:53.546136 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.546076    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa722002-4c5e-4943-a44b-e3cdbcbaf3eb-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-jk2rs\" (UID: \"fa722002-4c5e-4943-a44b-e3cdbcbaf3eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-jk2rs"
Jul 09 22:36:53.546136 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.546093    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-ml5qk\" (UID: \"1e7ee03d-8eda-4a91-8c2b-4360384fc4ea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ml5qk"
Jul 09 22:36:53.546136 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.546116    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ml5qk\" (UID: \"1e7ee03d-8eda-4a91-8c2b-4360384fc4ea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ml5qk"
Jul 09 22:36:53.546330 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.546147    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plmgx\" (UniqueName: \"kubernetes.io/projected/7f98ce5f-46f5-4fc8-a621-b4bf20950d95-kube-api-access-plmgx\") pod \"kube-storage-version-migrator-operator-846bf668f7-96bwl\" (UID: \"7f98ce5f-46f5-4fc8-a621-b4bf20950d95\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-96bwl"
Jul 09 22:36:53.546330 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.546173    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbds6\" (UniqueName: \"kubernetes.io/projected/4efdab1d-67c6-4d97-aca8-42aaf7f7ae53-kube-api-access-cbds6\") pod \"volume-data-source-validator-5d456fdbcd-527t2\" (UID: \"4efdab1d-67c6-4d97-aca8-42aaf7f7ae53\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-527t2"
Jul 09 22:36:53.546330 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.546191    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb564a11-973b-40db-ac7b-a20e2e4bf01d-config\") pod \"console-operator-68b757fb67-v29jg\" (UID: \"fb564a11-973b-40db-ac7b-a20e2e4bf01d\") " pod="openshift-console-operator/console-operator-68b757fb67-v29jg"
Jul 09 22:36:53.546330 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.546213    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a748629-9bfc-4da5-9343-faaf57711458-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-krqdt\" (UID: \"3a748629-9bfc-4da5-9343-faaf57711458\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-krqdt"
Jul 09 22:36:53.546330 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.546253    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f98ce5f-46f5-4fc8-a621-b4bf20950d95-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-96bwl\" (UID: \"7f98ce5f-46f5-4fc8-a621-b4bf20950d95\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-96bwl"
Jul 09 22:36:53.546330 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:53.546299    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 22:36:53.546629 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:53.546355    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-cluster-monitoring-operator-tls podName:1e7ee03d-8eda-4a91-8c2b-4360384fc4ea nodeName:}" failed. No retries permitted until 2026-07-09 22:36:54.046338545 +0000 UTC m=+268.754234130 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-ml5qk" (UID: "1e7ee03d-8eda-4a91-8c2b-4360384fc4ea") : secret "cluster-monitoring-operator-tls" not found
Jul 09 22:36:53.546629 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.546401    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmftm\" (UniqueName: \"kubernetes.io/projected/fa722002-4c5e-4943-a44b-e3cdbcbaf3eb-kube-api-access-pmftm\") pod \"insights-operator-5c847dcfc4-jk2rs\" (UID: \"fa722002-4c5e-4943-a44b-e3cdbcbaf3eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-jk2rs"
Jul 09 22:36:53.546629 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.546429    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fa722002-4c5e-4943-a44b-e3cdbcbaf3eb-snapshots\") pod \"insights-operator-5c847dcfc4-jk2rs\" (UID: \"fa722002-4c5e-4943-a44b-e3cdbcbaf3eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-jk2rs"
Jul 09 22:36:53.546629 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.546451    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb564a11-973b-40db-ac7b-a20e2e4bf01d-serving-cert\") pod \"console-operator-68b757fb67-v29jg\" (UID: \"fb564a11-973b-40db-ac7b-a20e2e4bf01d\") " pod="openshift-console-operator/console-operator-68b757fb67-v29jg"
Jul 09 22:36:53.546629 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.546478    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa722002-4c5e-4943-a44b-e3cdbcbaf3eb-tmp\") pod \"insights-operator-5c847dcfc4-jk2rs\" (UID: \"fa722002-4c5e-4943-a44b-e3cdbcbaf3eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-jk2rs"
Jul 09 22:36:53.546629 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.546500    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa722002-4c5e-4943-a44b-e3cdbcbaf3eb-serving-cert\") pod \"insights-operator-5c847dcfc4-jk2rs\" (UID: \"fa722002-4c5e-4943-a44b-e3cdbcbaf3eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-jk2rs"
Jul 09 22:36:53.546629 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.546528    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2gzd\" (UniqueName: \"kubernetes.io/projected/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-kube-api-access-m2gzd\") pod \"cluster-monitoring-operator-64786d9cbb-ml5qk\" (UID: \"1e7ee03d-8eda-4a91-8c2b-4360384fc4ea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ml5qk"
Jul 09 22:36:53.546629 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.546551    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa722002-4c5e-4943-a44b-e3cdbcbaf3eb-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-jk2rs\" (UID: \"fa722002-4c5e-4943-a44b-e3cdbcbaf3eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-jk2rs"
Jul 09 22:36:53.547126 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.546819    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-ml5qk\" (UID: \"1e7ee03d-8eda-4a91-8c2b-4360384fc4ea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ml5qk"
Jul 09 22:36:53.547126 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.546839    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb564a11-973b-40db-ac7b-a20e2e4bf01d-trusted-ca\") pod \"console-operator-68b757fb67-v29jg\" (UID: \"fb564a11-973b-40db-ac7b-a20e2e4bf01d\") " pod="openshift-console-operator/console-operator-68b757fb67-v29jg"
Jul 09 22:36:53.547126 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.546936    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb564a11-973b-40db-ac7b-a20e2e4bf01d-config\") pod \"console-operator-68b757fb67-v29jg\" (UID: \"fb564a11-973b-40db-ac7b-a20e2e4bf01d\") " pod="openshift-console-operator/console-operator-68b757fb67-v29jg"
Jul 09 22:36:53.547126 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.546998    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa722002-4c5e-4943-a44b-e3cdbcbaf3eb-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-jk2rs\" (UID: \"fa722002-4c5e-4943-a44b-e3cdbcbaf3eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-jk2rs"
Jul 09 22:36:53.547126 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.547028    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa722002-4c5e-4943-a44b-e3cdbcbaf3eb-tmp\") pod \"insights-operator-5c847dcfc4-jk2rs\" (UID: \"fa722002-4c5e-4943-a44b-e3cdbcbaf3eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-jk2rs"
Jul 09 22:36:53.547314 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.547134    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fa722002-4c5e-4943-a44b-e3cdbcbaf3eb-snapshots\") pod \"insights-operator-5c847dcfc4-jk2rs\" (UID: \"fa722002-4c5e-4943-a44b-e3cdbcbaf3eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-jk2rs"
Jul 09 22:36:53.548938 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.548914    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb564a11-973b-40db-ac7b-a20e2e4bf01d-serving-cert\") pod \"console-operator-68b757fb67-v29jg\" (UID: \"fb564a11-973b-40db-ac7b-a20e2e4bf01d\") " pod="openshift-console-operator/console-operator-68b757fb67-v29jg"
Jul 09 22:36:53.549036 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.548977    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa722002-4c5e-4943-a44b-e3cdbcbaf3eb-serving-cert\") pod \"insights-operator-5c847dcfc4-jk2rs\" (UID: \"fa722002-4c5e-4943-a44b-e3cdbcbaf3eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-jk2rs"
Jul 09 22:36:53.555269 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.555167    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbds6\" (UniqueName: \"kubernetes.io/projected/4efdab1d-67c6-4d97-aca8-42aaf7f7ae53-kube-api-access-cbds6\") pod \"volume-data-source-validator-5d456fdbcd-527t2\" (UID: \"4efdab1d-67c6-4d97-aca8-42aaf7f7ae53\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-527t2"
Jul 09 22:36:53.555269 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.555219    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwwwf\" (UniqueName: \"kubernetes.io/projected/fb564a11-973b-40db-ac7b-a20e2e4bf01d-kube-api-access-jwwwf\") pod \"console-operator-68b757fb67-v29jg\" (UID: \"fb564a11-973b-40db-ac7b-a20e2e4bf01d\") " pod="openshift-console-operator/console-operator-68b757fb67-v29jg"
Jul 09 22:36:53.555407 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.555389    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2gzd\" (UniqueName: \"kubernetes.io/projected/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-kube-api-access-m2gzd\") pod \"cluster-monitoring-operator-64786d9cbb-ml5qk\" (UID: \"1e7ee03d-8eda-4a91-8c2b-4360384fc4ea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ml5qk"
Jul 09 22:36:53.555647 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.555628    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmftm\" (UniqueName: \"kubernetes.io/projected/fa722002-4c5e-4943-a44b-e3cdbcbaf3eb-kube-api-access-pmftm\") pod \"insights-operator-5c847dcfc4-jk2rs\" (UID: \"fa722002-4c5e-4943-a44b-e3cdbcbaf3eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-jk2rs"
Jul 09 22:36:53.613108 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.613074    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-527t2"
Jul 09 22:36:53.628174 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.628112    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-v29jg"
Jul 09 22:36:53.632997 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.632975    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-jk2rs"
Jul 09 22:36:53.647736 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.647711    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqvvr\" (UniqueName: \"kubernetes.io/projected/3a748629-9bfc-4da5-9343-faaf57711458-kube-api-access-vqvvr\") pod \"cluster-samples-operator-56fcf86bf-krqdt\" (UID: \"3a748629-9bfc-4da5-9343-faaf57711458\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-krqdt"
Jul 09 22:36:53.647847 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.647784    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f98ce5f-46f5-4fc8-a621-b4bf20950d95-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-96bwl\" (UID: \"7f98ce5f-46f5-4fc8-a621-b4bf20950d95\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-96bwl"
Jul 09 22:36:53.647943 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.647917    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plmgx\" (UniqueName: \"kubernetes.io/projected/7f98ce5f-46f5-4fc8-a621-b4bf20950d95-kube-api-access-plmgx\") pod \"kube-storage-version-migrator-operator-846bf668f7-96bwl\" (UID: \"7f98ce5f-46f5-4fc8-a621-b4bf20950d95\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-96bwl"
Jul 09 22:36:53.648020 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.647979    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a748629-9bfc-4da5-9343-faaf57711458-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-krqdt\" (UID: \"3a748629-9bfc-4da5-9343-faaf57711458\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-krqdt"
Jul 09 22:36:53.648020 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.648008    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f98ce5f-46f5-4fc8-a621-b4bf20950d95-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-96bwl\" (UID: \"7f98ce5f-46f5-4fc8-a621-b4bf20950d95\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-96bwl"
Jul 09 22:36:53.648498 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:53.648259    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 22:36:53.648498 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:53.648372    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a748629-9bfc-4da5-9343-faaf57711458-samples-operator-tls podName:3a748629-9bfc-4da5-9343-faaf57711458 nodeName:}" failed. No retries permitted until 2026-07-09 22:36:54.148350392 +0000 UTC m=+268.856245979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3a748629-9bfc-4da5-9343-faaf57711458-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-krqdt" (UID: "3a748629-9bfc-4da5-9343-faaf57711458") : secret "samples-operator-tls" not found
Jul 09 22:36:53.648659 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.648581    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f98ce5f-46f5-4fc8-a621-b4bf20950d95-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-96bwl\" (UID: \"7f98ce5f-46f5-4fc8-a621-b4bf20950d95\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-96bwl"
Jul 09 22:36:53.650631 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.650602    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f98ce5f-46f5-4fc8-a621-b4bf20950d95-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-96bwl\" (UID: \"7f98ce5f-46f5-4fc8-a621-b4bf20950d95\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-96bwl"
Jul 09 22:36:53.655697 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.655659    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plmgx\" (UniqueName: \"kubernetes.io/projected/7f98ce5f-46f5-4fc8-a621-b4bf20950d95-kube-api-access-plmgx\") pod \"kube-storage-version-migrator-operator-846bf668f7-96bwl\" (UID: \"7f98ce5f-46f5-4fc8-a621-b4bf20950d95\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-96bwl"
Jul 09 22:36:53.657703 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.657674    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqvvr\" (UniqueName: \"kubernetes.io/projected/3a748629-9bfc-4da5-9343-faaf57711458-kube-api-access-vqvvr\") pod \"cluster-samples-operator-56fcf86bf-krqdt\" (UID: \"3a748629-9bfc-4da5-9343-faaf57711458\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-krqdt"
Jul 09 22:36:53.708472 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.708425    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-96bwl"
Jul 09 22:36:53.755192 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.755118    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-527t2"]
Jul 09 22:36:53.758400 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:36:53.758376    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4efdab1d_67c6_4d97_aca8_42aaf7f7ae53.slice/crio-6cb6776b8484288abf0a31555f68a0da2de6176787ae65b2d600740a36aa806e WatchSource:0}: Error finding container 6cb6776b8484288abf0a31555f68a0da2de6176787ae65b2d600740a36aa806e: Status 404 returned error can't find the container with id 6cb6776b8484288abf0a31555f68a0da2de6176787ae65b2d600740a36aa806e
Jul 09 22:36:53.771312 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.771258    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-v29jg"]
Jul 09 22:36:53.774700 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:36:53.774672    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb564a11_973b_40db_ac7b_a20e2e4bf01d.slice/crio-bec536b7b7061c66c653348bddf598ae6340abf3828be3d1569ae10c08ee53ca WatchSource:0}: Error finding container bec536b7b7061c66c653348bddf598ae6340abf3828be3d1569ae10c08ee53ca: Status 404 returned error can't find the container with id bec536b7b7061c66c653348bddf598ae6340abf3828be3d1569ae10c08ee53ca
Jul 09 22:36:53.787505 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.787480    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-jk2rs"]
Jul 09 22:36:53.790213 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:36:53.790184    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa722002_4c5e_4943_a44b_e3cdbcbaf3eb.slice/crio-67b154196f62592db1642f3f73961ee8a4d7fe3ab0c64b89d324e498bef596a8 WatchSource:0}: Error finding container 67b154196f62592db1642f3f73961ee8a4d7fe3ab0c64b89d324e498bef596a8: Status 404 returned error can't find the container with id 67b154196f62592db1642f3f73961ee8a4d7fe3ab0c64b89d324e498bef596a8
Jul 09 22:36:53.813648 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.813575    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jk2rs" event={"ID":"fa722002-4c5e-4943-a44b-e3cdbcbaf3eb","Type":"ContainerStarted","Data":"67b154196f62592db1642f3f73961ee8a4d7fe3ab0c64b89d324e498bef596a8"}
Jul 09 22:36:53.814679 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.814655    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-v29jg" event={"ID":"fb564a11-973b-40db-ac7b-a20e2e4bf01d","Type":"ContainerStarted","Data":"bec536b7b7061c66c653348bddf598ae6340abf3828be3d1569ae10c08ee53ca"}
Jul 09 22:36:53.815696 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.815677    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-527t2" event={"ID":"4efdab1d-67c6-4d97-aca8-42aaf7f7ae53","Type":"ContainerStarted","Data":"6cb6776b8484288abf0a31555f68a0da2de6176787ae65b2d600740a36aa806e"}
Jul 09 22:36:53.837832 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:53.837810    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-96bwl"]
Jul 09 22:36:53.840531 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:36:53.840510    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f98ce5f_46f5_4fc8_a621_b4bf20950d95.slice/crio-4ad3adec961927afd2d9ee66d35a181ce763027ce8e99474ef55a890c95375b3 WatchSource:0}: Error finding container 4ad3adec961927afd2d9ee66d35a181ce763027ce8e99474ef55a890c95375b3: Status 404 returned error can't find the container with id 4ad3adec961927afd2d9ee66d35a181ce763027ce8e99474ef55a890c95375b3
Jul 09 22:36:54.051469 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:54.051436    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ml5qk\" (UID: \"1e7ee03d-8eda-4a91-8c2b-4360384fc4ea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ml5qk"
Jul 09 22:36:54.051624 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:54.051582    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 22:36:54.051670 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:54.051641    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-cluster-monitoring-operator-tls podName:1e7ee03d-8eda-4a91-8c2b-4360384fc4ea nodeName:}" failed. No retries permitted until 2026-07-09 22:36:55.051626933 +0000 UTC m=+269.759522503 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-ml5qk" (UID: "1e7ee03d-8eda-4a91-8c2b-4360384fc4ea") : secret "cluster-monitoring-operator-tls" not found
Jul 09 22:36:54.152552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:54.152480    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a748629-9bfc-4da5-9343-faaf57711458-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-krqdt\" (UID: \"3a748629-9bfc-4da5-9343-faaf57711458\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-krqdt"
Jul 09 22:36:54.152680 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:54.152636    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 22:36:54.152715 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:54.152695    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a748629-9bfc-4da5-9343-faaf57711458-samples-operator-tls podName:3a748629-9bfc-4da5-9343-faaf57711458 nodeName:}" failed. No retries permitted until 2026-07-09 22:36:55.152680766 +0000 UTC m=+269.860576333 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3a748629-9bfc-4da5-9343-faaf57711458-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-krqdt" (UID: "3a748629-9bfc-4da5-9343-faaf57711458") : secret "samples-operator-tls" not found
Jul 09 22:36:54.819760 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:54.819726    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-96bwl" event={"ID":"7f98ce5f-46f5-4fc8-a621-b4bf20950d95","Type":"ContainerStarted","Data":"4ad3adec961927afd2d9ee66d35a181ce763027ce8e99474ef55a890c95375b3"}
Jul 09 22:36:55.061207 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:55.060800    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ml5qk\" (UID: \"1e7ee03d-8eda-4a91-8c2b-4360384fc4ea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ml5qk"
Jul 09 22:36:55.061207 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:55.060953    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 22:36:55.061207 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:55.061014    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-cluster-monitoring-operator-tls podName:1e7ee03d-8eda-4a91-8c2b-4360384fc4ea nodeName:}" failed. No retries permitted until 2026-07-09 22:36:57.060996916 +0000 UTC m=+271.768892487 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-ml5qk" (UID: "1e7ee03d-8eda-4a91-8c2b-4360384fc4ea") : secret "cluster-monitoring-operator-tls" not found
Jul 09 22:36:55.162824 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:55.162159    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a748629-9bfc-4da5-9343-faaf57711458-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-krqdt\" (UID: \"3a748629-9bfc-4da5-9343-faaf57711458\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-krqdt"
Jul 09 22:36:55.162824 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:55.162331    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 22:36:55.162824 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:55.162398    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a748629-9bfc-4da5-9343-faaf57711458-samples-operator-tls podName:3a748629-9bfc-4da5-9343-faaf57711458 nodeName:}" failed. No retries permitted until 2026-07-09 22:36:57.162377815 +0000 UTC m=+271.870273383 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3a748629-9bfc-4da5-9343-faaf57711458-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-krqdt" (UID: "3a748629-9bfc-4da5-9343-faaf57711458") : secret "samples-operator-tls" not found
Jul 09 22:36:55.823703 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:55.823674    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-527t2" event={"ID":"4efdab1d-67c6-4d97-aca8-42aaf7f7ae53","Type":"ContainerStarted","Data":"f2f644c23681613dad8b656f882d01c68c8783e96c3dcdfc6ed8e18210bc09ca"}
Jul 09 22:36:55.838626 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:55.838096    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-527t2" podStartSLOduration=1.251374594 podStartE2EDuration="2.838076289s" totalImagesPullingTime="1.586701695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:36:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:36:55.837886924 +0000 UTC m=+270.545782502" watchObservedRunningTime="2026-07-09 22:36:55.838076289 +0000 UTC m=+270.545971868"
Jul 09 22:36:57.078844 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:57.078795    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ml5qk\" (UID: \"1e7ee03d-8eda-4a91-8c2b-4360384fc4ea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ml5qk"
Jul 09 22:36:57.079325 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:57.078968    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 22:36:57.079325 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:57.079066    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-cluster-monitoring-operator-tls podName:1e7ee03d-8eda-4a91-8c2b-4360384fc4ea nodeName:}" failed. No retries permitted until 2026-07-09 22:37:01.079044798 +0000 UTC m=+275.786940387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-ml5qk" (UID: "1e7ee03d-8eda-4a91-8c2b-4360384fc4ea") : secret "cluster-monitoring-operator-tls" not found
Jul 09 22:36:57.180237 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:57.180192    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a748629-9bfc-4da5-9343-faaf57711458-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-krqdt\" (UID: \"3a748629-9bfc-4da5-9343-faaf57711458\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-krqdt"
Jul 09 22:36:57.180422 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:57.180381    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 22:36:57.180485 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:57.180444    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a748629-9bfc-4da5-9343-faaf57711458-samples-operator-tls podName:3a748629-9bfc-4da5-9343-faaf57711458 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:01.180430502 +0000 UTC m=+275.888326067 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3a748629-9bfc-4da5-9343-faaf57711458-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-krqdt" (UID: "3a748629-9bfc-4da5-9343-faaf57711458") : secret "samples-operator-tls" not found
Jul 09 22:36:57.831666 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:57.831624    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-96bwl" event={"ID":"7f98ce5f-46f5-4fc8-a621-b4bf20950d95","Type":"ContainerStarted","Data":"2dd4263731ea460576f46f2f34b4442b4087e7ed8b765b1328781a935fa399ec"}
Jul 09 22:36:57.833207 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:57.833181    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jk2rs" event={"ID":"fa722002-4c5e-4943-a44b-e3cdbcbaf3eb","Type":"ContainerStarted","Data":"3f2c42a2aed46e1eb9f835e7fa2160791b3f347413b3505bbd250f4567daa970"}
Jul 09 22:36:57.834806 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:57.834785    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-v29jg_fb564a11-973b-40db-ac7b-a20e2e4bf01d/console-operator/0.log"
Jul 09 22:36:57.834948 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:57.834824    2564 generic.go:356] "Generic (PLEG): container finished" podID="fb564a11-973b-40db-ac7b-a20e2e4bf01d" containerID="771275a5cb8f9399ec793224a00f6355d985eaf89e2b8842d2ecbf254ba98bec" exitCode=255
Jul 09 22:36:57.834948 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:57.834855    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-v29jg" event={"ID":"fb564a11-973b-40db-ac7b-a20e2e4bf01d","Type":"ContainerDied","Data":"771275a5cb8f9399ec793224a00f6355d985eaf89e2b8842d2ecbf254ba98bec"}
Jul 09 22:36:57.835140 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:57.835122    2564 scope.go:117] "RemoveContainer" containerID="771275a5cb8f9399ec793224a00f6355d985eaf89e2b8842d2ecbf254ba98bec"
Jul 09 22:36:57.849438 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:57.849388    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-96bwl" podStartSLOduration=1.371092092 podStartE2EDuration="4.849368386s" totalImagesPullingTime="3.478276294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:36:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:36:57.847777693 +0000 UTC m=+272.555673281" watchObservedRunningTime="2026-07-09 22:36:57.849368386 +0000 UTC m=+272.557263954"
Jul 09 22:36:57.881318 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:57.881267    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-jk2rs" podStartSLOduration=1.355538937 podStartE2EDuration="4.881245878s" totalImagesPullingTime="3.525706941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:36:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:36:57.880670459 +0000 UTC m=+272.588566047" watchObservedRunningTime="2026-07-09 22:36:57.881245878 +0000 UTC m=+272.589141469"
Jul 09 22:36:58.015071 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.013765    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xql5r"]
Jul 09 22:36:58.017373 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.017350    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:36:58.019611 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.019523    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 22:36:58.019611 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.019556    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pvkvm\""
Jul 09 22:36:58.019611 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.019606    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 22:36:58.026848 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.026827    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xql5r"]
Jul 09 22:36:58.088267 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.088182    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-crio-socket\") pod \"insights-runtime-extractor-xql5r\" (UID: \"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1\") " pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:36:58.088267 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.088247    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xql5r\" (UID: \"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1\") " pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:36:58.088766 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.088432    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-data-volume\") pod \"insights-runtime-extractor-xql5r\" (UID: \"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1\") " pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:36:58.088766 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.088467    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xql5r\" (UID: \"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1\") " pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:36:58.088766 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.088546    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsl4x\" (UniqueName: \"kubernetes.io/projected/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-kube-api-access-lsl4x\") pod \"insights-runtime-extractor-xql5r\" (UID: \"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1\") " pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:36:58.189072 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.189037    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-data-volume\") pod \"insights-runtime-extractor-xql5r\" (UID: \"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1\") " pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:36:58.189072 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.189071    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xql5r\" (UID: \"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1\") " pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:36:58.189324 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.189097    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsl4x\" (UniqueName: \"kubernetes.io/projected/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-kube-api-access-lsl4x\") pod \"insights-runtime-extractor-xql5r\" (UID: \"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1\") " pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:36:58.189324 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.189143    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-crio-socket\") pod \"insights-runtime-extractor-xql5r\" (UID: \"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1\") " pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:36:58.189324 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.189159    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xql5r\" (UID: \"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1\") " pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:36:58.189324 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:58.189184    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 22:36:58.189324 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:58.189262    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-kube-rbac-proxy-cm podName:1de4a026-3f71-4b1d-9cc7-9b89969ac2f1 nodeName:}" failed. No retries permitted until 2026-07-09 22:36:58.689242896 +0000 UTC m=+273.397138475 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xql5r" (UID: "1de4a026-3f71-4b1d-9cc7-9b89969ac2f1") : configmap "kube-rbac-proxy" not found
Jul 09 22:36:58.189324 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:58.189262    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 22:36:58.189324 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.189270    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-crio-socket\") pod \"insights-runtime-extractor-xql5r\" (UID: \"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1\") " pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:36:58.189324 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:58.189312    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-insights-runtime-extractor-tls podName:1de4a026-3f71-4b1d-9cc7-9b89969ac2f1 nodeName:}" failed. No retries permitted until 2026-07-09 22:36:58.689296697 +0000 UTC m=+273.397192263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xql5r" (UID: "1de4a026-3f71-4b1d-9cc7-9b89969ac2f1") : secret "insights-runtime-extractor-tls" not found
Jul 09 22:36:58.189588 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.189500    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-data-volume\") pod \"insights-runtime-extractor-xql5r\" (UID: \"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1\") " pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:36:58.196915 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.196890    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsl4x\" (UniqueName: \"kubernetes.io/projected/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-kube-api-access-lsl4x\") pod \"insights-runtime-extractor-xql5r\" (UID: \"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1\") " pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:36:58.693998 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.693967    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xql5r\" (UID: \"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1\") " pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:36:58.694183 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.694036    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xql5r\" (UID: \"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1\") " pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:36:58.694183 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:58.694109    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 22:36:58.694183 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:58.694128    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 22:36:58.694301 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:58.694184    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-kube-rbac-proxy-cm podName:1de4a026-3f71-4b1d-9cc7-9b89969ac2f1 nodeName:}" failed. No retries permitted until 2026-07-09 22:36:59.694165825 +0000 UTC m=+274.402061393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xql5r" (UID: "1de4a026-3f71-4b1d-9cc7-9b89969ac2f1") : configmap "kube-rbac-proxy" not found
Jul 09 22:36:58.694301 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:58.694202    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-insights-runtime-extractor-tls podName:1de4a026-3f71-4b1d-9cc7-9b89969ac2f1 nodeName:}" failed. No retries permitted until 2026-07-09 22:36:59.694193759 +0000 UTC m=+274.402089330 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xql5r" (UID: "1de4a026-3f71-4b1d-9cc7-9b89969ac2f1") : secret "insights-runtime-extractor-tls" not found
Jul 09 22:36:58.839798 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.839771    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-v29jg_fb564a11-973b-40db-ac7b-a20e2e4bf01d/console-operator/1.log"
Jul 09 22:36:58.840160 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.840147    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-v29jg_fb564a11-973b-40db-ac7b-a20e2e4bf01d/console-operator/0.log"
Jul 09 22:36:58.840216 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.840180    2564 generic.go:356] "Generic (PLEG): container finished" podID="fb564a11-973b-40db-ac7b-a20e2e4bf01d" containerID="92fbf6dade6c95904835f22fe9509e121459a475cf90422544c5e9ebb7364389" exitCode=255
Jul 09 22:36:58.840293 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.840274    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-v29jg" event={"ID":"fb564a11-973b-40db-ac7b-a20e2e4bf01d","Type":"ContainerDied","Data":"92fbf6dade6c95904835f22fe9509e121459a475cf90422544c5e9ebb7364389"}
Jul 09 22:36:58.840349 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.840334    2564 scope.go:117] "RemoveContainer" containerID="771275a5cb8f9399ec793224a00f6355d985eaf89e2b8842d2ecbf254ba98bec"
Jul 09 22:36:58.840465 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.840448    2564 scope.go:117] "RemoveContainer" containerID="92fbf6dade6c95904835f22fe9509e121459a475cf90422544c5e9ebb7364389"
Jul 09 22:36:58.840660 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:58.840633    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-v29jg_openshift-console-operator(fb564a11-973b-40db-ac7b-a20e2e4bf01d)\"" pod="openshift-console-operator/console-operator-68b757fb67-v29jg" podUID="fb564a11-973b-40db-ac7b-a20e2e4bf01d"
Jul 09 22:36:58.997863 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:58.997787    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-z4rw4"]
Jul 09 22:36:59.005029 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.005005    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-z4rw4"
Jul 09 22:36:59.007065 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.007040    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 09 22:36:59.007190 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.007093    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-twcg4\""
Jul 09 22:36:59.007336 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.007321    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 09 22:36:59.011062 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.011040    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-z4rw4"]
Jul 09 22:36:59.096851 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.096821    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw48h\" (UniqueName: \"kubernetes.io/projected/e5a63c0e-90dd-4ff7-88e0-17ee3f744164-kube-api-access-dw48h\") pod \"migrator-d57d58cc9-z4rw4\" (UID: \"e5a63c0e-90dd-4ff7-88e0-17ee3f744164\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-z4rw4"
Jul 09 22:36:59.197821 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.197794    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw48h\" (UniqueName: \"kubernetes.io/projected/e5a63c0e-90dd-4ff7-88e0-17ee3f744164-kube-api-access-dw48h\") pod \"migrator-d57d58cc9-z4rw4\" (UID: \"e5a63c0e-90dd-4ff7-88e0-17ee3f744164\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-z4rw4"
Jul 09 22:36:59.205478 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.205449    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw48h\" (UniqueName: \"kubernetes.io/projected/e5a63c0e-90dd-4ff7-88e0-17ee3f744164-kube-api-access-dw48h\") pod \"migrator-d57d58cc9-z4rw4\" (UID: \"e5a63c0e-90dd-4ff7-88e0-17ee3f744164\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-z4rw4"
Jul 09 22:36:59.315361 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.315290    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-z4rw4"
Jul 09 22:36:59.389185 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.389088    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-9d8mp"]
Jul 09 22:36:59.393708 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.393687    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-9d8mp"
Jul 09 22:36:59.395863 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.395844    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 09 22:36:59.396334 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.396312    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 09 22:36:59.396427 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.396353    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 09 22:36:59.396499 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.396312    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 09 22:36:59.396499 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.396462    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-5wlzw\""
Jul 09 22:36:59.400493 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.400441    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-9d8mp"]
Jul 09 22:36:59.434538 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.434508    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-z4rw4"]
Jul 09 22:36:59.437552 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:36:59.437529    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a63c0e_90dd_4ff7_88e0_17ee3f744164.slice/crio-2d6c1b6781b583e215e0f6d2f119163d5e605c65ad3f4566c5169b5c7feee5c1 WatchSource:0}: Error finding container 2d6c1b6781b583e215e0f6d2f119163d5e605c65ad3f4566c5169b5c7feee5c1: Status 404 returned error can't find the container with id 2d6c1b6781b583e215e0f6d2f119163d5e605c65ad3f4566c5169b5c7feee5c1
Jul 09 22:36:59.500517 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.500497    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5130cb61-a676-483f-be5b-f57c098117c1-signing-cabundle\") pod \"service-ca-758f599c5-9d8mp\" (UID: \"5130cb61-a676-483f-be5b-f57c098117c1\") " pod="openshift-service-ca/service-ca-758f599c5-9d8mp"
Jul 09 22:36:59.500603 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.500559    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5130cb61-a676-483f-be5b-f57c098117c1-signing-key\") pod \"service-ca-758f599c5-9d8mp\" (UID: \"5130cb61-a676-483f-be5b-f57c098117c1\") " pod="openshift-service-ca/service-ca-758f599c5-9d8mp"
Jul 09 22:36:59.500646 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.500599    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgc4l\" (UniqueName: \"kubernetes.io/projected/5130cb61-a676-483f-be5b-f57c098117c1-kube-api-access-hgc4l\") pod \"service-ca-758f599c5-9d8mp\" (UID: \"5130cb61-a676-483f-be5b-f57c098117c1\") " pod="openshift-service-ca/service-ca-758f599c5-9d8mp"
Jul 09 22:36:59.601461 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.601403    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5130cb61-a676-483f-be5b-f57c098117c1-signing-key\") pod \"service-ca-758f599c5-9d8mp\" (UID: \"5130cb61-a676-483f-be5b-f57c098117c1\") " pod="openshift-service-ca/service-ca-758f599c5-9d8mp"
Jul 09 22:36:59.601461 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.601435    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgc4l\" (UniqueName: \"kubernetes.io/projected/5130cb61-a676-483f-be5b-f57c098117c1-kube-api-access-hgc4l\") pod \"service-ca-758f599c5-9d8mp\" (UID: \"5130cb61-a676-483f-be5b-f57c098117c1\") " pod="openshift-service-ca/service-ca-758f599c5-9d8mp"
Jul 09 22:36:59.601594 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.601518    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5130cb61-a676-483f-be5b-f57c098117c1-signing-cabundle\") pod \"service-ca-758f599c5-9d8mp\" (UID: \"5130cb61-a676-483f-be5b-f57c098117c1\") " pod="openshift-service-ca/service-ca-758f599c5-9d8mp"
Jul 09 22:36:59.602140 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.602116    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5130cb61-a676-483f-be5b-f57c098117c1-signing-cabundle\") pod \"service-ca-758f599c5-9d8mp\" (UID: \"5130cb61-a676-483f-be5b-f57c098117c1\") " pod="openshift-service-ca/service-ca-758f599c5-9d8mp"
Jul 09 22:36:59.603907 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.603860    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5130cb61-a676-483f-be5b-f57c098117c1-signing-key\") pod \"service-ca-758f599c5-9d8mp\" (UID: \"5130cb61-a676-483f-be5b-f57c098117c1\") " pod="openshift-service-ca/service-ca-758f599c5-9d8mp"
Jul 09 22:36:59.609890 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.609847    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgc4l\" (UniqueName: \"kubernetes.io/projected/5130cb61-a676-483f-be5b-f57c098117c1-kube-api-access-hgc4l\") pod \"service-ca-758f599c5-9d8mp\" (UID: \"5130cb61-a676-483f-be5b-f57c098117c1\") " pod="openshift-service-ca/service-ca-758f599c5-9d8mp"
Jul 09 22:36:59.702553 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.702526    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xql5r\" (UID: \"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1\") " pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:36:59.702694 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.702598    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xql5r\" (UID: \"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1\") " pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:36:59.702694 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:59.702662    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 22:36:59.702694 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:59.702684    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 22:36:59.702795 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:59.702724    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-kube-rbac-proxy-cm podName:1de4a026-3f71-4b1d-9cc7-9b89969ac2f1 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:01.702710582 +0000 UTC m=+276.410606146 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xql5r" (UID: "1de4a026-3f71-4b1d-9cc7-9b89969ac2f1") : configmap "kube-rbac-proxy" not found
Jul 09 22:36:59.702795 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:59.702737    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-insights-runtime-extractor-tls podName:1de4a026-3f71-4b1d-9cc7-9b89969ac2f1 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:01.702730801 +0000 UTC m=+276.410626366 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xql5r" (UID: "1de4a026-3f71-4b1d-9cc7-9b89969ac2f1") : secret "insights-runtime-extractor-tls" not found
Jul 09 22:36:59.703409 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.703396    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-9d8mp"
Jul 09 22:36:59.808729 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.808708    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8prz6_545740d3-4dfd-4016-a536-19e114d01fd2/dns-node-resolver/0.log"
Jul 09 22:36:59.822661 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.822635    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-9d8mp"]
Jul 09 22:36:59.825337 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:36:59.825310    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5130cb61_a676_483f_be5b_f57c098117c1.slice/crio-9ea03fb4bb7866658ff241b180843eb4d9ebc8cef717646bfcd2a0e23fed6d4a WatchSource:0}: Error finding container 9ea03fb4bb7866658ff241b180843eb4d9ebc8cef717646bfcd2a0e23fed6d4a: Status 404 returned error can't find the container with id 9ea03fb4bb7866658ff241b180843eb4d9ebc8cef717646bfcd2a0e23fed6d4a
Jul 09 22:36:59.844227 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.844206    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-v29jg_fb564a11-973b-40db-ac7b-a20e2e4bf01d/console-operator/1.log"
Jul 09 22:36:59.844527 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.844511    2564 scope.go:117] "RemoveContainer" containerID="92fbf6dade6c95904835f22fe9509e121459a475cf90422544c5e9ebb7364389"
Jul 09 22:36:59.844661 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:36:59.844644    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-v29jg_openshift-console-operator(fb564a11-973b-40db-ac7b-a20e2e4bf01d)\"" pod="openshift-console-operator/console-operator-68b757fb67-v29jg" podUID="fb564a11-973b-40db-ac7b-a20e2e4bf01d"
Jul 09 22:36:59.845412 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.845392    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-9d8mp" event={"ID":"5130cb61-a676-483f-be5b-f57c098117c1","Type":"ContainerStarted","Data":"9ea03fb4bb7866658ff241b180843eb4d9ebc8cef717646bfcd2a0e23fed6d4a"}
Jul 09 22:36:59.846333 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:36:59.846315    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-z4rw4" event={"ID":"e5a63c0e-90dd-4ff7-88e0-17ee3f744164","Type":"ContainerStarted","Data":"2d6c1b6781b583e215e0f6d2f119163d5e605c65ad3f4566c5169b5c7feee5c1"}
Jul 09 22:37:00.806972 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:00.806941    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kvxs4_b814909b-6f08-45e4-87fc-f598576068b0/node-ca/0.log"
Jul 09 22:37:01.116523 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:01.116444    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ml5qk\" (UID: \"1e7ee03d-8eda-4a91-8c2b-4360384fc4ea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ml5qk"
Jul 09 22:37:01.116657 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:01.116594    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 22:37:01.116657 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:01.116655    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-cluster-monitoring-operator-tls podName:1e7ee03d-8eda-4a91-8c2b-4360384fc4ea nodeName:}" failed. No retries permitted until 2026-07-09 22:37:09.116639413 +0000 UTC m=+283.824534985 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-ml5qk" (UID: "1e7ee03d-8eda-4a91-8c2b-4360384fc4ea") : secret "cluster-monitoring-operator-tls" not found
Jul 09 22:37:01.216889 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:01.216849    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a748629-9bfc-4da5-9343-faaf57711458-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-krqdt\" (UID: \"3a748629-9bfc-4da5-9343-faaf57711458\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-krqdt"
Jul 09 22:37:01.217058 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:01.217034    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 22:37:01.217126 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:01.217111    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a748629-9bfc-4da5-9343-faaf57711458-samples-operator-tls podName:3a748629-9bfc-4da5-9343-faaf57711458 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:09.2170909 +0000 UTC m=+283.924986467 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3a748629-9bfc-4da5-9343-faaf57711458-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-krqdt" (UID: "3a748629-9bfc-4da5-9343-faaf57711458") : secret "samples-operator-tls" not found
Jul 09 22:37:01.721775 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:01.721746    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xql5r\" (UID: \"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1\") " pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:37:01.721958 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:01.721851    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xql5r\" (UID: \"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1\") " pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:37:01.721958 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:01.721866    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 22:37:01.721958 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:01.721944    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-kube-rbac-proxy-cm podName:1de4a026-3f71-4b1d-9cc7-9b89969ac2f1 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:05.721929818 +0000 UTC m=+280.429825387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xql5r" (UID: "1de4a026-3f71-4b1d-9cc7-9b89969ac2f1") : configmap "kube-rbac-proxy" not found
Jul 09 22:37:01.722095 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:01.721999    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 22:37:01.722095 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:01.722052    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-insights-runtime-extractor-tls podName:1de4a026-3f71-4b1d-9cc7-9b89969ac2f1 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:05.722039802 +0000 UTC m=+280.429935368 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xql5r" (UID: "1de4a026-3f71-4b1d-9cc7-9b89969ac2f1") : secret "insights-runtime-extractor-tls" not found
Jul 09 22:37:01.854842 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:01.854811    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-z4rw4" event={"ID":"e5a63c0e-90dd-4ff7-88e0-17ee3f744164","Type":"ContainerStarted","Data":"b8969d273020644ff786a0b68f077c8579c1031ad9bc623021dd91f37a807893"}
Jul 09 22:37:01.855287 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:01.854861    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-z4rw4" event={"ID":"e5a63c0e-90dd-4ff7-88e0-17ee3f744164","Type":"ContainerStarted","Data":"8ed9ad39dd99a3fff2c62b311ad0821f7fc18aee5915b00fd816750d927f8e5b"}
Jul 09 22:37:01.871621 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:01.871562    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-z4rw4" podStartSLOduration=2.458494881 podStartE2EDuration="3.871547707s" totalImagesPullingTime="1.413052826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:36:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:01.871061293 +0000 UTC m=+276.578956900" watchObservedRunningTime="2026-07-09 22:37:01.871547707 +0000 UTC m=+276.579443294"
Jul 09 22:37:02.006560 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:02.006476    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xv6cj_4c9c71de-bcb4-43da-ac3f-42631496dbdd/serve-healthcheck-canary/0.log"
Jul 09 22:37:02.860781 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:02.860747    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-9d8mp" event={"ID":"5130cb61-a676-483f-be5b-f57c098117c1","Type":"ContainerStarted","Data":"37948d4e3af6cb2e9762a55eed517c4f24fc9a7d168cf34356f882202e16c7cd"}
Jul 09 22:37:02.878523 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:02.878443    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-9d8mp" podStartSLOduration=1.350707576 podStartE2EDuration="3.878418194s" totalImagesPullingTime="2.527710618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:36:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:02.87582092 +0000 UTC m=+277.583716509" watchObservedRunningTime="2026-07-09 22:37:02.878418194 +0000 UTC m=+277.586313784"
Jul 09 22:37:03.629100 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:03.629010    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-v29jg"
Jul 09 22:37:03.629266 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:03.629123    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-v29jg"
Jul 09 22:37:03.630131 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:03.629559    2564 scope.go:117] "RemoveContainer" containerID="92fbf6dade6c95904835f22fe9509e121459a475cf90422544c5e9ebb7364389"
Jul 09 22:37:03.630131 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:03.629749    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-v29jg_openshift-console-operator(fb564a11-973b-40db-ac7b-a20e2e4bf01d)\"" pod="openshift-console-operator/console-operator-68b757fb67-v29jg" podUID="fb564a11-973b-40db-ac7b-a20e2e4bf01d"
Jul 09 22:37:05.760562 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:05.760518    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xql5r\" (UID: \"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1\") " pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:37:05.761003 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:05.760624    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xql5r\" (UID: \"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1\") " pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:37:05.761003 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:05.760684    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 22:37:05.761003 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:05.760747    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-insights-runtime-extractor-tls podName:1de4a026-3f71-4b1d-9cc7-9b89969ac2f1 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:13.760732114 +0000 UTC m=+288.468627684 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xql5r" (UID: "1de4a026-3f71-4b1d-9cc7-9b89969ac2f1") : secret "insights-runtime-extractor-tls" not found
Jul 09 22:37:05.761003 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:05.760776    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 22:37:05.761003 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:05.760852    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-kube-rbac-proxy-cm podName:1de4a026-3f71-4b1d-9cc7-9b89969ac2f1 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:13.760837378 +0000 UTC m=+288.468732950 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xql5r" (UID: "1de4a026-3f71-4b1d-9cc7-9b89969ac2f1") : configmap "kube-rbac-proxy" not found
Jul 09 22:37:07.569436 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:07.569391    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs" podUID="3c993f43-ee03-498e-b6d0-5e8f413839b1"
Jul 09 22:37:07.569436 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:07.569392    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hx7rz" podUID="d7db35e3-d753-41f8-af7e-6d7a605e89cd"
Jul 09 22:37:07.569864 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:07.569410    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb" podUID="1d270c40-c725-483f-bf1c-41b9e826f8e2"
Jul 09 22:37:07.880113 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:07.880037    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:37:07.880249 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:07.880039    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:37:07.880249 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:07.880037    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb"
Jul 09 22:37:09.189577 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:09.189538    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ml5qk\" (UID: \"1e7ee03d-8eda-4a91-8c2b-4360384fc4ea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ml5qk"
Jul 09 22:37:09.189976 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:09.189696    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 22:37:09.189976 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:09.189762    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-cluster-monitoring-operator-tls podName:1e7ee03d-8eda-4a91-8c2b-4360384fc4ea nodeName:}" failed. No retries permitted until 2026-07-09 22:37:25.189745165 +0000 UTC m=+299.897640750 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-ml5qk" (UID: "1e7ee03d-8eda-4a91-8c2b-4360384fc4ea") : secret "cluster-monitoring-operator-tls" not found
Jul 09 22:37:09.290790 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:09.290760    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a748629-9bfc-4da5-9343-faaf57711458-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-krqdt\" (UID: \"3a748629-9bfc-4da5-9343-faaf57711458\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-krqdt"
Jul 09 22:37:09.293047 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:09.293027    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a748629-9bfc-4da5-9343-faaf57711458-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-krqdt\" (UID: \"3a748629-9bfc-4da5-9343-faaf57711458\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-krqdt"
Jul 09 22:37:09.315031 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:09.315012    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-krqdt"
Jul 09 22:37:09.435272 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:09.435243    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-krqdt"]
Jul 09 22:37:09.887423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:09.887349    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-krqdt" event={"ID":"3a748629-9bfc-4da5-9343-faaf57711458","Type":"ContainerStarted","Data":"3abc96a6ddc4d8567431890cafb97c2b8c0241681788421e3043e9eb90d1507c"}
Jul 09 22:37:11.106383 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:11.106351    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls\") pod \"dns-default-hx7rz\" (UID: \"d7db35e3-d753-41f8-af7e-6d7a605e89cd\") " pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:37:11.106383 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:11.106390    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5wtkb\" (UID: \"1d270c40-c725-483f-bf1c-41b9e826f8e2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb"
Jul 09 22:37:11.106947 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:11.106439    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:37:11.109326 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:11.109297    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7db35e3-d753-41f8-af7e-6d7a605e89cd-metrics-tls\") pod \"dns-default-hx7rz\" (UID: \"d7db35e3-d753-41f8-af7e-6d7a605e89cd\") " pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:37:11.109480 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:11.109434    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d270c40-c725-483f-bf1c-41b9e826f8e2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5wtkb\" (UID: \"1d270c40-c725-483f-bf1c-41b9e826f8e2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb"
Jul 09 22:37:11.109598 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:11.109584    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls\") pod \"image-registry-696ffdcfbf-rbsjs\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") " pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:37:11.183380 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:11.183353    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xdqcx\""
Jul 09 22:37:11.183380 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:11.183354    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lt8xn\""
Jul 09 22:37:11.183563 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:11.183354    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6gjz6\""
Jul 09 22:37:11.191155 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:11.191139    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb"
Jul 09 22:37:11.191214 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:11.191170    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:37:11.191214 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:11.191184    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:37:11.367895 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:11.366290    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb"]
Jul 09 22:37:11.372497 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:37:11.369551    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d270c40_c725_483f_bf1c_41b9e826f8e2.slice/crio-48f152f7fd5016e1c573864072bbd0c0e43439a596974476e657d9e78f44e05a WatchSource:0}: Error finding container 48f152f7fd5016e1c573864072bbd0c0e43439a596974476e657d9e78f44e05a: Status 404 returned error can't find the container with id 48f152f7fd5016e1c573864072bbd0c0e43439a596974476e657d9e78f44e05a
Jul 09 22:37:11.603354 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:11.603333    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hx7rz"]
Jul 09 22:37:11.606593 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:37:11.606561    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7db35e3_d753_41f8_af7e_6d7a605e89cd.slice/crio-875f15bb191f56ca2d1dc7d87258ca642c4c1c7123478a10c62bed09f1f925e5 WatchSource:0}: Error finding container 875f15bb191f56ca2d1dc7d87258ca642c4c1c7123478a10c62bed09f1f925e5: Status 404 returned error can't find the container with id 875f15bb191f56ca2d1dc7d87258ca642c4c1c7123478a10c62bed09f1f925e5
Jul 09 22:37:11.607157 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:11.607129    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-696ffdcfbf-rbsjs"]
Jul 09 22:37:11.610046 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:37:11.610014    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c993f43_ee03_498e_b6d0_5e8f413839b1.slice/crio-6cbe4a442392cb61f9361d8754c1dbb87f951e47eafac4c3a0cc2b1f9c2a4fa4 WatchSource:0}: Error finding container 6cbe4a442392cb61f9361d8754c1dbb87f951e47eafac4c3a0cc2b1f9c2a4fa4: Status 404 returned error can't find the container with id 6cbe4a442392cb61f9361d8754c1dbb87f951e47eafac4c3a0cc2b1f9c2a4fa4
Jul 09 22:37:11.896778 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:11.896684    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs" event={"ID":"3c993f43-ee03-498e-b6d0-5e8f413839b1","Type":"ContainerStarted","Data":"8265cb2367d043b6b754b18d9760acc56df9c786232689f51a881cd8f2e3fd87"}
Jul 09 22:37:11.896778 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:11.896750    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs" event={"ID":"3c993f43-ee03-498e-b6d0-5e8f413839b1","Type":"ContainerStarted","Data":"6cbe4a442392cb61f9361d8754c1dbb87f951e47eafac4c3a0cc2b1f9c2a4fa4"}
Jul 09 22:37:11.897020 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:11.896780    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:37:11.898073 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:11.898051    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hx7rz" event={"ID":"d7db35e3-d753-41f8-af7e-6d7a605e89cd","Type":"ContainerStarted","Data":"875f15bb191f56ca2d1dc7d87258ca642c4c1c7123478a10c62bed09f1f925e5"}
Jul 09 22:37:11.899218 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:11.899195    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb" event={"ID":"1d270c40-c725-483f-bf1c-41b9e826f8e2","Type":"ContainerStarted","Data":"48f152f7fd5016e1c573864072bbd0c0e43439a596974476e657d9e78f44e05a"}
Jul 09 22:37:11.917703 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:11.917650    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs" podStartSLOduration=285.917629985 podStartE2EDuration="4m45.917629985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:32:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:11.915926769 +0000 UTC m=+286.623822357" watchObservedRunningTime="2026-07-09 22:37:11.917629985 +0000 UTC m=+286.625525573"
Jul 09 22:37:12.905553 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:12.905467    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-krqdt" event={"ID":"3a748629-9bfc-4da5-9343-faaf57711458","Type":"ContainerStarted","Data":"d35fb5f114fa2cc62be1a343a611b8bc7b7ae1c7dd10fbecbee3043bac8f9f9e"}
Jul 09 22:37:12.905553 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:12.905529    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-krqdt" event={"ID":"3a748629-9bfc-4da5-9343-faaf57711458","Type":"ContainerStarted","Data":"6a92019bd2847a9e81023957fc4d962788387d4821ddd5a62eaebe1c02c268ef"}
Jul 09 22:37:13.831591 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:13.831551    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xql5r\" (UID: \"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1\") " pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:37:13.831778 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:13.831635    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xql5r\" (UID: \"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1\") " pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:37:13.831778 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:13.831713    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 22:37:13.831920 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:13.831794    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-insights-runtime-extractor-tls podName:1de4a026-3f71-4b1d-9cc7-9b89969ac2f1 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:29.831772639 +0000 UTC m=+304.539668207 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xql5r" (UID: "1de4a026-3f71-4b1d-9cc7-9b89969ac2f1") : secret "insights-runtime-extractor-tls" not found
Jul 09 22:37:13.832187 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:13.832157    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xql5r\" (UID: \"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1\") " pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:37:13.911084 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:13.911050    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb" event={"ID":"1d270c40-c725-483f-bf1c-41b9e826f8e2","Type":"ContainerStarted","Data":"cfda2f825c7cee1d41406a6dc05b6fe1c57e189352a8a95ec52e2481946b5474"}
Jul 09 22:37:13.926809 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:13.926759    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5wtkb" podStartSLOduration=262.965072051 podStartE2EDuration="4m24.926741523s" totalImagesPullingTime="1.961669472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:32:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:13.926298708 +0000 UTC m=+288.634194296" watchObservedRunningTime="2026-07-09 22:37:13.926741523 +0000 UTC m=+288.634637111"
Jul 09 22:37:13.927222 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:13.927180    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-krqdt" podStartSLOduration=17.862849283 podStartE2EDuration="20.927170268s" totalImagesPullingTime="3.064320985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:36:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:12.924174804 +0000 UTC m=+287.632070392" watchObservedRunningTime="2026-07-09 22:37:13.927170268 +0000 UTC m=+288.635065856"
Jul 09 22:37:14.915830 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:14.915796    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hx7rz" event={"ID":"d7db35e3-d753-41f8-af7e-6d7a605e89cd","Type":"ContainerStarted","Data":"9ac0a68fb1df67d5de3ac37f618c6f92afe8b626841c3d809cfd5a0a36136c69"}
Jul 09 22:37:14.916210 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:14.915844    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hx7rz" event={"ID":"d7db35e3-d753-41f8-af7e-6d7a605e89cd","Type":"ContainerStarted","Data":"bc44645cd98cedde8ed17b6890442bd3efe2d388db07738d4aebbd41564aecd0"}
Jul 09 22:37:14.932324 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:14.932283    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hx7rz" podStartSLOduration=251.342110483 podStartE2EDuration="4m13.932267799s" totalImagesPullingTime="2.590157316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:33:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:14.931998171 +0000 UTC m=+289.639893769" watchObservedRunningTime="2026-07-09 22:37:14.932267799 +0000 UTC m=+289.640163386"
Jul 09 22:37:15.919112 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:15.919084    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:37:15.962264 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:15.962239    2564 scope.go:117] "RemoveContainer" containerID="92fbf6dade6c95904835f22fe9509e121459a475cf90422544c5e9ebb7364389"
Jul 09 22:37:16.923438 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:16.923413    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-v29jg_fb564a11-973b-40db-ac7b-a20e2e4bf01d/console-operator/1.log"
Jul 09 22:37:16.923809 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:16.923525    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-v29jg" event={"ID":"fb564a11-973b-40db-ac7b-a20e2e4bf01d","Type":"ContainerStarted","Data":"5fa0583efedbd3b15362fedcec27c700a7da438f8e56409f51b47d92f305da53"}
Jul 09 22:37:16.924021 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:16.923991    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-v29jg"
Jul 09 22:37:16.928258 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:16.928241    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-v29jg"
Jul 09 22:37:16.939951 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:16.939915    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-v29jg" podStartSLOduration=20.394570982 podStartE2EDuration="23.939903227s" totalImagesPullingTime="3.545332245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:36:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:16.938657127 +0000 UTC m=+291.646552715" watchObservedRunningTime="2026-07-09 22:37:16.939903227 +0000 UTC m=+291.647798813"
Jul 09 22:37:21.568820 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:21.568787    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-pg6hp"]
Jul 09 22:37:21.571885 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:21.571843    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-pg6hp"
Jul 09 22:37:21.574654 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:21.574617    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 22:37:21.575006 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:21.574982    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-82q79\""
Jul 09 22:37:21.575557 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:21.575540    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 22:37:21.588808 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:21.588780    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-pg6hp"]
Jul 09 22:37:21.589238 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:21.589217    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4p4j\" (UniqueName: \"kubernetes.io/projected/ec09072b-d4d9-4284-a116-d6d5b1c65de8-kube-api-access-f4p4j\") pod \"downloads-685bfb5f64-pg6hp\" (UID: \"ec09072b-d4d9-4284-a116-d6d5b1c65de8\") " pod="openshift-console/downloads-685bfb5f64-pg6hp"
Jul 09 22:37:21.690400 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:21.690369    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4p4j\" (UniqueName: \"kubernetes.io/projected/ec09072b-d4d9-4284-a116-d6d5b1c65de8-kube-api-access-f4p4j\") pod \"downloads-685bfb5f64-pg6hp\" (UID: \"ec09072b-d4d9-4284-a116-d6d5b1c65de8\") " pod="openshift-console/downloads-685bfb5f64-pg6hp"
Jul 09 22:37:21.700558 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:21.700526    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4p4j\" (UniqueName: \"kubernetes.io/projected/ec09072b-d4d9-4284-a116-d6d5b1c65de8-kube-api-access-f4p4j\") pod \"downloads-685bfb5f64-pg6hp\" (UID: \"ec09072b-d4d9-4284-a116-d6d5b1c65de8\") " pod="openshift-console/downloads-685bfb5f64-pg6hp"
Jul 09 22:37:21.881711 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:21.881628    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-pg6hp"
Jul 09 22:37:22.009280 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:22.009251    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-pg6hp"]
Jul 09 22:37:22.012149 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:37:22.012126    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec09072b_d4d9_4284_a116_d6d5b1c65de8.slice/crio-9e2e63e4a34a5bd3c635e1c7f01b29eb5bbedbdf05b9f6712b56906b2a2ba6ad WatchSource:0}: Error finding container 9e2e63e4a34a5bd3c635e1c7f01b29eb5bbedbdf05b9f6712b56906b2a2ba6ad: Status 404 returned error can't find the container with id 9e2e63e4a34a5bd3c635e1c7f01b29eb5bbedbdf05b9f6712b56906b2a2ba6ad
Jul 09 22:37:22.948139 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:22.948102    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-pg6hp" event={"ID":"ec09072b-d4d9-4284-a116-d6d5b1c65de8","Type":"ContainerStarted","Data":"9e2e63e4a34a5bd3c635e1c7f01b29eb5bbedbdf05b9f6712b56906b2a2ba6ad"}
Jul 09 22:37:23.960699 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:23.960658    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8r82v" podUID="d94a7d72-cc1e-4193-99df-08721091f47e"
Jul 09 22:37:25.216675 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:25.216635    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ml5qk\" (UID: \"1e7ee03d-8eda-4a91-8c2b-4360384fc4ea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ml5qk"
Jul 09 22:37:25.219439 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:25.219405    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e7ee03d-8eda-4a91-8c2b-4360384fc4ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ml5qk\" (UID: \"1e7ee03d-8eda-4a91-8c2b-4360384fc4ea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ml5qk"
Jul 09 22:37:25.422211 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:25.422177    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ml5qk"
Jul 09 22:37:25.567743 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:25.567713    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ml5qk"]
Jul 09 22:37:25.571623 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:37:25.571586    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e7ee03d_8eda_4a91_8c2b_4360384fc4ea.slice/crio-175c79c8d5510f0bb9f499402c6edfcc7597ec7bd07e27fed97e2798e24f1625 WatchSource:0}: Error finding container 175c79c8d5510f0bb9f499402c6edfcc7597ec7bd07e27fed97e2798e24f1625: Status 404 returned error can't find the container with id 175c79c8d5510f0bb9f499402c6edfcc7597ec7bd07e27fed97e2798e24f1625
Jul 09 22:37:25.705921 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:25.705892    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-v29jg_fb564a11-973b-40db-ac7b-a20e2e4bf01d/console-operator/1.log"
Jul 09 22:37:25.711032 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:25.711010    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-v29jg_fb564a11-973b-40db-ac7b-a20e2e4bf01d/console-operator/1.log"
Jul 09 22:37:25.718409 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:25.718392    2564 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 22:37:25.926111 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:25.925934    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hx7rz"
Jul 09 22:37:25.965238 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:25.965205    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ml5qk" event={"ID":"1e7ee03d-8eda-4a91-8c2b-4360384fc4ea","Type":"ContainerStarted","Data":"175c79c8d5510f0bb9f499402c6edfcc7597ec7bd07e27fed97e2798e24f1625"}
Jul 09 22:37:27.973433 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:27.973348    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ml5qk" event={"ID":"1e7ee03d-8eda-4a91-8c2b-4360384fc4ea","Type":"ContainerStarted","Data":"7cbde56201fe96007c83b713ccda64f281a882bf1af4ceb0612a116405aadd90"}
Jul 09 22:37:27.994025 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:27.993973    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ml5qk" podStartSLOduration=32.852226317 podStartE2EDuration="34.993956627s" totalImagesPullingTime="2.14173031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:36:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:27.992372403 +0000 UTC m=+302.700268073" watchObservedRunningTime="2026-07-09 22:37:27.993956627 +0000 UTC m=+302.701852214"
Jul 09 22:37:29.854532 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:29.854498    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xql5r\" (UID: \"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1\") " pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:37:29.856977 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:29.856940    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1de4a026-3f71-4b1d-9cc7-9b89969ac2f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xql5r\" (UID: \"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1\") " pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:37:30.130631 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:30.130548    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pvkvm\""
Jul 09 22:37:30.138258 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:30.138235    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xql5r"
Jul 09 22:37:30.330953 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:30.330920    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xql5r"]
Jul 09 22:37:30.335056 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:37:30.335025    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1de4a026_3f71_4b1d_9cc7_9b89969ac2f1.slice/crio-43715ff98fe9a96cf92e69eb56fae4a7cd3357f74696e0833b0057b7fa61b095 WatchSource:0}: Error finding container 43715ff98fe9a96cf92e69eb56fae4a7cd3357f74696e0833b0057b7fa61b095: Status 404 returned error can't find the container with id 43715ff98fe9a96cf92e69eb56fae4a7cd3357f74696e0833b0057b7fa61b095
Jul 09 22:37:30.336652 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:30.336630    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 22:37:30.985631 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:30.985589    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xql5r" event={"ID":"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1","Type":"ContainerStarted","Data":"43715ff98fe9a96cf92e69eb56fae4a7cd3357f74696e0833b0057b7fa61b095"}
Jul 09 22:37:31.198633 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:31.198317    2564 patch_prober.go:28] interesting pod/image-registry-696ffdcfbf-rbsjs container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 09 22:37:31.198633 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:31.198383    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs" podUID="3c993f43-ee03-498e-b6d0-5e8f413839b1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 22:37:32.911354 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:32.911320    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:37:35.962318 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:35.962281    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:37:37.686996 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.686707    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-9bv6z"]
Jul 09 22:37:37.711315 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.711288    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-9bv6z"]
Jul 09 22:37:37.711530 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.711428    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9bv6z"
Jul 09 22:37:37.715857 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.715712    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-rsmkv\""
Jul 09 22:37:37.717655 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.716205    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 22:37:37.717655 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.716222    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 09 22:37:37.717655 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.716395    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 09 22:37:37.717655 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.716521    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nch5w"]
Jul 09 22:37:37.738026 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.738001    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:37.741084 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.741064    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 22:37:37.741534 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.741277    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-drsgl\""
Jul 09 22:37:37.741534 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.741334    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 22:37:37.741534 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.741281    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 22:37:37.826232 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.826192    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25958d91-7acb-4fc5-8171-16b5dc228075-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-9bv6z\" (UID: \"25958d91-7acb-4fc5-8171-16b5dc228075\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9bv6z"
Jul 09 22:37:37.826410 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.826247    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-node-exporter-accelerators-collector-config\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:37.826410 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.826322    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:37.826410 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.826362    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-node-exporter-textfile\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:37.826579 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.826415    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-root\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:37.826579 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.826458    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/25958d91-7acb-4fc5-8171-16b5dc228075-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-9bv6z\" (UID: \"25958d91-7acb-4fc5-8171-16b5dc228075\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9bv6z"
Jul 09 22:37:37.826579 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.826514    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx8sf\" (UniqueName: \"kubernetes.io/projected/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-kube-api-access-sx8sf\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:37.826579 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.826542    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-node-exporter-wtmp\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:37.826769 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.826577    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-metrics-client-ca\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:37.826769 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.826603    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4twzw\" (UniqueName: \"kubernetes.io/projected/25958d91-7acb-4fc5-8171-16b5dc228075-kube-api-access-4twzw\") pod \"openshift-state-metrics-54cf96dfcf-9bv6z\" (UID: \"25958d91-7acb-4fc5-8171-16b5dc228075\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9bv6z"
Jul 09 22:37:37.826769 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.826632    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25958d91-7acb-4fc5-8171-16b5dc228075-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-9bv6z\" (UID: \"25958d91-7acb-4fc5-8171-16b5dc228075\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9bv6z"
Jul 09 22:37:37.826769 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.826668    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-node-exporter-tls\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:37.826769 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.826720    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-sys\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:37.927462 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.927433    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:37.927642 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.927472    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-node-exporter-textfile\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:37.927642 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.927507    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-root\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:37.927642 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.927543    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/25958d91-7acb-4fc5-8171-16b5dc228075-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-9bv6z\" (UID: \"25958d91-7acb-4fc5-8171-16b5dc228075\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9bv6z"
Jul 09 22:37:37.927642 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.927595    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx8sf\" (UniqueName: \"kubernetes.io/projected/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-kube-api-access-sx8sf\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:37.927642 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.927620    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-node-exporter-wtmp\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:37.927924 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.927650    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-metrics-client-ca\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:37.927924 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.927674    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4twzw\" (UniqueName: \"kubernetes.io/projected/25958d91-7acb-4fc5-8171-16b5dc228075-kube-api-access-4twzw\") pod \"openshift-state-metrics-54cf96dfcf-9bv6z\" (UID: \"25958d91-7acb-4fc5-8171-16b5dc228075\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9bv6z"
Jul 09 22:37:37.927924 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.927706    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25958d91-7acb-4fc5-8171-16b5dc228075-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-9bv6z\" (UID: \"25958d91-7acb-4fc5-8171-16b5dc228075\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9bv6z"
Jul 09 22:37:37.927924 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.927734    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-node-exporter-tls\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:37.927924 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.927760    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-sys\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:37.927924 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.927799    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25958d91-7acb-4fc5-8171-16b5dc228075-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-9bv6z\" (UID: \"25958d91-7acb-4fc5-8171-16b5dc228075\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9bv6z"
Jul 09 22:37:37.927924 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.927836    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-node-exporter-accelerators-collector-config\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:37.927924 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.927910    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-node-exporter-textfile\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:37.928341 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.927925    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-root\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:37.928341 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:37.927968    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 09 22:37:37.928341 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:37.928013    2564 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 09 22:37:37.928341 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:37.928043    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-node-exporter-tls podName:dc7a487d-1cab-4257-b4f3-efc49c43ef1f nodeName:}" failed. No retries permitted until 2026-07-09 22:37:38.428023164 +0000 UTC m=+313.135918732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-node-exporter-tls") pod "node-exporter-nch5w" (UID: "dc7a487d-1cab-4257-b4f3-efc49c43ef1f") : secret "node-exporter-tls" not found
Jul 09 22:37:37.928341 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:37.928061    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25958d91-7acb-4fc5-8171-16b5dc228075-openshift-state-metrics-tls podName:25958d91-7acb-4fc5-8171-16b5dc228075 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:38.428052044 +0000 UTC m=+313.135947616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/25958d91-7acb-4fc5-8171-16b5dc228075-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-9bv6z" (UID: "25958d91-7acb-4fc5-8171-16b5dc228075") : secret "openshift-state-metrics-tls" not found
Jul 09 22:37:37.928341 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.928276    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-node-exporter-wtmp\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:37.928341 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.928331    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-sys\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:37.928690 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.928484    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-node-exporter-accelerators-collector-config\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:37.928690 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.928496    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-metrics-client-ca\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:37.928793 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.928708    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25958d91-7acb-4fc5-8171-16b5dc228075-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-9bv6z\" (UID: \"25958d91-7acb-4fc5-8171-16b5dc228075\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9bv6z"
Jul 09 22:37:37.931059 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.931025    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:37.931059 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.931037    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25958d91-7acb-4fc5-8171-16b5dc228075-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-9bv6z\" (UID: \"25958d91-7acb-4fc5-8171-16b5dc228075\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9bv6z"
Jul 09 22:37:37.937037 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.936986    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4twzw\" (UniqueName: \"kubernetes.io/projected/25958d91-7acb-4fc5-8171-16b5dc228075-kube-api-access-4twzw\") pod \"openshift-state-metrics-54cf96dfcf-9bv6z\" (UID: \"25958d91-7acb-4fc5-8171-16b5dc228075\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9bv6z"
Jul 09 22:37:37.937744 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:37.937721    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx8sf\" (UniqueName: \"kubernetes.io/projected/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-kube-api-access-sx8sf\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:38.433050 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:38.433009    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/25958d91-7acb-4fc5-8171-16b5dc228075-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-9bv6z\" (UID: \"25958d91-7acb-4fc5-8171-16b5dc228075\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9bv6z"
Jul 09 22:37:38.433216 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:38.433186    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-node-exporter-tls\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:38.435681 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:38.435659    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dc7a487d-1cab-4257-b4f3-efc49c43ef1f-node-exporter-tls\") pod \"node-exporter-nch5w\" (UID: \"dc7a487d-1cab-4257-b4f3-efc49c43ef1f\") " pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:38.435799 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:38.435731    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/25958d91-7acb-4fc5-8171-16b5dc228075-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-9bv6z\" (UID: \"25958d91-7acb-4fc5-8171-16b5dc228075\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9bv6z"
Jul 09 22:37:38.627413 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:38.627373    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9bv6z"
Jul 09 22:37:38.649578 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:38.649539    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nch5w"
Jul 09 22:37:40.561553 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.561522    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f5f98d58d-dc88w"]
Jul 09 22:37:40.580523 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.580389    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f5f98d58d-dc88w"]
Jul 09 22:37:40.580523 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.580512    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:40.583541 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.583307    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 22:37:40.583541 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.583326    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xrw77\""
Jul 09 22:37:40.583770 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.583637    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 22:37:40.584167 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.584146    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 22:37:40.584489 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.584456    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 22:37:40.585567 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.585333    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 22:37:40.590717 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.590512    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 09 22:37:40.653329 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.653295    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/773de76a-8101-4d0c-aa9b-8441e724faed-console-serving-cert\") pod \"console-6f5f98d58d-dc88w\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") " pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:40.653504 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.653374    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/773de76a-8101-4d0c-aa9b-8441e724faed-console-oauth-config\") pod \"console-6f5f98d58d-dc88w\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") " pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:40.653504 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.653420    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/773de76a-8101-4d0c-aa9b-8441e724faed-service-ca\") pod \"console-6f5f98d58d-dc88w\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") " pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:40.653504 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.653446    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfjf6\" (UniqueName: \"kubernetes.io/projected/773de76a-8101-4d0c-aa9b-8441e724faed-kube-api-access-dfjf6\") pod \"console-6f5f98d58d-dc88w\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") " pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:40.653504 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.653478    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/773de76a-8101-4d0c-aa9b-8441e724faed-trusted-ca-bundle\") pod \"console-6f5f98d58d-dc88w\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") " pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:40.653724 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.653531    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/773de76a-8101-4d0c-aa9b-8441e724faed-console-config\") pod \"console-6f5f98d58d-dc88w\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") " pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:40.653724 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.653572    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/773de76a-8101-4d0c-aa9b-8441e724faed-oauth-serving-cert\") pod \"console-6f5f98d58d-dc88w\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") " pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:40.692861 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.692828    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-589c58547d-nm58h"]
Jul 09 22:37:40.700813 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.700788    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:40.703623 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.703278    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dlcm6apbuanhr\""
Jul 09 22:37:40.703623 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.703341    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 09 22:37:40.703623 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.703366    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 09 22:37:40.703623 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.703490    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 09 22:37:40.703623 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.703496    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-l7x85\""
Jul 09 22:37:40.703623 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.703278    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 09 22:37:40.703994 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.703676    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 09 22:37:40.707581 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.707444    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-589c58547d-nm58h"]
Jul 09 22:37:40.754956 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.754922    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/773de76a-8101-4d0c-aa9b-8441e724faed-trusted-ca-bundle\") pod \"console-6f5f98d58d-dc88w\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") " pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:40.755145 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.754971    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/773de76a-8101-4d0c-aa9b-8441e724faed-console-config\") pod \"console-6f5f98d58d-dc88w\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") " pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:40.755145 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.755051    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/773de76a-8101-4d0c-aa9b-8441e724faed-oauth-serving-cert\") pod \"console-6f5f98d58d-dc88w\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") " pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:40.755145 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.755128    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c31db871-5285-4408-ae8b-1bd3a5244a5d-secret-thanos-querier-tls\") pod \"thanos-querier-589c58547d-nm58h\" (UID: \"c31db871-5285-4408-ae8b-1bd3a5244a5d\") " pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:40.755305 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.755161    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq6tb\" (UniqueName: \"kubernetes.io/projected/c31db871-5285-4408-ae8b-1bd3a5244a5d-kube-api-access-dq6tb\") pod \"thanos-querier-589c58547d-nm58h\" (UID: \"c31db871-5285-4408-ae8b-1bd3a5244a5d\") " pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:40.755361 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.755329    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c31db871-5285-4408-ae8b-1bd3a5244a5d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-589c58547d-nm58h\" (UID: \"c31db871-5285-4408-ae8b-1bd3a5244a5d\") " pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:40.755414 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.755385    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/773de76a-8101-4d0c-aa9b-8441e724faed-console-serving-cert\") pod \"console-6f5f98d58d-dc88w\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") " pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:40.755460 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.755418    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c31db871-5285-4408-ae8b-1bd3a5244a5d-secret-grpc-tls\") pod \"thanos-querier-589c58547d-nm58h\" (UID: \"c31db871-5285-4408-ae8b-1bd3a5244a5d\") " pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:40.755516 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.755489    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c31db871-5285-4408-ae8b-1bd3a5244a5d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-589c58547d-nm58h\" (UID: \"c31db871-5285-4408-ae8b-1bd3a5244a5d\") " pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:40.755569 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.755517    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c31db871-5285-4408-ae8b-1bd3a5244a5d-metrics-client-ca\") pod \"thanos-querier-589c58547d-nm58h\" (UID: \"c31db871-5285-4408-ae8b-1bd3a5244a5d\") " pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:40.755569 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.755548    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/773de76a-8101-4d0c-aa9b-8441e724faed-console-oauth-config\") pod \"console-6f5f98d58d-dc88w\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") " pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:40.755666 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.755575    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c31db871-5285-4408-ae8b-1bd3a5244a5d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-589c58547d-nm58h\" (UID: \"c31db871-5285-4408-ae8b-1bd3a5244a5d\") " pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:40.755666 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.755624    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c31db871-5285-4408-ae8b-1bd3a5244a5d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-589c58547d-nm58h\" (UID: \"c31db871-5285-4408-ae8b-1bd3a5244a5d\") " pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:40.755762 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.755661    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/773de76a-8101-4d0c-aa9b-8441e724faed-service-ca\") pod \"console-6f5f98d58d-dc88w\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") " pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:40.755762 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.755691    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfjf6\" (UniqueName: \"kubernetes.io/projected/773de76a-8101-4d0c-aa9b-8441e724faed-kube-api-access-dfjf6\") pod \"console-6f5f98d58d-dc88w\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") " pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:40.755856 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.755835    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/773de76a-8101-4d0c-aa9b-8441e724faed-console-config\") pod \"console-6f5f98d58d-dc88w\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") " pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:40.755930 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.755852    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/773de76a-8101-4d0c-aa9b-8441e724faed-oauth-serving-cert\") pod \"console-6f5f98d58d-dc88w\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") " pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:40.756146 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.756121    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/773de76a-8101-4d0c-aa9b-8441e724faed-trusted-ca-bundle\") pod \"console-6f5f98d58d-dc88w\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") " pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:40.757022 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.756916    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/773de76a-8101-4d0c-aa9b-8441e724faed-service-ca\") pod \"console-6f5f98d58d-dc88w\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") " pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:40.759330 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.759306    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/773de76a-8101-4d0c-aa9b-8441e724faed-console-oauth-config\") pod \"console-6f5f98d58d-dc88w\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") " pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:40.760297 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.760270    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/773de76a-8101-4d0c-aa9b-8441e724faed-console-serving-cert\") pod \"console-6f5f98d58d-dc88w\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") " pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:40.764385 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.764341    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfjf6\" (UniqueName: \"kubernetes.io/projected/773de76a-8101-4d0c-aa9b-8441e724faed-kube-api-access-dfjf6\") pod \"console-6f5f98d58d-dc88w\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") " pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:40.857096 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.857020    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c31db871-5285-4408-ae8b-1bd3a5244a5d-secret-thanos-querier-tls\") pod \"thanos-querier-589c58547d-nm58h\" (UID: \"c31db871-5285-4408-ae8b-1bd3a5244a5d\") " pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:40.857096 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.857053    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq6tb\" (UniqueName: \"kubernetes.io/projected/c31db871-5285-4408-ae8b-1bd3a5244a5d-kube-api-access-dq6tb\") pod \"thanos-querier-589c58547d-nm58h\" (UID: \"c31db871-5285-4408-ae8b-1bd3a5244a5d\") " pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:40.857096 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.857084    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c31db871-5285-4408-ae8b-1bd3a5244a5d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-589c58547d-nm58h\" (UID: \"c31db871-5285-4408-ae8b-1bd3a5244a5d\") " pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:40.857365 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.857114    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c31db871-5285-4408-ae8b-1bd3a5244a5d-secret-grpc-tls\") pod \"thanos-querier-589c58547d-nm58h\" (UID: \"c31db871-5285-4408-ae8b-1bd3a5244a5d\") " pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:40.857365 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.857175    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c31db871-5285-4408-ae8b-1bd3a5244a5d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-589c58547d-nm58h\" (UID: \"c31db871-5285-4408-ae8b-1bd3a5244a5d\") " pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:40.857365 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.857202    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c31db871-5285-4408-ae8b-1bd3a5244a5d-metrics-client-ca\") pod \"thanos-querier-589c58547d-nm58h\" (UID: \"c31db871-5285-4408-ae8b-1bd3a5244a5d\") " pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:40.857365 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.857228    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c31db871-5285-4408-ae8b-1bd3a5244a5d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-589c58547d-nm58h\" (UID: \"c31db871-5285-4408-ae8b-1bd3a5244a5d\") " pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:40.857365 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.857268    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c31db871-5285-4408-ae8b-1bd3a5244a5d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-589c58547d-nm58h\" (UID: \"c31db871-5285-4408-ae8b-1bd3a5244a5d\") " pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:40.859185 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.859130    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c31db871-5285-4408-ae8b-1bd3a5244a5d-metrics-client-ca\") pod \"thanos-querier-589c58547d-nm58h\" (UID: \"c31db871-5285-4408-ae8b-1bd3a5244a5d\") " pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:40.860218 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.860167    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c31db871-5285-4408-ae8b-1bd3a5244a5d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-589c58547d-nm58h\" (UID: \"c31db871-5285-4408-ae8b-1bd3a5244a5d\") " pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:40.860610 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.860579    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c31db871-5285-4408-ae8b-1bd3a5244a5d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-589c58547d-nm58h\" (UID: \"c31db871-5285-4408-ae8b-1bd3a5244a5d\") " pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:40.860712 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.860673    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c31db871-5285-4408-ae8b-1bd3a5244a5d-secret-grpc-tls\") pod \"thanos-querier-589c58547d-nm58h\" (UID: \"c31db871-5285-4408-ae8b-1bd3a5244a5d\") " pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:40.861024 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.861002    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c31db871-5285-4408-ae8b-1bd3a5244a5d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-589c58547d-nm58h\" (UID: \"c31db871-5285-4408-ae8b-1bd3a5244a5d\") " pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:40.861500 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.861483    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c31db871-5285-4408-ae8b-1bd3a5244a5d-secret-thanos-querier-tls\") pod \"thanos-querier-589c58547d-nm58h\" (UID: \"c31db871-5285-4408-ae8b-1bd3a5244a5d\") " pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:40.861906 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.861887    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c31db871-5285-4408-ae8b-1bd3a5244a5d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-589c58547d-nm58h\" (UID: \"c31db871-5285-4408-ae8b-1bd3a5244a5d\") " pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:40.864793 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.864773    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq6tb\" (UniqueName: \"kubernetes.io/projected/c31db871-5285-4408-ae8b-1bd3a5244a5d-kube-api-access-dq6tb\") pod \"thanos-querier-589c58547d-nm58h\" (UID: \"c31db871-5285-4408-ae8b-1bd3a5244a5d\") " pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:40.893279 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:40.893248    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:41.015152 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:41.015114    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:41.885153 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:37:41.885122    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc7a487d_1cab_4257_b4f3_efc49c43ef1f.slice/crio-34a8597c81a1e414cb46d400275dc7316e3b0a3bca3bb428c0296aa4e6ed688a WatchSource:0}: Error finding container 34a8597c81a1e414cb46d400275dc7316e3b0a3bca3bb428c0296aa4e6ed688a: Status 404 returned error can't find the container with id 34a8597c81a1e414cb46d400275dc7316e3b0a3bca3bb428c0296aa4e6ed688a
Jul 09 22:37:42.036190 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.035512    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-pg6hp" event={"ID":"ec09072b-d4d9-4284-a116-d6d5b1c65de8","Type":"ContainerStarted","Data":"611824e981e1f94cf23a2097802ebc8d6bbd1aca76597210529a13c4de178c51"}
Jul 09 22:37:42.036190 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.036102    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-pg6hp"
Jul 09 22:37:42.037989 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.037960    2564 patch_prober.go:28] interesting pod/downloads-685bfb5f64-pg6hp container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.19:8080/\": dial tcp 10.132.0.19:8080: connect: connection refused" start-of-body=
Jul 09 22:37:42.038164 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.038003    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-685bfb5f64-pg6hp" podUID="ec09072b-d4d9-4284-a116-d6d5b1c65de8" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.19:8080/\": dial tcp 10.132.0.19:8080: connect: connection refused"
Jul 09 22:37:42.038332 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.038276    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xql5r" event={"ID":"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1","Type":"ContainerStarted","Data":"a278acbad4f07139b77cb985e3c36ce5bae813f09954e6bc3efad66e1dc79ce7"}
Jul 09 22:37:42.040108 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.040059    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nch5w" event={"ID":"dc7a487d-1cab-4257-b4f3-efc49c43ef1f","Type":"ContainerStarted","Data":"34a8597c81a1e414cb46d400275dc7316e3b0a3bca3bb428c0296aa4e6ed688a"}
Jul 09 22:37:42.052943 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.052362    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-pg6hp" podStartSLOduration=1.185492927 podStartE2EDuration="21.052343211s" totalImagesPullingTime="19.866850284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:37:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:42.051165426 +0000 UTC m=+316.759061013" watchObservedRunningTime="2026-07-09 22:37:42.052343211 +0000 UTC m=+316.760238797"
Jul 09 22:37:42.057297 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.057235    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-9bv6z"]
Jul 09 22:37:42.061920 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:37:42.061863    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25958d91_7acb_4fc5_8171_16b5dc228075.slice/crio-2befca9483349343c920cf71811d01bfbe160545c6b0f29b1729b5b32f54c117 WatchSource:0}: Error finding container 2befca9483349343c920cf71811d01bfbe160545c6b0f29b1729b5b32f54c117: Status 404 returned error can't find the container with id 2befca9483349343c920cf71811d01bfbe160545c6b0f29b1729b5b32f54c117
Jul 09 22:37:42.294775 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.294717    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f5f98d58d-dc88w"]
Jul 09 22:37:42.296479 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.296321    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-589c58547d-nm58h"]
Jul 09 22:37:42.303792 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:37:42.303615    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod773de76a_8101_4d0c_aa9b_8441e724faed.slice/crio-f0bfc55e59d13eb1e35418b0d00acc25623aa7a95db0e592b3dd36d221562fae WatchSource:0}: Error finding container f0bfc55e59d13eb1e35418b0d00acc25623aa7a95db0e592b3dd36d221562fae: Status 404 returned error can't find the container with id f0bfc55e59d13eb1e35418b0d00acc25623aa7a95db0e592b3dd36d221562fae
Jul 09 22:37:42.477068 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.477000    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-tsg2g"]
Jul 09 22:37:42.481508 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.481478    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tsg2g"
Jul 09 22:37:42.485659 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.485447    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-x8b5t\""
Jul 09 22:37:42.485659 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.485457    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 09 22:37:42.492192 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.492138    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-tsg2g"]
Jul 09 22:37:42.574782 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.574594    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d867d2a-90ad-46bd-8f81-2b7cd2298e00-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-tsg2g\" (UID: \"2d867d2a-90ad-46bd-8f81-2b7cd2298e00\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tsg2g"
Jul 09 22:37:42.574782 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.574696    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nq7z\" (UniqueName: \"kubernetes.io/projected/2d867d2a-90ad-46bd-8f81-2b7cd2298e00-kube-api-access-9nq7z\") pod \"monitoring-plugin-d5dcff7cf-tsg2g\" (UID: \"2d867d2a-90ad-46bd-8f81-2b7cd2298e00\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tsg2g"
Jul 09 22:37:42.676567 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.675783    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nq7z\" (UniqueName: \"kubernetes.io/projected/2d867d2a-90ad-46bd-8f81-2b7cd2298e00-kube-api-access-9nq7z\") pod \"monitoring-plugin-d5dcff7cf-tsg2g\" (UID: \"2d867d2a-90ad-46bd-8f81-2b7cd2298e00\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tsg2g"
Jul 09 22:37:42.676567 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.675894    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d867d2a-90ad-46bd-8f81-2b7cd2298e00-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-tsg2g\" (UID: \"2d867d2a-90ad-46bd-8f81-2b7cd2298e00\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tsg2g"
Jul 09 22:37:42.676567 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:42.676323    2564 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 09 22:37:42.676567 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:42.676391    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d867d2a-90ad-46bd-8f81-2b7cd2298e00-monitoring-plugin-cert podName:2d867d2a-90ad-46bd-8f81-2b7cd2298e00 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:43.176369488 +0000 UTC m=+317.884265073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/2d867d2a-90ad-46bd-8f81-2b7cd2298e00-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-tsg2g" (UID: "2d867d2a-90ad-46bd-8f81-2b7cd2298e00") : secret "monitoring-plugin-cert" not found
Jul 09 22:37:42.686492 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.686437    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nq7z\" (UniqueName: \"kubernetes.io/projected/2d867d2a-90ad-46bd-8f81-2b7cd2298e00-kube-api-access-9nq7z\") pod \"monitoring-plugin-d5dcff7cf-tsg2g\" (UID: \"2d867d2a-90ad-46bd-8f81-2b7cd2298e00\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tsg2g"
Jul 09 22:37:42.797283 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.797191    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59cdbff66-lwbtk"]
Jul 09 22:37:42.801541 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.801519    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:42.815276 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.815199    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59cdbff66-lwbtk"]
Jul 09 22:37:42.878882 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.878418    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-console-oauth-config\") pod \"console-59cdbff66-lwbtk\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") " pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:42.878882 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.878537    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fjxp\" (UniqueName: \"kubernetes.io/projected/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-kube-api-access-9fjxp\") pod \"console-59cdbff66-lwbtk\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") " pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:42.878882 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.878600    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-console-serving-cert\") pod \"console-59cdbff66-lwbtk\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") " pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:42.878882 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.878644    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-console-config\") pod \"console-59cdbff66-lwbtk\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") " pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:42.878882 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.878668    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-oauth-serving-cert\") pod \"console-59cdbff66-lwbtk\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") " pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:42.878882 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.878721    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-service-ca\") pod \"console-59cdbff66-lwbtk\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") " pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:42.878882 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.878754    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-trusted-ca-bundle\") pod \"console-59cdbff66-lwbtk\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") " pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:42.979426 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.979390    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-service-ca\") pod \"console-59cdbff66-lwbtk\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") " pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:42.980151 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.979443    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-trusted-ca-bundle\") pod \"console-59cdbff66-lwbtk\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") " pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:42.980151 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.979496    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-console-oauth-config\") pod \"console-59cdbff66-lwbtk\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") " pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:42.980151 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.979534    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fjxp\" (UniqueName: \"kubernetes.io/projected/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-kube-api-access-9fjxp\") pod \"console-59cdbff66-lwbtk\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") " pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:42.980151 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.979586    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-console-serving-cert\") pod \"console-59cdbff66-lwbtk\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") " pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:42.980151 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.979625    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-console-config\") pod \"console-59cdbff66-lwbtk\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") " pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:42.980151 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.979651    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-oauth-serving-cert\") pod \"console-59cdbff66-lwbtk\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") " pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:42.982208 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.981294    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-service-ca\") pod \"console-59cdbff66-lwbtk\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") " pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:42.982208 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.981551    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-trusted-ca-bundle\") pod \"console-59cdbff66-lwbtk\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") " pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:42.982208 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.982156    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-oauth-serving-cert\") pod \"console-59cdbff66-lwbtk\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") " pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:42.982208 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.982158    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-console-config\") pod \"console-59cdbff66-lwbtk\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") " pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:42.985264 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.985223    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-console-oauth-config\") pod \"console-59cdbff66-lwbtk\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") " pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:42.986226 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:42.986188    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-console-serving-cert\") pod \"console-59cdbff66-lwbtk\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") " pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:43.000259 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:43.000213    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fjxp\" (UniqueName: \"kubernetes.io/projected/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-kube-api-access-9fjxp\") pod \"console-59cdbff66-lwbtk\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") " pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:43.048669 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:43.048516    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-589c58547d-nm58h" event={"ID":"c31db871-5285-4408-ae8b-1bd3a5244a5d","Type":"ContainerStarted","Data":"bd8ecb485c339658f72bc53b9a92b67989e0d0fa9986b53c359187f60be403f3"}
Jul 09 22:37:43.051886 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:43.051724    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9bv6z" event={"ID":"25958d91-7acb-4fc5-8171-16b5dc228075","Type":"ContainerStarted","Data":"f5399b6a84a748d9d4588952bf4b99c4d2be2656c8382871fa63f78c7381e75a"}
Jul 09 22:37:43.051886 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:43.051788    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9bv6z" event={"ID":"25958d91-7acb-4fc5-8171-16b5dc228075","Type":"ContainerStarted","Data":"b6447d94eb560a301383b07dbef3f0e923c05b1f2fc0588fd8e870fad1a05f78"}
Jul 09 22:37:43.051886 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:43.051816    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9bv6z" event={"ID":"25958d91-7acb-4fc5-8171-16b5dc228075","Type":"ContainerStarted","Data":"2befca9483349343c920cf71811d01bfbe160545c6b0f29b1729b5b32f54c117"}
Jul 09 22:37:43.055134 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:43.055052    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f5f98d58d-dc88w" event={"ID":"773de76a-8101-4d0c-aa9b-8441e724faed","Type":"ContainerStarted","Data":"f0bfc55e59d13eb1e35418b0d00acc25623aa7a95db0e592b3dd36d221562fae"}
Jul 09 22:37:43.069660 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:43.069101    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-pg6hp"
Jul 09 22:37:43.119112 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:43.118891    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:43.183495 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:43.182461    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d867d2a-90ad-46bd-8f81-2b7cd2298e00-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-tsg2g\" (UID: \"2d867d2a-90ad-46bd-8f81-2b7cd2298e00\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tsg2g"
Jul 09 22:37:43.183495 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:43.183084    2564 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 09 22:37:43.183495 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:37:43.183149    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d867d2a-90ad-46bd-8f81-2b7cd2298e00-monitoring-plugin-cert podName:2d867d2a-90ad-46bd-8f81-2b7cd2298e00 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:44.183128142 +0000 UTC m=+318.891023708 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/2d867d2a-90ad-46bd-8f81-2b7cd2298e00-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-tsg2g" (UID: "2d867d2a-90ad-46bd-8f81-2b7cd2298e00") : secret "monitoring-plugin-cert" not found
Jul 09 22:37:43.993685 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:43.993652    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 22:37:44.028009 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.027169    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-696ffdcfbf-rbsjs"]
Jul 09 22:37:44.028009 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.027221    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 22:37:44.028009 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.027647    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.039503 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.032648    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 09 22:37:44.039503 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.032925    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 09 22:37:44.039503 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.033149    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 09 22:37:44.039503 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.033338    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 09 22:37:44.039503 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.034242    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 09 22:37:44.039503 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.034434    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 09 22:37:44.039503 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.035633    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 09 22:37:44.039503 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.035825    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 09 22:37:44.039503 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.036026    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 09 22:37:44.039503 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.036277    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 09 22:37:44.039503 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.036550    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 09 22:37:44.039503 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.036824    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 09 22:37:44.039503 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.037114    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-chc37fnebtt6s\""
Jul 09 22:37:44.039503 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.037342    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-l6bkd\""
Jul 09 22:37:44.042134 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.041443    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 09 22:37:44.042134 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.042017    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 09 22:37:44.044122 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.043899    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 09 22:37:44.092290 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.092187    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.092290 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.092246    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.092544 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.092314    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.092544 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.092370    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.092544 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.092417    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.092544 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.092450    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.092544 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.092476    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.092544 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.092507    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.092913 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.092548    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.092913 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.092598    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-config\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.092913 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.092627    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-config-out\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.092913 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.092657    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-web-config\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.092913 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.092680    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.092913 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.092709    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.092913 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.092759    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lpgw\" (UniqueName: \"kubernetes.io/projected/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-kube-api-access-4lpgw\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.092913 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.092855    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.092913 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.092912    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.093355 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.092938    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.093355 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.092966    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.093355 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.092998    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.194207 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.193965    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.194207 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.194016    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.194207 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.194040    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.194949 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.194920    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.195331 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.195306    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.195425 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.195367    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d867d2a-90ad-46bd-8f81-2b7cd2298e00-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-tsg2g\" (UID: \"2d867d2a-90ad-46bd-8f81-2b7cd2298e00\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tsg2g"
Jul 09 22:37:44.195425 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.195395    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-config\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.195540 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.195424    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-config-out\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.195540 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.195455    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-web-config\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.195540 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.195479    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.195540 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.195508    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.195730 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.195543    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lpgw\" (UniqueName: \"kubernetes.io/projected/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-kube-api-access-4lpgw\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.195730 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.195609    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.195730 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.195639    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.195730 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.195665    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.195730 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.195698    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.195730 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.195725    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.196049 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.195775    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.196049 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.195820    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.196049 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.195847    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.196049 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.195895    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.196049 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.195931    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.197641 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.197608    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.198924 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.198898    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.199524 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.199497    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.200821 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.200794    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.200951 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.200807    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.206196 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.206130    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.207411 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.207301    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.207512 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.207488    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.208886 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.208750    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.216493 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.216470    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.220673 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.220604    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.221424 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.221359    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.222143 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.222112    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.223953 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.222591    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.224140 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.224079    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-config-out\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.225449 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.225013    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d867d2a-90ad-46bd-8f81-2b7cd2298e00-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-tsg2g\" (UID: \"2d867d2a-90ad-46bd-8f81-2b7cd2298e00\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tsg2g"
Jul 09 22:37:44.225929 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.225849    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-config\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.226396 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.226373    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.226638 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.224426    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lpgw\" (UniqueName: \"kubernetes.io/projected/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-kube-api-access-4lpgw\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.226638 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.226577    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-web-config\") pod \"prometheus-k8s-0\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.297550 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.297457    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tsg2g"
Jul 09 22:37:44.354266 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.354228    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:37:44.691573 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.691451    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59cdbff66-lwbtk"]
Jul 09 22:37:44.748565 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.748541    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-tsg2g"]
Jul 09 22:37:44.760575 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:37:44.760505    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d867d2a_90ad_46bd_8f81_2b7cd2298e00.slice/crio-ef5c003331f578c080bfb44a49760dfe45c68e75523e4b991d91012a32c197a8 WatchSource:0}: Error finding container ef5c003331f578c080bfb44a49760dfe45c68e75523e4b991d91012a32c197a8: Status 404 returned error can't find the container with id ef5c003331f578c080bfb44a49760dfe45c68e75523e4b991d91012a32c197a8
Jul 09 22:37:44.771451 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:44.771407    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 22:37:44.786344 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:37:44.786304    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec2bd304_6c9b_4f3f_99f9_ada0f872ed71.slice/crio-c186c46c67dbc53dcf47113766d5224e8a87658f3066d87229c0990b43e7e591 WatchSource:0}: Error finding container c186c46c67dbc53dcf47113766d5224e8a87658f3066d87229c0990b43e7e591: Status 404 returned error can't find the container with id c186c46c67dbc53dcf47113766d5224e8a87658f3066d87229c0990b43e7e591
Jul 09 22:37:45.068701 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:45.068005    2564 generic.go:356] "Generic (PLEG): container finished" podID="dc7a487d-1cab-4257-b4f3-efc49c43ef1f" containerID="8b6f88ffce5125b519f8f6d355de575426d260b0317ee41bd7872f79372657e3" exitCode=0
Jul 09 22:37:45.068701 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:45.068110    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nch5w" event={"ID":"dc7a487d-1cab-4257-b4f3-efc49c43ef1f","Type":"ContainerDied","Data":"8b6f88ffce5125b519f8f6d355de575426d260b0317ee41bd7872f79372657e3"}
Jul 09 22:37:45.071371 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:45.071337    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tsg2g" event={"ID":"2d867d2a-90ad-46bd-8f81-2b7cd2298e00","Type":"ContainerStarted","Data":"ef5c003331f578c080bfb44a49760dfe45c68e75523e4b991d91012a32c197a8"}
Jul 09 22:37:45.075245 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:45.075176    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xql5r" event={"ID":"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1","Type":"ContainerStarted","Data":"04c625ff090b929d32417e099452fb3494d953d35b8a959081d20530d201aba7"}
Jul 09 22:37:45.078737 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:45.078710    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9bv6z" event={"ID":"25958d91-7acb-4fc5-8171-16b5dc228075","Type":"ContainerStarted","Data":"e571d78ae6130a786a873959fb5f25a3ef78fd9aa260028aee5538a11251c12f"}
Jul 09 22:37:45.081473 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:45.081408    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cdbff66-lwbtk" event={"ID":"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25","Type":"ContainerStarted","Data":"546b2f7454f167e228da0277239f7920bcc65f7f1c6df212338d4dd3c2100893"}
Jul 09 22:37:45.083658 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:45.083590    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71","Type":"ContainerStarted","Data":"c186c46c67dbc53dcf47113766d5224e8a87658f3066d87229c0990b43e7e591"}
Jul 09 22:37:45.143925 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:45.143853    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9bv6z" podStartSLOduration=5.858857388 podStartE2EDuration="8.143830671s" totalImagesPullingTime="2.284973283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:37:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:45.142788864 +0000 UTC m=+319.850684458" watchObservedRunningTime="2026-07-09 22:37:45.143830671 +0000 UTC m=+319.851726259"
Jul 09 22:37:48.106593 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:48.106514    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f5f98d58d-dc88w" event={"ID":"773de76a-8101-4d0c-aa9b-8441e724faed","Type":"ContainerStarted","Data":"2cdddc9ec00639efb72a2955a02569e57986bbdb3ede890ef88d38a7a1ab0207"}
Jul 09 22:37:48.112053 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:48.112021    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-589c58547d-nm58h" event={"ID":"c31db871-5285-4408-ae8b-1bd3a5244a5d","Type":"ContainerStarted","Data":"565fc15d64294c5c201cc77a6f7624ea2bfe301190a362492619407ab88eb135"}
Jul 09 22:37:48.114861 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:48.114834    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nch5w" event={"ID":"dc7a487d-1cab-4257-b4f3-efc49c43ef1f","Type":"ContainerStarted","Data":"d22c05c28c1439dde40275eb13b819e5ce76611cd294e5364b305fc963af691b"}
Jul 09 22:37:48.124542 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:48.124283    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f5f98d58d-dc88w" podStartSLOduration=2.554014041 podStartE2EDuration="8.124266288s" totalImagesPullingTime="5.570252247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:37:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:48.12391536 +0000 UTC m=+322.831810947" watchObservedRunningTime="2026-07-09 22:37:48.124266288 +0000 UTC m=+322.832161876"
Jul 09 22:37:50.893463 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:50.893430    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:50.893819 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:50.893485    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:50.898265 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:50.898246    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:51.139427 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:51.139398    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-589c58547d-nm58h" event={"ID":"c31db871-5285-4408-ae8b-1bd3a5244a5d","Type":"ContainerStarted","Data":"2575d1af0c7184c229cb139e61799fb0aadbe0dcf3214d9f9accdb503f6773c4"}
Jul 09 22:37:51.142191 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:51.142164    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nch5w" event={"ID":"dc7a487d-1cab-4257-b4f3-efc49c43ef1f","Type":"ContainerStarted","Data":"6dbbab9041fa0c5f51c1869f6218738b3d20adcbb707952a660fe836bfe8fa38"}
Jul 09 22:37:51.156218 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:51.156198    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:37:51.166922 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:51.166853    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nch5w" podStartSLOduration=11.487575688 podStartE2EDuration="14.166836507s" totalImagesPullingTime="2.568585232s" totalInitContainerRuntime="110.675587ms" isStatefulPod=true podCreationTimestamp="2026-07-09 22:37:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:51.165654984 +0000 UTC m=+325.873550571" watchObservedRunningTime="2026-07-09 22:37:51.166836507 +0000 UTC m=+325.874732094"
Jul 09 22:37:52.155925 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:52.155888    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xql5r" event={"ID":"1de4a026-3f71-4b1d-9cc7-9b89969ac2f1","Type":"ContainerStarted","Data":"8a6e711faf32428ae5d7c600accb1b25939bfe54c843186321baff649b3c4e38"}
Jul 09 22:37:52.157492 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:52.157460    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cdbff66-lwbtk" event={"ID":"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25","Type":"ContainerStarted","Data":"fce0403977f4d776d26771ab6b9e4120630efc1ba1c39fcf694809bbd2d96ff4"}
Jul 09 22:37:52.158842 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:52.158817    2564 generic.go:356] "Generic (PLEG): container finished" podID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerID="e1b70f217d0a6e5f393a4b0916a48a2748ba9e51b3a4f6395e91876a17e6d698" exitCode=0
Jul 09 22:37:52.158951 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:52.158899    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71","Type":"ContainerDied","Data":"e1b70f217d0a6e5f393a4b0916a48a2748ba9e51b3a4f6395e91876a17e6d698"}
Jul 09 22:37:52.161050 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:52.161031    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-589c58547d-nm58h" event={"ID":"c31db871-5285-4408-ae8b-1bd3a5244a5d","Type":"ContainerStarted","Data":"c3931edcf27f121a05306564317a5dfd325a26a5d8226daab67c86fbb3dcf720"}
Jul 09 22:37:52.162270 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:52.162245    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tsg2g" event={"ID":"2d867d2a-90ad-46bd-8f81-2b7cd2298e00","Type":"ContainerStarted","Data":"7f53c2fd0634eb4e8be979070c9a207be23faf8d15c35f6bc7078c410552aad8"}
Jul 09 22:37:52.172919 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:52.172858    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xql5r" podStartSLOduration=34.922054142 podStartE2EDuration="55.172845557s" totalImagesPullingTime="20.250791415s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:36:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:52.171447917 +0000 UTC m=+326.879343523" watchObservedRunningTime="2026-07-09 22:37:52.172845557 +0000 UTC m=+326.880741145"
Jul 09 22:37:52.186217 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:52.186178    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tsg2g" podStartSLOduration=3.980267769 podStartE2EDuration="10.186165749s" totalImagesPullingTime="6.20589798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:52.185221682 +0000 UTC m=+326.893117271" watchObservedRunningTime="2026-07-09 22:37:52.186165749 +0000 UTC m=+326.894061333"
Jul 09 22:37:52.229414 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:52.229374    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59cdbff66-lwbtk" podStartSLOduration=3.966319276 podStartE2EDuration="10.22936092s" totalImagesPullingTime="6.263041644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:52.228036493 +0000 UTC m=+326.935932104" watchObservedRunningTime="2026-07-09 22:37:52.22936092 +0000 UTC m=+326.937256506"
Jul 09 22:37:53.119639 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:53.119570    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:53.119639 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:53.119635    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:53.126111 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:53.126084    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:53.172349 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:53.172269    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-589c58547d-nm58h" event={"ID":"c31db871-5285-4408-ae8b-1bd3a5244a5d","Type":"ContainerStarted","Data":"4e0a3eaef0d06bbe3d5205646a8e2f5ab2edfb011328ce4a6c21e558e9bd9f95"}
Jul 09 22:37:53.172349 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:53.172346    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-589c58547d-nm58h" event={"ID":"c31db871-5285-4408-ae8b-1bd3a5244a5d","Type":"ContainerStarted","Data":"49616c4e6526ec976488ef370df2a84259b7efbffd771d486b7beb7087c7d753"}
Jul 09 22:37:53.172903 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:53.172392    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-589c58547d-nm58h" event={"ID":"c31db871-5285-4408-ae8b-1bd3a5244a5d","Type":"ContainerStarted","Data":"d6a5be19c0f2c42c57b479b8c3114a7f583642128a834faec28efbb656555eec"}
Jul 09 22:37:53.172966 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:53.172911    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tsg2g"
Jul 09 22:37:53.177188 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:53.177168    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:37:53.178570 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:53.178547    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-tsg2g"
Jul 09 22:37:53.193503 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:53.193456    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-589c58547d-nm58h" podStartSLOduration=6.441194116 podStartE2EDuration="13.193439195s" totalImagesPullingTime="6.752245079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:37:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:53.192487927 +0000 UTC m=+327.900383545" watchObservedRunningTime="2026-07-09 22:37:53.193439195 +0000 UTC m=+327.901334783"
Jul 09 22:37:53.236792 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:53.236762    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f5f98d58d-dc88w"]
Jul 09 22:37:54.177882 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:54.177832    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:37:57.192592 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:57.192551    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71","Type":"ContainerStarted","Data":"2ccd451a6a781e8596494868896e41e9bcf3667a8c7baecee59dfcee7178dada"}
Jul 09 22:37:57.193094 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:57.192623    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71","Type":"ContainerStarted","Data":"e993ca4d6ab5db2d4a80c069742d68a9f9bfab0254579dcc8c61eb145465531d"}
Jul 09 22:37:57.193094 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:57.192652    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71","Type":"ContainerStarted","Data":"7d0f9a540320a240fd71e09bfdec9c4e34082e05525de53ad7a302730c97197c"}
Jul 09 22:37:57.193094 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:57.192677    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71","Type":"ContainerStarted","Data":"f898270bd915ff34e851bdf13300879832fe0f5368a2084b26505d2beb385cde"}
Jul 09 22:37:57.193094 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:57.192699    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71","Type":"ContainerStarted","Data":"2b0b49444e04385fbeb7dae06fcbd731ef1e77ddd060ba899864ac417e11ee1c"}
Jul 09 22:37:57.193094 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:57.192724    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71","Type":"ContainerStarted","Data":"4a6c63a43a23b31869df8cf610f6fd31e7e300bd06427f1a315a76667a7123ec"}
Jul 09 22:37:57.222836 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:57.222789    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.059961564 podStartE2EDuration="14.222770602s" totalImagesPullingTime="10.137097468s" totalInitContainerRuntime="25.71157ms" isStatefulPod=false podCreationTimestamp="2026-07-09 22:37:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:57.221180257 +0000 UTC m=+331.929075862" watchObservedRunningTime="2026-07-09 22:37:57.222770602 +0000 UTC m=+331.930666188"
Jul 09 22:37:59.354766 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:37:59.354732    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:38:00.188154 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:00.188130    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-589c58547d-nm58h"
Jul 09 22:38:09.060168 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.060109    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs" podUID="3c993f43-ee03-498e-b6d0-5e8f413839b1" containerName="registry" containerID="cri-o://8265cb2367d043b6b754b18d9760acc56df9c786232689f51a881cd8f2e3fd87" gracePeriod=30
Jul 09 22:38:09.250093 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.249816    2564 generic.go:356] "Generic (PLEG): container finished" podID="3c993f43-ee03-498e-b6d0-5e8f413839b1" containerID="8265cb2367d043b6b754b18d9760acc56df9c786232689f51a881cd8f2e3fd87" exitCode=0
Jul 09 22:38:09.250093 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.249908    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs" event={"ID":"3c993f43-ee03-498e-b6d0-5e8f413839b1","Type":"ContainerDied","Data":"8265cb2367d043b6b754b18d9760acc56df9c786232689f51a881cd8f2e3fd87"}
Jul 09 22:38:09.345002 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.344981    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:38:09.443116 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.443088    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c993f43-ee03-498e-b6d0-5e8f413839b1-installation-pull-secrets\") pod \"3c993f43-ee03-498e-b6d0-5e8f413839b1\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") "
Jul 09 22:38:09.443268 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.443140    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c993f43-ee03-498e-b6d0-5e8f413839b1-ca-trust-extracted\") pod \"3c993f43-ee03-498e-b6d0-5e8f413839b1\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") "
Jul 09 22:38:09.443268 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.443164    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdmn5\" (UniqueName: \"kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-kube-api-access-kdmn5\") pod \"3c993f43-ee03-498e-b6d0-5e8f413839b1\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") "
Jul 09 22:38:09.443268 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.443188    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls\") pod \"3c993f43-ee03-498e-b6d0-5e8f413839b1\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") "
Jul 09 22:38:09.443268 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.443215    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-certificates\") pod \"3c993f43-ee03-498e-b6d0-5e8f413839b1\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") "
Jul 09 22:38:09.443268 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.443244    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c993f43-ee03-498e-b6d0-5e8f413839b1-trusted-ca\") pod \"3c993f43-ee03-498e-b6d0-5e8f413839b1\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") "
Jul 09 22:38:09.443533 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.443400    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c993f43-ee03-498e-b6d0-5e8f413839b1-image-registry-private-configuration\") pod \"3c993f43-ee03-498e-b6d0-5e8f413839b1\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") "
Jul 09 22:38:09.443533 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.443491    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-bound-sa-token\") pod \"3c993f43-ee03-498e-b6d0-5e8f413839b1\" (UID: \"3c993f43-ee03-498e-b6d0-5e8f413839b1\") "
Jul 09 22:38:09.443715 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.443688    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3c993f43-ee03-498e-b6d0-5e8f413839b1" (UID: "3c993f43-ee03-498e-b6d0-5e8f413839b1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:38:09.443785 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.443727    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c993f43-ee03-498e-b6d0-5e8f413839b1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3c993f43-ee03-498e-b6d0-5e8f413839b1" (UID: "3c993f43-ee03-498e-b6d0-5e8f413839b1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:38:09.443943 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.443920    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c993f43-ee03-498e-b6d0-5e8f413839b1-trusted-ca\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:38:09.444020 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.443946    2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-certificates\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:38:09.445632 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.445609    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c993f43-ee03-498e-b6d0-5e8f413839b1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3c993f43-ee03-498e-b6d0-5e8f413839b1" (UID: "3c993f43-ee03-498e-b6d0-5e8f413839b1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:38:09.445735 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.445689    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-kube-api-access-kdmn5" (OuterVolumeSpecName: "kube-api-access-kdmn5") pod "3c993f43-ee03-498e-b6d0-5e8f413839b1" (UID: "3c993f43-ee03-498e-b6d0-5e8f413839b1"). InnerVolumeSpecName "kube-api-access-kdmn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:38:09.446080 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.446059    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3c993f43-ee03-498e-b6d0-5e8f413839b1" (UID: "3c993f43-ee03-498e-b6d0-5e8f413839b1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:38:09.446198 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.446177    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3c993f43-ee03-498e-b6d0-5e8f413839b1" (UID: "3c993f43-ee03-498e-b6d0-5e8f413839b1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:38:09.446253 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.446179    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c993f43-ee03-498e-b6d0-5e8f413839b1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3c993f43-ee03-498e-b6d0-5e8f413839b1" (UID: "3c993f43-ee03-498e-b6d0-5e8f413839b1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:38:09.452057 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.452024    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c993f43-ee03-498e-b6d0-5e8f413839b1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3c993f43-ee03-498e-b6d0-5e8f413839b1" (UID: "3c993f43-ee03-498e-b6d0-5e8f413839b1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:38:09.544363 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.544339    2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c993f43-ee03-498e-b6d0-5e8f413839b1-ca-trust-extracted\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:38:09.544363 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.544362    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdmn5\" (UniqueName: \"kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-kube-api-access-kdmn5\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:38:09.544523 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.544373    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-registry-tls\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:38:09.544523 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.544382    2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c993f43-ee03-498e-b6d0-5e8f413839b1-image-registry-private-configuration\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:38:09.544523 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.544391    2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c993f43-ee03-498e-b6d0-5e8f413839b1-bound-sa-token\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:38:09.544523 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:09.544399    2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c993f43-ee03-498e-b6d0-5e8f413839b1-installation-pull-secrets\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:38:10.255099 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:10.255026    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs"
Jul 09 22:38:10.255099 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:10.255054    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-696ffdcfbf-rbsjs" event={"ID":"3c993f43-ee03-498e-b6d0-5e8f413839b1","Type":"ContainerDied","Data":"6cbe4a442392cb61f9361d8754c1dbb87f951e47eafac4c3a0cc2b1f9c2a4fa4"}
Jul 09 22:38:10.255557 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:10.255108    2564 scope.go:117] "RemoveContainer" containerID="8265cb2367d043b6b754b18d9760acc56df9c786232689f51a881cd8f2e3fd87"
Jul 09 22:38:10.270768 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:10.270747    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-696ffdcfbf-rbsjs"]
Jul 09 22:38:10.276855 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:10.276835    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-696ffdcfbf-rbsjs"]
Jul 09 22:38:11.965357 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:11.965309    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c993f43-ee03-498e-b6d0-5e8f413839b1" path="/var/lib/kubelet/pods/3c993f43-ee03-498e-b6d0-5e8f413839b1/volumes"
Jul 09 22:38:18.271327 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:18.271241    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6f5f98d58d-dc88w" podUID="773de76a-8101-4d0c-aa9b-8441e724faed" containerName="console" containerID="cri-o://2cdddc9ec00639efb72a2955a02569e57986bbdb3ede890ef88d38a7a1ab0207" gracePeriod=15
Jul 09 22:38:18.571983 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:18.571954    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:38:18.725137 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:18.725106    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/773de76a-8101-4d0c-aa9b-8441e724faed-oauth-serving-cert\") pod \"773de76a-8101-4d0c-aa9b-8441e724faed\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") "
Jul 09 22:38:18.725287 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:18.725150    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/773de76a-8101-4d0c-aa9b-8441e724faed-console-serving-cert\") pod \"773de76a-8101-4d0c-aa9b-8441e724faed\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") "
Jul 09 22:38:18.725287 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:18.725171    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/773de76a-8101-4d0c-aa9b-8441e724faed-trusted-ca-bundle\") pod \"773de76a-8101-4d0c-aa9b-8441e724faed\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") "
Jul 09 22:38:18.725399 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:18.725376    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/773de76a-8101-4d0c-aa9b-8441e724faed-console-config\") pod \"773de76a-8101-4d0c-aa9b-8441e724faed\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") "
Jul 09 22:38:18.725444 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:18.725429    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfjf6\" (UniqueName: \"kubernetes.io/projected/773de76a-8101-4d0c-aa9b-8441e724faed-kube-api-access-dfjf6\") pod \"773de76a-8101-4d0c-aa9b-8441e724faed\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") "
Jul 09 22:38:18.725496 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:18.725465    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/773de76a-8101-4d0c-aa9b-8441e724faed-service-ca\") pod \"773de76a-8101-4d0c-aa9b-8441e724faed\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") "
Jul 09 22:38:18.725552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:18.725513    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/773de76a-8101-4d0c-aa9b-8441e724faed-console-oauth-config\") pod \"773de76a-8101-4d0c-aa9b-8441e724faed\" (UID: \"773de76a-8101-4d0c-aa9b-8441e724faed\") "
Jul 09 22:38:18.725552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:18.725514    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/773de76a-8101-4d0c-aa9b-8441e724faed-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "773de76a-8101-4d0c-aa9b-8441e724faed" (UID: "773de76a-8101-4d0c-aa9b-8441e724faed"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:38:18.725807 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:18.725577    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/773de76a-8101-4d0c-aa9b-8441e724faed-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "773de76a-8101-4d0c-aa9b-8441e724faed" (UID: "773de76a-8101-4d0c-aa9b-8441e724faed"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:38:18.725807 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:18.725789    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/773de76a-8101-4d0c-aa9b-8441e724faed-console-config" (OuterVolumeSpecName: "console-config") pod "773de76a-8101-4d0c-aa9b-8441e724faed" (UID: "773de76a-8101-4d0c-aa9b-8441e724faed"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:38:18.726001 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:18.725822    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/773de76a-8101-4d0c-aa9b-8441e724faed-oauth-serving-cert\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:38:18.726001 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:18.725842    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/773de76a-8101-4d0c-aa9b-8441e724faed-trusted-ca-bundle\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:38:18.726001 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:18.725844    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/773de76a-8101-4d0c-aa9b-8441e724faed-service-ca" (OuterVolumeSpecName: "service-ca") pod "773de76a-8101-4d0c-aa9b-8441e724faed" (UID: "773de76a-8101-4d0c-aa9b-8441e724faed"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:38:18.727486 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:18.727456    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/773de76a-8101-4d0c-aa9b-8441e724faed-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "773de76a-8101-4d0c-aa9b-8441e724faed" (UID: "773de76a-8101-4d0c-aa9b-8441e724faed"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:38:18.727583 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:18.727495    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/773de76a-8101-4d0c-aa9b-8441e724faed-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "773de76a-8101-4d0c-aa9b-8441e724faed" (UID: "773de76a-8101-4d0c-aa9b-8441e724faed"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:38:18.727583 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:18.727532    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/773de76a-8101-4d0c-aa9b-8441e724faed-kube-api-access-dfjf6" (OuterVolumeSpecName: "kube-api-access-dfjf6") pod "773de76a-8101-4d0c-aa9b-8441e724faed" (UID: "773de76a-8101-4d0c-aa9b-8441e724faed"). InnerVolumeSpecName "kube-api-access-dfjf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:38:18.827161 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:18.827097    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/773de76a-8101-4d0c-aa9b-8441e724faed-console-oauth-config\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:38:18.827161 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:18.827125    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/773de76a-8101-4d0c-aa9b-8441e724faed-console-serving-cert\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:38:18.827161 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:18.827136    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/773de76a-8101-4d0c-aa9b-8441e724faed-console-config\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:38:18.827161 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:18.827144    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfjf6\" (UniqueName: \"kubernetes.io/projected/773de76a-8101-4d0c-aa9b-8441e724faed-kube-api-access-dfjf6\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:38:18.827161 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:18.827154    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/773de76a-8101-4d0c-aa9b-8441e724faed-service-ca\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:38:19.297237 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:19.297207    2564 generic.go:356] "Generic (PLEG): container finished" podID="773de76a-8101-4d0c-aa9b-8441e724faed" containerID="2cdddc9ec00639efb72a2955a02569e57986bbdb3ede890ef88d38a7a1ab0207" exitCode=0
Jul 09 22:38:19.297660 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:19.297255    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f5f98d58d-dc88w"
Jul 09 22:38:19.297660 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:19.297293    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f5f98d58d-dc88w" event={"ID":"773de76a-8101-4d0c-aa9b-8441e724faed","Type":"ContainerDied","Data":"2cdddc9ec00639efb72a2955a02569e57986bbdb3ede890ef88d38a7a1ab0207"}
Jul 09 22:38:19.297660 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:19.297340    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f5f98d58d-dc88w" event={"ID":"773de76a-8101-4d0c-aa9b-8441e724faed","Type":"ContainerDied","Data":"f0bfc55e59d13eb1e35418b0d00acc25623aa7a95db0e592b3dd36d221562fae"}
Jul 09 22:38:19.297660 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:19.297360    2564 scope.go:117] "RemoveContainer" containerID="2cdddc9ec00639efb72a2955a02569e57986bbdb3ede890ef88d38a7a1ab0207"
Jul 09 22:38:19.314271 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:19.314255    2564 scope.go:117] "RemoveContainer" containerID="2cdddc9ec00639efb72a2955a02569e57986bbdb3ede890ef88d38a7a1ab0207"
Jul 09 22:38:19.314542 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:38:19.314515    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cdddc9ec00639efb72a2955a02569e57986bbdb3ede890ef88d38a7a1ab0207\": container with ID starting with 2cdddc9ec00639efb72a2955a02569e57986bbdb3ede890ef88d38a7a1ab0207 not found: ID does not exist" containerID="2cdddc9ec00639efb72a2955a02569e57986bbdb3ede890ef88d38a7a1ab0207"
Jul 09 22:38:19.314609 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:19.314548    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cdddc9ec00639efb72a2955a02569e57986bbdb3ede890ef88d38a7a1ab0207"} err="failed to get container status \"2cdddc9ec00639efb72a2955a02569e57986bbdb3ede890ef88d38a7a1ab0207\": rpc error: code = NotFound desc = could not find container \"2cdddc9ec00639efb72a2955a02569e57986bbdb3ede890ef88d38a7a1ab0207\": container with ID starting with 2cdddc9ec00639efb72a2955a02569e57986bbdb3ede890ef88d38a7a1ab0207 not found: ID does not exist"
Jul 09 22:38:19.317689 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:19.317668    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f5f98d58d-dc88w"]
Jul 09 22:38:19.321276 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:19.321256    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f5f98d58d-dc88w"]
Jul 09 22:38:19.966385 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:19.966349    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="773de76a-8101-4d0c-aa9b-8441e724faed" path="/var/lib/kubelet/pods/773de76a-8101-4d0c-aa9b-8441e724faed/volumes"
Jul 09 22:38:28.338333 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:28.338302    2564 generic.go:356] "Generic (PLEG): container finished" podID="fa722002-4c5e-4943-a44b-e3cdbcbaf3eb" containerID="3f2c42a2aed46e1eb9f835e7fa2160791b3f347413b3505bbd250f4567daa970" exitCode=0
Jul 09 22:38:28.338764 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:28.338376    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jk2rs" event={"ID":"fa722002-4c5e-4943-a44b-e3cdbcbaf3eb","Type":"ContainerDied","Data":"3f2c42a2aed46e1eb9f835e7fa2160791b3f347413b3505bbd250f4567daa970"}
Jul 09 22:38:28.338764 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:28.338714    2564 scope.go:117] "RemoveContainer" containerID="3f2c42a2aed46e1eb9f835e7fa2160791b3f347413b3505bbd250f4567daa970"
Jul 09 22:38:29.344502 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:29.344470    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jk2rs" event={"ID":"fa722002-4c5e-4943-a44b-e3cdbcbaf3eb","Type":"ContainerStarted","Data":"509addc43f2df6efbcea83b5813be56b1471c18b9fff97dbe9dc4f1b677084f3"}
Jul 09 22:38:33.361948 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:33.361839    2564 generic.go:356] "Generic (PLEG): container finished" podID="7f98ce5f-46f5-4fc8-a621-b4bf20950d95" containerID="2dd4263731ea460576f46f2f34b4442b4087e7ed8b765b1328781a935fa399ec" exitCode=0
Jul 09 22:38:33.361948 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:33.361917    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-96bwl" event={"ID":"7f98ce5f-46f5-4fc8-a621-b4bf20950d95","Type":"ContainerDied","Data":"2dd4263731ea460576f46f2f34b4442b4087e7ed8b765b1328781a935fa399ec"}
Jul 09 22:38:33.362457 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:33.362340    2564 scope.go:117] "RemoveContainer" containerID="2dd4263731ea460576f46f2f34b4442b4087e7ed8b765b1328781a935fa399ec"
Jul 09 22:38:34.367457 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:34.367426    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-96bwl" event={"ID":"7f98ce5f-46f5-4fc8-a621-b4bf20950d95","Type":"ContainerStarted","Data":"93dac7df13a14a698d61110e74c584bfff1f6f003864da87b7827c68b7686610"}
Jul 09 22:38:38.702790 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:38.702756    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs\") pod \"network-metrics-daemon-8r82v\" (UID: \"d94a7d72-cc1e-4193-99df-08721091f47e\") " pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:38:38.705099 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:38.705079    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94a7d72-cc1e-4193-99df-08721091f47e-metrics-certs\") pod \"network-metrics-daemon-8r82v\" (UID: \"d94a7d72-cc1e-4193-99df-08721091f47e\") " pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:38:38.965404 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:38.965330    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jjswb\""
Jul 09 22:38:38.973916 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:38.973894    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r82v"
Jul 09 22:38:39.097944 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:39.097920    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8r82v"]
Jul 09 22:38:39.100599 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:38:39.100573    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd94a7d72_cc1e_4193_99df_08721091f47e.slice/crio-caff6ef521677e697ab68ae770d9252b266cf9fe02958175e6a912a31f3c9c2e WatchSource:0}: Error finding container caff6ef521677e697ab68ae770d9252b266cf9fe02958175e6a912a31f3c9c2e: Status 404 returned error can't find the container with id caff6ef521677e697ab68ae770d9252b266cf9fe02958175e6a912a31f3c9c2e
Jul 09 22:38:39.387410 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:39.387331    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8r82v" event={"ID":"d94a7d72-cc1e-4193-99df-08721091f47e","Type":"ContainerStarted","Data":"caff6ef521677e697ab68ae770d9252b266cf9fe02958175e6a912a31f3c9c2e"}
Jul 09 22:38:40.393898 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:40.393795    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8r82v" event={"ID":"d94a7d72-cc1e-4193-99df-08721091f47e","Type":"ContainerStarted","Data":"ac674689f09b0488950f9212aa7f575adc04aa924ed6403a94f30f6f79ca7b3b"}
Jul 09 22:38:40.393898 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:40.393848    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8r82v" event={"ID":"d94a7d72-cc1e-4193-99df-08721091f47e","Type":"ContainerStarted","Data":"e4ddaa63e37af45e8af75ac691125fa3b86840c692e9d63b2cd14610be31129b"}
Jul 09 22:38:40.410245 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:40.410188    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8r82v" podStartSLOduration=373.423463965 podStartE2EDuration="6m14.410173711s" totalImagesPullingTime="986.709746ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:38:40.409226574 +0000 UTC m=+375.117122159" watchObservedRunningTime="2026-07-09 22:38:40.410173711 +0000 UTC m=+375.118069296"
Jul 09 22:38:44.354939 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:44.354900    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:38:44.374108 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:44.374085    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:38:44.430546 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:38:44.430523    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:02.336568 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:02.336539    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 22:39:02.337106 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:02.336860    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerName="prometheus" containerID="cri-o://4a6c63a43a23b31869df8cf610f6fd31e7e300bd06427f1a315a76667a7123ec" gracePeriod=600
Jul 09 22:39:02.337106 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:02.336918    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerName="thanos-sidecar" containerID="cri-o://f898270bd915ff34e851bdf13300879832fe0f5368a2084b26505d2beb385cde" gracePeriod=600
Jul 09 22:39:02.337106 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:02.336984    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerName="kube-rbac-proxy-thanos" containerID="cri-o://2ccd451a6a781e8596494868896e41e9bcf3667a8c7baecee59dfcee7178dada" gracePeriod=600
Jul 09 22:39:02.337106 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:02.336928    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerName="kube-rbac-proxy-web" containerID="cri-o://7d0f9a540320a240fd71e09bfdec9c4e34082e05525de53ad7a302730c97197c" gracePeriod=600
Jul 09 22:39:02.337106 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:02.336930    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerName="config-reloader" containerID="cri-o://2b0b49444e04385fbeb7dae06fcbd731ef1e77ddd060ba899864ac417e11ee1c" gracePeriod=600
Jul 09 22:39:02.337106 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:02.336917    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerName="kube-rbac-proxy" containerID="cri-o://e993ca4d6ab5db2d4a80c069742d68a9f9bfab0254579dcc8c61eb145465531d" gracePeriod=600
Jul 09 22:39:02.491987 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:02.491962    2564 generic.go:356] "Generic (PLEG): container finished" podID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerID="2ccd451a6a781e8596494868896e41e9bcf3667a8c7baecee59dfcee7178dada" exitCode=0
Jul 09 22:39:02.491987 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:02.491984    2564 generic.go:356] "Generic (PLEG): container finished" podID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerID="e993ca4d6ab5db2d4a80c069742d68a9f9bfab0254579dcc8c61eb145465531d" exitCode=0
Jul 09 22:39:02.492108 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:02.491991    2564 generic.go:356] "Generic (PLEG): container finished" podID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerID="f898270bd915ff34e851bdf13300879832fe0f5368a2084b26505d2beb385cde" exitCode=0
Jul 09 22:39:02.492108 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:02.491997    2564 generic.go:356] "Generic (PLEG): container finished" podID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerID="2b0b49444e04385fbeb7dae06fcbd731ef1e77ddd060ba899864ac417e11ee1c" exitCode=0
Jul 09 22:39:02.492108 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:02.492002    2564 generic.go:356] "Generic (PLEG): container finished" podID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerID="4a6c63a43a23b31869df8cf610f6fd31e7e300bd06427f1a315a76667a7123ec" exitCode=0
Jul 09 22:39:02.492108 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:02.492020    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71","Type":"ContainerDied","Data":"2ccd451a6a781e8596494868896e41e9bcf3667a8c7baecee59dfcee7178dada"}
Jul 09 22:39:02.492108 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:02.492071    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71","Type":"ContainerDied","Data":"e993ca4d6ab5db2d4a80c069742d68a9f9bfab0254579dcc8c61eb145465531d"}
Jul 09 22:39:02.492108 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:02.492096    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71","Type":"ContainerDied","Data":"f898270bd915ff34e851bdf13300879832fe0f5368a2084b26505d2beb385cde"}
Jul 09 22:39:02.492291 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:02.492122    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71","Type":"ContainerDied","Data":"2b0b49444e04385fbeb7dae06fcbd731ef1e77ddd060ba899864ac417e11ee1c"}
Jul 09 22:39:02.492291 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:02.492144    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71","Type":"ContainerDied","Data":"4a6c63a43a23b31869df8cf610f6fd31e7e300bd06427f1a315a76667a7123ec"}
Jul 09 22:39:03.499888 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.499850    2564 generic.go:356] "Generic (PLEG): container finished" podID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerID="7d0f9a540320a240fd71e09bfdec9c4e34082e05525de53ad7a302730c97197c" exitCode=0
Jul 09 22:39:03.500223 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.499904    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71","Type":"ContainerDied","Data":"7d0f9a540320a240fd71e09bfdec9c4e34082e05525de53ad7a302730c97197c"}
Jul 09 22:39:03.595038 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.595017    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:03.712803 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.712772    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-tls-assets\") pod \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") "
Jul 09 22:39:03.712803 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.712808    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") "
Jul 09 22:39:03.713038 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.712828    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-trusted-ca-bundle\") pod \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") "
Jul 09 22:39:03.713038 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.712865    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-config\") pod \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") "
Jul 09 22:39:03.713038 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.713002    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lpgw\" (UniqueName: \"kubernetes.io/projected/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-kube-api-access-4lpgw\") pod \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") "
Jul 09 22:39:03.713207 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.713067    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-configmap-serving-certs-ca-bundle\") pod \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") "
Jul 09 22:39:03.713207 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.713097    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-configmap-metrics-client-ca\") pod \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") "
Jul 09 22:39:03.713207 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.713136    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-prometheus-k8s-tls\") pod \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") "
Jul 09 22:39:03.713207 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.713163    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-configmap-kubelet-serving-ca-bundle\") pod \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") "
Jul 09 22:39:03.713207 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.713192    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-k8s-db\") pod \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") "
Jul 09 22:39:03.713449 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.713226    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-k8s-rulefiles-1\") pod \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") "
Jul 09 22:39:03.713449 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.713256    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-kube-rbac-proxy\") pod \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") "
Jul 09 22:39:03.713449 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.713279    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-config-out\") pod \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") "
Jul 09 22:39:03.713449 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.713285    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" (UID: "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:39:03.713449 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.713316    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-web-config\") pod \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") "
Jul 09 22:39:03.713449 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.713355    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-k8s-rulefiles-2\") pod \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") "
Jul 09 22:39:03.713818 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.713690    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" (UID: "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:39:03.714049 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.714027    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" (UID: "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:39:03.714163 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.714035    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" (UID: "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:39:03.714846 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.714580    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") "
Jul 09 22:39:03.714846 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.714631    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-grpc-tls\") pod \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") "
Jul 09 22:39:03.714846 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.714665    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-thanos-prometheus-http-client-file\") pod \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") "
Jul 09 22:39:03.714846 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.714709    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-metrics-client-certs\") pod \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") "
Jul 09 22:39:03.714846 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.714737    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-k8s-rulefiles-0\") pod \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\" (UID: \"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71\") "
Jul 09 22:39:03.715386 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.715359    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" (UID: "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:39:03.715653 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.715497    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:03.715653 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.715521    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:03.715653 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.715534    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-k8s-db\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:03.715653 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.715546    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:03.715653 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.715558    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:03.716015 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.715723    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-config" (OuterVolumeSpecName: "config") pod "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" (UID: "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:39:03.716015 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.715782    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" (UID: "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:39:03.716015 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.715841    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" (UID: "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:39:03.717633 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.716470    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" (UID: "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:39:03.717633 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.716570    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" (UID: "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:39:03.717633 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.716679    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" (UID: "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:39:03.717633 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.717625    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-kube-api-access-4lpgw" (OuterVolumeSpecName: "kube-api-access-4lpgw") pod "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" (UID: "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71"). InnerVolumeSpecName "kube-api-access-4lpgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:39:03.717900 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.717661    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" (UID: "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:39:03.718045 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.718022    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" (UID: "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:39:03.718384 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.718360    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" (UID: "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:39:03.718668 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.718618    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" (UID: "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:39:03.718668 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.718657    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-config-out" (OuterVolumeSpecName: "config-out") pod "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" (UID: "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:39:03.718821 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.718682    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" (UID: "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:39:03.719531 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.719502    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" (UID: "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:39:03.728330 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.728310    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-web-config" (OuterVolumeSpecName: "web-config") pod "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" (UID: "ec2bd304-6c9b-4f3f-99f9-ada0f872ed71"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:39:03.816827 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.816794    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:03.816827 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.816826    2564 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-grpc-tls\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:03.816827 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.816838    2564 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:03.817022 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.816847    2564 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-metrics-client-certs\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:03.817022 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.816856    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:03.817022 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.816865    2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-tls-assets\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:03.817022 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.816885    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:03.817022 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.816893    2564 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-config\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:03.817022 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.816902    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lpgw\" (UniqueName: \"kubernetes.io/projected/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-kube-api-access-4lpgw\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:03.817022 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.816910    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-configmap-metrics-client-ca\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:03.817022 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.816920    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:03.817022 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.816930    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:03.817022 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.816937    2564 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-secret-kube-rbac-proxy\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:03.817022 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.816945    2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-config-out\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:03.817022 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:03.816953    2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71-web-config\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:04.506731 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.506702    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec2bd304-6c9b-4f3f-99f9-ada0f872ed71","Type":"ContainerDied","Data":"c186c46c67dbc53dcf47113766d5224e8a87658f3066d87229c0990b43e7e591"}
Jul 09 22:39:04.507130 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.506749    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.507130 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.506769    2564 scope.go:117] "RemoveContainer" containerID="2ccd451a6a781e8596494868896e41e9bcf3667a8c7baecee59dfcee7178dada"
Jul 09 22:39:04.514778 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.514760    2564 scope.go:117] "RemoveContainer" containerID="e993ca4d6ab5db2d4a80c069742d68a9f9bfab0254579dcc8c61eb145465531d"
Jul 09 22:39:04.521642 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.521627    2564 scope.go:117] "RemoveContainer" containerID="7d0f9a540320a240fd71e09bfdec9c4e34082e05525de53ad7a302730c97197c"
Jul 09 22:39:04.525116 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.525095    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 22:39:04.528968 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.528947    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 22:39:04.530085 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.530063    2564 scope.go:117] "RemoveContainer" containerID="f898270bd915ff34e851bdf13300879832fe0f5368a2084b26505d2beb385cde"
Jul 09 22:39:04.536503 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.536486    2564 scope.go:117] "RemoveContainer" containerID="2b0b49444e04385fbeb7dae06fcbd731ef1e77ddd060ba899864ac417e11ee1c"
Jul 09 22:39:04.542804 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.542789    2564 scope.go:117] "RemoveContainer" containerID="4a6c63a43a23b31869df8cf610f6fd31e7e300bd06427f1a315a76667a7123ec"
Jul 09 22:39:04.549896 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.549855    2564 scope.go:117] "RemoveContainer" containerID="e1b70f217d0a6e5f393a4b0916a48a2748ba9e51b3a4f6395e91876a17e6d698"
Jul 09 22:39:04.554657 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.554640    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 22:39:04.555595 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.555571    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerName="thanos-sidecar"
Jul 09 22:39:04.555704 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.555693    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerName="thanos-sidecar"
Jul 09 22:39:04.555799 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.555789    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773de76a-8101-4d0c-aa9b-8441e724faed" containerName="console"
Jul 09 22:39:04.555911 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.555901    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="773de76a-8101-4d0c-aa9b-8441e724faed" containerName="console"
Jul 09 22:39:04.556019 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.556009    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c993f43-ee03-498e-b6d0-5e8f413839b1" containerName="registry"
Jul 09 22:39:04.556092 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.556083    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c993f43-ee03-498e-b6d0-5e8f413839b1" containerName="registry"
Jul 09 22:39:04.556158 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.556150    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerName="kube-rbac-proxy-thanos"
Jul 09 22:39:04.556226 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.556217    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerName="kube-rbac-proxy-thanos"
Jul 09 22:39:04.556307 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.556298    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerName="config-reloader"
Jul 09 22:39:04.556374 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.556365    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerName="config-reloader"
Jul 09 22:39:04.556508 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.556498    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerName="init-config-reloader"
Jul 09 22:39:04.556575 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.556567    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerName="init-config-reloader"
Jul 09 22:39:04.556637 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.556628    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerName="kube-rbac-proxy-web"
Jul 09 22:39:04.556698 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.556689    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerName="kube-rbac-proxy-web"
Jul 09 22:39:04.556825 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.556760    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerName="prometheus"
Jul 09 22:39:04.556912 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.556901    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerName="prometheus"
Jul 09 22:39:04.556996 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.556985    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerName="kube-rbac-proxy"
Jul 09 22:39:04.557058 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.557050    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerName="kube-rbac-proxy"
Jul 09 22:39:04.557320 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.557300    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerName="kube-rbac-proxy-web"
Jul 09 22:39:04.557320 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.557322    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerName="prometheus"
Jul 09 22:39:04.557463 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.557340    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerName="thanos-sidecar"
Jul 09 22:39:04.557463 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.557357    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c993f43-ee03-498e-b6d0-5e8f413839b1" containerName="registry"
Jul 09 22:39:04.557463 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.557366    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerName="kube-rbac-proxy-thanos"
Jul 09 22:39:04.557463 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.557376    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="773de76a-8101-4d0c-aa9b-8441e724faed" containerName="console"
Jul 09 22:39:04.557463 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.557392    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerName="kube-rbac-proxy"
Jul 09 22:39:04.557463 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.557402    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" containerName="config-reloader"
Jul 09 22:39:04.564453 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.564430    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.566925 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.566892    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 09 22:39:04.567027 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.566981    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 09 22:39:04.567176 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.567156    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 09 22:39:04.567298 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.567279    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 09 22:39:04.567368 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.567301    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 09 22:39:04.567368 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.567151    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-l6bkd\""
Jul 09 22:39:04.567547 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.567495    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 09 22:39:04.567677 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.567603    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-chc37fnebtt6s\""
Jul 09 22:39:04.567910 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.567858    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 09 22:39:04.568293 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.568273    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 09 22:39:04.568366 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.568292    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 09 22:39:04.568366 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.568336    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 09 22:39:04.568366 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.568284    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 09 22:39:04.568716 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.568656    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 09 22:39:04.568716 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.568678    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 09 22:39:04.570575 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.570556    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 09 22:39:04.572970 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.572950    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 09 22:39:04.575416 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.575391    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 22:39:04.623736 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.623708    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.623736 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.623737    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-web-config\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.623968 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.623761    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/618ca858-8bdc-491b-ad05-84fe643e6261-config-out\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.623968 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.623785    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/618ca858-8bdc-491b-ad05-84fe643e6261-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.623968 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.623825    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/618ca858-8bdc-491b-ad05-84fe643e6261-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.623968 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.623841    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7dx6\" (UniqueName: \"kubernetes.io/projected/618ca858-8bdc-491b-ad05-84fe643e6261-kube-api-access-p7dx6\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.623968 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.623864    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/618ca858-8bdc-491b-ad05-84fe643e6261-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.623968 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.623906    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-config\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.623968 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.623921    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.623968 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.623939    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/618ca858-8bdc-491b-ad05-84fe643e6261-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.624320 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.623988    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.624320 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.624068    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.624320 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.624099    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/618ca858-8bdc-491b-ad05-84fe643e6261-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.624320 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.624137    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.624320 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.624156    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/618ca858-8bdc-491b-ad05-84fe643e6261-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.624320 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.624206    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.624320 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.624229    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/618ca858-8bdc-491b-ad05-84fe643e6261-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.624320 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.624252    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.624320 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.624274    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/618ca858-8bdc-491b-ad05-84fe643e6261-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.624320 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.624292    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/618ca858-8bdc-491b-ad05-84fe643e6261-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.725201 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.725177    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.725347 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.725206    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/618ca858-8bdc-491b-ad05-84fe643e6261-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.725347 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.725227    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.725347 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.725249    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/618ca858-8bdc-491b-ad05-84fe643e6261-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.725499 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.725349    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/618ca858-8bdc-491b-ad05-84fe643e6261-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.725499 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.725390    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.725499 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.725419    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-web-config\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.725499 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.725448    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/618ca858-8bdc-491b-ad05-84fe643e6261-config-out\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.726021 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.725994    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/618ca858-8bdc-491b-ad05-84fe643e6261-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.726114 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.726078    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/618ca858-8bdc-491b-ad05-84fe643e6261-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.726172 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.726152    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/618ca858-8bdc-491b-ad05-84fe643e6261-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.726284 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.726261    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/618ca858-8bdc-491b-ad05-84fe643e6261-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.726562 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.726542    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/618ca858-8bdc-491b-ad05-84fe643e6261-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.726655 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.726575    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7dx6\" (UniqueName: \"kubernetes.io/projected/618ca858-8bdc-491b-ad05-84fe643e6261-kube-api-access-p7dx6\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.726655 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.726607    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/618ca858-8bdc-491b-ad05-84fe643e6261-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.726655 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.726648    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-config\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.726812 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.726669    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.726812 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.726700    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/618ca858-8bdc-491b-ad05-84fe643e6261-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.726812 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.726770    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.726812 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.726802    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.727032 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.726828    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/618ca858-8bdc-491b-ad05-84fe643e6261-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.727032 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.726857    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.727032 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.726909    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/618ca858-8bdc-491b-ad05-84fe643e6261-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.727439 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.727418    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/618ca858-8bdc-491b-ad05-84fe643e6261-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.729265 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.728309    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.729265 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.728525    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.729265 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.728552    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-web-config\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.729265 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.728741    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/618ca858-8bdc-491b-ad05-84fe643e6261-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.729265 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.728809    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/618ca858-8bdc-491b-ad05-84fe643e6261-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.729265 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.728838    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.729265 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.728974    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/618ca858-8bdc-491b-ad05-84fe643e6261-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.729676 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.729447    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/618ca858-8bdc-491b-ad05-84fe643e6261-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.729886 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.729839    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.730067 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.730028    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/618ca858-8bdc-491b-ad05-84fe643e6261-config-out\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.730989 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.730960    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.730989 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.730972    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-config\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.731165 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.731147    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.731955 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.731937    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/618ca858-8bdc-491b-ad05-84fe643e6261-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.732012 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.731991    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/618ca858-8bdc-491b-ad05-84fe643e6261-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.735563 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.735547    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7dx6\" (UniqueName: \"kubernetes.io/projected/618ca858-8bdc-491b-ad05-84fe643e6261-kube-api-access-p7dx6\") pod \"prometheus-k8s-0\" (UID: \"618ca858-8bdc-491b-ad05-84fe643e6261\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:04.875478 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:04.875436    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:05.021536 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:05.021451    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 22:39:05.025425 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:39:05.025397    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod618ca858_8bdc_491b_ad05_84fe643e6261.slice/crio-0f4269279d0ee4c5422d21433f580a8538c44bce2269e62bcfa7b5c6666e6503 WatchSource:0}: Error finding container 0f4269279d0ee4c5422d21433f580a8538c44bce2269e62bcfa7b5c6666e6503: Status 404 returned error can't find the container with id 0f4269279d0ee4c5422d21433f580a8538c44bce2269e62bcfa7b5c6666e6503
Jul 09 22:39:05.512841 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:05.512805    2564 generic.go:356] "Generic (PLEG): container finished" podID="618ca858-8bdc-491b-ad05-84fe643e6261" containerID="242bba14420f6794b00d03d935bd2b525392a2f22b7dc6f003b850555f2c22a4" exitCode=0
Jul 09 22:39:05.513194 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:05.512860    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"618ca858-8bdc-491b-ad05-84fe643e6261","Type":"ContainerDied","Data":"242bba14420f6794b00d03d935bd2b525392a2f22b7dc6f003b850555f2c22a4"}
Jul 09 22:39:05.513194 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:05.512934    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"618ca858-8bdc-491b-ad05-84fe643e6261","Type":"ContainerStarted","Data":"0f4269279d0ee4c5422d21433f580a8538c44bce2269e62bcfa7b5c6666e6503"}
Jul 09 22:39:05.965792 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:05.965759    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec2bd304-6c9b-4f3f-99f9-ada0f872ed71" path="/var/lib/kubelet/pods/ec2bd304-6c9b-4f3f-99f9-ada0f872ed71/volumes"
Jul 09 22:39:06.519563 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:06.519531    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"618ca858-8bdc-491b-ad05-84fe643e6261","Type":"ContainerStarted","Data":"236e10b46adfac3fa27af09a1ceb5b1574ad5631b5c997892a8ff618fda06ea1"}
Jul 09 22:39:06.519944 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:06.519594    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"618ca858-8bdc-491b-ad05-84fe643e6261","Type":"ContainerStarted","Data":"37805099447c4b88e68aa5afa7164981fad2980ff62bde43fce95ae55613a09e"}
Jul 09 22:39:06.519944 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:06.519623    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"618ca858-8bdc-491b-ad05-84fe643e6261","Type":"ContainerStarted","Data":"d8f6e67c6c2386b69cf5d3dc8a675e1706db96a7fe748695403db8e6bfd2c677"}
Jul 09 22:39:06.519944 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:06.519647    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"618ca858-8bdc-491b-ad05-84fe643e6261","Type":"ContainerStarted","Data":"5da075e3a24a4853e8fe6a84550f466c1dcb1f30fc46397e06d2a5862d58163c"}
Jul 09 22:39:06.519944 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:06.519674    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"618ca858-8bdc-491b-ad05-84fe643e6261","Type":"ContainerStarted","Data":"69febfd2298a04d44e43ddf927b9ca9a7e8f38c5ecf84abc58a13f615a4af745"}
Jul 09 22:39:06.519944 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:06.519702    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"618ca858-8bdc-491b-ad05-84fe643e6261","Type":"ContainerStarted","Data":"1e6b62e44693501f88e1f881013f65e3adadf1ed1a86b4fb872eea1f759c9ace"}
Jul 09 22:39:06.544530 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:06.544486    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.526366306 podStartE2EDuration="2.544472262s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.105956ms" isStatefulPod=false podCreationTimestamp="2026-07-09 22:39:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:39:06.543592993 +0000 UTC m=+401.251488575" watchObservedRunningTime="2026-07-09 22:39:06.544472262 +0000 UTC m=+401.252367848"
Jul 09 22:39:09.875598 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:09.875563    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:39:17.381049 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:17.381013    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59cdbff66-lwbtk"]
Jul 09 22:39:42.402148 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.402101    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-59cdbff66-lwbtk" podUID="1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25" containerName="console" containerID="cri-o://fce0403977f4d776d26771ab6b9e4120630efc1ba1c39fcf694809bbd2d96ff4" gracePeriod=15
Jul 09 22:39:42.655947 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.655892    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:39:42.666211 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.666184    2564 generic.go:356] "Generic (PLEG): container finished" podID="1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25" containerID="fce0403977f4d776d26771ab6b9e4120630efc1ba1c39fcf694809bbd2d96ff4" exitCode=0
Jul 09 22:39:42.666309 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.666217    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cdbff66-lwbtk"
Jul 09 22:39:42.666309 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.666236    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cdbff66-lwbtk" event={"ID":"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25","Type":"ContainerDied","Data":"fce0403977f4d776d26771ab6b9e4120630efc1ba1c39fcf694809bbd2d96ff4"}
Jul 09 22:39:42.666309 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.666283    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cdbff66-lwbtk" event={"ID":"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25","Type":"ContainerDied","Data":"546b2f7454f167e228da0277239f7920bcc65f7f1c6df212338d4dd3c2100893"}
Jul 09 22:39:42.666309 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.666305    2564 scope.go:117] "RemoveContainer" containerID="fce0403977f4d776d26771ab6b9e4120630efc1ba1c39fcf694809bbd2d96ff4"
Jul 09 22:39:42.674117 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.674097    2564 scope.go:117] "RemoveContainer" containerID="fce0403977f4d776d26771ab6b9e4120630efc1ba1c39fcf694809bbd2d96ff4"
Jul 09 22:39:42.674420 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:39:42.674401    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fce0403977f4d776d26771ab6b9e4120630efc1ba1c39fcf694809bbd2d96ff4\": container with ID starting with fce0403977f4d776d26771ab6b9e4120630efc1ba1c39fcf694809bbd2d96ff4 not found: ID does not exist" containerID="fce0403977f4d776d26771ab6b9e4120630efc1ba1c39fcf694809bbd2d96ff4"
Jul 09 22:39:42.674499 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.674433    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fce0403977f4d776d26771ab6b9e4120630efc1ba1c39fcf694809bbd2d96ff4"} err="failed to get container status \"fce0403977f4d776d26771ab6b9e4120630efc1ba1c39fcf694809bbd2d96ff4\": rpc error: code = NotFound desc = could not find container \"fce0403977f4d776d26771ab6b9e4120630efc1ba1c39fcf694809bbd2d96ff4\": container with ID starting with fce0403977f4d776d26771ab6b9e4120630efc1ba1c39fcf694809bbd2d96ff4 not found: ID does not exist"
Jul 09 22:39:42.738575 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.738546    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-console-config\") pod \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") "
Jul 09 22:39:42.738741 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.738582    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fjxp\" (UniqueName: \"kubernetes.io/projected/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-kube-api-access-9fjxp\") pod \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") "
Jul 09 22:39:42.738741 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.738613    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-console-oauth-config\") pod \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") "
Jul 09 22:39:42.738741 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.738674    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-oauth-serving-cert\") pod \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") "
Jul 09 22:39:42.738741 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.738705    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-console-serving-cert\") pod \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") "
Jul 09 22:39:42.738984 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.738799    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-service-ca\") pod \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") "
Jul 09 22:39:42.738984 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.738892    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-trusted-ca-bundle\") pod \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\" (UID: \"1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25\") "
Jul 09 22:39:42.739102 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.739049    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25" (UID: "1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:39:42.739102 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.738974    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-console-config" (OuterVolumeSpecName: "console-config") pod "1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25" (UID: "1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:39:42.739199 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.739120    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-service-ca" (OuterVolumeSpecName: "service-ca") pod "1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25" (UID: "1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:39:42.739273 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.739254    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-oauth-serving-cert\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:42.739330 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.739279    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-service-ca\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:42.739330 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.739289    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-console-config\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:42.739426 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.739364    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25" (UID: "1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:39:42.740723 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.740694    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25" (UID: "1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:39:42.740818 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.740789    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-kube-api-access-9fjxp" (OuterVolumeSpecName: "kube-api-access-9fjxp") pod "1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25" (UID: "1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25"). InnerVolumeSpecName "kube-api-access-9fjxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:39:42.740856 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.740823    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25" (UID: "1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:39:42.840396 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.840367    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-console-oauth-config\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:42.840396 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.840392    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-console-serving-cert\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:42.840396 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.840401    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-trusted-ca-bundle\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:42.840583 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.840409    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fjxp\" (UniqueName: \"kubernetes.io/projected/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25-kube-api-access-9fjxp\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:39:42.985798 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.985769    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59cdbff66-lwbtk"]
Jul 09 22:39:42.989708 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:42.989685    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59cdbff66-lwbtk"]
Jul 09 22:39:43.964952 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:39:43.964922    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25" path="/var/lib/kubelet/pods/1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25/volumes"
Jul 09 22:40:04.876038 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:40:04.876000    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:40:04.891265 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:40:04.891241    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:40:05.777013 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:40:05.776986    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 22:41:26.135814 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:41:26.135735    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-m5d7w"]
Jul 09 22:41:26.136384 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:41:26.136219    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25" containerName="console"
Jul 09 22:41:26.136384 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:41:26.136238    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25" containerName="console"
Jul 09 22:41:26.136384 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:41:26.136357    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e8957fa-f9bd-4284-ac2b-cbbe4ea11d25" containerName="console"
Jul 09 22:41:26.139305 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:41:26.139284    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-m5d7w"
Jul 09 22:41:26.141370 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:41:26.141355    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-pxj5m\""
Jul 09 22:41:26.142049 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:41:26.142027    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 22:41:26.142152 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:41:26.142059    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 22:41:26.152291 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:41:26.152269    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-m5d7w"]
Jul 09 22:41:26.290932 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:41:26.290893    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a0737f0-b0c6-4e19-9911-0ec414424c72-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-m5d7w\" (UID: \"4a0737f0-b0c6-4e19-9911-0ec414424c72\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m5d7w"
Jul 09 22:41:26.291089 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:41:26.291001    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx8wx\" (UniqueName: \"kubernetes.io/projected/4a0737f0-b0c6-4e19-9911-0ec414424c72-kube-api-access-dx8wx\") pod \"cert-manager-webhook-6486ffd997-m5d7w\" (UID: \"4a0737f0-b0c6-4e19-9911-0ec414424c72\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m5d7w"
Jul 09 22:41:26.391395 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:41:26.391318    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx8wx\" (UniqueName: \"kubernetes.io/projected/4a0737f0-b0c6-4e19-9911-0ec414424c72-kube-api-access-dx8wx\") pod \"cert-manager-webhook-6486ffd997-m5d7w\" (UID: \"4a0737f0-b0c6-4e19-9911-0ec414424c72\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m5d7w"
Jul 09 22:41:26.391395 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:41:26.391371    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a0737f0-b0c6-4e19-9911-0ec414424c72-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-m5d7w\" (UID: \"4a0737f0-b0c6-4e19-9911-0ec414424c72\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m5d7w"
Jul 09 22:41:26.399022 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:41:26.398999    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a0737f0-b0c6-4e19-9911-0ec414424c72-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-m5d7w\" (UID: \"4a0737f0-b0c6-4e19-9911-0ec414424c72\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m5d7w"
Jul 09 22:41:26.399643 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:41:26.399621    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx8wx\" (UniqueName: \"kubernetes.io/projected/4a0737f0-b0c6-4e19-9911-0ec414424c72-kube-api-access-dx8wx\") pod \"cert-manager-webhook-6486ffd997-m5d7w\" (UID: \"4a0737f0-b0c6-4e19-9911-0ec414424c72\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m5d7w"
Jul 09 22:41:26.465029 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:41:26.465001    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-m5d7w"
Jul 09 22:41:26.591244 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:41:26.591222    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-m5d7w"]
Jul 09 22:41:26.593666 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:41:26.593638    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a0737f0_b0c6_4e19_9911_0ec414424c72.slice/crio-5ca65af99d09eee8d420f9092820d218d135d061cc8a42ad4aa7385053ed8257 WatchSource:0}: Error finding container 5ca65af99d09eee8d420f9092820d218d135d061cc8a42ad4aa7385053ed8257: Status 404 returned error can't find the container with id 5ca65af99d09eee8d420f9092820d218d135d061cc8a42ad4aa7385053ed8257
Jul 09 22:41:27.096391 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:41:27.096354    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-m5d7w" event={"ID":"4a0737f0-b0c6-4e19-9911-0ec414424c72","Type":"ContainerStarted","Data":"5ca65af99d09eee8d420f9092820d218d135d061cc8a42ad4aa7385053ed8257"}
Jul 09 22:41:55.211831 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:41:55.211790    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-m5d7w" event={"ID":"4a0737f0-b0c6-4e19-9911-0ec414424c72","Type":"ContainerStarted","Data":"ae9e237a62bc917e0beb79686e3a313ab68806981523ea1801215f6c165676b0"}
Jul 09 22:41:55.212324 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:41:55.211846    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-m5d7w"
Jul 09 22:41:55.228846 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:41:55.228803    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-m5d7w" podStartSLOduration=1.508437155 podStartE2EDuration="29.22878834s" totalImagesPullingTime="27.720351185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:41:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:41:55.227025171 +0000 UTC m=+569.934920778" watchObservedRunningTime="2026-07-09 22:41:55.22878834 +0000 UTC m=+569.936683926"
Jul 09 22:42:01.218453 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:01.218417    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-m5d7w"
Jul 09 22:42:06.148555 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:06.148520    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f8b5887bc-d24k6"]
Jul 09 22:42:06.152074 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:06.152056    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f8b5887bc-d24k6"
Jul 09 22:42:06.154647 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:06.154628    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 09 22:42:06.154779 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:06.154749    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 09 22:42:06.154848 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:06.154777    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 09 22:42:06.154848 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:06.154782    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 09 22:42:06.154848 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:06.154832    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 09 22:42:06.155020 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:06.154930    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bhmjm\""
Jul 09 22:42:06.162027 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:06.161996    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f8b5887bc-d24k6"]
Jul 09 22:42:06.224796 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:06.224751    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsrkx\" (UniqueName: \"kubernetes.io/projected/44544d52-b84e-4186-901d-da29a95e71e3-kube-api-access-wsrkx\") pod \"lws-controller-manager-5f8b5887bc-d24k6\" (UID: \"44544d52-b84e-4186-901d-da29a95e71e3\") " pod="openshift-lws-operator/lws-controller-manager-5f8b5887bc-d24k6"
Jul 09 22:42:06.224796 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:06.224794    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44544d52-b84e-4186-901d-da29a95e71e3-cert\") pod \"lws-controller-manager-5f8b5887bc-d24k6\" (UID: \"44544d52-b84e-4186-901d-da29a95e71e3\") " pod="openshift-lws-operator/lws-controller-manager-5f8b5887bc-d24k6"
Jul 09 22:42:06.225045 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:06.224815    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/44544d52-b84e-4186-901d-da29a95e71e3-manager-config\") pod \"lws-controller-manager-5f8b5887bc-d24k6\" (UID: \"44544d52-b84e-4186-901d-da29a95e71e3\") " pod="openshift-lws-operator/lws-controller-manager-5f8b5887bc-d24k6"
Jul 09 22:42:06.225045 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:06.224904    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/44544d52-b84e-4186-901d-da29a95e71e3-metrics-cert\") pod \"lws-controller-manager-5f8b5887bc-d24k6\" (UID: \"44544d52-b84e-4186-901d-da29a95e71e3\") " pod="openshift-lws-operator/lws-controller-manager-5f8b5887bc-d24k6"
Jul 09 22:42:06.325793 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:06.325755    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsrkx\" (UniqueName: \"kubernetes.io/projected/44544d52-b84e-4186-901d-da29a95e71e3-kube-api-access-wsrkx\") pod \"lws-controller-manager-5f8b5887bc-d24k6\" (UID: \"44544d52-b84e-4186-901d-da29a95e71e3\") " pod="openshift-lws-operator/lws-controller-manager-5f8b5887bc-d24k6"
Jul 09 22:42:06.325793 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:06.325793    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44544d52-b84e-4186-901d-da29a95e71e3-cert\") pod \"lws-controller-manager-5f8b5887bc-d24k6\" (UID: \"44544d52-b84e-4186-901d-da29a95e71e3\") " pod="openshift-lws-operator/lws-controller-manager-5f8b5887bc-d24k6"
Jul 09 22:42:06.326088 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:06.325815    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/44544d52-b84e-4186-901d-da29a95e71e3-manager-config\") pod \"lws-controller-manager-5f8b5887bc-d24k6\" (UID: \"44544d52-b84e-4186-901d-da29a95e71e3\") " pod="openshift-lws-operator/lws-controller-manager-5f8b5887bc-d24k6"
Jul 09 22:42:06.326088 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:06.325835    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/44544d52-b84e-4186-901d-da29a95e71e3-metrics-cert\") pod \"lws-controller-manager-5f8b5887bc-d24k6\" (UID: \"44544d52-b84e-4186-901d-da29a95e71e3\") " pod="openshift-lws-operator/lws-controller-manager-5f8b5887bc-d24k6"
Jul 09 22:42:06.326536 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:06.326512    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/44544d52-b84e-4186-901d-da29a95e71e3-manager-config\") pod \"lws-controller-manager-5f8b5887bc-d24k6\" (UID: \"44544d52-b84e-4186-901d-da29a95e71e3\") " pod="openshift-lws-operator/lws-controller-manager-5f8b5887bc-d24k6"
Jul 09 22:42:06.328390 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:06.328372    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44544d52-b84e-4186-901d-da29a95e71e3-cert\") pod \"lws-controller-manager-5f8b5887bc-d24k6\" (UID: \"44544d52-b84e-4186-901d-da29a95e71e3\") " pod="openshift-lws-operator/lws-controller-manager-5f8b5887bc-d24k6"
Jul 09 22:42:06.328453 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:06.328421    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/44544d52-b84e-4186-901d-da29a95e71e3-metrics-cert\") pod \"lws-controller-manager-5f8b5887bc-d24k6\" (UID: \"44544d52-b84e-4186-901d-da29a95e71e3\") " pod="openshift-lws-operator/lws-controller-manager-5f8b5887bc-d24k6"
Jul 09 22:42:06.333748 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:06.333732    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsrkx\" (UniqueName: \"kubernetes.io/projected/44544d52-b84e-4186-901d-da29a95e71e3-kube-api-access-wsrkx\") pod \"lws-controller-manager-5f8b5887bc-d24k6\" (UID: \"44544d52-b84e-4186-901d-da29a95e71e3\") " pod="openshift-lws-operator/lws-controller-manager-5f8b5887bc-d24k6"
Jul 09 22:42:06.461742 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:06.461709    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f8b5887bc-d24k6"
Jul 09 22:42:06.588719 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:06.588679    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f8b5887bc-d24k6"]
Jul 09 22:42:06.592365 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:42:06.592340    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44544d52_b84e_4186_901d_da29a95e71e3.slice/crio-eb6e88bd4419e8451d60309a604651c7cba2c2def7961c746f807bbd98ff78fb WatchSource:0}: Error finding container eb6e88bd4419e8451d60309a604651c7cba2c2def7961c746f807bbd98ff78fb: Status 404 returned error can't find the container with id eb6e88bd4419e8451d60309a604651c7cba2c2def7961c746f807bbd98ff78fb
Jul 09 22:42:07.261525 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:07.261497    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f8b5887bc-d24k6" event={"ID":"44544d52-b84e-4186-901d-da29a95e71e3","Type":"ContainerStarted","Data":"eb6e88bd4419e8451d60309a604651c7cba2c2def7961c746f807bbd98ff78fb"}
Jul 09 22:42:09.271435 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:09.271357    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f8b5887bc-d24k6" event={"ID":"44544d52-b84e-4186-901d-da29a95e71e3","Type":"ContainerStarted","Data":"0b0d859fc5c0fd3c006c768c48f1e055a8ebb97c36f4a0a67b26416b89c23487"}
Jul 09 22:42:09.271784 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:09.271476    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5f8b5887bc-d24k6"
Jul 09 22:42:09.289290 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:09.289242    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5f8b5887bc-d24k6" podStartSLOduration=0.890010525 podStartE2EDuration="3.289225263s" totalImagesPullingTime="2.399214738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:42:09.287255172 +0000 UTC m=+583.995150766" watchObservedRunningTime="2026-07-09 22:42:09.289225263 +0000 UTC m=+583.997120889"
Jul 09 22:42:14.423661 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:14.423624    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st"]
Jul 09 22:42:14.427344 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:14.427324    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st"
Jul 09 22:42:14.429852 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:14.429831    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 22:42:14.430027 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:14.430007    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 22:42:14.431192 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:14.431171    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 22:42:14.431192 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:14.431186    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-k9dxk\""
Jul 09 22:42:14.431318 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:14.431214    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 22:42:14.455199 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:14.455178    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st"]
Jul 09 22:42:14.596485 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:14.596456    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/951aecc0-8eba-4299-9716-42b531b51b5b-tmp\") pod \"opendatahub-operator-controller-manager-54dbdc554f-pv5st\" (UID: \"951aecc0-8eba-4299-9716-42b531b51b5b\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st"
Jul 09 22:42:14.596635 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:14.596487    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtcth\" (UniqueName: \"kubernetes.io/projected/951aecc0-8eba-4299-9716-42b531b51b5b-kube-api-access-dtcth\") pod \"opendatahub-operator-controller-manager-54dbdc554f-pv5st\" (UID: \"951aecc0-8eba-4299-9716-42b531b51b5b\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st"
Jul 09 22:42:14.596635 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:14.596518    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/951aecc0-8eba-4299-9716-42b531b51b5b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54dbdc554f-pv5st\" (UID: \"951aecc0-8eba-4299-9716-42b531b51b5b\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st"
Jul 09 22:42:14.596754 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:14.596652    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/951aecc0-8eba-4299-9716-42b531b51b5b-manifests\") pod \"opendatahub-operator-controller-manager-54dbdc554f-pv5st\" (UID: \"951aecc0-8eba-4299-9716-42b531b51b5b\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st"
Jul 09 22:42:14.596754 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:14.596696    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/951aecc0-8eba-4299-9716-42b531b51b5b-webhook-cert\") pod \"opendatahub-operator-controller-manager-54dbdc554f-pv5st\" (UID: \"951aecc0-8eba-4299-9716-42b531b51b5b\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st"
Jul 09 22:42:14.697270 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:14.697233    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/951aecc0-8eba-4299-9716-42b531b51b5b-tmp\") pod \"opendatahub-operator-controller-manager-54dbdc554f-pv5st\" (UID: \"951aecc0-8eba-4299-9716-42b531b51b5b\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st"
Jul 09 22:42:14.697423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:14.697284    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtcth\" (UniqueName: \"kubernetes.io/projected/951aecc0-8eba-4299-9716-42b531b51b5b-kube-api-access-dtcth\") pod \"opendatahub-operator-controller-manager-54dbdc554f-pv5st\" (UID: \"951aecc0-8eba-4299-9716-42b531b51b5b\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st"
Jul 09 22:42:14.697423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:14.697322    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/951aecc0-8eba-4299-9716-42b531b51b5b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54dbdc554f-pv5st\" (UID: \"951aecc0-8eba-4299-9716-42b531b51b5b\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st"
Jul 09 22:42:14.697423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:14.697405    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/951aecc0-8eba-4299-9716-42b531b51b5b-manifests\") pod \"opendatahub-operator-controller-manager-54dbdc554f-pv5st\" (UID: \"951aecc0-8eba-4299-9716-42b531b51b5b\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st"
Jul 09 22:42:14.697585 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:14.697438    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/951aecc0-8eba-4299-9716-42b531b51b5b-webhook-cert\") pod \"opendatahub-operator-controller-manager-54dbdc554f-pv5st\" (UID: \"951aecc0-8eba-4299-9716-42b531b51b5b\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st"
Jul 09 22:42:14.697827 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:14.697792    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/951aecc0-8eba-4299-9716-42b531b51b5b-manifests\") pod \"opendatahub-operator-controller-manager-54dbdc554f-pv5st\" (UID: \"951aecc0-8eba-4299-9716-42b531b51b5b\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st"
Jul 09 22:42:14.700021 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:14.699995    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/951aecc0-8eba-4299-9716-42b531b51b5b-tmp\") pod \"opendatahub-operator-controller-manager-54dbdc554f-pv5st\" (UID: \"951aecc0-8eba-4299-9716-42b531b51b5b\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st"
Jul 09 22:42:14.700236 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:14.700213    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/951aecc0-8eba-4299-9716-42b531b51b5b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54dbdc554f-pv5st\" (UID: \"951aecc0-8eba-4299-9716-42b531b51b5b\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st"
Jul 09 22:42:14.700451 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:14.700434    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/951aecc0-8eba-4299-9716-42b531b51b5b-webhook-cert\") pod \"opendatahub-operator-controller-manager-54dbdc554f-pv5st\" (UID: \"951aecc0-8eba-4299-9716-42b531b51b5b\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st"
Jul 09 22:42:14.705636 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:14.705616    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtcth\" (UniqueName: \"kubernetes.io/projected/951aecc0-8eba-4299-9716-42b531b51b5b-kube-api-access-dtcth\") pod \"opendatahub-operator-controller-manager-54dbdc554f-pv5st\" (UID: \"951aecc0-8eba-4299-9716-42b531b51b5b\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st"
Jul 09 22:42:14.737696 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:14.737661    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st"
Jul 09 22:42:14.874480 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:14.874457    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st"]
Jul 09 22:42:14.876837 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:42:14.876809    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod951aecc0_8eba_4299_9716_42b531b51b5b.slice/crio-692e87ede0f2892720849f08d40e83fa784066bbd8e338341753fdb6fcc45164 WatchSource:0}: Error finding container 692e87ede0f2892720849f08d40e83fa784066bbd8e338341753fdb6fcc45164: Status 404 returned error can't find the container with id 692e87ede0f2892720849f08d40e83fa784066bbd8e338341753fdb6fcc45164
Jul 09 22:42:15.295884 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:15.295843    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st" event={"ID":"951aecc0-8eba-4299-9716-42b531b51b5b","Type":"ContainerStarted","Data":"692e87ede0f2892720849f08d40e83fa784066bbd8e338341753fdb6fcc45164"}
Jul 09 22:42:18.313160 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:18.313126    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st" event={"ID":"951aecc0-8eba-4299-9716-42b531b51b5b","Type":"ContainerStarted","Data":"4879fc07093533942ffca94a4b76d19654380fd9a129d7c59b49625b49c242b7"}
Jul 09 22:42:19.319190 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:19.319157    2564 generic.go:356] "Generic (PLEG): container finished" podID="951aecc0-8eba-4299-9716-42b531b51b5b" containerID="4879fc07093533942ffca94a4b76d19654380fd9a129d7c59b49625b49c242b7" exitCode=0
Jul 09 22:42:19.319572 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:19.319246    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st" event={"ID":"951aecc0-8eba-4299-9716-42b531b51b5b","Type":"ContainerDied","Data":"4879fc07093533942ffca94a4b76d19654380fd9a129d7c59b49625b49c242b7"}
Jul 09 22:42:20.277770 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:20.277742    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5f8b5887bc-d24k6"
Jul 09 22:42:20.327953 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:20.327922    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st" event={"ID":"951aecc0-8eba-4299-9716-42b531b51b5b","Type":"ContainerStarted","Data":"18f6e19666eb10a098756447609fedd82beb45a3a48348f25a4b74481e5463c8"}
Jul 09 22:42:20.328414 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:20.328104    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st"
Jul 09 22:42:20.348262 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:20.348216    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st" podStartSLOduration=2.045057984 podStartE2EDuration="6.348200375s" totalImagesPullingTime="3.285339395s" totalInitContainerRuntime="1.017802996s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:42:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:42:20.346992335 +0000 UTC m=+595.054887922" watchObservedRunningTime="2026-07-09 22:42:20.348200375 +0000 UTC m=+595.056095961"
Jul 09 22:42:25.747192 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:25.747166    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-v29jg_fb564a11-973b-40db-ac7b-a20e2e4bf01d/console-operator/1.log"
Jul 09 22:42:25.747736 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:25.747322    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-v29jg_fb564a11-973b-40db-ac7b-a20e2e4bf01d/console-operator/1.log"
Jul 09 22:42:31.334740 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:31.334708    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-pv5st"
Jul 09 22:42:33.535423 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:33.535390    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6965988765-cz682"]
Jul 09 22:42:33.538568 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:33.538551    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6965988765-cz682"
Jul 09 22:42:33.541616 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:33.541593    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7q296\""
Jul 09 22:42:33.542461 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:33.542443    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 09 22:42:33.542540 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:33.542445    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 09 22:42:33.542831 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:33.542816    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 22:42:33.542910 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:33.542822    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 22:42:33.556671 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:33.556649    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2a75b38-1b6a-4b3f-9867-02630a73bdef-tls-certs\") pod \"kube-auth-proxy-6965988765-cz682\" (UID: \"d2a75b38-1b6a-4b3f-9867-02630a73bdef\") " pod="openshift-ingress/kube-auth-proxy-6965988765-cz682"
Jul 09 22:42:33.556751 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:33.556684    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2a75b38-1b6a-4b3f-9867-02630a73bdef-tmp\") pod \"kube-auth-proxy-6965988765-cz682\" (UID: \"d2a75b38-1b6a-4b3f-9867-02630a73bdef\") " pod="openshift-ingress/kube-auth-proxy-6965988765-cz682"
Jul 09 22:42:33.556793 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:33.556776    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqqtg\" (UniqueName: \"kubernetes.io/projected/d2a75b38-1b6a-4b3f-9867-02630a73bdef-kube-api-access-jqqtg\") pod \"kube-auth-proxy-6965988765-cz682\" (UID: \"d2a75b38-1b6a-4b3f-9867-02630a73bdef\") " pod="openshift-ingress/kube-auth-proxy-6965988765-cz682"
Jul 09 22:42:33.569207 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:33.569184    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6965988765-cz682"]
Jul 09 22:42:33.657972 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:33.657935    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqqtg\" (UniqueName: \"kubernetes.io/projected/d2a75b38-1b6a-4b3f-9867-02630a73bdef-kube-api-access-jqqtg\") pod \"kube-auth-proxy-6965988765-cz682\" (UID: \"d2a75b38-1b6a-4b3f-9867-02630a73bdef\") " pod="openshift-ingress/kube-auth-proxy-6965988765-cz682"
Jul 09 22:42:33.658151 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:33.658017    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2a75b38-1b6a-4b3f-9867-02630a73bdef-tls-certs\") pod \"kube-auth-proxy-6965988765-cz682\" (UID: \"d2a75b38-1b6a-4b3f-9867-02630a73bdef\") " pod="openshift-ingress/kube-auth-proxy-6965988765-cz682"
Jul 09 22:42:33.658151 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:33.658053    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2a75b38-1b6a-4b3f-9867-02630a73bdef-tmp\") pod \"kube-auth-proxy-6965988765-cz682\" (UID: \"d2a75b38-1b6a-4b3f-9867-02630a73bdef\") " pod="openshift-ingress/kube-auth-proxy-6965988765-cz682"
Jul 09 22:42:33.658151 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:42:33.658144    2564 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 09 22:42:33.658275 ip-10-0-142-84 kubenswrapper[2564]: E0709 22:42:33.658202    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2a75b38-1b6a-4b3f-9867-02630a73bdef-tls-certs podName:d2a75b38-1b6a-4b3f-9867-02630a73bdef nodeName:}" failed. No retries permitted until 2026-07-09 22:42:34.158186561 +0000 UTC m=+608.866082126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d2a75b38-1b6a-4b3f-9867-02630a73bdef-tls-certs") pod "kube-auth-proxy-6965988765-cz682" (UID: "d2a75b38-1b6a-4b3f-9867-02630a73bdef") : secret "kube-auth-proxy-tls" not found
Jul 09 22:42:33.660281 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:33.660258    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2a75b38-1b6a-4b3f-9867-02630a73bdef-tmp\") pod \"kube-auth-proxy-6965988765-cz682\" (UID: \"d2a75b38-1b6a-4b3f-9867-02630a73bdef\") " pod="openshift-ingress/kube-auth-proxy-6965988765-cz682"
Jul 09 22:42:33.676646 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:33.676624    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqqtg\" (UniqueName: \"kubernetes.io/projected/d2a75b38-1b6a-4b3f-9867-02630a73bdef-kube-api-access-jqqtg\") pod \"kube-auth-proxy-6965988765-cz682\" (UID: \"d2a75b38-1b6a-4b3f-9867-02630a73bdef\") " pod="openshift-ingress/kube-auth-proxy-6965988765-cz682"
Jul 09 22:42:34.161660 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:34.161620    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2a75b38-1b6a-4b3f-9867-02630a73bdef-tls-certs\") pod \"kube-auth-proxy-6965988765-cz682\" (UID: \"d2a75b38-1b6a-4b3f-9867-02630a73bdef\") " pod="openshift-ingress/kube-auth-proxy-6965988765-cz682"
Jul 09 22:42:34.164303 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:34.164278    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2a75b38-1b6a-4b3f-9867-02630a73bdef-tls-certs\") pod \"kube-auth-proxy-6965988765-cz682\" (UID: \"d2a75b38-1b6a-4b3f-9867-02630a73bdef\") " pod="openshift-ingress/kube-auth-proxy-6965988765-cz682"
Jul 09 22:42:34.448005 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:34.447973    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6965988765-cz682"
Jul 09 22:42:34.586935 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:34.586910    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6965988765-cz682"]
Jul 09 22:42:34.589771 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:42:34.589746    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2a75b38_1b6a_4b3f_9867_02630a73bdef.slice/crio-d71d7db2f49cfb6388b4700e7290ada36fc03e75b29b2dbd7db0853e4ab334e7 WatchSource:0}: Error finding container d71d7db2f49cfb6388b4700e7290ada36fc03e75b29b2dbd7db0853e4ab334e7: Status 404 returned error can't find the container with id d71d7db2f49cfb6388b4700e7290ada36fc03e75b29b2dbd7db0853e4ab334e7
Jul 09 22:42:34.591575 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:34.591558    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 22:42:35.396937 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:35.396905    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6965988765-cz682" event={"ID":"d2a75b38-1b6a-4b3f-9867-02630a73bdef","Type":"ContainerStarted","Data":"d71d7db2f49cfb6388b4700e7290ada36fc03e75b29b2dbd7db0853e4ab334e7"}
Jul 09 22:42:38.412265 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:38.412224    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6965988765-cz682" event={"ID":"d2a75b38-1b6a-4b3f-9867-02630a73bdef","Type":"ContainerStarted","Data":"0fc31b6fcf0758b649fb596f85546993c9d5f3c43a3420e79bd7af869b322e94"}
Jul 09 22:42:38.429355 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:42:38.429287    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6965988765-cz682" podStartSLOduration=2.444805434 podStartE2EDuration="5.429268465s" totalImagesPullingTime="2.984463031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:42:38.427837896 +0000 UTC m=+613.135733485" watchObservedRunningTime="2026-07-09 22:42:38.429268465 +0000 UTC m=+613.137164054"
Jul 09 22:44:19.299619 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:19.299529    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mkbdw"]
Jul 09 22:44:19.303295 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:19.303273    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mkbdw"
Jul 09 22:44:19.305763 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:19.305741    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 09 22:44:19.305893 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:19.305820    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 22:44:19.305964 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:19.305897    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-szhh2\""
Jul 09 22:44:19.306691 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:19.306676    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 22:44:19.326757 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:19.326731    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mkbdw"]
Jul 09 22:44:19.328482 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:19.328461    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxmnc\" (UniqueName: \"kubernetes.io/projected/617ffbd8-bd75-4f6a-b272-67beed0ed3e6-kube-api-access-mxmnc\") pod \"dns-operator-controller-manager-864dd78c4c-mkbdw\" (UID: \"617ffbd8-bd75-4f6a-b272-67beed0ed3e6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mkbdw"
Jul 09 22:44:19.429254 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:19.429225    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxmnc\" (UniqueName: \"kubernetes.io/projected/617ffbd8-bd75-4f6a-b272-67beed0ed3e6-kube-api-access-mxmnc\") pod \"dns-operator-controller-manager-864dd78c4c-mkbdw\" (UID: \"617ffbd8-bd75-4f6a-b272-67beed0ed3e6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mkbdw"
Jul 09 22:44:19.437788 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:19.437769    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxmnc\" (UniqueName: \"kubernetes.io/projected/617ffbd8-bd75-4f6a-b272-67beed0ed3e6-kube-api-access-mxmnc\") pod \"dns-operator-controller-manager-864dd78c4c-mkbdw\" (UID: \"617ffbd8-bd75-4f6a-b272-67beed0ed3e6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mkbdw"
Jul 09 22:44:19.613364 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:19.613292    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mkbdw"
Jul 09 22:44:19.748015 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:19.747977    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mkbdw"]
Jul 09 22:44:19.750804 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:44:19.750779    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod617ffbd8_bd75_4f6a_b272_67beed0ed3e6.slice/crio-ef44e1680c219a6e701ee104761ae95844ee1cee48652a8f7f68722d1e9dd2ec WatchSource:0}: Error finding container ef44e1680c219a6e701ee104761ae95844ee1cee48652a8f7f68722d1e9dd2ec: Status 404 returned error can't find the container with id ef44e1680c219a6e701ee104761ae95844ee1cee48652a8f7f68722d1e9dd2ec
Jul 09 22:44:19.857442 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:19.857368    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mkbdw" event={"ID":"617ffbd8-bd75-4f6a-b272-67beed0ed3e6","Type":"ContainerStarted","Data":"ef44e1680c219a6e701ee104761ae95844ee1cee48652a8f7f68722d1e9dd2ec"}
Jul 09 22:44:22.873457 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:22.873420    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mkbdw" event={"ID":"617ffbd8-bd75-4f6a-b272-67beed0ed3e6","Type":"ContainerStarted","Data":"cae0ff07af0c6acdb8c998b0c87ff848154a3d0a3400a16139375561e8a5989e"}
Jul 09 22:44:22.873917 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:22.873502    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mkbdw"
Jul 09 22:44:22.891014 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:22.890967    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mkbdw" podStartSLOduration=1.738548218 podStartE2EDuration="3.890951517s" totalImagesPullingTime="2.152403299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:44:22.890587194 +0000 UTC m=+717.598482781" watchObservedRunningTime="2026-07-09 22:44:22.890951517 +0000 UTC m=+717.598847104"
Jul 09 22:44:30.962048 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:30.962007    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-csvhp"]
Jul 09 22:44:30.965646 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:30.965629    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-csvhp"
Jul 09 22:44:30.968228 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:30.968209    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gnpth\""
Jul 09 22:44:30.986862 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:30.986840    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-csvhp"]
Jul 09 22:44:31.023780 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:31.023756    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/66f132fc-5a2a-462f-9c4a-27399359f86c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-csvhp\" (UID: \"66f132fc-5a2a-462f-9c4a-27399359f86c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-csvhp"
Jul 09 22:44:31.023886 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:31.023796    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwrvn\" (UniqueName: \"kubernetes.io/projected/66f132fc-5a2a-462f-9c4a-27399359f86c-kube-api-access-lwrvn\") pod \"kuadrant-operator-controller-manager-86878c769f-csvhp\" (UID: \"66f132fc-5a2a-462f-9c4a-27399359f86c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-csvhp"
Jul 09 22:44:31.125208 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:31.125180    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/66f132fc-5a2a-462f-9c4a-27399359f86c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-csvhp\" (UID: \"66f132fc-5a2a-462f-9c4a-27399359f86c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-csvhp"
Jul 09 22:44:31.125332 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:31.125224    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwrvn\" (UniqueName: \"kubernetes.io/projected/66f132fc-5a2a-462f-9c4a-27399359f86c-kube-api-access-lwrvn\") pod \"kuadrant-operator-controller-manager-86878c769f-csvhp\" (UID: \"66f132fc-5a2a-462f-9c4a-27399359f86c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-csvhp"
Jul 09 22:44:31.125610 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:31.125593    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/66f132fc-5a2a-462f-9c4a-27399359f86c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-csvhp\" (UID: \"66f132fc-5a2a-462f-9c4a-27399359f86c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-csvhp"
Jul 09 22:44:31.136444 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:31.136418    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwrvn\" (UniqueName: \"kubernetes.io/projected/66f132fc-5a2a-462f-9c4a-27399359f86c-kube-api-access-lwrvn\") pod \"kuadrant-operator-controller-manager-86878c769f-csvhp\" (UID: \"66f132fc-5a2a-462f-9c4a-27399359f86c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-csvhp"
Jul 09 22:44:31.275452 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:31.275371    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-csvhp"
Jul 09 22:44:31.408338 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:31.408309    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-csvhp"]
Jul 09 22:44:31.412030 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:44:31.412004    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66f132fc_5a2a_462f_9c4a_27399359f86c.slice/crio-36684422f0f5c505385d023b6b79e186b2ac706481f1cbd1efa0da40a572a9b8 WatchSource:0}: Error finding container 36684422f0f5c505385d023b6b79e186b2ac706481f1cbd1efa0da40a572a9b8: Status 404 returned error can't find the container with id 36684422f0f5c505385d023b6b79e186b2ac706481f1cbd1efa0da40a572a9b8
Jul 09 22:44:31.917191 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:31.917161    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-csvhp" event={"ID":"66f132fc-5a2a-462f-9c4a-27399359f86c","Type":"ContainerStarted","Data":"36684422f0f5c505385d023b6b79e186b2ac706481f1cbd1efa0da40a572a9b8"}
Jul 09 22:44:33.880502 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:33.880475    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mkbdw"
Jul 09 22:44:36.943658 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:36.943626    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-csvhp" event={"ID":"66f132fc-5a2a-462f-9c4a-27399359f86c","Type":"ContainerStarted","Data":"dc20936672b5c8ee9e912d6f1ff40ef1b007262d39a1af632ad40b93470fcb2e"}
Jul 09 22:44:36.944088 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:36.943742    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-csvhp"
Jul 09 22:44:36.968046 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:36.968002    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-csvhp" podStartSLOduration=1.989251968 podStartE2EDuration="6.967985837s" totalImagesPullingTime="4.978733869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:44:36.966985674 +0000 UTC m=+731.674881271" watchObservedRunningTime="2026-07-09 22:44:36.967985837 +0000 UTC m=+731.675881424"
Jul 09 22:44:47.950728 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:44:47.950692    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-csvhp"
Jul 09 22:45:11.323144 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:45:11.323116    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:45:11.329342 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:45:11.329321    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"
Jul 09 22:45:11.331552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:45:11.331534    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 09 22:45:11.331552 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:45:11.331547    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-x6swm\""
Jul 09 22:45:11.337502 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:45:11.337482    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:45:11.363176 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:45:11.363154    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkgpn\" (UniqueName: \"kubernetes.io/projected/8fde3a27-6485-4c54-9d91-fa10e361aa8d-kube-api-access-xkgpn\") pod \"limitador-limitador-54d6d988d5-wq7rb\" (UID: \"8fde3a27-6485-4c54-9d91-fa10e361aa8d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"
Jul 09 22:45:11.363279 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:45:11.363256    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8fde3a27-6485-4c54-9d91-fa10e361aa8d-config-file\") pod \"limitador-limitador-54d6d988d5-wq7rb\" (UID: \"8fde3a27-6485-4c54-9d91-fa10e361aa8d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"
Jul 09 22:45:11.377788 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:45:11.377767    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:45:11.464274 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:45:11.464246    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8fde3a27-6485-4c54-9d91-fa10e361aa8d-config-file\") pod \"limitador-limitador-54d6d988d5-wq7rb\" (UID: \"8fde3a27-6485-4c54-9d91-fa10e361aa8d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"
Jul 09 22:45:11.464399 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:45:11.464313    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkgpn\" (UniqueName: \"kubernetes.io/projected/8fde3a27-6485-4c54-9d91-fa10e361aa8d-kube-api-access-xkgpn\") pod \"limitador-limitador-54d6d988d5-wq7rb\" (UID: \"8fde3a27-6485-4c54-9d91-fa10e361aa8d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"
Jul 09 22:45:11.464912 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:45:11.464862    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8fde3a27-6485-4c54-9d91-fa10e361aa8d-config-file\") pod \"limitador-limitador-54d6d988d5-wq7rb\" (UID: \"8fde3a27-6485-4c54-9d91-fa10e361aa8d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"
Jul 09 22:45:11.472847 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:45:11.472825    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkgpn\" (UniqueName: \"kubernetes.io/projected/8fde3a27-6485-4c54-9d91-fa10e361aa8d-kube-api-access-xkgpn\") pod \"limitador-limitador-54d6d988d5-wq7rb\" (UID: \"8fde3a27-6485-4c54-9d91-fa10e361aa8d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"
Jul 09 22:45:11.639896 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:45:11.639802    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"
Jul 09 22:45:11.769202 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:45:11.769177    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:45:11.771819 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:45:11.771794    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fde3a27_6485_4c54_9d91_fa10e361aa8d.slice/crio-67e4c4da85c77fc6cdf4930a1d7406d597bda1649cd81de1015f0e5885302fc4 WatchSource:0}: Error finding container 67e4c4da85c77fc6cdf4930a1d7406d597bda1649cd81de1015f0e5885302fc4: Status 404 returned error can't find the container with id 67e4c4da85c77fc6cdf4930a1d7406d597bda1649cd81de1015f0e5885302fc4
Jul 09 22:45:12.100465 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:45:12.100429    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wq7rb" event={"ID":"8fde3a27-6485-4c54-9d91-fa10e361aa8d","Type":"ContainerStarted","Data":"67e4c4da85c77fc6cdf4930a1d7406d597bda1649cd81de1015f0e5885302fc4"}
Jul 09 22:45:15.117103 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:45:15.117071    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wq7rb" event={"ID":"8fde3a27-6485-4c54-9d91-fa10e361aa8d","Type":"ContainerStarted","Data":"1081650f3182a4d6fa6f98a89247972804b96bc8b99d1c79a37e394f7e3d6400"}
Jul 09 22:45:15.117485 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:45:15.117141    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"
Jul 09 22:45:15.136667 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:45:15.136621    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-wq7rb" podStartSLOduration=1.66325496 podStartE2EDuration="4.1366065s" totalImagesPullingTime="2.47335154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:45:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:45:15.134570053 +0000 UTC m=+769.842465641" watchObservedRunningTime="2026-07-09 22:45:15.1366065 +0000 UTC m=+769.844502087"
Jul 09 22:45:26.122939 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:45:26.122910    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"
Jul 09 22:46:29.190890 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:46:29.190833    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:46:47.772084 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:46:47.772041    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:46:52.453940 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:46:52.453904    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:47:11.936861 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:11.936823    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:47:18.437897 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:18.437798    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:47:25.777211 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:25.777183    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-v29jg_fb564a11-973b-40db-ac7b-a20e2e4bf01d/console-operator/1.log"
Jul 09 22:47:25.778658 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:25.778636    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-v29jg_fb564a11-973b-40db-ac7b-a20e2e4bf01d/console-operator/1.log"
Jul 09 22:47:25.994907 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:25.994880    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"]
Jul 09 22:47:25.998564 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:25.998544    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"
Jul 09 22:47:26.001619 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:26.001590    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 22:47:26.001733 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:26.001613    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 09 22:47:26.001733 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:26.001633    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-52nhr\""
Jul 09 22:47:26.001733 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:26.001654    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 22:47:26.012772 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:26.012753    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"]
Jul 09 22:47:26.112202 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:26.112116    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c416cb22-5f72-4733-b651-0df7b5d96863-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hvbd\" (UID: \"c416cb22-5f72-4733-b651-0df7b5d96863\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"
Jul 09 22:47:26.112202 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:26.112154    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c416cb22-5f72-4733-b651-0df7b5d96863-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hvbd\" (UID: \"c416cb22-5f72-4733-b651-0df7b5d96863\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"
Jul 09 22:47:26.112202 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:26.112172    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxk4g\" (UniqueName: \"kubernetes.io/projected/c416cb22-5f72-4733-b651-0df7b5d96863-kube-api-access-kxk4g\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hvbd\" (UID: \"c416cb22-5f72-4733-b651-0df7b5d96863\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"
Jul 09 22:47:26.112414 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:26.112226    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c416cb22-5f72-4733-b651-0df7b5d96863-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hvbd\" (UID: \"c416cb22-5f72-4733-b651-0df7b5d96863\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"
Jul 09 22:47:26.112414 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:26.112267    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c416cb22-5f72-4733-b651-0df7b5d96863-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hvbd\" (UID: \"c416cb22-5f72-4733-b651-0df7b5d96863\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"
Jul 09 22:47:26.112414 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:26.112366    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c416cb22-5f72-4733-b651-0df7b5d96863-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hvbd\" (UID: \"c416cb22-5f72-4733-b651-0df7b5d96863\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"
Jul 09 22:47:26.213065 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:26.213026    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c416cb22-5f72-4733-b651-0df7b5d96863-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hvbd\" (UID: \"c416cb22-5f72-4733-b651-0df7b5d96863\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"
Jul 09 22:47:26.213238 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:26.213090    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c416cb22-5f72-4733-b651-0df7b5d96863-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hvbd\" (UID: \"c416cb22-5f72-4733-b651-0df7b5d96863\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"
Jul 09 22:47:26.213238 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:26.213123    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c416cb22-5f72-4733-b651-0df7b5d96863-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hvbd\" (UID: \"c416cb22-5f72-4733-b651-0df7b5d96863\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"
Jul 09 22:47:26.213238 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:26.213147    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxk4g\" (UniqueName: \"kubernetes.io/projected/c416cb22-5f72-4733-b651-0df7b5d96863-kube-api-access-kxk4g\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hvbd\" (UID: \"c416cb22-5f72-4733-b651-0df7b5d96863\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"
Jul 09 22:47:26.213238 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:26.213180    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c416cb22-5f72-4733-b651-0df7b5d96863-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hvbd\" (UID: \"c416cb22-5f72-4733-b651-0df7b5d96863\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"
Jul 09 22:47:26.213238 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:26.213232    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c416cb22-5f72-4733-b651-0df7b5d96863-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hvbd\" (UID: \"c416cb22-5f72-4733-b651-0df7b5d96863\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"
Jul 09 22:47:26.213489 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:26.213475    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c416cb22-5f72-4733-b651-0df7b5d96863-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hvbd\" (UID: \"c416cb22-5f72-4733-b651-0df7b5d96863\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"
Jul 09 22:47:26.213616 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:26.213588    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c416cb22-5f72-4733-b651-0df7b5d96863-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hvbd\" (UID: \"c416cb22-5f72-4733-b651-0df7b5d96863\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"
Jul 09 22:47:26.213669 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:26.213602    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c416cb22-5f72-4733-b651-0df7b5d96863-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hvbd\" (UID: \"c416cb22-5f72-4733-b651-0df7b5d96863\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"
Jul 09 22:47:26.215530 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:26.215507    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c416cb22-5f72-4733-b651-0df7b5d96863-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hvbd\" (UID: \"c416cb22-5f72-4733-b651-0df7b5d96863\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"
Jul 09 22:47:26.215694 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:26.215675    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c416cb22-5f72-4733-b651-0df7b5d96863-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hvbd\" (UID: \"c416cb22-5f72-4733-b651-0df7b5d96863\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"
Jul 09 22:47:26.222005 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:26.221985    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxk4g\" (UniqueName: \"kubernetes.io/projected/c416cb22-5f72-4733-b651-0df7b5d96863-kube-api-access-kxk4g\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hvbd\" (UID: \"c416cb22-5f72-4733-b651-0df7b5d96863\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"
Jul 09 22:47:26.309235 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:26.309206    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"
Jul 09 22:47:26.442378 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:26.442353    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"]
Jul 09 22:47:26.444035 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:47:26.444006    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc416cb22_5f72_4733_b651_0df7b5d96863.slice/crio-612fe6bda2b286dc1ecc024d8072aab26555c44822f95110a291793dd630473e WatchSource:0}: Error finding container 612fe6bda2b286dc1ecc024d8072aab26555c44822f95110a291793dd630473e: Status 404 returned error can't find the container with id 612fe6bda2b286dc1ecc024d8072aab26555c44822f95110a291793dd630473e
Jul 09 22:47:26.720269 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:26.720208    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd" event={"ID":"c416cb22-5f72-4733-b651-0df7b5d96863","Type":"ContainerStarted","Data":"612fe6bda2b286dc1ecc024d8072aab26555c44822f95110a291793dd630473e"}
Jul 09 22:47:27.726541 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:27.726505    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd" event={"ID":"c416cb22-5f72-4733-b651-0df7b5d96863","Type":"ContainerStarted","Data":"524d2528e81ca8454d4ac67c3c58cc52ae24f03c368fe33335cfb295e0ad48e0"}
Jul 09 22:47:27.750729 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:27.750678    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd" podStartSLOduration=1.685322126 podStartE2EDuration="2.750663813s" totalImagesPullingTime="1.065341687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:47:27.7496973 +0000 UTC m=+902.457592888" watchObservedRunningTime="2026-07-09 22:47:27.750663813 +0000 UTC m=+902.458559400"
Jul 09 22:47:28.238424 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:28.238387    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:47:36.309651 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:36.309613    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"
Jul 09 22:47:36.312082 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:36.309680    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"
Jul 09 22:47:36.322051 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:36.322030    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"
Jul 09 22:47:36.779977 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:36.779950    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hvbd"
Jul 09 22:47:36.843940 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:47:36.843910    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:48:45.249186 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:48:45.249155    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:48:54.147217 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:48:54.147135    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:49:06.534631 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:49:06.534597    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:49:15.437340 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:49:15.437300    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:49:25.199884 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:49:25.199833    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:49:52.441753 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:49:52.441720    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:50:04.140889 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:50:04.140836    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:50:39.350500 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:50:39.350418    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:50:48.839127 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:50:48.839091    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:50:58.137602 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:50:58.137573    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:51:08.744000 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:51:08.743964    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:51:18.139205 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:51:18.139171    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:51:29.747561 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:51:29.747523    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:51:40.749043 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:51:40.749010    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:51:49.742693 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:51:49.742614    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:52:11.930985 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:52:11.930953    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:52:23.545539 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:52:23.545508    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:52:25.812444 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:52:25.812413    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-v29jg_fb564a11-973b-40db-ac7b-a20e2e4bf01d/console-operator/1.log"
Jul 09 22:52:25.814786 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:52:25.814764    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-v29jg_fb564a11-973b-40db-ac7b-a20e2e4bf01d/console-operator/1.log"
Jul 09 22:52:48.532548 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:52:48.532515    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:52:58.739040 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:52:58.739006    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:53:13.733855 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:53:13.733820    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:53:25.636413 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:53:25.636322    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:53:34.736033 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:53:34.735994    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:53:44.234730 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:53:44.234695    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:53:53.234466 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:53:53.234438    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:54:19.455322 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:54:19.455286    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-csvhp"]
Jul 09 22:54:19.455898 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:54:19.455511    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-csvhp" podUID="66f132fc-5a2a-462f-9c4a-27399359f86c" containerName="manager" containerID="cri-o://dc20936672b5c8ee9e912d6f1ff40ef1b007262d39a1af632ad40b93470fcb2e" gracePeriod=10
Jul 09 22:54:21.670405 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:54:21.670373    2564 generic.go:356] "Generic (PLEG): container finished" podID="66f132fc-5a2a-462f-9c4a-27399359f86c" containerID="dc20936672b5c8ee9e912d6f1ff40ef1b007262d39a1af632ad40b93470fcb2e" exitCode=0
Jul 09 22:54:21.670747 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:54:21.670415    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-csvhp" event={"ID":"66f132fc-5a2a-462f-9c4a-27399359f86c","Type":"ContainerDied","Data":"dc20936672b5c8ee9e912d6f1ff40ef1b007262d39a1af632ad40b93470fcb2e"}
Jul 09 22:54:21.699751 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:54:21.699732    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-csvhp"
Jul 09 22:54:21.884744 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:54:21.884671    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/66f132fc-5a2a-462f-9c4a-27399359f86c-extensions-socket-volume\") pod \"66f132fc-5a2a-462f-9c4a-27399359f86c\" (UID: \"66f132fc-5a2a-462f-9c4a-27399359f86c\") "
Jul 09 22:54:21.884744 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:54:21.884702    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwrvn\" (UniqueName: \"kubernetes.io/projected/66f132fc-5a2a-462f-9c4a-27399359f86c-kube-api-access-lwrvn\") pod \"66f132fc-5a2a-462f-9c4a-27399359f86c\" (UID: \"66f132fc-5a2a-462f-9c4a-27399359f86c\") "
Jul 09 22:54:21.885055 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:54:21.885025    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66f132fc-5a2a-462f-9c4a-27399359f86c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "66f132fc-5a2a-462f-9c4a-27399359f86c" (UID: "66f132fc-5a2a-462f-9c4a-27399359f86c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:54:21.886984 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:54:21.886953    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66f132fc-5a2a-462f-9c4a-27399359f86c-kube-api-access-lwrvn" (OuterVolumeSpecName: "kube-api-access-lwrvn") pod "66f132fc-5a2a-462f-9c4a-27399359f86c" (UID: "66f132fc-5a2a-462f-9c4a-27399359f86c"). InnerVolumeSpecName "kube-api-access-lwrvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:54:21.986263 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:54:21.986234    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/66f132fc-5a2a-462f-9c4a-27399359f86c-extensions-socket-volume\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:54:21.986263 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:54:21.986259    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwrvn\" (UniqueName: \"kubernetes.io/projected/66f132fc-5a2a-462f-9c4a-27399359f86c-kube-api-access-lwrvn\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 22:54:22.676271 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:54:22.676237    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-csvhp" event={"ID":"66f132fc-5a2a-462f-9c4a-27399359f86c","Type":"ContainerDied","Data":"36684422f0f5c505385d023b6b79e186b2ac706481f1cbd1efa0da40a572a9b8"}
Jul 09 22:54:22.676271 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:54:22.676271    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-csvhp"
Jul 09 22:54:22.676751 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:54:22.676295    2564 scope.go:117] "RemoveContainer" containerID="dc20936672b5c8ee9e912d6f1ff40ef1b007262d39a1af632ad40b93470fcb2e"
Jul 09 22:54:22.691664 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:54:22.691640    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-csvhp"]
Jul 09 22:54:22.694760 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:54:22.694739    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-csvhp"]
Jul 09 22:54:23.965914 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:54:23.965885    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66f132fc-5a2a-462f-9c4a-27399359f86c" path="/var/lib/kubelet/pods/66f132fc-5a2a-462f-9c4a-27399359f86c/volumes"
Jul 09 22:55:20.812795 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:55:20.812722    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8txx"]
Jul 09 22:55:20.813250 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:55:20.813096    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66f132fc-5a2a-462f-9c4a-27399359f86c" containerName="manager"
Jul 09 22:55:20.813250 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:55:20.813108    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="66f132fc-5a2a-462f-9c4a-27399359f86c" containerName="manager"
Jul 09 22:55:20.813250 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:55:20.813179    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="66f132fc-5a2a-462f-9c4a-27399359f86c" containerName="manager"
Jul 09 22:55:20.816387 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:55:20.816370    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8txx"
Jul 09 22:55:20.820021 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:55:20.819996    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gnpth\""
Jul 09 22:55:20.832940 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:55:20.832914    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8txx"]
Jul 09 22:55:20.879448 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:55:20.879418    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5lk4\" (UniqueName: \"kubernetes.io/projected/0f46a625-38a3-4296-8e60-82ea59dc9acf-kube-api-access-z5lk4\") pod \"kuadrant-operator-controller-manager-86878c769f-k8txx\" (UID: \"0f46a625-38a3-4296-8e60-82ea59dc9acf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8txx"
Jul 09 22:55:20.879584 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:55:20.879506    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f46a625-38a3-4296-8e60-82ea59dc9acf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k8txx\" (UID: \"0f46a625-38a3-4296-8e60-82ea59dc9acf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8txx"
Jul 09 22:55:20.980616 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:55:20.980586    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5lk4\" (UniqueName: \"kubernetes.io/projected/0f46a625-38a3-4296-8e60-82ea59dc9acf-kube-api-access-z5lk4\") pod \"kuadrant-operator-controller-manager-86878c769f-k8txx\" (UID: \"0f46a625-38a3-4296-8e60-82ea59dc9acf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8txx"
Jul 09 22:55:20.980779 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:55:20.980642    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f46a625-38a3-4296-8e60-82ea59dc9acf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k8txx\" (UID: \"0f46a625-38a3-4296-8e60-82ea59dc9acf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8txx"
Jul 09 22:55:20.981038 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:55:20.981015    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f46a625-38a3-4296-8e60-82ea59dc9acf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k8txx\" (UID: \"0f46a625-38a3-4296-8e60-82ea59dc9acf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8txx"
Jul 09 22:55:20.989334 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:55:20.989319    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5lk4\" (UniqueName: \"kubernetes.io/projected/0f46a625-38a3-4296-8e60-82ea59dc9acf-kube-api-access-z5lk4\") pod \"kuadrant-operator-controller-manager-86878c769f-k8txx\" (UID: \"0f46a625-38a3-4296-8e60-82ea59dc9acf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8txx"
Jul 09 22:55:21.125715 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:55:21.125630    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8txx"
Jul 09 22:55:21.265521 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:55:21.265440    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8txx"]
Jul 09 22:55:21.267989 ip-10-0-142-84 kubenswrapper[2564]: W0709 22:55:21.267963    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f46a625_38a3_4296_8e60_82ea59dc9acf.slice/crio-eff489e5def9712b37e0401103a7963f042ba47184e0c2e5002079faa44248fd WatchSource:0}: Error finding container eff489e5def9712b37e0401103a7963f042ba47184e0c2e5002079faa44248fd: Status 404 returned error can't find the container with id eff489e5def9712b37e0401103a7963f042ba47184e0c2e5002079faa44248fd
Jul 09 22:55:21.967840 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:55:21.967804    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8txx" event={"ID":"0f46a625-38a3-4296-8e60-82ea59dc9acf","Type":"ContainerStarted","Data":"21b7515dbda2ceb471f78c51291aa750a1937a8f9495db73a04f95137d0cba47"}
Jul 09 22:55:21.968298 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:55:21.967855    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8txx" event={"ID":"0f46a625-38a3-4296-8e60-82ea59dc9acf","Type":"ContainerStarted","Data":"eff489e5def9712b37e0401103a7963f042ba47184e0c2e5002079faa44248fd"}
Jul 09 22:55:21.968298 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:55:21.967890    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8txx"
Jul 09 22:55:21.988204 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:55:21.988158    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8txx" podStartSLOduration=1.98814219 podStartE2EDuration="1.98814219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:55:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:55:21.986452656 +0000 UTC m=+1376.694348270" watchObservedRunningTime="2026-07-09 22:55:21.98814219 +0000 UTC m=+1376.696037776"
Jul 09 22:55:32.974789 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:55:32.974762    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8txx"
Jul 09 22:55:42.422930 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:55:42.422894    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:55:51.030434 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:55:51.030398    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:56:04.126797 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:56:04.126762    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:56:15.422235 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:56:15.422199    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:56:26.521122 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:56:26.521034    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:56:37.117441 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:56:37.117405    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:56:47.028316 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:56:47.028281    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:56:57.823058 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:56:57.823023    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:57:08.331651 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:57:08.331617    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:57:16.023115 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:57:16.023077    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:57:24.726798 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:57:24.726759    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:57:25.841178 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:57:25.841149    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-v29jg_fb564a11-973b-40db-ac7b-a20e2e4bf01d/console-operator/1.log"
Jul 09 22:57:25.844008 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:57:25.843988    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-v29jg_fb564a11-973b-40db-ac7b-a20e2e4bf01d/console-operator/1.log"
Jul 09 22:57:33.332899 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:57:33.332265    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:57:52.331717 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:57:52.331680    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:58:01.622620 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:58:01.622586    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:58:12.529944 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:58:12.529903    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:58:22.422906 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:58:22.422854    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:58:50.424017 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:58:50.423978    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:59:00.026504 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:59:00.026464    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:59:09.425203 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:59:09.425163    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:59:20.525538 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:59:20.525457    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:59:29.631535 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:59:29.631495    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:59:43.429245 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:59:43.429211    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 22:59:52.422822 ip-10-0-142-84 kubenswrapper[2564]: I0709 22:59:52.422785    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:00:02.326264 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:00:02.326232    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:00:11.826932 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:00:11.826894    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:00:24.121793 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:00:24.121759    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:00:31.927032 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:00:31.926998    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:00:41.219663 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:00:41.219633    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:00:56.729218 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:00:56.729128    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:01:07.926785 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:01:07.926750    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:01:19.626578 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:01:19.626542    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:01:31.725094 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:01:31.725062    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:01:42.120262 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:01:42.120230    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:01:50.724194 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:01:50.724160    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:02:12.525134 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:02:12.525100    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:02:21.420281 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:02:21.420203    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:02:25.871445 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:02:25.871414    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-v29jg_fb564a11-973b-40db-ac7b-a20e2e4bf01d/console-operator/1.log"
Jul 09 23:02:25.874852 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:02:25.874830    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-v29jg_fb564a11-973b-40db-ac7b-a20e2e4bf01d/console-operator/1.log"
Jul 09 23:03:42.223359 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:03:42.223325    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:03:50.739446 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:03:50.739410    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:04:04.894606 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:04.894577    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:04:13.124837 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:13.124797    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:04:45.325222 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:45.325189    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:04:51.075002 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.074942    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"]
Jul 09 23:04:51.079157 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.079138    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"
Jul 09 23:04:51.081315 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.081294    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-4e2b27a4\"/\"kube-root-ca.crt\""
Jul 09 23:04:51.081315 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.081305    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-4e2b27a4\"/\"openshift-service-ca.crt\""
Jul 09 23:04:51.081864 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.081848    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-4e2b27a4\"/\"e2e-lifecycle-model-4e2b27a4-kserve-self-signed-certs\""
Jul 09 23:04:51.081949 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.081897    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-4e2b27a4\"/\"default-dockercfg-vnvc9\""
Jul 09 23:04:51.086951 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.086929    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"]
Jul 09 23:04:51.227009 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.226967    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d24e9363-9a77-4093-9d95-89ce8c783a49-home\") pod \"e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z\" (UID: \"d24e9363-9a77-4093-9d95-89ce8c783a49\") " pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"
Jul 09 23:04:51.227198 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.227024    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d24e9363-9a77-4093-9d95-89ce8c783a49-dshm\") pod \"e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z\" (UID: \"d24e9363-9a77-4093-9d95-89ce8c783a49\") " pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"
Jul 09 23:04:51.227198 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.227085    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d24e9363-9a77-4093-9d95-89ce8c783a49-tmp-dir\") pod \"e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z\" (UID: \"d24e9363-9a77-4093-9d95-89ce8c783a49\") " pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"
Jul 09 23:04:51.227198 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.227145    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g9tg\" (UniqueName: \"kubernetes.io/projected/d24e9363-9a77-4093-9d95-89ce8c783a49-kube-api-access-7g9tg\") pod \"e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z\" (UID: \"d24e9363-9a77-4093-9d95-89ce8c783a49\") " pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"
Jul 09 23:04:51.227198 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.227180    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d24e9363-9a77-4093-9d95-89ce8c783a49-model-cache\") pod \"e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z\" (UID: \"d24e9363-9a77-4093-9d95-89ce8c783a49\") " pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"
Jul 09 23:04:51.227362 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.227226    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d24e9363-9a77-4093-9d95-89ce8c783a49-tls-certs\") pod \"e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z\" (UID: \"d24e9363-9a77-4093-9d95-89ce8c783a49\") " pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"
Jul 09 23:04:51.328700 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.328608    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d24e9363-9a77-4093-9d95-89ce8c783a49-dshm\") pod \"e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z\" (UID: \"d24e9363-9a77-4093-9d95-89ce8c783a49\") " pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"
Jul 09 23:04:51.328700 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.328683    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d24e9363-9a77-4093-9d95-89ce8c783a49-tmp-dir\") pod \"e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z\" (UID: \"d24e9363-9a77-4093-9d95-89ce8c783a49\") " pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"
Jul 09 23:04:51.328964 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.328716    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g9tg\" (UniqueName: \"kubernetes.io/projected/d24e9363-9a77-4093-9d95-89ce8c783a49-kube-api-access-7g9tg\") pod \"e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z\" (UID: \"d24e9363-9a77-4093-9d95-89ce8c783a49\") " pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"
Jul 09 23:04:51.328964 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.328748    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d24e9363-9a77-4093-9d95-89ce8c783a49-model-cache\") pod \"e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z\" (UID: \"d24e9363-9a77-4093-9d95-89ce8c783a49\") " pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"
Jul 09 23:04:51.328964 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.328798    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d24e9363-9a77-4093-9d95-89ce8c783a49-tls-certs\") pod \"e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z\" (UID: \"d24e9363-9a77-4093-9d95-89ce8c783a49\") " pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"
Jul 09 23:04:51.328964 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.328834    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d24e9363-9a77-4093-9d95-89ce8c783a49-home\") pod \"e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z\" (UID: \"d24e9363-9a77-4093-9d95-89ce8c783a49\") " pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"
Jul 09 23:04:51.329185 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.329137    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d24e9363-9a77-4093-9d95-89ce8c783a49-model-cache\") pod \"e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z\" (UID: \"d24e9363-9a77-4093-9d95-89ce8c783a49\") " pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"
Jul 09 23:04:51.329185 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.329140    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d24e9363-9a77-4093-9d95-89ce8c783a49-tmp-dir\") pod \"e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z\" (UID: \"d24e9363-9a77-4093-9d95-89ce8c783a49\") " pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"
Jul 09 23:04:51.329273 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.329197    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d24e9363-9a77-4093-9d95-89ce8c783a49-home\") pod \"e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z\" (UID: \"d24e9363-9a77-4093-9d95-89ce8c783a49\") " pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"
Jul 09 23:04:51.330908 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.330858    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d24e9363-9a77-4093-9d95-89ce8c783a49-dshm\") pod \"e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z\" (UID: \"d24e9363-9a77-4093-9d95-89ce8c783a49\") " pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"
Jul 09 23:04:51.331361 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.331343    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d24e9363-9a77-4093-9d95-89ce8c783a49-tls-certs\") pod \"e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z\" (UID: \"d24e9363-9a77-4093-9d95-89ce8c783a49\") " pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"
Jul 09 23:04:51.335883 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.335848    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g9tg\" (UniqueName: \"kubernetes.io/projected/d24e9363-9a77-4093-9d95-89ce8c783a49-kube-api-access-7g9tg\") pod \"e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z\" (UID: \"d24e9363-9a77-4093-9d95-89ce8c783a49\") " pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"
Jul 09 23:04:51.389563 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.389530    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"
Jul 09 23:04:51.518378 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.518356    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"]
Jul 09 23:04:51.620666 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.620635    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z" event={"ID":"d24e9363-9a77-4093-9d95-89ce8c783a49","Type":"ContainerStarted","Data":"472eb0a498d672580460008af127987e00433cc75a7f00a56fc959bfa65ba83b"}
Jul 09 23:04:51.620819 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.620680    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z" event={"ID":"d24e9363-9a77-4093-9d95-89ce8c783a49","Type":"ContainerStarted","Data":"15e9c67bab381a27530f738532a04cc59344c84ae277c1e10f8e03a1d392962f"}
Jul 09 23:04:51.638174 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:51.638128    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z" podStartSLOduration=0.638111454 podStartE2EDuration="638.111454ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:04:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:04:51.636827281 +0000 UTC m=+1946.344722864" watchObservedRunningTime="2026-07-09 23:04:51.638111454 +0000 UTC m=+1946.346007041"
Jul 09 23:04:53.723702 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:04:53.723664    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:05:01.389694 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:01.389657    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"
Jul 09 23:05:01.390227 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:01.389721    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"
Jul 09 23:05:01.401968 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:01.401945    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"
Jul 09 23:05:01.677957 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:01.677933    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"
Jul 09 23:05:08.229995 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:08.229961    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:05:21.403301 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:21.403218    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"]
Jul 09 23:05:21.793620 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:21.793585    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:05:36.423283 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.423229    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z" podUID="d24e9363-9a77-4093-9d95-89ce8c783a49" containerName="main" containerID="cri-o://472eb0a498d672580460008af127987e00433cc75a7f00a56fc959bfa65ba83b" gracePeriod=45
Jul 09 23:05:36.668472 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.668450    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"
Jul 09 23:05:36.820568 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.820540    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7g9tg\" (UniqueName: \"kubernetes.io/projected/d24e9363-9a77-4093-9d95-89ce8c783a49-kube-api-access-7g9tg\") pod \"d24e9363-9a77-4093-9d95-89ce8c783a49\" (UID: \"d24e9363-9a77-4093-9d95-89ce8c783a49\") "
Jul 09 23:05:36.820568 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.820568    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d24e9363-9a77-4093-9d95-89ce8c783a49-tls-certs\") pod \"d24e9363-9a77-4093-9d95-89ce8c783a49\" (UID: \"d24e9363-9a77-4093-9d95-89ce8c783a49\") "
Jul 09 23:05:36.820814 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.820592    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d24e9363-9a77-4093-9d95-89ce8c783a49-model-cache\") pod \"d24e9363-9a77-4093-9d95-89ce8c783a49\" (UID: \"d24e9363-9a77-4093-9d95-89ce8c783a49\") "
Jul 09 23:05:36.820814 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.820630    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d24e9363-9a77-4093-9d95-89ce8c783a49-dshm\") pod \"d24e9363-9a77-4093-9d95-89ce8c783a49\" (UID: \"d24e9363-9a77-4093-9d95-89ce8c783a49\") "
Jul 09 23:05:36.820814 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.820663    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d24e9363-9a77-4093-9d95-89ce8c783a49-tmp-dir\") pod \"d24e9363-9a77-4093-9d95-89ce8c783a49\" (UID: \"d24e9363-9a77-4093-9d95-89ce8c783a49\") "
Jul 09 23:05:36.820814 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.820696    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d24e9363-9a77-4093-9d95-89ce8c783a49-home\") pod \"d24e9363-9a77-4093-9d95-89ce8c783a49\" (UID: \"d24e9363-9a77-4093-9d95-89ce8c783a49\") "
Jul 09 23:05:36.821052 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.820899    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d24e9363-9a77-4093-9d95-89ce8c783a49-model-cache" (OuterVolumeSpecName: "model-cache") pod "d24e9363-9a77-4093-9d95-89ce8c783a49" (UID: "d24e9363-9a77-4093-9d95-89ce8c783a49"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:05:36.821052 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.820932    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d24e9363-9a77-4093-9d95-89ce8c783a49-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d24e9363-9a77-4093-9d95-89ce8c783a49" (UID: "d24e9363-9a77-4093-9d95-89ce8c783a49"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:05:36.821052 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.821003    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d24e9363-9a77-4093-9d95-89ce8c783a49-model-cache\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:05:36.821200 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.821114    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d24e9363-9a77-4093-9d95-89ce8c783a49-home" (OuterVolumeSpecName: "home") pod "d24e9363-9a77-4093-9d95-89ce8c783a49" (UID: "d24e9363-9a77-4093-9d95-89ce8c783a49"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:05:36.822969 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.822938    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d24e9363-9a77-4093-9d95-89ce8c783a49-dshm" (OuterVolumeSpecName: "dshm") pod "d24e9363-9a77-4093-9d95-89ce8c783a49" (UID: "d24e9363-9a77-4093-9d95-89ce8c783a49"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:05:36.823083 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.822989    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d24e9363-9a77-4093-9d95-89ce8c783a49-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d24e9363-9a77-4093-9d95-89ce8c783a49" (UID: "d24e9363-9a77-4093-9d95-89ce8c783a49"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 23:05:36.823083 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.823022    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d24e9363-9a77-4093-9d95-89ce8c783a49-kube-api-access-7g9tg" (OuterVolumeSpecName: "kube-api-access-7g9tg") pod "d24e9363-9a77-4093-9d95-89ce8c783a49" (UID: "d24e9363-9a77-4093-9d95-89ce8c783a49"). InnerVolumeSpecName "kube-api-access-7g9tg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:05:36.845088 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.845057    2564 generic.go:356] "Generic (PLEG): container finished" podID="d24e9363-9a77-4093-9d95-89ce8c783a49" containerID="472eb0a498d672580460008af127987e00433cc75a7f00a56fc959bfa65ba83b" exitCode=0
Jul 09 23:05:36.845194 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.845105    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"
Jul 09 23:05:36.845194 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.845112    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z" event={"ID":"d24e9363-9a77-4093-9d95-89ce8c783a49","Type":"ContainerDied","Data":"472eb0a498d672580460008af127987e00433cc75a7f00a56fc959bfa65ba83b"}
Jul 09 23:05:36.845194 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.845150    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z" event={"ID":"d24e9363-9a77-4093-9d95-89ce8c783a49","Type":"ContainerDied","Data":"15e9c67bab381a27530f738532a04cc59344c84ae277c1e10f8e03a1d392962f"}
Jul 09 23:05:36.845194 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.845166    2564 scope.go:117] "RemoveContainer" containerID="472eb0a498d672580460008af127987e00433cc75a7f00a56fc959bfa65ba83b"
Jul 09 23:05:36.853641 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.853627    2564 scope.go:117] "RemoveContainer" containerID="472eb0a498d672580460008af127987e00433cc75a7f00a56fc959bfa65ba83b"
Jul 09 23:05:36.853945 ip-10-0-142-84 kubenswrapper[2564]: E0709 23:05:36.853927    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"472eb0a498d672580460008af127987e00433cc75a7f00a56fc959bfa65ba83b\": container with ID starting with 472eb0a498d672580460008af127987e00433cc75a7f00a56fc959bfa65ba83b not found: ID does not exist" containerID="472eb0a498d672580460008af127987e00433cc75a7f00a56fc959bfa65ba83b"
Jul 09 23:05:36.854010 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.853952    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"472eb0a498d672580460008af127987e00433cc75a7f00a56fc959bfa65ba83b"} err="failed to get container status \"472eb0a498d672580460008af127987e00433cc75a7f00a56fc959bfa65ba83b\": rpc error: code = NotFound desc = could not find container \"472eb0a498d672580460008af127987e00433cc75a7f00a56fc959bfa65ba83b\": container with ID starting with 472eb0a498d672580460008af127987e00433cc75a7f00a56fc959bfa65ba83b not found: ID does not exist"
Jul 09 23:05:36.863794 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.863775    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"]
Jul 09 23:05:36.869422 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.869401    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-4e2b27a4/e2e-lifecycle-model-4e2b27a4-kserve-54f48b9bd7-nmt7z"]
Jul 09 23:05:36.922266 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.922241    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7g9tg\" (UniqueName: \"kubernetes.io/projected/d24e9363-9a77-4093-9d95-89ce8c783a49-kube-api-access-7g9tg\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:05:36.922266 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.922262    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d24e9363-9a77-4093-9d95-89ce8c783a49-tls-certs\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:05:36.922397 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.922278    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d24e9363-9a77-4093-9d95-89ce8c783a49-dshm\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:05:36.922397 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.922289    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d24e9363-9a77-4093-9d95-89ce8c783a49-tmp-dir\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:05:36.922397 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:36.922299    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d24e9363-9a77-4093-9d95-89ce8c783a49-home\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:05:37.965685 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:05:37.965651    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d24e9363-9a77-4093-9d95-89ce8c783a49" path="/var/lib/kubelet/pods/d24e9363-9a77-4093-9d95-89ce8c783a49/volumes"
Jul 09 23:06:00.728847 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:06:00.728811    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:06:10.125136 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:06:10.125102    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:06:21.222167 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:06:21.222136    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:07:09.323853 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:09.323821    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:07:20.022988 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:20.022961    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:07:21.877167 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:21.877124    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"]
Jul 09 23:07:21.877705 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:21.877686    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d24e9363-9a77-4093-9d95-89ce8c783a49" containerName="main"
Jul 09 23:07:21.877801 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:21.877707    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d24e9363-9a77-4093-9d95-89ce8c783a49" containerName="main"
Jul 09 23:07:21.877859 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:21.877831    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d24e9363-9a77-4093-9d95-89ce8c783a49" containerName="main"
Jul 09 23:07:21.881333 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:21.881309    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"
Jul 09 23:07:21.883484 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:21.883451    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ed9500\"/\"openshift-service-ca.crt\""
Jul 09 23:07:21.883484 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:21.883466    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ed9500\"/\"kube-root-ca.crt\""
Jul 09 23:07:21.884086 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:21.884070    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ed9500\"/\"test-model-ed9500-kserve-self-signed-certs\""
Jul 09 23:07:21.884086 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:21.884083    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ed9500\"/\"default-dockercfg-zfmvn\""
Jul 09 23:07:21.890694 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:21.890669    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"]
Jul 09 23:07:21.945619 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:21.945586    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-tls-certs\") pod \"test-model-ed9500-kserve-8657589f4c-zp5zr\" (UID: \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\") " pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"
Jul 09 23:07:21.945748 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:21.945640    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-model-cache\") pod \"test-model-ed9500-kserve-8657589f4c-zp5zr\" (UID: \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\") " pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"
Jul 09 23:07:21.945748 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:21.945683    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-tmp-dir\") pod \"test-model-ed9500-kserve-8657589f4c-zp5zr\" (UID: \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\") " pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"
Jul 09 23:07:21.945748 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:21.945706    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrprd\" (UniqueName: \"kubernetes.io/projected/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-kube-api-access-nrprd\") pod \"test-model-ed9500-kserve-8657589f4c-zp5zr\" (UID: \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\") " pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"
Jul 09 23:07:21.945748 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:21.945732    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-home\") pod \"test-model-ed9500-kserve-8657589f4c-zp5zr\" (UID: \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\") " pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"
Jul 09 23:07:21.945943 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:21.945764    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-dshm\") pod \"test-model-ed9500-kserve-8657589f4c-zp5zr\" (UID: \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\") " pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"
Jul 09 23:07:22.046888 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:22.046852    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-model-cache\") pod \"test-model-ed9500-kserve-8657589f4c-zp5zr\" (UID: \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\") " pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"
Jul 09 23:07:22.047054 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:22.046898    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-tmp-dir\") pod \"test-model-ed9500-kserve-8657589f4c-zp5zr\" (UID: \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\") " pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"
Jul 09 23:07:22.047054 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:22.046922    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrprd\" (UniqueName: \"kubernetes.io/projected/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-kube-api-access-nrprd\") pod \"test-model-ed9500-kserve-8657589f4c-zp5zr\" (UID: \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\") " pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"
Jul 09 23:07:22.047054 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:22.046965    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-home\") pod \"test-model-ed9500-kserve-8657589f4c-zp5zr\" (UID: \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\") " pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"
Jul 09 23:07:22.047054 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:22.047009    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-dshm\") pod \"test-model-ed9500-kserve-8657589f4c-zp5zr\" (UID: \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\") " pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"
Jul 09 23:07:22.047268 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:22.047076    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-tls-certs\") pod \"test-model-ed9500-kserve-8657589f4c-zp5zr\" (UID: \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\") " pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"
Jul 09 23:07:22.047268 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:22.047258    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-model-cache\") pod \"test-model-ed9500-kserve-8657589f4c-zp5zr\" (UID: \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\") " pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"
Jul 09 23:07:22.047386 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:22.047363    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-tmp-dir\") pod \"test-model-ed9500-kserve-8657589f4c-zp5zr\" (UID: \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\") " pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"
Jul 09 23:07:22.047481 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:22.047465    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-home\") pod \"test-model-ed9500-kserve-8657589f4c-zp5zr\" (UID: \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\") " pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"
Jul 09 23:07:22.049258 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:22.049238    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-dshm\") pod \"test-model-ed9500-kserve-8657589f4c-zp5zr\" (UID: \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\") " pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"
Jul 09 23:07:22.049466 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:22.049448    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-tls-certs\") pod \"test-model-ed9500-kserve-8657589f4c-zp5zr\" (UID: \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\") " pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"
Jul 09 23:07:22.054294 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:22.054271    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrprd\" (UniqueName: \"kubernetes.io/projected/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-kube-api-access-nrprd\") pod \"test-model-ed9500-kserve-8657589f4c-zp5zr\" (UID: \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\") " pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"
Jul 09 23:07:22.191738 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:22.191707    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"
Jul 09 23:07:22.324239 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:22.324044    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"]
Jul 09 23:07:22.326654 ip-10-0-142-84 kubenswrapper[2564]: W0709 23:07:22.326627    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb2e8fae_9502_4cd2_a9c8_b9b579f14ee8.slice/crio-7c9922c0d23fe75b73bb484dfe70744fe974f2fb78b79309af2ea59d55f16159 WatchSource:0}: Error finding container 7c9922c0d23fe75b73bb484dfe70744fe974f2fb78b79309af2ea59d55f16159: Status 404 returned error can't find the container with id 7c9922c0d23fe75b73bb484dfe70744fe974f2fb78b79309af2ea59d55f16159
Jul 09 23:07:22.350925 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:22.350894    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr" event={"ID":"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8","Type":"ContainerStarted","Data":"7c9922c0d23fe75b73bb484dfe70744fe974f2fb78b79309af2ea59d55f16159"}
Jul 09 23:07:23.357508 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:23.357471    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr" event={"ID":"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8","Type":"ContainerStarted","Data":"dd9c4145264b9fff256f3c737d3b2c6392aea8cc6f8f613bef8a926aeb969e2d"}
Jul 09 23:07:23.373172 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:23.373128    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr" podStartSLOduration=2.37311364 podStartE2EDuration="2.37311364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:07:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:07:23.371413646 +0000 UTC m=+2098.079309234" watchObservedRunningTime="2026-07-09 23:07:23.37311364 +0000 UTC m=+2098.081009227"
Jul 09 23:07:25.901011 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:25.900978    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-v29jg_fb564a11-973b-40db-ac7b-a20e2e4bf01d/console-operator/1.log"
Jul 09 23:07:25.906015 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:25.905990    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-v29jg_fb564a11-973b-40db-ac7b-a20e2e4bf01d/console-operator/1.log"
Jul 09 23:07:31.430588 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:31.430558    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:07:32.191987 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:32.191947    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"
Jul 09 23:07:32.192165 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:32.192004    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"
Jul 09 23:07:32.204454 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:32.204430    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"
Jul 09 23:07:32.416323 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:32.416291    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"
Jul 09 23:07:55.886542 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:55.886511    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"]
Jul 09 23:07:55.890172 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:55.890155    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"
Jul 09 23:07:55.892719 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:55.892697    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ceba72\"/\"test-model-ceba72-kserve-self-signed-certs\""
Jul 09 23:07:55.892855 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:55.892708    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ceba72\"/\"openshift-service-ca.crt\""
Jul 09 23:07:55.892855 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:55.892713    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ceba72\"/\"kube-root-ca.crt\""
Jul 09 23:07:55.892976 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:55.892713    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ceba72\"/\"default-dockercfg-p28rl\""
Jul 09 23:07:55.898694 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:55.898671    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"]
Jul 09 23:07:56.049213 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:56.049174    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-home\") pod \"test-model-ceba72-kserve-5576d7c95c-src49\" (UID: \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\") " pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"
Jul 09 23:07:56.049417 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:56.049228    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-model-cache\") pod \"test-model-ceba72-kserve-5576d7c95c-src49\" (UID: \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\") " pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"
Jul 09 23:07:56.049417 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:56.049310    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-tls-certs\") pod \"test-model-ceba72-kserve-5576d7c95c-src49\" (UID: \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\") " pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"
Jul 09 23:07:56.049417 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:56.049349    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-dshm\") pod \"test-model-ceba72-kserve-5576d7c95c-src49\" (UID: \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\") " pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"
Jul 09 23:07:56.049417 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:56.049372    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsgqh\" (UniqueName: \"kubernetes.io/projected/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-kube-api-access-jsgqh\") pod \"test-model-ceba72-kserve-5576d7c95c-src49\" (UID: \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\") " pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"
Jul 09 23:07:56.049596 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:56.049434    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-tmp-dir\") pod \"test-model-ceba72-kserve-5576d7c95c-src49\" (UID: \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\") " pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"
Jul 09 23:07:56.150707 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:56.150618    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-tls-certs\") pod \"test-model-ceba72-kserve-5576d7c95c-src49\" (UID: \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\") " pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"
Jul 09 23:07:56.150707 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:56.150662    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-dshm\") pod \"test-model-ceba72-kserve-5576d7c95c-src49\" (UID: \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\") " pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"
Jul 09 23:07:56.150707 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:56.150686    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsgqh\" (UniqueName: \"kubernetes.io/projected/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-kube-api-access-jsgqh\") pod \"test-model-ceba72-kserve-5576d7c95c-src49\" (UID: \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\") " pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"
Jul 09 23:07:56.151043 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:56.150748    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-tmp-dir\") pod \"test-model-ceba72-kserve-5576d7c95c-src49\" (UID: \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\") " pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"
Jul 09 23:07:56.151043 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:56.150777    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-home\") pod \"test-model-ceba72-kserve-5576d7c95c-src49\" (UID: \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\") " pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"
Jul 09 23:07:56.151043 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:56.150815    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-model-cache\") pod \"test-model-ceba72-kserve-5576d7c95c-src49\" (UID: \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\") " pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"
Jul 09 23:07:56.151201 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:56.151157    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-tmp-dir\") pod \"test-model-ceba72-kserve-5576d7c95c-src49\" (UID: \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\") " pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"
Jul 09 23:07:56.151201 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:56.151177    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-home\") pod \"test-model-ceba72-kserve-5576d7c95c-src49\" (UID: \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\") " pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"
Jul 09 23:07:56.151304 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:56.151237    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-model-cache\") pod \"test-model-ceba72-kserve-5576d7c95c-src49\" (UID: \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\") " pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"
Jul 09 23:07:56.153471 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:56.153447    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-dshm\") pod \"test-model-ceba72-kserve-5576d7c95c-src49\" (UID: \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\") " pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"
Jul 09 23:07:56.153711 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:56.153696    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-tls-certs\") pod \"test-model-ceba72-kserve-5576d7c95c-src49\" (UID: \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\") " pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"
Jul 09 23:07:56.158471 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:56.158454    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsgqh\" (UniqueName: \"kubernetes.io/projected/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-kube-api-access-jsgqh\") pod \"test-model-ceba72-kserve-5576d7c95c-src49\" (UID: \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\") " pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"
Jul 09 23:07:56.200716 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:56.200689    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"
Jul 09 23:07:56.338067 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:56.338044    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"]
Jul 09 23:07:56.340377 ip-10-0-142-84 kubenswrapper[2564]: W0709 23:07:56.340350    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea100777_b3a8_4d6a_8ce0_8550ff0aba73.slice/crio-ba246f62cfbc65d334548bf089f4581c2f5dfc27e62dcb5614aad9fa84196bf8 WatchSource:0}: Error finding container ba246f62cfbc65d334548bf089f4581c2f5dfc27e62dcb5614aad9fa84196bf8: Status 404 returned error can't find the container with id ba246f62cfbc65d334548bf089f4581c2f5dfc27e62dcb5614aad9fa84196bf8
Jul 09 23:07:56.521032 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:56.520993    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49" event={"ID":"ea100777-b3a8-4d6a-8ce0-8550ff0aba73","Type":"ContainerStarted","Data":"eeb58b417d8538f2655300a96aa0d34e4d420b68d4df41a2d4b58e3ddb01a000"}
Jul 09 23:07:56.521199 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:56.521047    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49" event={"ID":"ea100777-b3a8-4d6a-8ce0-8550ff0aba73","Type":"ContainerStarted","Data":"ba246f62cfbc65d334548bf089f4581c2f5dfc27e62dcb5614aad9fa84196bf8"}
Jul 09 23:07:56.535090 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:07:56.535046    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49" podStartSLOduration=1.535025774 podStartE2EDuration="1.535025774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:07:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:07:56.534577759 +0000 UTC m=+2131.242473346" watchObservedRunningTime="2026-07-09 23:07:56.535025774 +0000 UTC m=+2131.242921361"
Jul 09 23:08:01.119170 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:01.119134    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:08:06.201352 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:06.201313    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"
Jul 09 23:08:06.201809 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:06.201388    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"
Jul 09 23:08:06.214221 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:06.214192    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"
Jul 09 23:08:06.579086 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:06.579007    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"
Jul 09 23:08:18.432700 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:18.432628    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"]
Jul 09 23:08:19.361435 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:19.361405    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"]
Jul 09 23:08:25.325591 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:25.325555    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:08:33.452754 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.452693    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr" podUID="bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8" containerName="main" containerID="cri-o://dd9c4145264b9fff256f3c737d3b2c6392aea8cc6f8f613bef8a926aeb969e2d" gracePeriod=45
Jul 09 23:08:33.698364 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.698329    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"
Jul 09 23:08:33.706018 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.705960    2564 generic.go:356] "Generic (PLEG): container finished" podID="bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8" containerID="dd9c4145264b9fff256f3c737d3b2c6392aea8cc6f8f613bef8a926aeb969e2d" exitCode=0
Jul 09 23:08:33.706018 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.705991    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"
Jul 09 23:08:33.706148 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.706037    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr" event={"ID":"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8","Type":"ContainerDied","Data":"dd9c4145264b9fff256f3c737d3b2c6392aea8cc6f8f613bef8a926aeb969e2d"}
Jul 09 23:08:33.706148 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.706077    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr" event={"ID":"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8","Type":"ContainerDied","Data":"7c9922c0d23fe75b73bb484dfe70744fe974f2fb78b79309af2ea59d55f16159"}
Jul 09 23:08:33.706148 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.706095    2564 scope.go:117] "RemoveContainer" containerID="dd9c4145264b9fff256f3c737d3b2c6392aea8cc6f8f613bef8a926aeb969e2d"
Jul 09 23:08:33.714206 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.714189    2564 scope.go:117] "RemoveContainer" containerID="dd9c4145264b9fff256f3c737d3b2c6392aea8cc6f8f613bef8a926aeb969e2d"
Jul 09 23:08:33.714471 ip-10-0-142-84 kubenswrapper[2564]: E0709 23:08:33.714453    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd9c4145264b9fff256f3c737d3b2c6392aea8cc6f8f613bef8a926aeb969e2d\": container with ID starting with dd9c4145264b9fff256f3c737d3b2c6392aea8cc6f8f613bef8a926aeb969e2d not found: ID does not exist" containerID="dd9c4145264b9fff256f3c737d3b2c6392aea8cc6f8f613bef8a926aeb969e2d"
Jul 09 23:08:33.714534 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.714480    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd9c4145264b9fff256f3c737d3b2c6392aea8cc6f8f613bef8a926aeb969e2d"} err="failed to get container status \"dd9c4145264b9fff256f3c737d3b2c6392aea8cc6f8f613bef8a926aeb969e2d\": rpc error: code = NotFound desc = could not find container \"dd9c4145264b9fff256f3c737d3b2c6392aea8cc6f8f613bef8a926aeb969e2d\": container with ID starting with dd9c4145264b9fff256f3c737d3b2c6392aea8cc6f8f613bef8a926aeb969e2d not found: ID does not exist"
Jul 09 23:08:33.787818 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.787791    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-home\") pod \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\" (UID: \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\") "
Jul 09 23:08:33.788013 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.787860    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-dshm\") pod \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\" (UID: \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\") "
Jul 09 23:08:33.788013 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.787935    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-tmp-dir\") pod \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\" (UID: \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\") "
Jul 09 23:08:33.788013 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.787965    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrprd\" (UniqueName: \"kubernetes.io/projected/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-kube-api-access-nrprd\") pod \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\" (UID: \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\") "
Jul 09 23:08:33.788182 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.788029    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-model-cache\") pod \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\" (UID: \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\") "
Jul 09 23:08:33.788182 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.788038    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-home" (OuterVolumeSpecName: "home") pod "bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8" (UID: "bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:08:33.788182 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.788064    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-tls-certs\") pod \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\" (UID: \"bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8\") "
Jul 09 23:08:33.788340 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.788173    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8" (UID: "bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:08:33.788340 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.788252    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-model-cache" (OuterVolumeSpecName: "model-cache") pod "bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8" (UID: "bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:08:33.788453 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.788404    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-home\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:08:33.788453 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.788424    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-tmp-dir\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:08:33.788453 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.788435    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-model-cache\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:08:33.790123 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.790099    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-dshm" (OuterVolumeSpecName: "dshm") pod "bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8" (UID: "bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:08:33.790237 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.790192    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-kube-api-access-nrprd" (OuterVolumeSpecName: "kube-api-access-nrprd") pod "bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8" (UID: "bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8"). InnerVolumeSpecName "kube-api-access-nrprd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:08:33.790278 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.790247    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8" (UID: "bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 23:08:33.889811 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.889779    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-dshm\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:08:33.889811 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.889803    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrprd\" (UniqueName: \"kubernetes.io/projected/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-kube-api-access-nrprd\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:08:33.889811 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:33.889814    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8-tls-certs\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:08:34.020053 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.020024    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"]
Jul 09 23:08:34.025340 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.025317    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-ed9500/test-model-ed9500-kserve-8657589f4c-zp5zr"]
Jul 09 23:08:34.382544 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.382452    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49" podUID="ea100777-b3a8-4d6a-8ce0-8550ff0aba73" containerName="main" containerID="cri-o://eeb58b417d8538f2655300a96aa0d34e4d420b68d4df41a2d4b58e3ddb01a000" gracePeriod=45
Jul 09 23:08:34.631607 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.631582    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"
Jul 09 23:08:34.696437 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.696406    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-dshm\") pod \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\" (UID: \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\") "
Jul 09 23:08:34.696617 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.696448    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-tls-certs\") pod \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\" (UID: \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\") "
Jul 09 23:08:34.696617 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.696499    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-home\") pod \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\" (UID: \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\") "
Jul 09 23:08:34.696617 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.696544    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-model-cache\") pod \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\" (UID: \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\") "
Jul 09 23:08:34.696617 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.696566    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsgqh\" (UniqueName: \"kubernetes.io/projected/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-kube-api-access-jsgqh\") pod \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\" (UID: \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\") "
Jul 09 23:08:34.696617 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.696588    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-tmp-dir\") pod \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\" (UID: \"ea100777-b3a8-4d6a-8ce0-8550ff0aba73\") "
Jul 09 23:08:34.696925 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.696791    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-home" (OuterVolumeSpecName: "home") pod "ea100777-b3a8-4d6a-8ce0-8550ff0aba73" (UID: "ea100777-b3a8-4d6a-8ce0-8550ff0aba73"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:08:34.696925 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.696803    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-model-cache" (OuterVolumeSpecName: "model-cache") pod "ea100777-b3a8-4d6a-8ce0-8550ff0aba73" (UID: "ea100777-b3a8-4d6a-8ce0-8550ff0aba73"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:08:34.696925 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.696921    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ea100777-b3a8-4d6a-8ce0-8550ff0aba73" (UID: "ea100777-b3a8-4d6a-8ce0-8550ff0aba73"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:08:34.698657 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.698631    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-dshm" (OuterVolumeSpecName: "dshm") pod "ea100777-b3a8-4d6a-8ce0-8550ff0aba73" (UID: "ea100777-b3a8-4d6a-8ce0-8550ff0aba73"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:08:34.698754 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.698695    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ea100777-b3a8-4d6a-8ce0-8550ff0aba73" (UID: "ea100777-b3a8-4d6a-8ce0-8550ff0aba73"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 23:08:34.698754 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.698709    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-kube-api-access-jsgqh" (OuterVolumeSpecName: "kube-api-access-jsgqh") pod "ea100777-b3a8-4d6a-8ce0-8550ff0aba73" (UID: "ea100777-b3a8-4d6a-8ce0-8550ff0aba73"). InnerVolumeSpecName "kube-api-access-jsgqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:08:34.713008 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.712982    2564 generic.go:356] "Generic (PLEG): container finished" podID="ea100777-b3a8-4d6a-8ce0-8550ff0aba73" containerID="eeb58b417d8538f2655300a96aa0d34e4d420b68d4df41a2d4b58e3ddb01a000" exitCode=0
Jul 09 23:08:34.713156 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.713022    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"
Jul 09 23:08:34.713156 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.713059    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49" event={"ID":"ea100777-b3a8-4d6a-8ce0-8550ff0aba73","Type":"ContainerDied","Data":"eeb58b417d8538f2655300a96aa0d34e4d420b68d4df41a2d4b58e3ddb01a000"}
Jul 09 23:08:34.713156 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.713116    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49" event={"ID":"ea100777-b3a8-4d6a-8ce0-8550ff0aba73","Type":"ContainerDied","Data":"ba246f62cfbc65d334548bf089f4581c2f5dfc27e62dcb5614aad9fa84196bf8"}
Jul 09 23:08:34.713156 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.713138    2564 scope.go:117] "RemoveContainer" containerID="eeb58b417d8538f2655300a96aa0d34e4d420b68d4df41a2d4b58e3ddb01a000"
Jul 09 23:08:34.721789 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.721774    2564 scope.go:117] "RemoveContainer" containerID="eeb58b417d8538f2655300a96aa0d34e4d420b68d4df41a2d4b58e3ddb01a000"
Jul 09 23:08:34.722053 ip-10-0-142-84 kubenswrapper[2564]: E0709 23:08:34.722033    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eeb58b417d8538f2655300a96aa0d34e4d420b68d4df41a2d4b58e3ddb01a000\": container with ID starting with eeb58b417d8538f2655300a96aa0d34e4d420b68d4df41a2d4b58e3ddb01a000 not found: ID does not exist" containerID="eeb58b417d8538f2655300a96aa0d34e4d420b68d4df41a2d4b58e3ddb01a000"
Jul 09 23:08:34.722100 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.722061    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeb58b417d8538f2655300a96aa0d34e4d420b68d4df41a2d4b58e3ddb01a000"} err="failed to get container status \"eeb58b417d8538f2655300a96aa0d34e4d420b68d4df41a2d4b58e3ddb01a000\": rpc error: code = NotFound desc = could not find container \"eeb58b417d8538f2655300a96aa0d34e4d420b68d4df41a2d4b58e3ddb01a000\": container with ID starting with eeb58b417d8538f2655300a96aa0d34e4d420b68d4df41a2d4b58e3ddb01a000 not found: ID does not exist"
Jul 09 23:08:34.731532 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.731513    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"]
Jul 09 23:08:34.733802 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.733780    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-ceba72/test-model-ceba72-kserve-5576d7c95c-src49"]
Jul 09 23:08:34.797827 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.797797    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsgqh\" (UniqueName: \"kubernetes.io/projected/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-kube-api-access-jsgqh\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:08:34.797827 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.797823    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-tmp-dir\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:08:34.798056 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.797837    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-dshm\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:08:34.798056 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.797850    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-tls-certs\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:08:34.798056 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.797860    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-home\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:08:34.798056 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:34.797896    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea100777-b3a8-4d6a-8ce0-8550ff0aba73-model-cache\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:08:35.966062 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:35.966032    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8" path="/var/lib/kubelet/pods/bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8/volumes"
Jul 09 23:08:35.966433 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:08:35.966409    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea100777-b3a8-4d6a-8ce0-8550ff0aba73" path="/var/lib/kubelet/pods/ea100777-b3a8-4d6a-8ce0-8550ff0aba73/volumes"
Jul 09 23:09:06.127051 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:09:06.127009    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:09:20.823061 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:09:20.823025    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:09:32.629107 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:09:32.629065    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:09:45.027070 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:09:45.027037    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:09:59.031666 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:09:59.031626    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:10:09.926980 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:09.926950    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:10:20.571815 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.571781    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"]
Jul 09 23:10:20.572331 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.572226    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8" containerName="main"
Jul 09 23:10:20.572331 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.572238    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8" containerName="main"
Jul 09 23:10:20.572331 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.572246    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea100777-b3a8-4d6a-8ce0-8550ff0aba73" containerName="main"
Jul 09 23:10:20.572331 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.572251    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea100777-b3a8-4d6a-8ce0-8550ff0aba73" containerName="main"
Jul 09 23:10:20.572331 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.572303    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb2e8fae-9502-4cd2-a9c8-b9b579f14ee8" containerName="main"
Jul 09 23:10:20.572331 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.572312    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea100777-b3a8-4d6a-8ce0-8550ff0aba73" containerName="main"
Jul 09 23:10:20.575407 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.575390    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"
Jul 09 23:10:20.578106 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.578071    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-566ef9\"/\"default-dockercfg-9xdfj\""
Jul 09 23:10:20.578106 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.578082    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-566ef9\"/\"openshift-service-ca.crt\""
Jul 09 23:10:20.578303 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.578089    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-566ef9\"/\"kube-root-ca.crt\""
Jul 09 23:10:20.578303 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.578140    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-566ef9\"/\"auth-test-model-566ef9-kserve-self-signed-certs\""
Jul 09 23:10:20.585364 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.585346    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"]
Jul 09 23:10:20.715285 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.715251    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4d31b73-9e53-4983-8ea8-91286614e615-dshm\") pod \"auth-test-model-566ef9-kserve-77f856dd7f-g5z7n\" (UID: \"f4d31b73-9e53-4983-8ea8-91286614e615\") " pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"
Jul 09 23:10:20.715458 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.715293    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4d31b73-9e53-4983-8ea8-91286614e615-model-cache\") pod \"auth-test-model-566ef9-kserve-77f856dd7f-g5z7n\" (UID: \"f4d31b73-9e53-4983-8ea8-91286614e615\") " pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"
Jul 09 23:10:20.715458 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.715320    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4d31b73-9e53-4983-8ea8-91286614e615-home\") pod \"auth-test-model-566ef9-kserve-77f856dd7f-g5z7n\" (UID: \"f4d31b73-9e53-4983-8ea8-91286614e615\") " pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"
Jul 09 23:10:20.715458 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.715335    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4d31b73-9e53-4983-8ea8-91286614e615-tmp-dir\") pod \"auth-test-model-566ef9-kserve-77f856dd7f-g5z7n\" (UID: \"f4d31b73-9e53-4983-8ea8-91286614e615\") " pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"
Jul 09 23:10:20.715458 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.715366    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5x74\" (UniqueName: \"kubernetes.io/projected/f4d31b73-9e53-4983-8ea8-91286614e615-kube-api-access-w5x74\") pod \"auth-test-model-566ef9-kserve-77f856dd7f-g5z7n\" (UID: \"f4d31b73-9e53-4983-8ea8-91286614e615\") " pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"
Jul 09 23:10:20.715458 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.715431    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4d31b73-9e53-4983-8ea8-91286614e615-tls-certs\") pod \"auth-test-model-566ef9-kserve-77f856dd7f-g5z7n\" (UID: \"f4d31b73-9e53-4983-8ea8-91286614e615\") " pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"
Jul 09 23:10:20.823195 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.823092    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4d31b73-9e53-4983-8ea8-91286614e615-tls-certs\") pod \"auth-test-model-566ef9-kserve-77f856dd7f-g5z7n\" (UID: \"f4d31b73-9e53-4983-8ea8-91286614e615\") " pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"
Jul 09 23:10:20.823364 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.823251    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4d31b73-9e53-4983-8ea8-91286614e615-dshm\") pod \"auth-test-model-566ef9-kserve-77f856dd7f-g5z7n\" (UID: \"f4d31b73-9e53-4983-8ea8-91286614e615\") " pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"
Jul 09 23:10:20.823481 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.823460    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4d31b73-9e53-4983-8ea8-91286614e615-model-cache\") pod \"auth-test-model-566ef9-kserve-77f856dd7f-g5z7n\" (UID: \"f4d31b73-9e53-4983-8ea8-91286614e615\") " pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"
Jul 09 23:10:20.823520 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.823505    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4d31b73-9e53-4983-8ea8-91286614e615-home\") pod \"auth-test-model-566ef9-kserve-77f856dd7f-g5z7n\" (UID: \"f4d31b73-9e53-4983-8ea8-91286614e615\") " pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"
Jul 09 23:10:20.823561 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.823521    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4d31b73-9e53-4983-8ea8-91286614e615-tmp-dir\") pod \"auth-test-model-566ef9-kserve-77f856dd7f-g5z7n\" (UID: \"f4d31b73-9e53-4983-8ea8-91286614e615\") " pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"
Jul 09 23:10:20.823561 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.823543    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5x74\" (UniqueName: \"kubernetes.io/projected/f4d31b73-9e53-4983-8ea8-91286614e615-kube-api-access-w5x74\") pod \"auth-test-model-566ef9-kserve-77f856dd7f-g5z7n\" (UID: \"f4d31b73-9e53-4983-8ea8-91286614e615\") " pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"
Jul 09 23:10:20.824077 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.824053    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4d31b73-9e53-4983-8ea8-91286614e615-model-cache\") pod \"auth-test-model-566ef9-kserve-77f856dd7f-g5z7n\" (UID: \"f4d31b73-9e53-4983-8ea8-91286614e615\") " pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"
Jul 09 23:10:20.824207 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.824111    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4d31b73-9e53-4983-8ea8-91286614e615-home\") pod \"auth-test-model-566ef9-kserve-77f856dd7f-g5z7n\" (UID: \"f4d31b73-9e53-4983-8ea8-91286614e615\") " pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"
Jul 09 23:10:20.824207 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.824153    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4d31b73-9e53-4983-8ea8-91286614e615-tmp-dir\") pod \"auth-test-model-566ef9-kserve-77f856dd7f-g5z7n\" (UID: \"f4d31b73-9e53-4983-8ea8-91286614e615\") " pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"
Jul 09 23:10:20.825761 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.825742    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4d31b73-9e53-4983-8ea8-91286614e615-dshm\") pod \"auth-test-model-566ef9-kserve-77f856dd7f-g5z7n\" (UID: \"f4d31b73-9e53-4983-8ea8-91286614e615\") " pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"
Jul 09 23:10:20.825945 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.825928    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4d31b73-9e53-4983-8ea8-91286614e615-tls-certs\") pod \"auth-test-model-566ef9-kserve-77f856dd7f-g5z7n\" (UID: \"f4d31b73-9e53-4983-8ea8-91286614e615\") " pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"
Jul 09 23:10:20.831526 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.831498    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5x74\" (UniqueName: \"kubernetes.io/projected/f4d31b73-9e53-4983-8ea8-91286614e615-kube-api-access-w5x74\") pod \"auth-test-model-566ef9-kserve-77f856dd7f-g5z7n\" (UID: \"f4d31b73-9e53-4983-8ea8-91286614e615\") " pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"
Jul 09 23:10:20.885600 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:20.885572    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"
Jul 09 23:10:21.015223 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:21.015199    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"]
Jul 09 23:10:21.017136 ip-10-0-142-84 kubenswrapper[2564]: W0709 23:10:21.017104    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4d31b73_9e53_4983_8ea8_91286614e615.slice/crio-5792e2719cab447dce99e09caae394e98a9f7cfe56c785a993ade7593dab46c1 WatchSource:0}: Error finding container 5792e2719cab447dce99e09caae394e98a9f7cfe56c785a993ade7593dab46c1: Status 404 returned error can't find the container with id 5792e2719cab447dce99e09caae394e98a9f7cfe56c785a993ade7593dab46c1
Jul 09 23:10:21.216176 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:21.216135    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n" event={"ID":"f4d31b73-9e53-4983-8ea8-91286614e615","Type":"ContainerStarted","Data":"c84aaa57d1bd25928fdd1c4bfb75f16fe44c1afdc605ce4b6c9317fcf0ce78e5"}
Jul 09 23:10:21.216176 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:21.216175    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n" event={"ID":"f4d31b73-9e53-4983-8ea8-91286614e615","Type":"ContainerStarted","Data":"5792e2719cab447dce99e09caae394e98a9f7cfe56c785a993ade7593dab46c1"}
Jul 09 23:10:21.233182 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:21.233131    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n" podStartSLOduration=1.233117065 podStartE2EDuration="1.233117065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:10:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:10:21.231494272 +0000 UTC m=+2275.939389860" watchObservedRunningTime="2026-07-09 23:10:21.233117065 +0000 UTC m=+2275.941012701"
Jul 09 23:10:24.236392 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:24.236362    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:10:30.886065 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:30.886029    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"
Jul 09 23:10:30.886479 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:30.886081    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"
Jul 09 23:10:30.898603 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:30.898573    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"
Jul 09 23:10:31.272206 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:31.272179    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"
Jul 09 23:10:50.681738 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:50.681706    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"]
Jul 09 23:10:50.685151 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:50.685132    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"
Jul 09 23:10:50.687359 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:50.687339    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-57ed9c\"/\"kube-root-ca.crt\""
Jul 09 23:10:50.688018 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:50.688003    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-57ed9c\"/\"auth-test-model-57ed9c-kserve-self-signed-certs\""
Jul 09 23:10:50.688107 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:50.688091    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-57ed9c\"/\"default-dockercfg-65m8c\""
Jul 09 23:10:50.688408 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:50.688097    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-57ed9c\"/\"openshift-service-ca.crt\""
Jul 09 23:10:50.694963 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:50.694942    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"]
Jul 09 23:10:50.769223 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:50.769191    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de024e99-260e-4401-ae6d-b67293200ef0-model-cache\") pod \"auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h\" (UID: \"de024e99-260e-4401-ae6d-b67293200ef0\") " pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"
Jul 09 23:10:50.769384 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:50.769241    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de024e99-260e-4401-ae6d-b67293200ef0-dshm\") pod \"auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h\" (UID: \"de024e99-260e-4401-ae6d-b67293200ef0\") " pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"
Jul 09 23:10:50.769384 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:50.769266    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de024e99-260e-4401-ae6d-b67293200ef0-tls-certs\") pod \"auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h\" (UID: \"de024e99-260e-4401-ae6d-b67293200ef0\") " pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"
Jul 09 23:10:50.769384 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:50.769331    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlqhk\" (UniqueName: \"kubernetes.io/projected/de024e99-260e-4401-ae6d-b67293200ef0-kube-api-access-mlqhk\") pod \"auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h\" (UID: \"de024e99-260e-4401-ae6d-b67293200ef0\") " pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"
Jul 09 23:10:50.769384 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:50.769352    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de024e99-260e-4401-ae6d-b67293200ef0-tmp-dir\") pod \"auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h\" (UID: \"de024e99-260e-4401-ae6d-b67293200ef0\") " pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"
Jul 09 23:10:50.769384 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:50.769377    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de024e99-260e-4401-ae6d-b67293200ef0-home\") pod \"auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h\" (UID: \"de024e99-260e-4401-ae6d-b67293200ef0\") " pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"
Jul 09 23:10:50.870885 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:50.870830    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlqhk\" (UniqueName: \"kubernetes.io/projected/de024e99-260e-4401-ae6d-b67293200ef0-kube-api-access-mlqhk\") pod \"auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h\" (UID: \"de024e99-260e-4401-ae6d-b67293200ef0\") " pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"
Jul 09 23:10:50.871092 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:50.870976    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de024e99-260e-4401-ae6d-b67293200ef0-tmp-dir\") pod \"auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h\" (UID: \"de024e99-260e-4401-ae6d-b67293200ef0\") " pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"
Jul 09 23:10:50.871092 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:50.871015    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de024e99-260e-4401-ae6d-b67293200ef0-home\") pod \"auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h\" (UID: \"de024e99-260e-4401-ae6d-b67293200ef0\") " pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"
Jul 09 23:10:50.871212 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:50.871101    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de024e99-260e-4401-ae6d-b67293200ef0-model-cache\") pod \"auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h\" (UID: \"de024e99-260e-4401-ae6d-b67293200ef0\") " pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"
Jul 09 23:10:50.871212 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:50.871161    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de024e99-260e-4401-ae6d-b67293200ef0-dshm\") pod \"auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h\" (UID: \"de024e99-260e-4401-ae6d-b67293200ef0\") " pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"
Jul 09 23:10:50.871212 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:50.871198    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de024e99-260e-4401-ae6d-b67293200ef0-tls-certs\") pod \"auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h\" (UID: \"de024e99-260e-4401-ae6d-b67293200ef0\") " pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"
Jul 09 23:10:50.871465 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:50.871444    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de024e99-260e-4401-ae6d-b67293200ef0-tmp-dir\") pod \"auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h\" (UID: \"de024e99-260e-4401-ae6d-b67293200ef0\") " pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"
Jul 09 23:10:50.871531 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:50.871501    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de024e99-260e-4401-ae6d-b67293200ef0-home\") pod \"auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h\" (UID: \"de024e99-260e-4401-ae6d-b67293200ef0\") " pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"
Jul 09 23:10:50.871531 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:50.871516    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de024e99-260e-4401-ae6d-b67293200ef0-model-cache\") pod \"auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h\" (UID: \"de024e99-260e-4401-ae6d-b67293200ef0\") " pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"
Jul 09 23:10:50.873433 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:50.873412    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de024e99-260e-4401-ae6d-b67293200ef0-dshm\") pod \"auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h\" (UID: \"de024e99-260e-4401-ae6d-b67293200ef0\") " pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"
Jul 09 23:10:50.873904 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:50.873859    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de024e99-260e-4401-ae6d-b67293200ef0-tls-certs\") pod \"auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h\" (UID: \"de024e99-260e-4401-ae6d-b67293200ef0\") " pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"
Jul 09 23:10:50.878605 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:50.878583    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlqhk\" (UniqueName: \"kubernetes.io/projected/de024e99-260e-4401-ae6d-b67293200ef0-kube-api-access-mlqhk\") pod \"auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h\" (UID: \"de024e99-260e-4401-ae6d-b67293200ef0\") " pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"
Jul 09 23:10:50.994771 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:50.994700    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"
Jul 09 23:10:51.128649 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:51.128619    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"]
Jul 09 23:10:51.131825 ip-10-0-142-84 kubenswrapper[2564]: W0709 23:10:51.131797    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde024e99_260e_4401_ae6d_b67293200ef0.slice/crio-66adba5d32ab8c073b5e40d3dca2732dd99b9726a2b7706d4b255334b2e36c93 WatchSource:0}: Error finding container 66adba5d32ab8c073b5e40d3dca2732dd99b9726a2b7706d4b255334b2e36c93: Status 404 returned error can't find the container with id 66adba5d32ab8c073b5e40d3dca2732dd99b9726a2b7706d4b255334b2e36c93
Jul 09 23:10:51.359376 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:51.359292    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h" event={"ID":"de024e99-260e-4401-ae6d-b67293200ef0","Type":"ContainerStarted","Data":"2924af73a7ccd6c1ae7aa32bcb5f4ccfbc04e0c080955651bdbc44af7712aeab"}
Jul 09 23:10:51.359376 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:51.359338    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h" event={"ID":"de024e99-260e-4401-ae6d-b67293200ef0","Type":"ContainerStarted","Data":"66adba5d32ab8c073b5e40d3dca2732dd99b9726a2b7706d4b255334b2e36c93"}
Jul 09 23:10:51.377041 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:51.376992    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h" podStartSLOduration=1.37697749 podStartE2EDuration="1.37697749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:10:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:10:51.375401536 +0000 UTC m=+2306.083297126" watchObservedRunningTime="2026-07-09 23:10:51.37697749 +0000 UTC m=+2306.084873121"
Jul 09 23:10:54.764956 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:10:54.764923    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:11:00.995766 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:11:00.995734    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"
Jul 09 23:11:00.996168 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:11:00.995782    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"
Jul 09 23:11:01.008561 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:11:01.008527    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"
Jul 09 23:11:01.418479 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:11:01.418393    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"
Jul 09 23:11:11.039476 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:11:11.039442    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:11:29.956746 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:11:29.956671    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:11:47.123086 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:11:47.123050    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:12:05.927358 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:12:05.927321    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:12:25.931473 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:12:25.931443    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-v29jg_fb564a11-973b-40db-ac7b-a20e2e4bf01d/console-operator/1.log"
Jul 09 23:12:25.941284 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:12:25.941262    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-v29jg_fb564a11-973b-40db-ac7b-a20e2e4bf01d/console-operator/1.log"
Jul 09 23:12:27.131166 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:12:27.127729    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:12:46.025097 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:12:46.025056    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:12:58.746447 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:12:58.746366    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"]
Jul 09 23:12:59.589117 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:12:59.589086    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"]
Jul 09 23:13:01.530972 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:01.530943    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:13:13.766996 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:13.766935    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n" podUID="f4d31b73-9e53-4983-8ea8-91286614e615" containerName="main" containerID="cri-o://c84aaa57d1bd25928fdd1c4bfb75f16fe44c1afdc605ce4b6c9317fcf0ce78e5" gracePeriod=45
Jul 09 23:13:14.022079 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.022013    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"
Jul 09 23:13:14.046636 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.046599    2564 generic.go:356] "Generic (PLEG): container finished" podID="f4d31b73-9e53-4983-8ea8-91286614e615" containerID="c84aaa57d1bd25928fdd1c4bfb75f16fe44c1afdc605ce4b6c9317fcf0ce78e5" exitCode=0
Jul 09 23:13:14.046906 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.046646    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"
Jul 09 23:13:14.046906 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.046685    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n" event={"ID":"f4d31b73-9e53-4983-8ea8-91286614e615","Type":"ContainerDied","Data":"c84aaa57d1bd25928fdd1c4bfb75f16fe44c1afdc605ce4b6c9317fcf0ce78e5"}
Jul 09 23:13:14.046906 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.046727    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n" event={"ID":"f4d31b73-9e53-4983-8ea8-91286614e615","Type":"ContainerDied","Data":"5792e2719cab447dce99e09caae394e98a9f7cfe56c785a993ade7593dab46c1"}
Jul 09 23:13:14.046906 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.046747    2564 scope.go:117] "RemoveContainer" containerID="c84aaa57d1bd25928fdd1c4bfb75f16fe44c1afdc605ce4b6c9317fcf0ce78e5"
Jul 09 23:13:14.055454 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.055435    2564 scope.go:117] "RemoveContainer" containerID="c84aaa57d1bd25928fdd1c4bfb75f16fe44c1afdc605ce4b6c9317fcf0ce78e5"
Jul 09 23:13:14.055706 ip-10-0-142-84 kubenswrapper[2564]: E0709 23:13:14.055684    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c84aaa57d1bd25928fdd1c4bfb75f16fe44c1afdc605ce4b6c9317fcf0ce78e5\": container with ID starting with c84aaa57d1bd25928fdd1c4bfb75f16fe44c1afdc605ce4b6c9317fcf0ce78e5 not found: ID does not exist" containerID="c84aaa57d1bd25928fdd1c4bfb75f16fe44c1afdc605ce4b6c9317fcf0ce78e5"
Jul 09 23:13:14.055782 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.055716    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c84aaa57d1bd25928fdd1c4bfb75f16fe44c1afdc605ce4b6c9317fcf0ce78e5"} err="failed to get container status \"c84aaa57d1bd25928fdd1c4bfb75f16fe44c1afdc605ce4b6c9317fcf0ce78e5\": rpc error: code = NotFound desc = could not find container \"c84aaa57d1bd25928fdd1c4bfb75f16fe44c1afdc605ce4b6c9317fcf0ce78e5\": container with ID starting with c84aaa57d1bd25928fdd1c4bfb75f16fe44c1afdc605ce4b6c9317fcf0ce78e5 not found: ID does not exist"
Jul 09 23:13:14.123203 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.123168    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4d31b73-9e53-4983-8ea8-91286614e615-dshm\") pod \"f4d31b73-9e53-4983-8ea8-91286614e615\" (UID: \"f4d31b73-9e53-4983-8ea8-91286614e615\") "
Jul 09 23:13:14.123372 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.123210    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5x74\" (UniqueName: \"kubernetes.io/projected/f4d31b73-9e53-4983-8ea8-91286614e615-kube-api-access-w5x74\") pod \"f4d31b73-9e53-4983-8ea8-91286614e615\" (UID: \"f4d31b73-9e53-4983-8ea8-91286614e615\") "
Jul 09 23:13:14.123372 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.123269    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4d31b73-9e53-4983-8ea8-91286614e615-tls-certs\") pod \"f4d31b73-9e53-4983-8ea8-91286614e615\" (UID: \"f4d31b73-9e53-4983-8ea8-91286614e615\") "
Jul 09 23:13:14.123372 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.123306    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4d31b73-9e53-4983-8ea8-91286614e615-model-cache\") pod \"f4d31b73-9e53-4983-8ea8-91286614e615\" (UID: \"f4d31b73-9e53-4983-8ea8-91286614e615\") "
Jul 09 23:13:14.123372 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.123329    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4d31b73-9e53-4983-8ea8-91286614e615-home\") pod \"f4d31b73-9e53-4983-8ea8-91286614e615\" (UID: \"f4d31b73-9e53-4983-8ea8-91286614e615\") "
Jul 09 23:13:14.123584 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.123375    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4d31b73-9e53-4983-8ea8-91286614e615-tmp-dir\") pod \"f4d31b73-9e53-4983-8ea8-91286614e615\" (UID: \"f4d31b73-9e53-4983-8ea8-91286614e615\") "
Jul 09 23:13:14.123640 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.123619    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d31b73-9e53-4983-8ea8-91286614e615-model-cache" (OuterVolumeSpecName: "model-cache") pod "f4d31b73-9e53-4983-8ea8-91286614e615" (UID: "f4d31b73-9e53-4983-8ea8-91286614e615"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:13:14.123698 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.123641    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d31b73-9e53-4983-8ea8-91286614e615-home" (OuterVolumeSpecName: "home") pod "f4d31b73-9e53-4983-8ea8-91286614e615" (UID: "f4d31b73-9e53-4983-8ea8-91286614e615"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:13:14.123698 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.123667    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d31b73-9e53-4983-8ea8-91286614e615-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f4d31b73-9e53-4983-8ea8-91286614e615" (UID: "f4d31b73-9e53-4983-8ea8-91286614e615"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:13:14.123814 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.123732    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4d31b73-9e53-4983-8ea8-91286614e615-model-cache\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:13:14.123814 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.123746    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4d31b73-9e53-4983-8ea8-91286614e615-home\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:13:14.125525 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.125493    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d31b73-9e53-4983-8ea8-91286614e615-dshm" (OuterVolumeSpecName: "dshm") pod "f4d31b73-9e53-4983-8ea8-91286614e615" (UID: "f4d31b73-9e53-4983-8ea8-91286614e615"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:13:14.125641 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.125549    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4d31b73-9e53-4983-8ea8-91286614e615-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f4d31b73-9e53-4983-8ea8-91286614e615" (UID: "f4d31b73-9e53-4983-8ea8-91286614e615"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 23:13:14.125641 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.125556    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4d31b73-9e53-4983-8ea8-91286614e615-kube-api-access-w5x74" (OuterVolumeSpecName: "kube-api-access-w5x74") pod "f4d31b73-9e53-4983-8ea8-91286614e615" (UID: "f4d31b73-9e53-4983-8ea8-91286614e615"). InnerVolumeSpecName "kube-api-access-w5x74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:13:14.225209 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.225174    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4d31b73-9e53-4983-8ea8-91286614e615-dshm\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:13:14.225209 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.225202    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5x74\" (UniqueName: \"kubernetes.io/projected/f4d31b73-9e53-4983-8ea8-91286614e615-kube-api-access-w5x74\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:13:14.225209 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.225212    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4d31b73-9e53-4983-8ea8-91286614e615-tls-certs\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:13:14.225443 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.225220    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4d31b73-9e53-4983-8ea8-91286614e615-tmp-dir\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:13:14.366213 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.366179    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"]
Jul 09 23:13:14.370254 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.370229    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-566ef9/auth-test-model-566ef9-kserve-77f856dd7f-g5z7n"]
Jul 09 23:13:14.609292 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.609209    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h" podUID="de024e99-260e-4401-ae6d-b67293200ef0" containerName="main" containerID="cri-o://2924af73a7ccd6c1ae7aa32bcb5f4ccfbc04e0c080955651bdbc44af7712aeab" gracePeriod=45
Jul 09 23:13:14.865248 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.865189    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"
Jul 09 23:13:14.931455 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.931426    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de024e99-260e-4401-ae6d-b67293200ef0-home\") pod \"de024e99-260e-4401-ae6d-b67293200ef0\" (UID: \"de024e99-260e-4401-ae6d-b67293200ef0\") "
Jul 09 23:13:14.931602 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.931525    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de024e99-260e-4401-ae6d-b67293200ef0-tmp-dir\") pod \"de024e99-260e-4401-ae6d-b67293200ef0\" (UID: \"de024e99-260e-4401-ae6d-b67293200ef0\") "
Jul 09 23:13:14.931602 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.931553    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de024e99-260e-4401-ae6d-b67293200ef0-tls-certs\") pod \"de024e99-260e-4401-ae6d-b67293200ef0\" (UID: \"de024e99-260e-4401-ae6d-b67293200ef0\") "
Jul 09 23:13:14.931602 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.931585    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlqhk\" (UniqueName: \"kubernetes.io/projected/de024e99-260e-4401-ae6d-b67293200ef0-kube-api-access-mlqhk\") pod \"de024e99-260e-4401-ae6d-b67293200ef0\" (UID: \"de024e99-260e-4401-ae6d-b67293200ef0\") "
Jul 09 23:13:14.931727 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.931607    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de024e99-260e-4401-ae6d-b67293200ef0-dshm\") pod \"de024e99-260e-4401-ae6d-b67293200ef0\" (UID: \"de024e99-260e-4401-ae6d-b67293200ef0\") "
Jul 09 23:13:14.931727 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.931626    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de024e99-260e-4401-ae6d-b67293200ef0-model-cache\") pod \"de024e99-260e-4401-ae6d-b67293200ef0\" (UID: \"de024e99-260e-4401-ae6d-b67293200ef0\") "
Jul 09 23:13:14.931727 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.931712    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de024e99-260e-4401-ae6d-b67293200ef0-home" (OuterVolumeSpecName: "home") pod "de024e99-260e-4401-ae6d-b67293200ef0" (UID: "de024e99-260e-4401-ae6d-b67293200ef0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:13:14.931840 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.931732    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de024e99-260e-4401-ae6d-b67293200ef0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "de024e99-260e-4401-ae6d-b67293200ef0" (UID: "de024e99-260e-4401-ae6d-b67293200ef0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:13:14.931896 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.931883    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de024e99-260e-4401-ae6d-b67293200ef0-home\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:13:14.931936 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.931915    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de024e99-260e-4401-ae6d-b67293200ef0-tmp-dir\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:13:14.931983 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.931960    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de024e99-260e-4401-ae6d-b67293200ef0-model-cache" (OuterVolumeSpecName: "model-cache") pod "de024e99-260e-4401-ae6d-b67293200ef0" (UID: "de024e99-260e-4401-ae6d-b67293200ef0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:13:14.933859 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.933832    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de024e99-260e-4401-ae6d-b67293200ef0-dshm" (OuterVolumeSpecName: "dshm") pod "de024e99-260e-4401-ae6d-b67293200ef0" (UID: "de024e99-260e-4401-ae6d-b67293200ef0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:13:14.934026 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.933889    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de024e99-260e-4401-ae6d-b67293200ef0-kube-api-access-mlqhk" (OuterVolumeSpecName: "kube-api-access-mlqhk") pod "de024e99-260e-4401-ae6d-b67293200ef0" (UID: "de024e99-260e-4401-ae6d-b67293200ef0"). InnerVolumeSpecName "kube-api-access-mlqhk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:13:14.934026 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:14.933958    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de024e99-260e-4401-ae6d-b67293200ef0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "de024e99-260e-4401-ae6d-b67293200ef0" (UID: "de024e99-260e-4401-ae6d-b67293200ef0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 23:13:15.033284 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:15.033254    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de024e99-260e-4401-ae6d-b67293200ef0-dshm\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:13:15.033284 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:15.033279    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de024e99-260e-4401-ae6d-b67293200ef0-model-cache\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:13:15.033284 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:15.033289    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de024e99-260e-4401-ae6d-b67293200ef0-tls-certs\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:13:15.033484 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:15.033298    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlqhk\" (UniqueName: \"kubernetes.io/projected/de024e99-260e-4401-ae6d-b67293200ef0-kube-api-access-mlqhk\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:13:15.052883 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:15.052851    2564 generic.go:356] "Generic (PLEG): container finished" podID="de024e99-260e-4401-ae6d-b67293200ef0" containerID="2924af73a7ccd6c1ae7aa32bcb5f4ccfbc04e0c080955651bdbc44af7712aeab" exitCode=0
Jul 09 23:13:15.053016 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:15.052915    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"
Jul 09 23:13:15.053016 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:15.052931    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h" event={"ID":"de024e99-260e-4401-ae6d-b67293200ef0","Type":"ContainerDied","Data":"2924af73a7ccd6c1ae7aa32bcb5f4ccfbc04e0c080955651bdbc44af7712aeab"}
Jul 09 23:13:15.053016 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:15.052969    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h" event={"ID":"de024e99-260e-4401-ae6d-b67293200ef0","Type":"ContainerDied","Data":"66adba5d32ab8c073b5e40d3dca2732dd99b9726a2b7706d4b255334b2e36c93"}
Jul 09 23:13:15.053016 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:15.052988    2564 scope.go:117] "RemoveContainer" containerID="2924af73a7ccd6c1ae7aa32bcb5f4ccfbc04e0c080955651bdbc44af7712aeab"
Jul 09 23:13:15.061607 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:15.061589    2564 scope.go:117] "RemoveContainer" containerID="2924af73a7ccd6c1ae7aa32bcb5f4ccfbc04e0c080955651bdbc44af7712aeab"
Jul 09 23:13:15.061862 ip-10-0-142-84 kubenswrapper[2564]: E0709 23:13:15.061845    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2924af73a7ccd6c1ae7aa32bcb5f4ccfbc04e0c080955651bdbc44af7712aeab\": container with ID starting with 2924af73a7ccd6c1ae7aa32bcb5f4ccfbc04e0c080955651bdbc44af7712aeab not found: ID does not exist" containerID="2924af73a7ccd6c1ae7aa32bcb5f4ccfbc04e0c080955651bdbc44af7712aeab"
Jul 09 23:13:15.061936 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:15.061893    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2924af73a7ccd6c1ae7aa32bcb5f4ccfbc04e0c080955651bdbc44af7712aeab"} err="failed to get container status \"2924af73a7ccd6c1ae7aa32bcb5f4ccfbc04e0c080955651bdbc44af7712aeab\": rpc error: code = NotFound desc = could not find container \"2924af73a7ccd6c1ae7aa32bcb5f4ccfbc04e0c080955651bdbc44af7712aeab\": container with ID starting with 2924af73a7ccd6c1ae7aa32bcb5f4ccfbc04e0c080955651bdbc44af7712aeab not found: ID does not exist"
Jul 09 23:13:15.071624 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:15.071606    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"]
Jul 09 23:13:15.075469 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:15.075451    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-57ed9c/auth-test-model-57ed9c-kserve-7d7787dc59-dpq5h"]
Jul 09 23:13:15.966221 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:15.966193    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de024e99-260e-4401-ae6d-b67293200ef0" path="/var/lib/kubelet/pods/de024e99-260e-4401-ae6d-b67293200ef0/volumes"
Jul 09 23:13:15.966586 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:15.966560    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4d31b73-9e53-4983-8ea8-91286614e615" path="/var/lib/kubelet/pods/f4d31b73-9e53-4983-8ea8-91286614e615/volumes"
Jul 09 23:13:18.076053 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.076015    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"]
Jul 09 23:13:18.076652 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.076579    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de024e99-260e-4401-ae6d-b67293200ef0" containerName="main"
Jul 09 23:13:18.076652 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.076595    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="de024e99-260e-4401-ae6d-b67293200ef0" containerName="main"
Jul 09 23:13:18.076652 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.076615    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4d31b73-9e53-4983-8ea8-91286614e615" containerName="main"
Jul 09 23:13:18.076652 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.076622    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4d31b73-9e53-4983-8ea8-91286614e615" containerName="main"
Jul 09 23:13:18.076899 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.076724    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4d31b73-9e53-4983-8ea8-91286614e615" containerName="main"
Jul 09 23:13:18.076899 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.076738    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="de024e99-260e-4401-ae6d-b67293200ef0" containerName="main"
Jul 09 23:13:18.081167 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.081146    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"
Jul 09 23:13:18.083234 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.083216    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-57ed9c\"/\"openshift-service-ca.crt\""
Jul 09 23:13:18.083730 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.083703    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-57ed9c\"/\"sub-test-model-57ed9c-kserve-self-signed-certs\""
Jul 09 23:13:18.083933 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.083915    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-57ed9c\"/\"default-dockercfg-65m8c\""
Jul 09 23:13:18.084021 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.083953    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-57ed9c\"/\"kube-root-ca.crt\""
Jul 09 23:13:18.087816 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.087794    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"]
Jul 09 23:13:18.158256 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.158223    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54637e09-1b63-47fa-baab-80950d5b08c0-tmp-dir\") pod \"sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b\" (UID: \"54637e09-1b63-47fa-baab-80950d5b08c0\") " pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"
Jul 09 23:13:18.158256 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.158259    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54637e09-1b63-47fa-baab-80950d5b08c0-home\") pod \"sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b\" (UID: \"54637e09-1b63-47fa-baab-80950d5b08c0\") " pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"
Jul 09 23:13:18.158456 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.158296    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tmwj\" (UniqueName: \"kubernetes.io/projected/54637e09-1b63-47fa-baab-80950d5b08c0-kube-api-access-4tmwj\") pod \"sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b\" (UID: \"54637e09-1b63-47fa-baab-80950d5b08c0\") " pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"
Jul 09 23:13:18.158456 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.158323    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54637e09-1b63-47fa-baab-80950d5b08c0-dshm\") pod \"sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b\" (UID: \"54637e09-1b63-47fa-baab-80950d5b08c0\") " pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"
Jul 09 23:13:18.158456 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.158338    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54637e09-1b63-47fa-baab-80950d5b08c0-model-cache\") pod \"sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b\" (UID: \"54637e09-1b63-47fa-baab-80950d5b08c0\") " pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"
Jul 09 23:13:18.158456 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.158373    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54637e09-1b63-47fa-baab-80950d5b08c0-tls-certs\") pod \"sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b\" (UID: \"54637e09-1b63-47fa-baab-80950d5b08c0\") " pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"
Jul 09 23:13:18.259031 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.258998    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tmwj\" (UniqueName: \"kubernetes.io/projected/54637e09-1b63-47fa-baab-80950d5b08c0-kube-api-access-4tmwj\") pod \"sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b\" (UID: \"54637e09-1b63-47fa-baab-80950d5b08c0\") " pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"
Jul 09 23:13:18.259202 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.259042    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54637e09-1b63-47fa-baab-80950d5b08c0-dshm\") pod \"sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b\" (UID: \"54637e09-1b63-47fa-baab-80950d5b08c0\") " pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"
Jul 09 23:13:18.259202 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.259066    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54637e09-1b63-47fa-baab-80950d5b08c0-model-cache\") pod \"sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b\" (UID: \"54637e09-1b63-47fa-baab-80950d5b08c0\") " pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"
Jul 09 23:13:18.259202 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.259099    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54637e09-1b63-47fa-baab-80950d5b08c0-tls-certs\") pod \"sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b\" (UID: \"54637e09-1b63-47fa-baab-80950d5b08c0\") " pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"
Jul 09 23:13:18.259202 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.259184    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54637e09-1b63-47fa-baab-80950d5b08c0-tmp-dir\") pod \"sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b\" (UID: \"54637e09-1b63-47fa-baab-80950d5b08c0\") " pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"
Jul 09 23:13:18.259402 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.259209    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54637e09-1b63-47fa-baab-80950d5b08c0-home\") pod \"sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b\" (UID: \"54637e09-1b63-47fa-baab-80950d5b08c0\") " pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"
Jul 09 23:13:18.259520 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.259496    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54637e09-1b63-47fa-baab-80950d5b08c0-model-cache\") pod \"sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b\" (UID: \"54637e09-1b63-47fa-baab-80950d5b08c0\") " pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"
Jul 09 23:13:18.259582 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.259532    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54637e09-1b63-47fa-baab-80950d5b08c0-tmp-dir\") pod \"sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b\" (UID: \"54637e09-1b63-47fa-baab-80950d5b08c0\") " pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"
Jul 09 23:13:18.259625 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.259577    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54637e09-1b63-47fa-baab-80950d5b08c0-home\") pod \"sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b\" (UID: \"54637e09-1b63-47fa-baab-80950d5b08c0\") " pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"
Jul 09 23:13:18.261303 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.261284    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54637e09-1b63-47fa-baab-80950d5b08c0-dshm\") pod \"sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b\" (UID: \"54637e09-1b63-47fa-baab-80950d5b08c0\") " pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"
Jul 09 23:13:18.261553 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.261537    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54637e09-1b63-47fa-baab-80950d5b08c0-tls-certs\") pod \"sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b\" (UID: \"54637e09-1b63-47fa-baab-80950d5b08c0\") " pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"
Jul 09 23:13:18.265817 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.265794    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tmwj\" (UniqueName: \"kubernetes.io/projected/54637e09-1b63-47fa-baab-80950d5b08c0-kube-api-access-4tmwj\") pod \"sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b\" (UID: \"54637e09-1b63-47fa-baab-80950d5b08c0\") " pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"
Jul 09 23:13:18.391114 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.391025    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"
Jul 09 23:13:18.520537 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.520509    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"]
Jul 09 23:13:18.523663 ip-10-0-142-84 kubenswrapper[2564]: W0709 23:13:18.523637    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54637e09_1b63_47fa_baab_80950d5b08c0.slice/crio-bd6df5d99cf0d6fa85388ad7400a0a5a5e5aed35e863d935978546ac1acd5905 WatchSource:0}: Error finding container bd6df5d99cf0d6fa85388ad7400a0a5a5e5aed35e863d935978546ac1acd5905: Status 404 returned error can't find the container with id bd6df5d99cf0d6fa85388ad7400a0a5a5e5aed35e863d935978546ac1acd5905
Jul 09 23:13:18.531683 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:18.531665    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:13:19.076710 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:19.076677    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b" event={"ID":"54637e09-1b63-47fa-baab-80950d5b08c0","Type":"ContainerStarted","Data":"f0f9a9f16a1920599c011386ed235245f077938103e4962dc73ef2884616f920"}
Jul 09 23:13:19.077108 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:19.076719    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b" event={"ID":"54637e09-1b63-47fa-baab-80950d5b08c0","Type":"ContainerStarted","Data":"bd6df5d99cf0d6fa85388ad7400a0a5a5e5aed35e863d935978546ac1acd5905"}
Jul 09 23:13:19.094808 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:19.094663    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b" podStartSLOduration=1.094618433 podStartE2EDuration="1.094618433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:13:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:13:19.092259558 +0000 UTC m=+2453.800155157" watchObservedRunningTime="2026-07-09 23:13:19.094618433 +0000 UTC m=+2453.802514014"
Jul 09 23:13:28.391511 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:28.391476    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"
Jul 09 23:13:28.392040 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:28.391616    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"
Jul 09 23:13:28.403781 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:28.403756    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"
Jul 09 23:13:29.134449 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:29.134418    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"
Jul 09 23:13:32.029665 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:32.029627    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:13:59.927197 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:13:59.927151    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:14:06.481141 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:06.481107    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"]
Jul 09 23:14:09.583549 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:09.583521    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"]
Jul 09 23:14:09.586962 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:09.586943    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"
Jul 09 23:14:09.589507 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:09.589484    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-566ef9\"/\"kube-root-ca.crt\""
Jul 09 23:14:09.589507 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:09.589495    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-566ef9\"/\"rate-test-model-566ef9-kserve-self-signed-certs\""
Jul 09 23:14:09.589662 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:09.589514    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-566ef9\"/\"openshift-service-ca.crt\""
Jul 09 23:14:09.589662 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:09.589586    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-566ef9\"/\"default-dockercfg-9xdfj\""
Jul 09 23:14:09.597294 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:09.597275    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"]
Jul 09 23:14:09.709062 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:09.709034    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4e8506d-05f4-4eab-afcd-42aa58600f1e-dshm\") pod \"rate-test-model-566ef9-kserve-5995dd46bc-qhst5\" (UID: \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\") " pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"
Jul 09 23:14:09.709062 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:09.709072    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4e8506d-05f4-4eab-afcd-42aa58600f1e-home\") pod \"rate-test-model-566ef9-kserve-5995dd46bc-qhst5\" (UID: \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\") " pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"
Jul 09 23:14:09.709285 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:09.709109    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4e8506d-05f4-4eab-afcd-42aa58600f1e-tmp-dir\") pod \"rate-test-model-566ef9-kserve-5995dd46bc-qhst5\" (UID: \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\") " pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"
Jul 09 23:14:09.709285 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:09.709129    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb72l\" (UniqueName: \"kubernetes.io/projected/c4e8506d-05f4-4eab-afcd-42aa58600f1e-kube-api-access-sb72l\") pod \"rate-test-model-566ef9-kserve-5995dd46bc-qhst5\" (UID: \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\") " pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"
Jul 09 23:14:09.709285 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:09.709171    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4e8506d-05f4-4eab-afcd-42aa58600f1e-model-cache\") pod \"rate-test-model-566ef9-kserve-5995dd46bc-qhst5\" (UID: \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\") " pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"
Jul 09 23:14:09.709285 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:09.709187    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4e8506d-05f4-4eab-afcd-42aa58600f1e-tls-certs\") pod \"rate-test-model-566ef9-kserve-5995dd46bc-qhst5\" (UID: \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\") " pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"
Jul 09 23:14:09.809999 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:09.809951    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4e8506d-05f4-4eab-afcd-42aa58600f1e-home\") pod \"rate-test-model-566ef9-kserve-5995dd46bc-qhst5\" (UID: \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\") " pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"
Jul 09 23:14:09.809999 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:09.810009    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4e8506d-05f4-4eab-afcd-42aa58600f1e-tmp-dir\") pod \"rate-test-model-566ef9-kserve-5995dd46bc-qhst5\" (UID: \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\") " pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"
Jul 09 23:14:09.810243 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:09.810032    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb72l\" (UniqueName: \"kubernetes.io/projected/c4e8506d-05f4-4eab-afcd-42aa58600f1e-kube-api-access-sb72l\") pod \"rate-test-model-566ef9-kserve-5995dd46bc-qhst5\" (UID: \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\") " pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"
Jul 09 23:14:09.810243 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:09.810084    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4e8506d-05f4-4eab-afcd-42aa58600f1e-model-cache\") pod \"rate-test-model-566ef9-kserve-5995dd46bc-qhst5\" (UID: \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\") " pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"
Jul 09 23:14:09.810243 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:09.810100    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4e8506d-05f4-4eab-afcd-42aa58600f1e-tls-certs\") pod \"rate-test-model-566ef9-kserve-5995dd46bc-qhst5\" (UID: \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\") " pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"
Jul 09 23:14:09.810243 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:09.810153    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4e8506d-05f4-4eab-afcd-42aa58600f1e-dshm\") pod \"rate-test-model-566ef9-kserve-5995dd46bc-qhst5\" (UID: \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\") " pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"
Jul 09 23:14:09.810461 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:09.810356    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4e8506d-05f4-4eab-afcd-42aa58600f1e-tmp-dir\") pod \"rate-test-model-566ef9-kserve-5995dd46bc-qhst5\" (UID: \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\") " pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"
Jul 09 23:14:09.810519 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:09.810455    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4e8506d-05f4-4eab-afcd-42aa58600f1e-home\") pod \"rate-test-model-566ef9-kserve-5995dd46bc-qhst5\" (UID: \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\") " pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"
Jul 09 23:14:09.810519 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:09.810488    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4e8506d-05f4-4eab-afcd-42aa58600f1e-model-cache\") pod \"rate-test-model-566ef9-kserve-5995dd46bc-qhst5\" (UID: \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\") " pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"
Jul 09 23:14:09.812435 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:09.812413    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4e8506d-05f4-4eab-afcd-42aa58600f1e-dshm\") pod \"rate-test-model-566ef9-kserve-5995dd46bc-qhst5\" (UID: \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\") " pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"
Jul 09 23:14:09.812633 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:09.812613    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4e8506d-05f4-4eab-afcd-42aa58600f1e-tls-certs\") pod \"rate-test-model-566ef9-kserve-5995dd46bc-qhst5\" (UID: \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\") " pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"
Jul 09 23:14:09.817883 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:09.817847    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb72l\" (UniqueName: \"kubernetes.io/projected/c4e8506d-05f4-4eab-afcd-42aa58600f1e-kube-api-access-sb72l\") pod \"rate-test-model-566ef9-kserve-5995dd46bc-qhst5\" (UID: \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\") " pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"
Jul 09 23:14:09.896854 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:09.896765    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"
Jul 09 23:14:10.025638 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:10.025617    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"]
Jul 09 23:14:10.027708 ip-10-0-142-84 kubenswrapper[2564]: W0709 23:14:10.027672    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4e8506d_05f4_4eab_afcd_42aa58600f1e.slice/crio-fafd87a6e924cf62754886225d79b23fc54e55778eb1b955ec01f118415dd60f WatchSource:0}: Error finding container fafd87a6e924cf62754886225d79b23fc54e55778eb1b955ec01f118415dd60f: Status 404 returned error can't find the container with id fafd87a6e924cf62754886225d79b23fc54e55778eb1b955ec01f118415dd60f
Jul 09 23:14:10.320481 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:10.320449    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5" event={"ID":"c4e8506d-05f4-4eab-afcd-42aa58600f1e","Type":"ContainerStarted","Data":"bb1c7b49b455a422b80fb8ac9542ebd02dc2c644c948dfca9f9694ceeff52940"}
Jul 09 23:14:10.320663 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:10.320490    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5" event={"ID":"c4e8506d-05f4-4eab-afcd-42aa58600f1e","Type":"ContainerStarted","Data":"fafd87a6e924cf62754886225d79b23fc54e55778eb1b955ec01f118415dd60f"}
Jul 09 23:14:18.522925 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:18.522793    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5" podStartSLOduration=9.522775658 podStartE2EDuration="9.522775658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:14:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:14:10.335221575 +0000 UTC m=+2505.043117175" watchObservedRunningTime="2026-07-09 23:14:18.522775658 +0000 UTC m=+2513.230671239"
Jul 09 23:14:18.524258 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:18.524238    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:14:19.897878 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:19.897831    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"
Jul 09 23:14:19.898244 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:19.897899    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"
Jul 09 23:14:19.910443 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:19.910421    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"
Jul 09 23:14:20.383664 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:20.383640    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"
Jul 09 23:14:21.502120 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:21.502077    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b" podUID="54637e09-1b63-47fa-baab-80950d5b08c0" containerName="main" containerID="cri-o://f0f9a9f16a1920599c011386ed235245f077938103e4962dc73ef2884616f920" gracePeriod=45
Jul 09 23:14:21.757074 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:21.757015    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"
Jul 09 23:14:21.820356 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:21.820328    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54637e09-1b63-47fa-baab-80950d5b08c0-tmp-dir\") pod \"54637e09-1b63-47fa-baab-80950d5b08c0\" (UID: \"54637e09-1b63-47fa-baab-80950d5b08c0\") "
Jul 09 23:14:21.820356 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:21.820362    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54637e09-1b63-47fa-baab-80950d5b08c0-tls-certs\") pod \"54637e09-1b63-47fa-baab-80950d5b08c0\" (UID: \"54637e09-1b63-47fa-baab-80950d5b08c0\") "
Jul 09 23:14:21.820607 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:21.820394    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54637e09-1b63-47fa-baab-80950d5b08c0-dshm\") pod \"54637e09-1b63-47fa-baab-80950d5b08c0\" (UID: \"54637e09-1b63-47fa-baab-80950d5b08c0\") "
Jul 09 23:14:21.820607 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:21.820415    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tmwj\" (UniqueName: \"kubernetes.io/projected/54637e09-1b63-47fa-baab-80950d5b08c0-kube-api-access-4tmwj\") pod \"54637e09-1b63-47fa-baab-80950d5b08c0\" (UID: \"54637e09-1b63-47fa-baab-80950d5b08c0\") "
Jul 09 23:14:21.820607 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:21.820462    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54637e09-1b63-47fa-baab-80950d5b08c0-home\") pod \"54637e09-1b63-47fa-baab-80950d5b08c0\" (UID: \"54637e09-1b63-47fa-baab-80950d5b08c0\") "
Jul 09 23:14:21.820607 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:21.820476    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54637e09-1b63-47fa-baab-80950d5b08c0-model-cache\") pod \"54637e09-1b63-47fa-baab-80950d5b08c0\" (UID: \"54637e09-1b63-47fa-baab-80950d5b08c0\") "
Jul 09 23:14:21.820804 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:21.820666    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54637e09-1b63-47fa-baab-80950d5b08c0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "54637e09-1b63-47fa-baab-80950d5b08c0" (UID: "54637e09-1b63-47fa-baab-80950d5b08c0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:14:21.820804 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:21.820745    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54637e09-1b63-47fa-baab-80950d5b08c0-home" (OuterVolumeSpecName: "home") pod "54637e09-1b63-47fa-baab-80950d5b08c0" (UID: "54637e09-1b63-47fa-baab-80950d5b08c0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:14:21.820804 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:21.820761    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54637e09-1b63-47fa-baab-80950d5b08c0-model-cache" (OuterVolumeSpecName: "model-cache") pod "54637e09-1b63-47fa-baab-80950d5b08c0" (UID: "54637e09-1b63-47fa-baab-80950d5b08c0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:14:21.822552 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:21.822524    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54637e09-1b63-47fa-baab-80950d5b08c0-dshm" (OuterVolumeSpecName: "dshm") pod "54637e09-1b63-47fa-baab-80950d5b08c0" (UID: "54637e09-1b63-47fa-baab-80950d5b08c0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:14:21.822667 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:21.822569    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54637e09-1b63-47fa-baab-80950d5b08c0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "54637e09-1b63-47fa-baab-80950d5b08c0" (UID: "54637e09-1b63-47fa-baab-80950d5b08c0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 23:14:21.822667 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:21.822601    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54637e09-1b63-47fa-baab-80950d5b08c0-kube-api-access-4tmwj" (OuterVolumeSpecName: "kube-api-access-4tmwj") pod "54637e09-1b63-47fa-baab-80950d5b08c0" (UID: "54637e09-1b63-47fa-baab-80950d5b08c0"). InnerVolumeSpecName "kube-api-access-4tmwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:14:21.921987 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:21.921955    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54637e09-1b63-47fa-baab-80950d5b08c0-home\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:14:21.921987 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:21.921980    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54637e09-1b63-47fa-baab-80950d5b08c0-model-cache\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:14:21.921987 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:21.921989    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54637e09-1b63-47fa-baab-80950d5b08c0-tmp-dir\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:14:21.921987 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:21.921997    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54637e09-1b63-47fa-baab-80950d5b08c0-tls-certs\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:14:21.922256 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:21.922005    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54637e09-1b63-47fa-baab-80950d5b08c0-dshm\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:14:21.922256 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:21.922013    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tmwj\" (UniqueName: \"kubernetes.io/projected/54637e09-1b63-47fa-baab-80950d5b08c0-kube-api-access-4tmwj\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:14:22.379338 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:22.379304    2564 generic.go:356] "Generic (PLEG): container finished" podID="54637e09-1b63-47fa-baab-80950d5b08c0" containerID="f0f9a9f16a1920599c011386ed235245f077938103e4962dc73ef2884616f920" exitCode=0
Jul 09 23:14:22.379552 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:22.379352    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"
Jul 09 23:14:22.379552 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:22.379356    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b" event={"ID":"54637e09-1b63-47fa-baab-80950d5b08c0","Type":"ContainerDied","Data":"f0f9a9f16a1920599c011386ed235245f077938103e4962dc73ef2884616f920"}
Jul 09 23:14:22.379552 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:22.379478    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b" event={"ID":"54637e09-1b63-47fa-baab-80950d5b08c0","Type":"ContainerDied","Data":"bd6df5d99cf0d6fa85388ad7400a0a5a5e5aed35e863d935978546ac1acd5905"}
Jul 09 23:14:22.379552 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:22.379504    2564 scope.go:117] "RemoveContainer" containerID="f0f9a9f16a1920599c011386ed235245f077938103e4962dc73ef2884616f920"
Jul 09 23:14:22.388065 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:22.388035    2564 scope.go:117] "RemoveContainer" containerID="f0f9a9f16a1920599c011386ed235245f077938103e4962dc73ef2884616f920"
Jul 09 23:14:22.388319 ip-10-0-142-84 kubenswrapper[2564]: E0709 23:14:22.388298    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0f9a9f16a1920599c011386ed235245f077938103e4962dc73ef2884616f920\": container with ID starting with f0f9a9f16a1920599c011386ed235245f077938103e4962dc73ef2884616f920 not found: ID does not exist" containerID="f0f9a9f16a1920599c011386ed235245f077938103e4962dc73ef2884616f920"
Jul 09 23:14:22.388384 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:22.388327    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0f9a9f16a1920599c011386ed235245f077938103e4962dc73ef2884616f920"} err="failed to get container status \"f0f9a9f16a1920599c011386ed235245f077938103e4962dc73ef2884616f920\": rpc error: code = NotFound desc = could not find container \"f0f9a9f16a1920599c011386ed235245f077938103e4962dc73ef2884616f920\": container with ID starting with f0f9a9f16a1920599c011386ed235245f077938103e4962dc73ef2884616f920 not found: ID does not exist"
Jul 09 23:14:22.394179 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:22.394157    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"]
Jul 09 23:14:22.397178 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:22.397158    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-57ed9c/sub-test-model-57ed9c-kserve-8cbcf47cc-kkj4b"]
Jul 09 23:14:23.966054 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:23.966019    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54637e09-1b63-47fa-baab-80950d5b08c0" path="/var/lib/kubelet/pods/54637e09-1b63-47fa-baab-80950d5b08c0/volumes"
Jul 09 23:14:50.165152 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.165115    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"]
Jul 09 23:14:50.165774 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.165753    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54637e09-1b63-47fa-baab-80950d5b08c0" containerName="main"
Jul 09 23:14:50.165864 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.165777    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="54637e09-1b63-47fa-baab-80950d5b08c0" containerName="main"
Jul 09 23:14:50.165956 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.165935    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="54637e09-1b63-47fa-baab-80950d5b08c0" containerName="main"
Jul 09 23:14:50.169137 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.169114    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"
Jul 09 23:14:50.172583 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.172227    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-57ed9c\"/\"openshift-service-ca.crt\""
Jul 09 23:14:50.172583 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.172320    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-57ed9c\"/\"default-dockercfg-65m8c\""
Jul 09 23:14:50.172583 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.172464    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-57ed9c\"/\"rate-test-model-57ed9c-kserve-self-signed-certs\""
Jul 09 23:14:50.172583 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.172468    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-57ed9c\"/\"kube-root-ca.crt\""
Jul 09 23:14:50.176576 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.176550    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"]
Jul 09 23:14:50.256896 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.256845    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-tls-certs\") pod \"rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds\" (UID: \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\") " pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"
Jul 09 23:14:50.257068 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.256911    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-dshm\") pod \"rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds\" (UID: \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\") " pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"
Jul 09 23:14:50.257068 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.256932    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-tmp-dir\") pod \"rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds\" (UID: \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\") " pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"
Jul 09 23:14:50.257068 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.256965    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6xs9\" (UniqueName: \"kubernetes.io/projected/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-kube-api-access-j6xs9\") pod \"rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds\" (UID: \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\") " pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"
Jul 09 23:14:50.257068 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.257041    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-home\") pod \"rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds\" (UID: \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\") " pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"
Jul 09 23:14:50.257216 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.257106    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-model-cache\") pod \"rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds\" (UID: \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\") " pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"
Jul 09 23:14:50.357463 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.357431    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-model-cache\") pod \"rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds\" (UID: \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\") " pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"
Jul 09 23:14:50.357463 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.357469    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-tls-certs\") pod \"rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds\" (UID: \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\") " pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"
Jul 09 23:14:50.357688 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.357503    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-dshm\") pod \"rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds\" (UID: \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\") " pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"
Jul 09 23:14:50.357688 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.357622    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-tmp-dir\") pod \"rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds\" (UID: \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\") " pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"
Jul 09 23:14:50.357851 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.357687    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6xs9\" (UniqueName: \"kubernetes.io/projected/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-kube-api-access-j6xs9\") pod \"rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds\" (UID: \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\") " pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"
Jul 09 23:14:50.357851 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.357737    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-home\") pod \"rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds\" (UID: \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\") " pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"
Jul 09 23:14:50.358009 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.357917    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-model-cache\") pod \"rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds\" (UID: \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\") " pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"
Jul 09 23:14:50.358064 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.358021    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-tmp-dir\") pod \"rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds\" (UID: \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\") " pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"
Jul 09 23:14:50.358103 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.358069    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-home\") pod \"rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds\" (UID: \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\") " pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"
Jul 09 23:14:50.359854 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.359834    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-dshm\") pod \"rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds\" (UID: \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\") " pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"
Jul 09 23:14:50.360006 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.359991    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-tls-certs\") pod \"rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds\" (UID: \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\") " pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"
Jul 09 23:14:50.365519 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.365500    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6xs9\" (UniqueName: \"kubernetes.io/projected/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-kube-api-access-j6xs9\") pod \"rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds\" (UID: \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\") " pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"
Jul 09 23:14:50.480112 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.480088    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"
Jul 09 23:14:50.611049 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:50.611028    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"]
Jul 09 23:14:50.612858 ip-10-0-142-84 kubenswrapper[2564]: W0709 23:14:50.612830    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20206cb7_f50e_4b03_b1f4_e4f57ae127cf.slice/crio-30ba0b64ee6495087577b083e69c5bb8e42b54249028fdf77de4293050c000fc WatchSource:0}: Error finding container 30ba0b64ee6495087577b083e69c5bb8e42b54249028fdf77de4293050c000fc: Status 404 returned error can't find the container with id 30ba0b64ee6495087577b083e69c5bb8e42b54249028fdf77de4293050c000fc
Jul 09 23:14:51.516797 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:51.516756    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds" event={"ID":"20206cb7-f50e-4b03-b1f4-e4f57ae127cf","Type":"ContainerStarted","Data":"fe33c466a81d4c3b5a1895f0688acbf78ff22184a8cbb2f33e43e4e65c5e9e32"}
Jul 09 23:14:51.517209 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:51.516807    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds" event={"ID":"20206cb7-f50e-4b03-b1f4-e4f57ae127cf","Type":"ContainerStarted","Data":"30ba0b64ee6495087577b083e69c5bb8e42b54249028fdf77de4293050c000fc"}
Jul 09 23:14:51.533101 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:51.533048    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds" podStartSLOduration=1.533033165 podStartE2EDuration="1.533033165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:14:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:14:51.531956997 +0000 UTC m=+2546.239852603" watchObservedRunningTime="2026-07-09 23:14:51.533033165 +0000 UTC m=+2546.240928751"
Jul 09 23:14:54.131048 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:14:54.131017    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:15:00.481006 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:00.480969    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"
Jul 09 23:15:00.481006 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:00.481015    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"
Jul 09 23:15:00.494102 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:00.494067    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"
Jul 09 23:15:00.572080 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:00.572047    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"
Jul 09 23:15:15.535838 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:15.535801    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:15:30.119861 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:30.119826    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:15:38.275893 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:38.275850    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"]
Jul 09 23:15:39.152451 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:39.152419    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"]
Jul 09 23:15:45.920124 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:45.920090    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:15:46.253630 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:46.253597    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7269-140015658420096"]
Jul 09 23:15:46.257209 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:46.257193    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7269-140015658420096"
Jul 09 23:15:46.259221 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:46.259198    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-gqbhf\""
Jul 09 23:15:46.263290 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:46.263262    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7269-140015658420096"]
Jul 09 23:15:46.361368 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:46.361338    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skb7j\" (UniqueName: \"kubernetes.io/projected/c9eb49c1-905c-4a2c-8f66-5306aff750a0-kube-api-access-skb7j\") pod \"test-curl-7269-140015658420096\" (UID: \"c9eb49c1-905c-4a2c-8f66-5306aff750a0\") " pod="openshift-ingress/test-curl-7269-140015658420096"
Jul 09 23:15:46.461840 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:46.461808    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skb7j\" (UniqueName: \"kubernetes.io/projected/c9eb49c1-905c-4a2c-8f66-5306aff750a0-kube-api-access-skb7j\") pod \"test-curl-7269-140015658420096\" (UID: \"c9eb49c1-905c-4a2c-8f66-5306aff750a0\") " pod="openshift-ingress/test-curl-7269-140015658420096"
Jul 09 23:15:46.469184 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:46.469157    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skb7j\" (UniqueName: \"kubernetes.io/projected/c9eb49c1-905c-4a2c-8f66-5306aff750a0-kube-api-access-skb7j\") pod \"test-curl-7269-140015658420096\" (UID: \"c9eb49c1-905c-4a2c-8f66-5306aff750a0\") " pod="openshift-ingress/test-curl-7269-140015658420096"
Jul 09 23:15:46.568017 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:46.567928    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7269-140015658420096"
Jul 09 23:15:46.697157 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:46.697088    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7269-140015658420096"]
Jul 09 23:15:46.699513 ip-10-0-142-84 kubenswrapper[2564]: W0709 23:15:46.699476    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9eb49c1_905c_4a2c_8f66_5306aff750a0.slice/crio-988342da684a34d76c9217385bd774c56be6716100f649b38672abdf3697b414 WatchSource:0}: Error finding container 988342da684a34d76c9217385bd774c56be6716100f649b38672abdf3697b414: Status 404 returned error can't find the container with id 988342da684a34d76c9217385bd774c56be6716100f649b38672abdf3697b414
Jul 09 23:15:46.700782 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:46.700761    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 23:15:46.785059 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:46.785033    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7269-140015658420096" event={"ID":"c9eb49c1-905c-4a2c-8f66-5306aff750a0","Type":"ContainerStarted","Data":"988342da684a34d76c9217385bd774c56be6716100f649b38672abdf3697b414"}
Jul 09 23:15:47.790819 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:47.790781    2564 generic.go:356] "Generic (PLEG): container finished" podID="c9eb49c1-905c-4a2c-8f66-5306aff750a0" containerID="1090e4a69d52352afd15e9b503cb877b724018f8bcc8e430cbfa8ec030e29826" exitCode=0
Jul 09 23:15:47.791208 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:47.790864    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7269-140015658420096" event={"ID":"c9eb49c1-905c-4a2c-8f66-5306aff750a0","Type":"ContainerDied","Data":"1090e4a69d52352afd15e9b503cb877b724018f8bcc8e430cbfa8ec030e29826"}
Jul 09 23:15:48.934486 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:48.934457    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7269-140015658420096"
Jul 09 23:15:48.969415 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:48.969391    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7269-140015658420096_c9eb49c1-905c-4a2c-8f66-5306aff750a0/test-curl-7269-140015658420096/0.log"
Jul 09 23:15:48.985802 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:48.985772    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skb7j\" (UniqueName: \"kubernetes.io/projected/c9eb49c1-905c-4a2c-8f66-5306aff750a0-kube-api-access-skb7j\") pod \"c9eb49c1-905c-4a2c-8f66-5306aff750a0\" (UID: \"c9eb49c1-905c-4a2c-8f66-5306aff750a0\") "
Jul 09 23:15:48.988113 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:48.988085    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9eb49c1-905c-4a2c-8f66-5306aff750a0-kube-api-access-skb7j" (OuterVolumeSpecName: "kube-api-access-skb7j") pod "c9eb49c1-905c-4a2c-8f66-5306aff750a0" (UID: "c9eb49c1-905c-4a2c-8f66-5306aff750a0"). InnerVolumeSpecName "kube-api-access-skb7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:15:48.996508 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:48.996485    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7269-140015658420096"]
Jul 09 23:15:49.000232 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:49.000212    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7269-140015658420096"]
Jul 09 23:15:49.086940 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:49.086844    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skb7j\" (UniqueName: \"kubernetes.io/projected/c9eb49c1-905c-4a2c-8f66-5306aff750a0-kube-api-access-skb7j\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:15:49.132071 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:49.132041    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7269-140015658420096"]
Jul 09 23:15:49.132471 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:49.132457    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9eb49c1-905c-4a2c-8f66-5306aff750a0" containerName="test-curl-7269-140015658420096"
Jul 09 23:15:49.132519 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:49.132474    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9eb49c1-905c-4a2c-8f66-5306aff750a0" containerName="test-curl-7269-140015658420096"
Jul 09 23:15:49.132553 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:49.132541    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9eb49c1-905c-4a2c-8f66-5306aff750a0" containerName="test-curl-7269-140015658420096"
Jul 09 23:15:49.135492 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:49.135478    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7269-140015658420096"
Jul 09 23:15:49.141684 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:49.141662    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7269-140015658420096"]
Jul 09 23:15:49.187442 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:49.187414    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8gkv\" (UniqueName: \"kubernetes.io/projected/5d282553-19fa-4df3-88e7-1feeb48a0a26-kube-api-access-z8gkv\") pod \"test-curl-7269-140015658420096\" (UID: \"5d282553-19fa-4df3-88e7-1feeb48a0a26\") " pod="openshift-ingress/test-curl-7269-140015658420096"
Jul 09 23:15:49.288992 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:49.288952    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8gkv\" (UniqueName: \"kubernetes.io/projected/5d282553-19fa-4df3-88e7-1feeb48a0a26-kube-api-access-z8gkv\") pod \"test-curl-7269-140015658420096\" (UID: \"5d282553-19fa-4df3-88e7-1feeb48a0a26\") " pod="openshift-ingress/test-curl-7269-140015658420096"
Jul 09 23:15:49.296923 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:49.296900    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8gkv\" (UniqueName: \"kubernetes.io/projected/5d282553-19fa-4df3-88e7-1feeb48a0a26-kube-api-access-z8gkv\") pod \"test-curl-7269-140015658420096\" (UID: \"5d282553-19fa-4df3-88e7-1feeb48a0a26\") " pod="openshift-ingress/test-curl-7269-140015658420096"
Jul 09 23:15:49.445592 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:49.445553    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7269-140015658420096"
Jul 09 23:15:49.576794 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:49.576771    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7269-140015658420096"]
Jul 09 23:15:49.579048 ip-10-0-142-84 kubenswrapper[2564]: W0709 23:15:49.579026    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d282553_19fa_4df3_88e7_1feeb48a0a26.slice/crio-9a512bb1c57953fbbac4c72d6161449bbf6fa443358817ae1c3af33ce263997b WatchSource:0}: Error finding container 9a512bb1c57953fbbac4c72d6161449bbf6fa443358817ae1c3af33ce263997b: Status 404 returned error can't find the container with id 9a512bb1c57953fbbac4c72d6161449bbf6fa443358817ae1c3af33ce263997b
Jul 09 23:15:49.802940 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:49.802843    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7269-140015658420096"
Jul 09 23:15:49.802940 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:49.802848    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="988342da684a34d76c9217385bd774c56be6716100f649b38672abdf3697b414"
Jul 09 23:15:49.804112 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:49.804079    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7269-140015658420096" event={"ID":"5d282553-19fa-4df3-88e7-1feeb48a0a26","Type":"ContainerStarted","Data":"9a512bb1c57953fbbac4c72d6161449bbf6fa443358817ae1c3af33ce263997b"}
Jul 09 23:15:49.814081 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:49.814052    2564 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7269-140015658420096" oldPodUID="c9eb49c1-905c-4a2c-8f66-5306aff750a0" podUID="5d282553-19fa-4df3-88e7-1feeb48a0a26"
Jul 09 23:15:49.966284 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:49.966261    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9eb49c1-905c-4a2c-8f66-5306aff750a0" path="/var/lib/kubelet/pods/c9eb49c1-905c-4a2c-8f66-5306aff750a0/volumes"
Jul 09 23:15:50.810348 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:50.810317    2564 generic.go:356] "Generic (PLEG): container finished" podID="5d282553-19fa-4df3-88e7-1feeb48a0a26" containerID="d6995011a8d0d2d69b7bdc37191d2d85b39e3e98ba56bc17db8f191b3c4413f6" exitCode=0
Jul 09 23:15:50.810522 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:50.810395    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7269-140015658420096" event={"ID":"5d282553-19fa-4df3-88e7-1feeb48a0a26","Type":"ContainerDied","Data":"d6995011a8d0d2d69b7bdc37191d2d85b39e3e98ba56bc17db8f191b3c4413f6"}
Jul 09 23:15:51.952325 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:51.952296    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7269-140015658420096"
Jul 09 23:15:51.970806 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:51.970782    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7269-140015658420096_5d282553-19fa-4df3-88e7-1feeb48a0a26/test-curl-7269-140015658420096/0.log"
Jul 09 23:15:51.995548 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:51.995513    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7269-140015658420096"]
Jul 09 23:15:51.999112 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:51.999085    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7269-140015658420096"]
Jul 09 23:15:52.013089 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:52.013064    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8gkv\" (UniqueName: \"kubernetes.io/projected/5d282553-19fa-4df3-88e7-1feeb48a0a26-kube-api-access-z8gkv\") pod \"5d282553-19fa-4df3-88e7-1feeb48a0a26\" (UID: \"5d282553-19fa-4df3-88e7-1feeb48a0a26\") "
Jul 09 23:15:52.015078 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:52.015057    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d282553-19fa-4df3-88e7-1feeb48a0a26-kube-api-access-z8gkv" (OuterVolumeSpecName: "kube-api-access-z8gkv") pod "5d282553-19fa-4df3-88e7-1feeb48a0a26" (UID: "5d282553-19fa-4df3-88e7-1feeb48a0a26"). InnerVolumeSpecName "kube-api-access-z8gkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:15:52.114385 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:52.114276    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8gkv\" (UniqueName: \"kubernetes.io/projected/5d282553-19fa-4df3-88e7-1feeb48a0a26-kube-api-access-z8gkv\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:15:52.821907 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:52.821865    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a512bb1c57953fbbac4c72d6161449bbf6fa443358817ae1c3af33ce263997b"
Jul 09 23:15:52.821907 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:52.821907    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7269-140015658420096"
Jul 09 23:15:52.831117 ip-10-0-142-84 kubenswrapper[2564]: E0709 23:15:52.831093    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7269-140015658420096\" is forbidden: User \"system:node:ip-10-0-142-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-142-84.ec2.internal' and this object" podUID="5d282553-19fa-4df3-88e7-1feeb48a0a26" pod="openshift-ingress/test-curl-7269-140015658420096"
Jul 09 23:15:53.296112 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.296069    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5" podUID="c4e8506d-05f4-4eab-afcd-42aa58600f1e" containerName="main" containerID="cri-o://bb1c7b49b455a422b80fb8ac9542ebd02dc2c644c948dfca9f9694ceeff52940" gracePeriod=45
Jul 09 23:15:53.545526 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.545504    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"
Jul 09 23:15:53.562129 ip-10-0-142-84 kubenswrapper[2564]: E0709 23:15:53.562064    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7269-140015658420096\" is forbidden: User \"system:node:ip-10-0-142-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-142-84.ec2.internal' and this object" podUID="5d282553-19fa-4df3-88e7-1feeb48a0a26" pod="openshift-ingress/test-curl-7269-140015658420096"
Jul 09 23:15:53.626545 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.626518    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4e8506d-05f4-4eab-afcd-42aa58600f1e-model-cache\") pod \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\" (UID: \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\") "
Jul 09 23:15:53.626725 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.626569    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4e8506d-05f4-4eab-afcd-42aa58600f1e-tmp-dir\") pod \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\" (UID: \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\") "
Jul 09 23:15:53.626725 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.626612    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4e8506d-05f4-4eab-afcd-42aa58600f1e-tls-certs\") pod \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\" (UID: \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\") "
Jul 09 23:15:53.626725 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.626667    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sb72l\" (UniqueName: \"kubernetes.io/projected/c4e8506d-05f4-4eab-afcd-42aa58600f1e-kube-api-access-sb72l\") pod \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\" (UID: \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\") "
Jul 09 23:15:53.626725 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.626725    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4e8506d-05f4-4eab-afcd-42aa58600f1e-home\") pod \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\" (UID: \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\") "
Jul 09 23:15:53.626988 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.626761    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4e8506d-05f4-4eab-afcd-42aa58600f1e-dshm\") pod \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\" (UID: \"c4e8506d-05f4-4eab-afcd-42aa58600f1e\") "
Jul 09 23:15:53.626988 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.626822    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4e8506d-05f4-4eab-afcd-42aa58600f1e-model-cache" (OuterVolumeSpecName: "model-cache") pod "c4e8506d-05f4-4eab-afcd-42aa58600f1e" (UID: "c4e8506d-05f4-4eab-afcd-42aa58600f1e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:15:53.626988 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.626960    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4e8506d-05f4-4eab-afcd-42aa58600f1e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c4e8506d-05f4-4eab-afcd-42aa58600f1e" (UID: "c4e8506d-05f4-4eab-afcd-42aa58600f1e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:15:53.627163 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.627146    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4e8506d-05f4-4eab-afcd-42aa58600f1e-model-cache\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:15:53.627216 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.627153    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4e8506d-05f4-4eab-afcd-42aa58600f1e-home" (OuterVolumeSpecName: "home") pod "c4e8506d-05f4-4eab-afcd-42aa58600f1e" (UID: "c4e8506d-05f4-4eab-afcd-42aa58600f1e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:15:53.627216 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.627170    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4e8506d-05f4-4eab-afcd-42aa58600f1e-tmp-dir\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:15:53.629328 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.629305    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4e8506d-05f4-4eab-afcd-42aa58600f1e-dshm" (OuterVolumeSpecName: "dshm") pod "c4e8506d-05f4-4eab-afcd-42aa58600f1e" (UID: "c4e8506d-05f4-4eab-afcd-42aa58600f1e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:15:53.629444 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.629381    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4e8506d-05f4-4eab-afcd-42aa58600f1e-kube-api-access-sb72l" (OuterVolumeSpecName: "kube-api-access-sb72l") pod "c4e8506d-05f4-4eab-afcd-42aa58600f1e" (UID: "c4e8506d-05f4-4eab-afcd-42aa58600f1e"). InnerVolumeSpecName "kube-api-access-sb72l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:15:53.629525 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.629506    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4e8506d-05f4-4eab-afcd-42aa58600f1e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c4e8506d-05f4-4eab-afcd-42aa58600f1e" (UID: "c4e8506d-05f4-4eab-afcd-42aa58600f1e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 23:15:53.728221 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.728187    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4e8506d-05f4-4eab-afcd-42aa58600f1e-home\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:15:53.728221 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.728214    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4e8506d-05f4-4eab-afcd-42aa58600f1e-dshm\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:15:53.728221 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.728225    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4e8506d-05f4-4eab-afcd-42aa58600f1e-tls-certs\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:15:53.728453 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.728238    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sb72l\" (UniqueName: \"kubernetes.io/projected/c4e8506d-05f4-4eab-afcd-42aa58600f1e-kube-api-access-sb72l\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:15:53.828069 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.827986    2564 generic.go:356] "Generic (PLEG): container finished" podID="c4e8506d-05f4-4eab-afcd-42aa58600f1e" containerID="bb1c7b49b455a422b80fb8ac9542ebd02dc2c644c948dfca9f9694ceeff52940" exitCode=0
Jul 09 23:15:53.828069 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.828025    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"
Jul 09 23:15:53.828069 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.828064    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5" event={"ID":"c4e8506d-05f4-4eab-afcd-42aa58600f1e","Type":"ContainerDied","Data":"bb1c7b49b455a422b80fb8ac9542ebd02dc2c644c948dfca9f9694ceeff52940"}
Jul 09 23:15:53.828303 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.828100    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5" event={"ID":"c4e8506d-05f4-4eab-afcd-42aa58600f1e","Type":"ContainerDied","Data":"fafd87a6e924cf62754886225d79b23fc54e55778eb1b955ec01f118415dd60f"}
Jul 09 23:15:53.828303 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.828117    2564 scope.go:117] "RemoveContainer" containerID="bb1c7b49b455a422b80fb8ac9542ebd02dc2c644c948dfca9f9694ceeff52940"
Jul 09 23:15:53.832613 ip-10-0-142-84 kubenswrapper[2564]: E0709 23:15:53.832587    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7269-140015658420096\" is forbidden: User \"system:node:ip-10-0-142-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-142-84.ec2.internal' and this object" podUID="5d282553-19fa-4df3-88e7-1feeb48a0a26" pod="openshift-ingress/test-curl-7269-140015658420096"
Jul 09 23:15:53.838956 ip-10-0-142-84 kubenswrapper[2564]: E0709 23:15:53.838925    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7269-140015658420096\" is forbidden: User \"system:node:ip-10-0-142-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-142-84.ec2.internal' and this object" podUID="5d282553-19fa-4df3-88e7-1feeb48a0a26" pod="openshift-ingress/test-curl-7269-140015658420096"
Jul 09 23:15:53.839654 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.839639    2564 scope.go:117] "RemoveContainer" containerID="bb1c7b49b455a422b80fb8ac9542ebd02dc2c644c948dfca9f9694ceeff52940"
Jul 09 23:15:53.839927 ip-10-0-142-84 kubenswrapper[2564]: E0709 23:15:53.839901    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb1c7b49b455a422b80fb8ac9542ebd02dc2c644c948dfca9f9694ceeff52940\": container with ID starting with bb1c7b49b455a422b80fb8ac9542ebd02dc2c644c948dfca9f9694ceeff52940 not found: ID does not exist" containerID="bb1c7b49b455a422b80fb8ac9542ebd02dc2c644c948dfca9f9694ceeff52940"
Jul 09 23:15:53.840028 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.839943    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb1c7b49b455a422b80fb8ac9542ebd02dc2c644c948dfca9f9694ceeff52940"} err="failed to get container status \"bb1c7b49b455a422b80fb8ac9542ebd02dc2c644c948dfca9f9694ceeff52940\": rpc error: code = NotFound desc = could not find container \"bb1c7b49b455a422b80fb8ac9542ebd02dc2c644c948dfca9f9694ceeff52940\": container with ID starting with bb1c7b49b455a422b80fb8ac9542ebd02dc2c644c948dfca9f9694ceeff52940 not found: ID does not exist"
Jul 09 23:15:53.850204 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.850183    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"]
Jul 09 23:15:53.852048 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.852029    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-566ef9/rate-test-model-566ef9-kserve-5995dd46bc-qhst5"]
Jul 09 23:15:53.965811 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.965784    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d282553-19fa-4df3-88e7-1feeb48a0a26" path="/var/lib/kubelet/pods/5d282553-19fa-4df3-88e7-1feeb48a0a26/volumes"
Jul 09 23:15:53.966231 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:53.966218    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4e8506d-05f4-4eab-afcd-42aa58600f1e" path="/var/lib/kubelet/pods/c4e8506d-05f4-4eab-afcd-42aa58600f1e/volumes"
Jul 09 23:15:54.175097 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.175002    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds" podUID="20206cb7-f50e-4b03-b1f4-e4f57ae127cf" containerName="main" containerID="cri-o://fe33c466a81d4c3b5a1895f0688acbf78ff22184a8cbb2f33e43e4e65c5e9e32" gracePeriod=45
Jul 09 23:15:54.432412 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.432391    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"
Jul 09 23:15:54.536838 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.536811    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-tmp-dir\") pod \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\" (UID: \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\") "
Jul 09 23:15:54.537003 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.536864    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6xs9\" (UniqueName: \"kubernetes.io/projected/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-kube-api-access-j6xs9\") pod \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\" (UID: \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\") "
Jul 09 23:15:54.537003 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.536908    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-model-cache\") pod \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\" (UID: \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\") "
Jul 09 23:15:54.537003 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.536943    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-dshm\") pod \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\" (UID: \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\") "
Jul 09 23:15:54.537160 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.537005    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-tls-certs\") pod \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\" (UID: \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\") "
Jul 09 23:15:54.537160 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.537020    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-home\") pod \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\" (UID: \"20206cb7-f50e-4b03-b1f4-e4f57ae127cf\") "
Jul 09 23:15:54.537160 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.537127    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "20206cb7-f50e-4b03-b1f4-e4f57ae127cf" (UID: "20206cb7-f50e-4b03-b1f4-e4f57ae127cf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:15:54.537324 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.537220    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-model-cache" (OuterVolumeSpecName: "model-cache") pod "20206cb7-f50e-4b03-b1f4-e4f57ae127cf" (UID: "20206cb7-f50e-4b03-b1f4-e4f57ae127cf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:15:54.537385 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.537341    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-home" (OuterVolumeSpecName: "home") pod "20206cb7-f50e-4b03-b1f4-e4f57ae127cf" (UID: "20206cb7-f50e-4b03-b1f4-e4f57ae127cf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:15:54.537385 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.537352    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-model-cache\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:15:54.537385 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.537372    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-tmp-dir\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:15:54.539060 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.539036    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-dshm" (OuterVolumeSpecName: "dshm") pod "20206cb7-f50e-4b03-b1f4-e4f57ae127cf" (UID: "20206cb7-f50e-4b03-b1f4-e4f57ae127cf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:15:54.539060 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.539048    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "20206cb7-f50e-4b03-b1f4-e4f57ae127cf" (UID: "20206cb7-f50e-4b03-b1f4-e4f57ae127cf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 23:15:54.539217 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.539087    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-kube-api-access-j6xs9" (OuterVolumeSpecName: "kube-api-access-j6xs9") pod "20206cb7-f50e-4b03-b1f4-e4f57ae127cf" (UID: "20206cb7-f50e-4b03-b1f4-e4f57ae127cf"). InnerVolumeSpecName "kube-api-access-j6xs9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:15:54.638013 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.637969    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6xs9\" (UniqueName: \"kubernetes.io/projected/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-kube-api-access-j6xs9\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:15:54.638013 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.638009    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-dshm\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:15:54.638013 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.638020    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-tls-certs\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:15:54.638013 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.638028    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20206cb7-f50e-4b03-b1f4-e4f57ae127cf-home\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:15:54.833899 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.833803    2564 generic.go:356] "Generic (PLEG): container finished" podID="20206cb7-f50e-4b03-b1f4-e4f57ae127cf" containerID="fe33c466a81d4c3b5a1895f0688acbf78ff22184a8cbb2f33e43e4e65c5e9e32" exitCode=0
Jul 09 23:15:54.833899 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.833860    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"
Jul 09 23:15:54.834130 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.833902    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds" event={"ID":"20206cb7-f50e-4b03-b1f4-e4f57ae127cf","Type":"ContainerDied","Data":"fe33c466a81d4c3b5a1895f0688acbf78ff22184a8cbb2f33e43e4e65c5e9e32"}
Jul 09 23:15:54.834130 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.833954    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds" event={"ID":"20206cb7-f50e-4b03-b1f4-e4f57ae127cf","Type":"ContainerDied","Data":"30ba0b64ee6495087577b083e69c5bb8e42b54249028fdf77de4293050c000fc"}
Jul 09 23:15:54.834130 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.833976    2564 scope.go:117] "RemoveContainer" containerID="fe33c466a81d4c3b5a1895f0688acbf78ff22184a8cbb2f33e43e4e65c5e9e32"
Jul 09 23:15:54.843464 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.843447    2564 scope.go:117] "RemoveContainer" containerID="fe33c466a81d4c3b5a1895f0688acbf78ff22184a8cbb2f33e43e4e65c5e9e32"
Jul 09 23:15:54.843717 ip-10-0-142-84 kubenswrapper[2564]: E0709 23:15:54.843698    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe33c466a81d4c3b5a1895f0688acbf78ff22184a8cbb2f33e43e4e65c5e9e32\": container with ID starting with fe33c466a81d4c3b5a1895f0688acbf78ff22184a8cbb2f33e43e4e65c5e9e32 not found: ID does not exist" containerID="fe33c466a81d4c3b5a1895f0688acbf78ff22184a8cbb2f33e43e4e65c5e9e32"
Jul 09 23:15:54.843789 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.843723    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe33c466a81d4c3b5a1895f0688acbf78ff22184a8cbb2f33e43e4e65c5e9e32"} err="failed to get container status \"fe33c466a81d4c3b5a1895f0688acbf78ff22184a8cbb2f33e43e4e65c5e9e32\": rpc error: code = NotFound desc = could not find container \"fe33c466a81d4c3b5a1895f0688acbf78ff22184a8cbb2f33e43e4e65c5e9e32\": container with ID starting with fe33c466a81d4c3b5a1895f0688acbf78ff22184a8cbb2f33e43e4e65c5e9e32 not found: ID does not exist"
Jul 09 23:15:54.853962 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.853939    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"]
Jul 09 23:15:54.858714 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:54.858693    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-57ed9c/rate-test-model-57ed9c-kserve-594ffb5bc9-ql4ds"]
Jul 09 23:15:55.231845 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:55.231814    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7269-140015658421104"]
Jul 09 23:15:55.232216 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:55.232203    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4e8506d-05f4-4eab-afcd-42aa58600f1e" containerName="main"
Jul 09 23:15:55.232276 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:55.232219    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4e8506d-05f4-4eab-afcd-42aa58600f1e" containerName="main"
Jul 09 23:15:55.232276 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:55.232236    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d282553-19fa-4df3-88e7-1feeb48a0a26" containerName="test-curl-7269-140015658420096"
Jul 09 23:15:55.232276 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:55.232242    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d282553-19fa-4df3-88e7-1feeb48a0a26" containerName="test-curl-7269-140015658420096"
Jul 09 23:15:55.232276 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:55.232259    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20206cb7-f50e-4b03-b1f4-e4f57ae127cf" containerName="main"
Jul 09 23:15:55.232276 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:55.232265    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="20206cb7-f50e-4b03-b1f4-e4f57ae127cf" containerName="main"
Jul 09 23:15:55.232435 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:55.232333    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4e8506d-05f4-4eab-afcd-42aa58600f1e" containerName="main"
Jul 09 23:15:55.232435 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:55.232340    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d282553-19fa-4df3-88e7-1feeb48a0a26" containerName="test-curl-7269-140015658420096"
Jul 09 23:15:55.232435 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:55.232349    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="20206cb7-f50e-4b03-b1f4-e4f57ae127cf" containerName="main"
Jul 09 23:15:55.236717 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:55.236702    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7269-140015658421104"
Jul 09 23:15:55.238698 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:55.238666    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-gqbhf\""
Jul 09 23:15:55.241559 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:55.241539    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7269-140015658421104"]
Jul 09 23:15:55.342941 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:55.342899    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2rnd\" (UniqueName: \"kubernetes.io/projected/91b609ee-c9dd-47c2-a196-2bbfa1b64c74-kube-api-access-p2rnd\") pod \"test-curl-7269-140015658421104\" (UID: \"91b609ee-c9dd-47c2-a196-2bbfa1b64c74\") " pod="openshift-ingress/test-curl-7269-140015658421104"
Jul 09 23:15:55.444295 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:55.444257    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2rnd\" (UniqueName: \"kubernetes.io/projected/91b609ee-c9dd-47c2-a196-2bbfa1b64c74-kube-api-access-p2rnd\") pod \"test-curl-7269-140015658421104\" (UID: \"91b609ee-c9dd-47c2-a196-2bbfa1b64c74\") " pod="openshift-ingress/test-curl-7269-140015658421104"
Jul 09 23:15:55.452749 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:55.452727    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2rnd\" (UniqueName: \"kubernetes.io/projected/91b609ee-c9dd-47c2-a196-2bbfa1b64c74-kube-api-access-p2rnd\") pod \"test-curl-7269-140015658421104\" (UID: \"91b609ee-c9dd-47c2-a196-2bbfa1b64c74\") " pod="openshift-ingress/test-curl-7269-140015658421104"
Jul 09 23:15:55.547235 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:55.547154    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7269-140015658421104"
Jul 09 23:15:55.678209 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:55.678176    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7269-140015658421104"]
Jul 09 23:15:55.681264 ip-10-0-142-84 kubenswrapper[2564]: W0709 23:15:55.681232    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91b609ee_c9dd_47c2_a196_2bbfa1b64c74.slice/crio-85da52eec73e54623c05e479dc0868bd94106eba958b5918217d72b523cfd16d WatchSource:0}: Error finding container 85da52eec73e54623c05e479dc0868bd94106eba958b5918217d72b523cfd16d: Status 404 returned error can't find the container with id 85da52eec73e54623c05e479dc0868bd94106eba958b5918217d72b523cfd16d
Jul 09 23:15:55.841637 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:55.841553    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7269-140015658421104" event={"ID":"91b609ee-c9dd-47c2-a196-2bbfa1b64c74","Type":"ContainerStarted","Data":"85da52eec73e54623c05e479dc0868bd94106eba958b5918217d72b523cfd16d"}
Jul 09 23:15:55.965527 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:55.965495    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20206cb7-f50e-4b03-b1f4-e4f57ae127cf" path="/var/lib/kubelet/pods/20206cb7-f50e-4b03-b1f4-e4f57ae127cf/volumes"
Jul 09 23:15:56.848617 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:56.848530    2564 generic.go:356] "Generic (PLEG): container finished" podID="91b609ee-c9dd-47c2-a196-2bbfa1b64c74" containerID="7042f14827adb38c39ebee506675e186f615f3d4c1dbb403d1bc993a57a89a1e" exitCode=0
Jul 09 23:15:56.848617 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:56.848589    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7269-140015658421104" event={"ID":"91b609ee-c9dd-47c2-a196-2bbfa1b64c74","Type":"ContainerDied","Data":"7042f14827adb38c39ebee506675e186f615f3d4c1dbb403d1bc993a57a89a1e"}
Jul 09 23:15:58.001906 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:58.001883    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7269-140015658421104"
Jul 09 23:15:58.023164 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:58.023143    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7269-140015658421104_91b609ee-c9dd-47c2-a196-2bbfa1b64c74/test-curl-7269-140015658421104/0.log"
Jul 09 23:15:58.046457 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:58.046433    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7269-140015658421104"]
Jul 09 23:15:58.053386 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:58.053361    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7269-140015658421104"]
Jul 09 23:15:58.067967 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:58.067945    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2rnd\" (UniqueName: \"kubernetes.io/projected/91b609ee-c9dd-47c2-a196-2bbfa1b64c74-kube-api-access-p2rnd\") pod \"91b609ee-c9dd-47c2-a196-2bbfa1b64c74\" (UID: \"91b609ee-c9dd-47c2-a196-2bbfa1b64c74\") "
Jul 09 23:15:58.070162 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:58.070136    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91b609ee-c9dd-47c2-a196-2bbfa1b64c74-kube-api-access-p2rnd" (OuterVolumeSpecName: "kube-api-access-p2rnd") pod "91b609ee-c9dd-47c2-a196-2bbfa1b64c74" (UID: "91b609ee-c9dd-47c2-a196-2bbfa1b64c74"). InnerVolumeSpecName "kube-api-access-p2rnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:15:58.169194 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:58.169117    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2rnd\" (UniqueName: \"kubernetes.io/projected/91b609ee-c9dd-47c2-a196-2bbfa1b64c74-kube-api-access-p2rnd\") on node \"ip-10-0-142-84.ec2.internal\" DevicePath \"\""
Jul 09 23:15:58.859494 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:58.859466    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85da52eec73e54623c05e479dc0868bd94106eba958b5918217d72b523cfd16d"
Jul 09 23:15:58.859494 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:58.859495    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7269-140015658421104"
Jul 09 23:15:58.868887 ip-10-0-142-84 kubenswrapper[2564]: E0709 23:15:58.868842    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7269-140015658421104\" is forbidden: User \"system:node:ip-10-0-142-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-142-84.ec2.internal' and this object" podUID="91b609ee-c9dd-47c2-a196-2bbfa1b64c74" pod="openshift-ingress/test-curl-7269-140015658421104"
Jul 09 23:15:59.965500 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:15:59.965469    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91b609ee-c9dd-47c2-a196-2bbfa1b64c74" path="/var/lib/kubelet/pods/91b609ee-c9dd-47c2-a196-2bbfa1b64c74/volumes"
Jul 09 23:16:02.424517 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:02.424483    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:16:14.121549 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:14.121511    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wq7rb"]
Jul 09 23:16:18.322488 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:18.322459    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54dbdc554f-pv5st_951aecc0-8eba-4299-9716-42b531b51b5b/copy-manifests/0.log"
Jul 09 23:16:18.329659 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:18.329636    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54dbdc554f-pv5st_951aecc0-8eba-4299-9716-42b531b51b5b/manager/0.log"
Jul 09 23:16:20.915428 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:20.915394    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mkbdw_617ffbd8-bd75-4f6a-b272-67beed0ed3e6/manager/0.log"
Jul 09 23:16:21.282972 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:21.282941    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-k8txx_0f46a625-38a3-4296-8e60-82ea59dc9acf/manager/0.log"
Jul 09 23:16:21.415180 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:21.415152    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wq7rb_8fde3a27-6485-4c54-9d91-fa10e361aa8d/limitador/0.log"
Jul 09 23:16:22.143220 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:22.143188    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6965988765-cz682_d2a75b38-1b6a-4b3f-9867-02630a73bdef/kube-auth-proxy/0.log"
Jul 09 23:16:23.595315 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:23.595284    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-5hvbd_c416cb22-5f72-4733-b651-0df7b5d96863/main/0.log"
Jul 09 23:16:28.345225 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:28.345193    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bnh24/must-gather-mlnlx"]
Jul 09 23:16:28.345589 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:28.345547    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91b609ee-c9dd-47c2-a196-2bbfa1b64c74" containerName="test-curl-7269-140015658421104"
Jul 09 23:16:28.345589 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:28.345558    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="91b609ee-c9dd-47c2-a196-2bbfa1b64c74" containerName="test-curl-7269-140015658421104"
Jul 09 23:16:28.345661 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:28.345630    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="91b609ee-c9dd-47c2-a196-2bbfa1b64c74" containerName="test-curl-7269-140015658421104"
Jul 09 23:16:28.350765 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:28.350746    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bnh24/must-gather-mlnlx"
Jul 09 23:16:28.352897 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:28.352858    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bnh24\"/\"openshift-service-ca.crt\""
Jul 09 23:16:28.352897 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:28.352895    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bnh24\"/\"kube-root-ca.crt\""
Jul 09 23:16:28.353351 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:28.353338    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bnh24\"/\"default-dockercfg-f4t74\""
Jul 09 23:16:28.359531 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:28.359507    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bnh24/must-gather-mlnlx"]
Jul 09 23:16:28.424724 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:28.424700    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3b18909e-9e4a-4fa5-9913-819f4157ba73-must-gather-output\") pod \"must-gather-mlnlx\" (UID: \"3b18909e-9e4a-4fa5-9913-819f4157ba73\") " pod="openshift-must-gather-bnh24/must-gather-mlnlx"
Jul 09 23:16:28.424826 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:28.424725    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5h77\" (UniqueName: \"kubernetes.io/projected/3b18909e-9e4a-4fa5-9913-819f4157ba73-kube-api-access-j5h77\") pod \"must-gather-mlnlx\" (UID: \"3b18909e-9e4a-4fa5-9913-819f4157ba73\") " pod="openshift-must-gather-bnh24/must-gather-mlnlx"
Jul 09 23:16:28.526071 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:28.526040    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3b18909e-9e4a-4fa5-9913-819f4157ba73-must-gather-output\") pod \"must-gather-mlnlx\" (UID: \"3b18909e-9e4a-4fa5-9913-819f4157ba73\") " pod="openshift-must-gather-bnh24/must-gather-mlnlx"
Jul 09 23:16:28.526071 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:28.526070    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5h77\" (UniqueName: \"kubernetes.io/projected/3b18909e-9e4a-4fa5-9913-819f4157ba73-kube-api-access-j5h77\") pod \"must-gather-mlnlx\" (UID: \"3b18909e-9e4a-4fa5-9913-819f4157ba73\") " pod="openshift-must-gather-bnh24/must-gather-mlnlx"
Jul 09 23:16:28.526430 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:28.526411    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3b18909e-9e4a-4fa5-9913-819f4157ba73-must-gather-output\") pod \"must-gather-mlnlx\" (UID: \"3b18909e-9e4a-4fa5-9913-819f4157ba73\") " pod="openshift-must-gather-bnh24/must-gather-mlnlx"
Jul 09 23:16:28.533352 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:28.533325    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5h77\" (UniqueName: \"kubernetes.io/projected/3b18909e-9e4a-4fa5-9913-819f4157ba73-kube-api-access-j5h77\") pod \"must-gather-mlnlx\" (UID: \"3b18909e-9e4a-4fa5-9913-819f4157ba73\") " pod="openshift-must-gather-bnh24/must-gather-mlnlx"
Jul 09 23:16:28.660571 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:28.660504    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bnh24/must-gather-mlnlx"
Jul 09 23:16:28.790270 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:28.790240    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bnh24/must-gather-mlnlx"]
Jul 09 23:16:28.793183 ip-10-0-142-84 kubenswrapper[2564]: W0709 23:16:28.793158    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b18909e_9e4a_4fa5_9913_819f4157ba73.slice/crio-50dc98724f5e7ca8de79f28ed01391f73af3c380912daad483bdace3dbc1d8d1 WatchSource:0}: Error finding container 50dc98724f5e7ca8de79f28ed01391f73af3c380912daad483bdace3dbc1d8d1: Status 404 returned error can't find the container with id 50dc98724f5e7ca8de79f28ed01391f73af3c380912daad483bdace3dbc1d8d1
Jul 09 23:16:29.007677 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:29.007648    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bnh24/must-gather-mlnlx" event={"ID":"3b18909e-9e4a-4fa5-9913-819f4157ba73","Type":"ContainerStarted","Data":"50dc98724f5e7ca8de79f28ed01391f73af3c380912daad483bdace3dbc1d8d1"}
Jul 09 23:16:30.019072 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:30.019030    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bnh24/must-gather-mlnlx" event={"ID":"3b18909e-9e4a-4fa5-9913-819f4157ba73","Type":"ContainerStarted","Data":"16e8ee11d4e82778682fd8bf1d409af8759645b5d76bdf4c869bfef5ef851096"}
Jul 09 23:16:31.027240 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:31.027203    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bnh24/must-gather-mlnlx" event={"ID":"3b18909e-9e4a-4fa5-9913-819f4157ba73","Type":"ContainerStarted","Data":"7587a360e220f3506a9d9286c7aaef46a4e6e9eec1c81b74fc58fe7ab212372d"}
Jul 09 23:16:31.042469 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:31.042422    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bnh24/must-gather-mlnlx" podStartSLOduration=1.9735430840000001 podStartE2EDuration="3.042406479s" totalImagesPullingTime="1.068863395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:16:31.040891838 +0000 UTC m=+2645.748787427" watchObservedRunningTime="2026-07-09 23:16:31.042406479 +0000 UTC m=+2645.750302060"
Jul 09 23:16:31.407807 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:31.407719    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g9tnl_f95a3161-5787-4d60-b2ea-7c6222a168c7/global-pull-secret-syncer/0.log"
Jul 09 23:16:31.518682 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:31.518654    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bdts6_f583e68f-51a9-41f6-93e6-e614945e189a/konnectivity-agent/0.log"
Jul 09 23:16:31.612051 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:31.612018    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-84.ec2.internal_72ab890cca4207a62d6e551584e9677e/haproxy/0.log"
Jul 09 23:16:36.669015 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:36.668982    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mkbdw_617ffbd8-bd75-4f6a-b272-67beed0ed3e6/manager/0.log"
Jul 09 23:16:36.968439 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:36.968403    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-k8txx_0f46a625-38a3-4296-8e60-82ea59dc9acf/manager/0.log"
Jul 09 23:16:36.991178 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:36.991099    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wq7rb_8fde3a27-6485-4c54-9d91-fa10e361aa8d/limitador/0.log"
Jul 09 23:16:38.829807 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:38.829773    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-ml5qk_1e7ee03d-8eda-4a91-8c2b-4360384fc4ea/cluster-monitoring-operator/0.log"
Jul 09 23:16:38.943143 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:38.943073    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-tsg2g_2d867d2a-90ad-46bd-8f81-2b7cd2298e00/monitoring-plugin/0.log"
Jul 09 23:16:39.056711 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:39.056590    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nch5w_dc7a487d-1cab-4257-b4f3-efc49c43ef1f/node-exporter/0.log"
Jul 09 23:16:39.077576 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:39.077545    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nch5w_dc7a487d-1cab-4257-b4f3-efc49c43ef1f/kube-rbac-proxy/0.log"
Jul 09 23:16:39.104603 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:39.104574    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nch5w_dc7a487d-1cab-4257-b4f3-efc49c43ef1f/init-textfile/0.log"
Jul 09 23:16:39.216347 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:39.216315    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-9bv6z_25958d91-7acb-4fc5-8171-16b5dc228075/kube-rbac-proxy-main/0.log"
Jul 09 23:16:39.235817 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:39.235784    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-9bv6z_25958d91-7acb-4fc5-8171-16b5dc228075/kube-rbac-proxy-self/0.log"
Jul 09 23:16:39.256796 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:39.256767    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-9bv6z_25958d91-7acb-4fc5-8171-16b5dc228075/openshift-state-metrics/0.log"
Jul 09 23:16:39.291662 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:39.291605    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_618ca858-8bdc-491b-ad05-84fe643e6261/prometheus/0.log"
Jul 09 23:16:39.311403 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:39.311323    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_618ca858-8bdc-491b-ad05-84fe643e6261/config-reloader/0.log"
Jul 09 23:16:39.332189 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:39.332165    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_618ca858-8bdc-491b-ad05-84fe643e6261/thanos-sidecar/0.log"
Jul 09 23:16:39.358799 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:39.358769    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_618ca858-8bdc-491b-ad05-84fe643e6261/kube-rbac-proxy-web/0.log"
Jul 09 23:16:39.379194 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:39.379172    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_618ca858-8bdc-491b-ad05-84fe643e6261/kube-rbac-proxy/0.log"
Jul 09 23:16:39.399938 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:39.399910    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_618ca858-8bdc-491b-ad05-84fe643e6261/kube-rbac-proxy-thanos/0.log"
Jul 09 23:16:39.422165 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:39.422134    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_618ca858-8bdc-491b-ad05-84fe643e6261/init-config-reloader/0.log"
Jul 09 23:16:39.598176 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:39.598095    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-589c58547d-nm58h_c31db871-5285-4408-ae8b-1bd3a5244a5d/thanos-query/0.log"
Jul 09 23:16:39.620906 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:39.620834    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-589c58547d-nm58h_c31db871-5285-4408-ae8b-1bd3a5244a5d/kube-rbac-proxy-web/0.log"
Jul 09 23:16:39.641190 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:39.641159    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-589c58547d-nm58h_c31db871-5285-4408-ae8b-1bd3a5244a5d/kube-rbac-proxy/0.log"
Jul 09 23:16:39.660262 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:39.660229    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-589c58547d-nm58h_c31db871-5285-4408-ae8b-1bd3a5244a5d/prom-label-proxy/0.log"
Jul 09 23:16:39.680004 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:39.679976    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-589c58547d-nm58h_c31db871-5285-4408-ae8b-1bd3a5244a5d/kube-rbac-proxy-rules/0.log"
Jul 09 23:16:39.708224 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:39.708163    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-589c58547d-nm58h_c31db871-5285-4408-ae8b-1bd3a5244a5d/kube-rbac-proxy-metrics/0.log"
Jul 09 23:16:40.907006 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:40.906965    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-5wtkb_1d270c40-c725-483f-bf1c-41b9e826f8e2/networking-console-plugin/0.log"
Jul 09 23:16:41.361165 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:41.361131    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bnh24/perf-node-gather-daemonset-kgrjg"]
Jul 09 23:16:41.368704 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:41.368670    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-kgrjg"
Jul 09 23:16:41.375668 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:41.375634    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bnh24/perf-node-gather-daemonset-kgrjg"]
Jul 09 23:16:41.458120 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:41.458073    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/283031a5-6438-4a0e-bc03-4809cae8a34c-podres\") pod \"perf-node-gather-daemonset-kgrjg\" (UID: \"283031a5-6438-4a0e-bc03-4809cae8a34c\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-kgrjg"
Jul 09 23:16:41.458351 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:41.458159    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khbhn\" (UniqueName: \"kubernetes.io/projected/283031a5-6438-4a0e-bc03-4809cae8a34c-kube-api-access-khbhn\") pod \"perf-node-gather-daemonset-kgrjg\" (UID: \"283031a5-6438-4a0e-bc03-4809cae8a34c\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-kgrjg"
Jul 09 23:16:41.458351 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:41.458294    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/283031a5-6438-4a0e-bc03-4809cae8a34c-proc\") pod \"perf-node-gather-daemonset-kgrjg\" (UID: \"283031a5-6438-4a0e-bc03-4809cae8a34c\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-kgrjg"
Jul 09 23:16:41.458351 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:41.458338    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/283031a5-6438-4a0e-bc03-4809cae8a34c-lib-modules\") pod \"perf-node-gather-daemonset-kgrjg\" (UID: \"283031a5-6438-4a0e-bc03-4809cae8a34c\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-kgrjg"
Jul 09 23:16:41.458545 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:41.458400    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/283031a5-6438-4a0e-bc03-4809cae8a34c-sys\") pod \"perf-node-gather-daemonset-kgrjg\" (UID: \"283031a5-6438-4a0e-bc03-4809cae8a34c\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-kgrjg"
Jul 09 23:16:41.534754 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:41.534700    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-v29jg_fb564a11-973b-40db-ac7b-a20e2e4bf01d/console-operator/1.log"
Jul 09 23:16:41.541674 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:41.541650    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-v29jg_fb564a11-973b-40db-ac7b-a20e2e4bf01d/console-operator/2.log"
Jul 09 23:16:41.559065 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:41.559032    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/283031a5-6438-4a0e-bc03-4809cae8a34c-proc\") pod \"perf-node-gather-daemonset-kgrjg\" (UID: \"283031a5-6438-4a0e-bc03-4809cae8a34c\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-kgrjg"
Jul 09 23:16:41.559234 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:41.559090    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/283031a5-6438-4a0e-bc03-4809cae8a34c-lib-modules\") pod \"perf-node-gather-daemonset-kgrjg\" (UID: \"283031a5-6438-4a0e-bc03-4809cae8a34c\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-kgrjg"
Jul 09 23:16:41.559234 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:41.559159    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/283031a5-6438-4a0e-bc03-4809cae8a34c-sys\") pod \"perf-node-gather-daemonset-kgrjg\" (UID: \"283031a5-6438-4a0e-bc03-4809cae8a34c\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-kgrjg"
Jul 09 23:16:41.559234 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:41.559225    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/283031a5-6438-4a0e-bc03-4809cae8a34c-podres\") pod \"perf-node-gather-daemonset-kgrjg\" (UID: \"283031a5-6438-4a0e-bc03-4809cae8a34c\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-kgrjg"
Jul 09 23:16:41.559381 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:41.559240    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/283031a5-6438-4a0e-bc03-4809cae8a34c-proc\") pod \"perf-node-gather-daemonset-kgrjg\" (UID: \"283031a5-6438-4a0e-bc03-4809cae8a34c\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-kgrjg"
Jul 09 23:16:41.559381 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:41.559253    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khbhn\" (UniqueName: \"kubernetes.io/projected/283031a5-6438-4a0e-bc03-4809cae8a34c-kube-api-access-khbhn\") pod \"perf-node-gather-daemonset-kgrjg\" (UID: \"283031a5-6438-4a0e-bc03-4809cae8a34c\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-kgrjg"
Jul 09 23:16:41.559381 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:41.559247    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/283031a5-6438-4a0e-bc03-4809cae8a34c-lib-modules\") pod \"perf-node-gather-daemonset-kgrjg\" (UID: \"283031a5-6438-4a0e-bc03-4809cae8a34c\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-kgrjg"
Jul 09 23:16:41.559381 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:41.559353    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/283031a5-6438-4a0e-bc03-4809cae8a34c-podres\") pod \"perf-node-gather-daemonset-kgrjg\" (UID: \"283031a5-6438-4a0e-bc03-4809cae8a34c\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-kgrjg"
Jul 09 23:16:41.559381 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:41.559372    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/283031a5-6438-4a0e-bc03-4809cae8a34c-sys\") pod \"perf-node-gather-daemonset-kgrjg\" (UID: \"283031a5-6438-4a0e-bc03-4809cae8a34c\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-kgrjg"
Jul 09 23:16:41.567434 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:41.567412    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khbhn\" (UniqueName: \"kubernetes.io/projected/283031a5-6438-4a0e-bc03-4809cae8a34c-kube-api-access-khbhn\") pod \"perf-node-gather-daemonset-kgrjg\" (UID: \"283031a5-6438-4a0e-bc03-4809cae8a34c\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-kgrjg"
Jul 09 23:16:41.688276 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:41.688245    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-kgrjg"
Jul 09 23:16:41.904410 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:41.904086    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bnh24/perf-node-gather-daemonset-kgrjg"]
Jul 09 23:16:42.104670 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:42.104614    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-kgrjg" event={"ID":"283031a5-6438-4a0e-bc03-4809cae8a34c","Type":"ContainerStarted","Data":"9e1ff00389f9da32e315c7374e494838cd7771c7f84803354a97c8afc4e47397"}
Jul 09 23:16:42.105140 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:42.104700    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-kgrjg" event={"ID":"283031a5-6438-4a0e-bc03-4809cae8a34c","Type":"ContainerStarted","Data":"32a16dec34876760a735f717bc7eb77613004f8efde01609cd56c81075e5a30e"}
Jul 09 23:16:42.105140 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:42.104891    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-kgrjg"
Jul 09 23:16:42.118261 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:42.118211    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-kgrjg" podStartSLOduration=1.11818507 podStartE2EDuration="1.11818507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 23:16:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:16:42.117686545 +0000 UTC m=+2656.825582133" watchObservedRunningTime="2026-07-09 23:16:42.11818507 +0000 UTC m=+2656.826080654"
Jul 09 23:16:42.167238 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:42.167212    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-pg6hp_ec09072b-d4d9-4284-a116-d6d5b1c65de8/download-server/0.log"
Jul 09 23:16:42.791376 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:42.791349    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-527t2_4efdab1d-67c6-4d97-aca8-42aaf7f7ae53/volume-data-source-validator/0.log"
Jul 09 23:16:43.756282 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:43.756254    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hx7rz_d7db35e3-d753-41f8-af7e-6d7a605e89cd/dns/0.log"
Jul 09 23:16:43.778392 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:43.778368    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hx7rz_d7db35e3-d753-41f8-af7e-6d7a605e89cd/kube-rbac-proxy/0.log"
Jul 09 23:16:43.893972 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:43.893942    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8prz6_545740d3-4dfd-4016-a536-19e114d01fd2/dns-node-resolver/0.log"
Jul 09 23:16:44.470331 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:44.470301    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kvxs4_b814909b-6f08-45e4-87fc-f598576068b0/node-ca/0.log"
Jul 09 23:16:45.560766 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:45.560741    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6965988765-cz682_d2a75b38-1b6a-4b3f-9867-02630a73bdef/kube-auth-proxy/0.log"
Jul 09 23:16:46.448964 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:46.448937    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xv6cj_4c9c71de-bcb4-43da-ac3f-42631496dbdd/serve-healthcheck-canary/0.log"
Jul 09 23:16:46.885175 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:46.885098    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-jk2rs_fa722002-4c5e-4943-a44b-e3cdbcbaf3eb/insights-operator/0.log"
Jul 09 23:16:46.885583 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:46.885518    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-jk2rs_fa722002-4c5e-4943-a44b-e3cdbcbaf3eb/insights-operator/1.log"
Jul 09 23:16:47.035435 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:47.035404    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xql5r_1de4a026-3f71-4b1d-9cc7-9b89969ac2f1/kube-rbac-proxy/0.log"
Jul 09 23:16:47.057693 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:47.057666    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xql5r_1de4a026-3f71-4b1d-9cc7-9b89969ac2f1/exporter/0.log"
Jul 09 23:16:47.078986 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:47.078943    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xql5r_1de4a026-3f71-4b1d-9cc7-9b89969ac2f1/extractor/0.log"
Jul 09 23:16:48.122754 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:48.122728    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-kgrjg"
Jul 09 23:16:49.786402 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:49.786324    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54dbdc554f-pv5st_951aecc0-8eba-4299-9716-42b531b51b5b/manager/0.log"
Jul 09 23:16:49.811020 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:49.810990    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54dbdc554f-pv5st_951aecc0-8eba-4299-9716-42b531b51b5b/copy-manifests/0.log"
Jul 09 23:16:51.044920 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:51.044895    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5f8b5887bc-d24k6_44544d52-b84e-4186-901d-da29a95e71e3/manager/0.log"
Jul 09 23:16:51.805314 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:51.805227    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6965988765-cz682_d2a75b38-1b6a-4b3f-9867-02630a73bdef/kube-auth-proxy/0.log"
Jul 09 23:16:53.114119 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:53.114095    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6965988765-cz682_d2a75b38-1b6a-4b3f-9867-02630a73bdef/kube-auth-proxy/0.log"
Jul 09 23:16:56.036664 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:56.036635    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-z4rw4_e5a63c0e-90dd-4ff7-88e0-17ee3f744164/migrator/0.log"
Jul 09 23:16:56.055624 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:56.055598    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-z4rw4_e5a63c0e-90dd-4ff7-88e0-17ee3f744164/graceful-termination/0.log"
Jul 09 23:16:56.386134 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:56.386030    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-96bwl_7f98ce5f-46f5-4fc8-a621-b4bf20950d95/kube-storage-version-migrator-operator/1.log"
Jul 09 23:16:56.386978 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:56.386954    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-96bwl_7f98ce5f-46f5-4fc8-a621-b4bf20950d95/kube-storage-version-migrator-operator/0.log"
Jul 09 23:16:57.282313 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:57.282281    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8xdm8_28a65a7d-a6a4-48e7-a2ce-0a109e64ae6b/kube-multus/0.log"
Jul 09 23:16:57.460825 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:57.460795    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ftqnt_58f72045-9e77-46a8-a0c5-26d90d2de9bc/kube-multus-additional-cni-plugins/0.log"
Jul 09 23:16:57.479680 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:57.479656    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ftqnt_58f72045-9e77-46a8-a0c5-26d90d2de9bc/egress-router-binary-copy/0.log"
Jul 09 23:16:57.500395 ip-10-0-142-84 kubenswrapper[2564]: I0709 23:16:57.500358    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ftqnt_58f72045-9e77-46a8-a0c5-26d90d2de9bc/cni-plugins/0.log"