Jul 10 02:07:51.106781 ip-10-0-139-215 systemd[1]: Starting Kubernetes Kubelet...
Jul 10 02:07:52.270188 ip-10-0-139-215 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 02:07:52.270188 ip-10-0-139-215 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 10 02:07:52.270188 ip-10-0-139-215 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 02:07:52.270188 ip-10-0-139-215 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 10 02:07:52.270188 ip-10-0-139-215 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 02:07:52.271192 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.271097    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 10 02:07:52.275065 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275048    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 02:07:52.275065 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275066    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 02:07:52.275153 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275070    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 02:07:52.275153 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275074    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 02:07:52.275153 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275078    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 02:07:52.275153 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275081    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 02:07:52.275153 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275084    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 02:07:52.275153 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275087    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 02:07:52.275153 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275090    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 02:07:52.275153 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275093    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 02:07:52.275153 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275095    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 02:07:52.275153 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275098    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 02:07:52.275153 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275114    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 02:07:52.275153 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275117    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 02:07:52.275153 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275120    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 02:07:52.275153 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275123    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 02:07:52.275153 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275126    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 02:07:52.275153 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275129    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 02:07:52.275153 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275132    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 02:07:52.275153 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275135    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 02:07:52.275153 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275139    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 02:07:52.275153 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275143    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 02:07:52.275641 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275146    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 02:07:52.275641 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275149    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 02:07:52.275641 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275151    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 02:07:52.275641 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275154    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 02:07:52.275641 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275157    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 02:07:52.275641 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275160    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 02:07:52.275641 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275163    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 02:07:52.275641 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275167    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 02:07:52.275641 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275170    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 02:07:52.275641 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275172    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 02:07:52.275641 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275175    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 02:07:52.275641 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275178    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 02:07:52.275641 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275181    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 02:07:52.275641 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275184    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 02:07:52.275641 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275187    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 02:07:52.275641 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275189    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 02:07:52.275641 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275192    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 02:07:52.275641 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275195    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 02:07:52.275641 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275197    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 02:07:52.275641 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275200    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 02:07:52.276154 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275203    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 02:07:52.276154 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275205    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 02:07:52.276154 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275210    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 02:07:52.276154 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275214    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 02:07:52.276154 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275219    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 02:07:52.276154 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275224    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 02:07:52.276154 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275227    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 02:07:52.276154 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275230    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 02:07:52.276154 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275233    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 02:07:52.276154 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275235    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 02:07:52.276154 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275238    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 02:07:52.276154 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275242    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 02:07:52.276154 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275245    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 02:07:52.276154 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275248    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 02:07:52.276154 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275252    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 02:07:52.276154 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275255    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 02:07:52.276154 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275258    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 02:07:52.276154 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275261    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 02:07:52.276154 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275264    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 02:07:52.276634 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275266    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 02:07:52.276634 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275269    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 02:07:52.276634 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275272    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 02:07:52.276634 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275274    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 02:07:52.276634 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275279    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 02:07:52.276634 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275283    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 02:07:52.276634 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275286    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 02:07:52.276634 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275290    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 02:07:52.276634 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275293    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 02:07:52.276634 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275297    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 02:07:52.276634 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275303    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 02:07:52.276634 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275307    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 02:07:52.276634 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275309    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 02:07:52.276634 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275312    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 02:07:52.276634 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275315    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 02:07:52.276634 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275318    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 02:07:52.276634 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275320    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 02:07:52.276634 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275323    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 02:07:52.276634 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275326    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 02:07:52.276634 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275329    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 02:07:52.277146 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275333    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 02:07:52.277146 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275336    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 02:07:52.277146 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275338    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 02:07:52.277146 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275341    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 02:07:52.277146 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275344    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 02:07:52.277146 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275347    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 02:07:52.277146 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275351    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 02:07:52.277146 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275354    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 02:07:52.277146 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275356    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 02:07:52.277146 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275359    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 02:07:52.277146 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275362    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 02:07:52.277146 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275364    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 02:07:52.277146 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275367    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 02:07:52.277146 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275370    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 02:07:52.277146 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275373    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 02:07:52.277146 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275376    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 02:07:52.277146 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275379    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 02:07:52.277146 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.275382    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 02:07:52.277146 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276208    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 02:07:52.277146 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276215    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 02:07:52.277658 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276219    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 02:07:52.277658 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276222    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 02:07:52.277658 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276225    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 02:07:52.277658 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276229    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 02:07:52.277658 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276232    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 02:07:52.277658 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276234    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 02:07:52.277658 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276237    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 02:07:52.277658 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276240    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 02:07:52.277658 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276243    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 02:07:52.277658 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276245    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 02:07:52.277658 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276248    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 02:07:52.277658 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276251    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 02:07:52.277658 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276254    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 02:07:52.277658 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276257    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 02:07:52.277658 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276259    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 02:07:52.277658 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276262    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 02:07:52.277658 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276266    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 02:07:52.277658 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276269    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 02:07:52.277658 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276272    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 02:07:52.277658 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276275    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 02:07:52.278182 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276278    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 02:07:52.278182 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276281    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 02:07:52.278182 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276284    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 02:07:52.278182 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276287    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 02:07:52.278182 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276289    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 02:07:52.278182 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276292    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 02:07:52.278182 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276295    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 02:07:52.278182 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276297    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 02:07:52.278182 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276300    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 02:07:52.278182 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276303    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 02:07:52.278182 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276305    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 02:07:52.278182 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276308    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 02:07:52.278182 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276311    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 02:07:52.278182 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276313    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 02:07:52.278182 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276316    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 02:07:52.278182 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276319    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 02:07:52.278182 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276322    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 02:07:52.278182 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276325    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 02:07:52.278182 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276328    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 02:07:52.278655 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276330    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 02:07:52.278655 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276333    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 02:07:52.278655 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276336    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 02:07:52.278655 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276339    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 02:07:52.278655 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276341    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 02:07:52.278655 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276344    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 02:07:52.278655 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276346    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 02:07:52.278655 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276350    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 02:07:52.278655 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276353    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 02:07:52.278655 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276355    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 02:07:52.278655 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276358    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 02:07:52.278655 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276361    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 02:07:52.278655 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276364    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 02:07:52.278655 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276367    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 02:07:52.278655 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276371    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 02:07:52.278655 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276376    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 02:07:52.278655 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276379    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 02:07:52.278655 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276382    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 02:07:52.278655 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276384    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 02:07:52.278655 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276387    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 02:07:52.279208 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276390    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 02:07:52.279208 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276393    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 02:07:52.279208 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276396    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 02:07:52.279208 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276398    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 02:07:52.279208 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276401    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 02:07:52.279208 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276403    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 02:07:52.279208 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276406    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 02:07:52.279208 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276409    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 02:07:52.279208 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276411    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 02:07:52.279208 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276414    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 02:07:52.279208 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276418    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 02:07:52.279208 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276421    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 02:07:52.279208 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276423    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 02:07:52.279208 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276428    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 02:07:52.279208 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276430    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 02:07:52.279208 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276433    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 02:07:52.279208 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276436    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 02:07:52.279208 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276440    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 02:07:52.279208 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276444    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 02:07:52.279208 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276447    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 02:07:52.279714 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276450    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 02:07:52.279714 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276454    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 02:07:52.279714 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276457    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 02:07:52.279714 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276461    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 02:07:52.279714 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276464    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 02:07:52.279714 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276469    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 02:07:52.279714 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276471    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 02:07:52.279714 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276474    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 02:07:52.279714 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276477    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 02:07:52.279714 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276480    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 02:07:52.279714 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276483    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 02:07:52.279714 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276486    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 02:07:52.279714 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276490    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 02:07:52.279714 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276494    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 02:07:52.279714 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276497    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 02:07:52.279714 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276500    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 02:07:52.279714 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276504    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 02:07:52.279714 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276506    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 02:07:52.279714 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276905    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 02:07:52.279714 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276911    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 02:07:52.280259 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276914    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 02:07:52.280259 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276918    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 02:07:52.280259 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276926    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 02:07:52.280259 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276929    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 02:07:52.280259 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276933    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 02:07:52.280259 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276935    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 02:07:52.280259 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276939    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 02:07:52.280259 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276942    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 02:07:52.280259 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276945    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 02:07:52.280259 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276947    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 02:07:52.280259 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276951    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 02:07:52.280259 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276955    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 02:07:52.280259 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276959    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 02:07:52.280259 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276962    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 02:07:52.280259 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276965    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 02:07:52.280259 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276968    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 02:07:52.280259 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276971    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 02:07:52.280259 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276974    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 02:07:52.280259 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276977    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 02:07:52.280259 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276979    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 02:07:52.280766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276983    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 02:07:52.280766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276986    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 02:07:52.280766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276988    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 02:07:52.280766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276991    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 02:07:52.280766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276994    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 02:07:52.280766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276996    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 02:07:52.280766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.276999    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 02:07:52.280766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277002    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 02:07:52.280766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277005    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 02:07:52.280766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277007    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 02:07:52.280766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277010    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 02:07:52.280766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277013    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 02:07:52.280766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277016    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 02:07:52.280766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277018    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 02:07:52.280766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277022    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 02:07:52.280766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277027    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 02:07:52.280766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277031    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 02:07:52.280766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277035    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 02:07:52.280766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277038    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 02:07:52.280766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277041    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 02:07:52.281280 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277044    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 02:07:52.281280 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277047    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 02:07:52.281280 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277049    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 02:07:52.281280 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277052    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 02:07:52.281280 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277055    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 02:07:52.281280 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277057    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 02:07:52.281280 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277060    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 02:07:52.281280 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277063    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 02:07:52.281280 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277065    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 02:07:52.281280 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277068    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 02:07:52.281280 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277071    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 02:07:52.281280 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277073    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 02:07:52.281280 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277076    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 02:07:52.281280 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277079    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 02:07:52.281280 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277081    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 02:07:52.281280 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277084    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 02:07:52.281280 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277087    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 02:07:52.281280 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277090    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 02:07:52.281280 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277093    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 02:07:52.281280 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277095    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 02:07:52.281816 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277098    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 02:07:52.281816 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277115    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 02:07:52.281816 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277117    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 02:07:52.281816 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277121    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 02:07:52.281816 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277123    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 02:07:52.281816 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277126    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 02:07:52.281816 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277131    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 02:07:52.281816 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277134    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 02:07:52.281816 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277138    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 02:07:52.281816 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277141    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 02:07:52.281816 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277143    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 02:07:52.281816 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277146    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 02:07:52.281816 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277149    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 02:07:52.281816 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277152    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 02:07:52.281816 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277155    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 02:07:52.281816 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277158    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 02:07:52.281816 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277161    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 02:07:52.281816 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277164    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 02:07:52.281816 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277166    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 02:07:52.282323 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277170    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 02:07:52.282323 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277173    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 02:07:52.282323 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277176    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 02:07:52.282323 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277179    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 02:07:52.282323 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277181    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 02:07:52.282323 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277184    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 02:07:52.282323 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277187    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 02:07:52.282323 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277190    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 02:07:52.282323 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277192    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 02:07:52.282323 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277195    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 02:07:52.282323 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277198    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 02:07:52.282323 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277202    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 02:07:52.282323 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277206    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 02:07:52.282323 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277209    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 02:07:52.282323 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277212    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 02:07:52.282323 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277215    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 02:07:52.282323 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277218    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 02:07:52.282323 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277221    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 02:07:52.282323 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277301    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jul 10 02:07:52.282323 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277314    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 10 02:07:52.282830 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277323    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jul 10 02:07:52.282830 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277330    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 10 02:07:52.282830 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277338    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 10 02:07:52.282830 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277343    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 10 02:07:52.282830 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277356    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 10 02:07:52.282830 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277362    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 10 02:07:52.282830 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277366    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 10 02:07:52.282830 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277370    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 10 02:07:52.282830 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277374    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 10 02:07:52.282830 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277377    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 10 02:07:52.282830 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277381    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 10 02:07:52.282830 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277384    2576 flags.go:64] FLAG: --cgroup-root=""
Jul 10 02:07:52.282830 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277387    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 10 02:07:52.282830 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277390    2576 flags.go:64] FLAG: --client-ca-file=""
Jul 10 02:07:52.282830 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277393    2576 flags.go:64] FLAG: --cloud-provider="external"
Jul 10 02:07:52.282830 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277397    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jul 10 02:07:52.282830 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277402    2576 flags.go:64] FLAG: --cluster-domain=""
Jul 10 02:07:52.282830 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277406    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 10 02:07:52.282830 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277409    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 10 02:07:52.282830 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277413    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 10 02:07:52.282830 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277416    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jul 10 02:07:52.282830 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277420    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 10 02:07:52.282830 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277424    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 10 02:07:52.283463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277427    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 10 02:07:52.283463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277430    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 10 02:07:52.283463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277434    2576 flags.go:64] FLAG: --contention-profiling="false"
Jul 10 02:07:52.283463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277437    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 10 02:07:52.283463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277440    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 10 02:07:52.283463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277444    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 10 02:07:52.283463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277447    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 10 02:07:52.283463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277452    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 10 02:07:52.283463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277457    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 10 02:07:52.283463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277461    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 10 02:07:52.283463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277464    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jul 10 02:07:52.283463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277467    2576 flags.go:64] FLAG: --enable-server="true"
Jul 10 02:07:52.283463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277471    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 10 02:07:52.283463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277476    2576 flags.go:64] FLAG: --event-burst="100"
Jul 10 02:07:52.283463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277479    2576 flags.go:64] FLAG: --event-qps="50"
Jul 10 02:07:52.283463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277482    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 10 02:07:52.283463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277486    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 10 02:07:52.283463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277489    2576 flags.go:64] FLAG: --eviction-hard=""
Jul 10 02:07:52.283463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277493    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 10 02:07:52.283463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277496    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 10 02:07:52.283463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277499    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 10 02:07:52.283463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277503    2576 flags.go:64] FLAG: --eviction-soft=""
Jul 10 02:07:52.283463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277506    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 10 02:07:52.283463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277509    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 10 02:07:52.283463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277513    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 10 02:07:52.284112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277516    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 10 02:07:52.284112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277519    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 10 02:07:52.284112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277522    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jul 10 02:07:52.284112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277525    2576 flags.go:64] FLAG: --feature-gates=""
Jul 10 02:07:52.284112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277529    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 10 02:07:52.284112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277533    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 10 02:07:52.284112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277536    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 10 02:07:52.284112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277539    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 10 02:07:52.284112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277543    2576 flags.go:64] FLAG: --healthz-port="10248"
Jul 10 02:07:52.284112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277546    2576 flags.go:64] FLAG: --help="false"
Jul 10 02:07:52.284112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277549    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-139-215.ec2.internal"
Jul 10 02:07:52.284112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277552    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 10 02:07:52.284112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277555    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 10 02:07:52.284112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277559    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 10 02:07:52.284112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277562    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 10 02:07:52.284112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277567    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 10 02:07:52.284112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277570    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 10 02:07:52.284112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277573    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jul 10 02:07:52.284112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277576    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 10 02:07:52.284112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277579    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jul 10 02:07:52.284112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277583    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 10 02:07:52.284112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277587    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jul 10 02:07:52.284112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277593    2576 flags.go:64] FLAG: --kube-reserved=""
Jul 10 02:07:52.284112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277596    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 10 02:07:52.284726 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277599    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 10 02:07:52.284726 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277602    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 10 02:07:52.284726 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277605    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 10 02:07:52.284726 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277608    2576 flags.go:64] FLAG: --lock-file=""
Jul 10 02:07:52.284726 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277611    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 10 02:07:52.284726 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277614    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 10 02:07:52.284726 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277618    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 10 02:07:52.284726 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277624    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 10 02:07:52.284726 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277627    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 10 02:07:52.284726 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277630    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 10 02:07:52.284726 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277633    2576 flags.go:64] FLAG: --logging-format="text"
Jul 10 02:07:52.284726 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277636    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 10 02:07:52.284726 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277639    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 10 02:07:52.284726 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277642    2576 flags.go:64] FLAG: --manifest-url=""
Jul 10 02:07:52.284726 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277645    2576 flags.go:64] FLAG: --manifest-url-header=""
Jul 10 02:07:52.284726 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277650    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 10 02:07:52.284726 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277654    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jul 10 02:07:52.284726 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277658    2576 flags.go:64] FLAG: --max-pods="110"
Jul 10 02:07:52.284726 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277662    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 10 02:07:52.284726 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277665    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 10 02:07:52.284726 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277668    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 10 02:07:52.284726 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277671    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 10 02:07:52.284726 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277674    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 10 02:07:52.284726 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277678    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 10 02:07:52.284726 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277681    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 10 02:07:52.285405 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277689    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jul 10 02:07:52.285405 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277692    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 10 02:07:52.285405 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277695    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 10 02:07:52.285405 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277699    2576 flags.go:64] FLAG: --pod-cidr=""
Jul 10 02:07:52.285405 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277702    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 10 02:07:52.285405 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277710    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jul 10 02:07:52.285405 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277713    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 10 02:07:52.285405 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277721    2576 flags.go:64] FLAG: --pods-per-core="0"
Jul 10 02:07:52.285405 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277724    2576 flags.go:64] FLAG: --port="10250"
Jul 10 02:07:52.285405 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277728    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 10 02:07:52.285405 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277731    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ac03c87de5e91515"
Jul 10 02:07:52.285405 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277734    2576 flags.go:64] FLAG: --qos-reserved=""
Jul 10 02:07:52.285405 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277737    2576 flags.go:64] FLAG: --read-only-port="10255"
Jul 10 02:07:52.285405 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277740    2576 flags.go:64] FLAG: --register-node="true"
Jul 10 02:07:52.285405 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277744    2576 flags.go:64] FLAG: --register-with-taints=""
Jul 10 02:07:52.285405 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277748    2576 flags.go:64] FLAG: --registry-burst="10"
Jul 10 02:07:52.285405 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277751    2576 flags.go:64] FLAG: --registry-qps="5"
Jul 10 02:07:52.285405 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277754    2576 flags.go:64] FLAG: --reserved-cpus=""
Jul 10 02:07:52.285405 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277757    2576 flags.go:64] FLAG: --reserved-memory=""
Jul 10 02:07:52.285405 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277761    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 10 02:07:52.285405 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277764    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 10 02:07:52.285405 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277768    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jul 10 02:07:52.285405 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277771    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 10 02:07:52.285405 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277774    2576 flags.go:64] FLAG: --runonce="false"
Jul 10 02:07:52.285405 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277777    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 10 02:07:52.286052 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277780    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 10 02:07:52.286052 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277783    2576 flags.go:64] FLAG: --seccomp-default="false"
Jul 10 02:07:52.286052 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277786    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 10 02:07:52.286052 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277789    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 10 02:07:52.286052 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277792    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 10 02:07:52.286052 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277795    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 10 02:07:52.286052 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277798    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jul 10 02:07:52.286052 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277802    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 10 02:07:52.286052 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277805    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 10 02:07:52.286052 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277808    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jul 10 02:07:52.286052 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277811    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 10 02:07:52.286052 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277814    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 10 02:07:52.286052 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277819    2576 flags.go:64] FLAG: --system-cgroups=""
Jul 10 02:07:52.286052 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277822    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 10 02:07:52.286052 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277828    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 10 02:07:52.286052 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277831    2576 flags.go:64] FLAG: --tls-cert-file=""
Jul 10 02:07:52.286052 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277834    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 10 02:07:52.286052 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277839    2576 flags.go:64] FLAG: --tls-min-version=""
Jul 10 02:07:52.286052 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277842    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jul 10 02:07:52.286052 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277845    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 10 02:07:52.286052 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277848    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 10 02:07:52.286052 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277851    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 10 02:07:52.286052 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277854    2576 flags.go:64] FLAG: --v="2"
Jul 10 02:07:52.286052 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277858    2576 flags.go:64] FLAG: --version="false"
Jul 10 02:07:52.286052 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277863    2576 flags.go:64] FLAG: --vmodule=""
Jul 10 02:07:52.286750 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277867    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 10 02:07:52.286750 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.277871    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 10 02:07:52.286750 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277995    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 02:07:52.286750 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.277999    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 02:07:52.286750 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278003    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 02:07:52.286750 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278006    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 02:07:52.286750 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278009    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 02:07:52.286750 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278013    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 02:07:52.286750 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278017    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 02:07:52.286750 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278020    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 02:07:52.286750 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278024    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 02:07:52.286750 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278027    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 02:07:52.286750 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278030    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 02:07:52.286750 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278033    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 02:07:52.286750 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278036    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 02:07:52.286750 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278039    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 02:07:52.286750 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278042    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 02:07:52.286750 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278044    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 02:07:52.286750 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278047    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 02:07:52.286750 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278051    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 02:07:52.287284 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278056    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 02:07:52.287284 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278060    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 02:07:52.287284 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278063    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 02:07:52.287284 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278066    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 02:07:52.287284 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278069    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 02:07:52.287284 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278071    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 02:07:52.287284 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278076    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 02:07:52.287284 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278080    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 02:07:52.287284 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278083    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 02:07:52.287284 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278085    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 02:07:52.287284 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278088    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 02:07:52.287284 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278091    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 02:07:52.287284 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278094    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 02:07:52.287284 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278096    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 02:07:52.287284 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278111    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 02:07:52.287284 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278115    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 02:07:52.287284 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278118    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 02:07:52.287284 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278120    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 02:07:52.287284 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278123    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 02:07:52.287766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278126    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 02:07:52.287766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278129    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 02:07:52.287766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278132    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 02:07:52.287766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278134    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 02:07:52.287766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278137    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 02:07:52.287766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278140    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 02:07:52.287766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278143    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 02:07:52.287766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278145    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 02:07:52.287766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278148    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 02:07:52.287766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278151    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 02:07:52.287766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278153    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 02:07:52.287766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278156    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 02:07:52.287766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278160    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 02:07:52.287766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278163    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 02:07:52.287766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278166    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 02:07:52.287766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278169    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 02:07:52.287766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278172    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 02:07:52.287766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278175    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 02:07:52.287766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278178    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 02:07:52.287766 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278180    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 02:07:52.288304 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278183    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 02:07:52.288304 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278186    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 02:07:52.288304 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278190    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 02:07:52.288304 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278193    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 02:07:52.288304 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278195    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 02:07:52.288304 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278198    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 02:07:52.288304 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278201    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 02:07:52.288304 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278204    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 02:07:52.288304 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278207    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 02:07:52.288304 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278210    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 02:07:52.288304 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278212    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 02:07:52.288304 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278215    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 02:07:52.288304 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278218    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 02:07:52.288304 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278220    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 02:07:52.288304 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278223    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 02:07:52.288304 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278226    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 02:07:52.288304 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278229    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 02:07:52.288304 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278231    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 02:07:52.288304 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278236    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 02:07:52.288304 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278239    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 02:07:52.288805 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278242    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 02:07:52.288805 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278245    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 02:07:52.288805 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278247    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 02:07:52.288805 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278250    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 02:07:52.288805 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278254    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 02:07:52.288805 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278257    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 02:07:52.288805 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278260    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 02:07:52.288805 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278264    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 02:07:52.288805 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278266    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 02:07:52.288805 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278269    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 02:07:52.288805 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278272    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 02:07:52.288805 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278274    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 02:07:52.288805 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278277    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 02:07:52.288805 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278280    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 02:07:52.288805 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278283    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 02:07:52.288805 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278285    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 02:07:52.288805 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278288    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 02:07:52.288805 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278291    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 02:07:52.288805 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278293    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 02:07:52.289308 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278296    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 02:07:52.289308 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278299    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 02:07:52.289308 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.278301    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 02:07:52.289308 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.278826    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 02:07:52.289308 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.286389    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 10 02:07:52.289308 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.286407    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 10 02:07:52.289308 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.286421    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 10 02:07:52.289308 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.286430    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 10 02:07:52.289308 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286490    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 02:07:52.289308 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286495    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 02:07:52.289308 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286499    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 02:07:52.289308 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286502    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 02:07:52.289308 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286506    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 02:07:52.289308 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286509    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 02:07:52.289308 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286512    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 02:07:52.289712 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286516    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 02:07:52.289712 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286520    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 02:07:52.289712 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286523    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 02:07:52.289712 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286526    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 02:07:52.289712 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286529    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 02:07:52.289712 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286533    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 02:07:52.289712 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286536    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 02:07:52.289712 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286539    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 02:07:52.289712 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286541    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 02:07:52.289712 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286544    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 02:07:52.289712 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286547    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 02:07:52.289712 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286550    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 02:07:52.289712 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286552    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 02:07:52.289712 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286556    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 02:07:52.289712 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286558    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 02:07:52.289712 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286562    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 02:07:52.289712 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286565    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 02:07:52.289712 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286568    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 02:07:52.289712 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286570    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 02:07:52.289712 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286573    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 02:07:52.290223 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286576    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 02:07:52.290223 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286579    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 02:07:52.290223 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286582    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 02:07:52.290223 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286585    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 02:07:52.290223 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286588    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 02:07:52.290223 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286592    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 02:07:52.290223 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286594    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 02:07:52.290223 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286599    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 02:07:52.290223 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286603    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 02:07:52.290223 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286606    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 02:07:52.290223 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286609    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 02:07:52.290223 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286612    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 02:07:52.290223 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286615    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 02:07:52.290223 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286618    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 02:07:52.290223 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286620    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 02:07:52.290223 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286623    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 02:07:52.290223 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286626    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 02:07:52.290223 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286629    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 02:07:52.290223 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286632    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 02:07:52.290716 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286635    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 02:07:52.290716 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286638    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 02:07:52.290716 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286641    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 02:07:52.290716 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286643    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 02:07:52.290716 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286646    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 02:07:52.290716 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286649    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 02:07:52.290716 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286651    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 02:07:52.290716 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286654    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 02:07:52.290716 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286657    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 02:07:52.290716 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286660    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 02:07:52.290716 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286663    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 02:07:52.290716 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286666    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 02:07:52.290716 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286668    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 02:07:52.290716 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286671    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 02:07:52.290716 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286673    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 02:07:52.290716 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286677    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 02:07:52.290716 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286680    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 02:07:52.290716 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286683    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 02:07:52.290716 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286686    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 02:07:52.290716 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286688    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 02:07:52.291255 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286691    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 02:07:52.291255 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286694    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 02:07:52.291255 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286697    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 02:07:52.291255 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286700    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 02:07:52.291255 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286702    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 02:07:52.291255 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286705    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 02:07:52.291255 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286708    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 02:07:52.291255 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286711    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 02:07:52.291255 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286714    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 02:07:52.291255 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286717    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 02:07:52.291255 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286720    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 02:07:52.291255 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286723    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 02:07:52.291255 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286726    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 02:07:52.291255 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286729    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 02:07:52.291255 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286732    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 02:07:52.291255 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286734    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 02:07:52.291255 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286737    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 02:07:52.291255 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286740    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 02:07:52.291255 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286742    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 02:07:52.291778 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286745    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 02:07:52.291778 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286748    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 02:07:52.291778 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286751    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 02:07:52.291778 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286754    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 02:07:52.291778 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286758    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 02:07:52.291778 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286762    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 02:07:52.291778 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286767    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 02:07:52.291778 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286770    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 02:07:52.291778 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286773    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 02:07:52.291778 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286778    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 02:07:52.291778 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286782    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 02:07:52.291778 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286786    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 02:07:52.291778 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286789    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 02:07:52.291778 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286791    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 02:07:52.291778 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.286796    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 02:07:52.292186 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286919    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 02:07:52.292186 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286923    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 02:07:52.292186 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286927    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 02:07:52.292186 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286930    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 02:07:52.292186 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286933    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 02:07:52.292186 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286936    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 02:07:52.292186 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286939    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 02:07:52.292186 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286942    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 02:07:52.292186 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286945    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 02:07:52.292186 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286948    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 02:07:52.292186 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286950    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 02:07:52.292186 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286954    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 02:07:52.292186 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286956    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 02:07:52.292186 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286959    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 02:07:52.292186 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286962    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 02:07:52.292186 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286965    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 02:07:52.292186 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286967    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 02:07:52.292186 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286971    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 02:07:52.292186 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286975    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 02:07:52.292186 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286978    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 02:07:52.292722 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286981    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 02:07:52.292722 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286984    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 02:07:52.292722 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286987    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 02:07:52.292722 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286991    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 02:07:52.292722 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286994    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 02:07:52.292722 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286996    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 02:07:52.292722 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.286999    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 02:07:52.292722 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287002    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 02:07:52.292722 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287005    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 02:07:52.292722 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287008    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 02:07:52.292722 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287010    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 02:07:52.292722 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287013    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 02:07:52.292722 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287016    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 02:07:52.292722 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287018    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 02:07:52.292722 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287021    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 02:07:52.292722 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287024    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 02:07:52.292722 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287026    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 02:07:52.292722 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287029    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 02:07:52.292722 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287031    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 02:07:52.292722 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287034    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 02:07:52.293232 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287037    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 02:07:52.293232 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287039    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 02:07:52.293232 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287042    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 02:07:52.293232 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287045    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 02:07:52.293232 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287049    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 02:07:52.293232 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287052    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 02:07:52.293232 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287054    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 02:07:52.293232 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287057    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 02:07:52.293232 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287061    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 02:07:52.293232 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287064    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 02:07:52.293232 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287068    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 02:07:52.293232 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287071    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 02:07:52.293232 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287074    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 02:07:52.293232 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287077    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 02:07:52.293232 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287080    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 02:07:52.293232 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287083    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 02:07:52.293232 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287086    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 02:07:52.293232 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287089    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 02:07:52.293232 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287092    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 02:07:52.293841 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287094    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 02:07:52.293841 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287097    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 02:07:52.293841 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287120    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 02:07:52.293841 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287124    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 02:07:52.293841 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287127    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 02:07:52.293841 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287130    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 02:07:52.293841 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287133    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 02:07:52.293841 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287136    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 02:07:52.293841 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287139    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 02:07:52.293841 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287142    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 02:07:52.293841 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287145    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 02:07:52.293841 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287148    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 02:07:52.293841 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287151    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 02:07:52.293841 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287155    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 02:07:52.293841 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287159    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 02:07:52.293841 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287162    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 02:07:52.293841 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287165    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 02:07:52.293841 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287167    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 02:07:52.293841 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287171    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 02:07:52.293841 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287174    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 02:07:52.294366 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287177    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 02:07:52.294366 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287179    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 02:07:52.294366 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287182    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 02:07:52.294366 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287185    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 02:07:52.294366 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287188    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 02:07:52.294366 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287191    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 02:07:52.294366 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287193    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 02:07:52.294366 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287196    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 02:07:52.294366 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287199    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 02:07:52.294366 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287202    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 02:07:52.294366 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287205    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 02:07:52.294366 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287207    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 02:07:52.294366 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287210    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 02:07:52.294366 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287213    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 02:07:52.294366 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287215    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 02:07:52.294366 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287218    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 02:07:52.294366 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287221    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 02:07:52.294366 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287224    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 02:07:52.294366 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287227    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 02:07:52.294366 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:52.287230    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 02:07:52.295163 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.287235    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 02:07:52.295163 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.287357    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 10 02:07:52.295163 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.291417    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 10 02:07:52.295163 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.293350    2576 server.go:1019] "Starting client certificate rotation"
Jul 10 02:07:52.295163 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.293479    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 02:07:52.295163 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.293534    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 02:07:52.300473 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.300439    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 02:07:52.305481 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.305455    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 02:07:52.314581 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.314562    2576 log.go:25] "Validated CRI v1 runtime API"
Jul 10 02:07:52.316849 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.316827    2576 log.go:25] "Validated CRI v1 image API"
Jul 10 02:07:52.319236 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.319206    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 10 02:07:52.321881 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.321858    2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 d40e5520-ec75-457b-99c9-13ccadbb3bb2:/dev/nvme0n1p4 f89aaf5d-9294-4a23-ad16-c269c5cae017:/dev/nvme0n1p3]
Jul 10 02:07:52.321943 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.321881    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 10 02:07:52.327535 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.327392    2576 manager.go:216] Machine: {Timestamp:2026-07-10 02:07:52.325935157 +0000 UTC m=+1.091847384 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105594 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24895c2d3beba0380050e1b1760c3d SystemUUID:ec24895c-2d3b-eba0-3800-50e1b1760c3d BootID:c2e9d2e2-e567-49ef-ba6f-96c5ca6c49bc Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f2:92:90:4f:67 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f2:92:90:4f:67 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:24:d2:27:46:85 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 10 02:07:52.327535 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.327524    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 10 02:07:52.327668 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.327626    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 10 02:07:52.330736 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.330717    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 02:07:52.331245 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.331212    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 10 02:07:52.331416 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.331252    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-215.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 10 02:07:52.332049 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.332038    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jul 10 02:07:52.332088 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.332052    2576 container_manager_linux.go:309] "Creating device plugin manager"
Jul 10 02:07:52.332088 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.332059    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 02:07:52.332942 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.332928    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 02:07:52.334397 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.334386    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 10 02:07:52.337599 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.337586    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 02:07:52.337792 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.337781    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 10 02:07:52.337829 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.337813    2576 kubelet.go:486] "Attempting to sync node with API server"
Jul 10 02:07:52.337862 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.337829    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 10 02:07:52.337862 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.337846    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 10 02:07:52.337929 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.337878    2576 kubelet.go:398] "Adding apiserver pod source"
Jul 10 02:07:52.337929 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.337889    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 10 02:07:52.338533 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.338518    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 02:07:52.338586 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.338546    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 02:07:52.344022 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.343991    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 10 02:07:52.346292 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.346274    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 10 02:07:52.346360 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.346309    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 10 02:07:52.346496 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.346484    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 10 02:07:52.346551 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.346502    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 10 02:07:52.346551 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.346508    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 10 02:07:52.346551 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.346515    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 10 02:07:52.346551 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.346524    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 10 02:07:52.346551 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.346531    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 10 02:07:52.347200 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.347186    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 10 02:07:52.347200 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.347198    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 10 02:07:52.347283 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.347206    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 10 02:07:52.347283 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.347212    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 10 02:07:52.347283 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.347220    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 10 02:07:52.347283 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.347229    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 10 02:07:52.348452 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.348439    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 10 02:07:52.348452 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.348451    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 10 02:07:52.349918 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:52.349890    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 10 02:07:52.349918 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:52.349897    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-215.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 10 02:07:52.352150 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.352137    2576 server.go:1268] "Started kubelet"
Jul 10 02:07:52.352276 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.352239    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 10 02:07:52.352379 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.352256    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 10 02:07:52.352379 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.352343    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 10 02:07:52.353007 ip-10-0-139-215 systemd[1]: Started Kubernetes Kubelet.
Jul 10 02:07:52.353870 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.353850    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 10 02:07:52.354524 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.354505    2576 server.go:310] "Adding debug handlers to kubelet server"
Jul 10 02:07:52.358320 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:52.358301    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 10 02:07:52.359597 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.359576    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 10 02:07:52.359694 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.359594    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 10 02:07:52.359802 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:52.359780    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-215.ec2.internal\" not found"
Jul 10 02:07:52.360419 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.360393    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 10 02:07:52.360962 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.360407    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 10 02:07:52.360962 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.360961    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 10 02:07:52.361135 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.360899    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dmpsj"
Jul 10 02:07:52.361135 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.361114    2576 factory.go:153] Registering CRI-O factory
Jul 10 02:07:52.361135 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.361122    2576 reconstruct.go:97] "Volume reconstruction finished"
Jul 10 02:07:52.361135 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.361130    2576 reconciler.go:29] "Reconciler: start to sync state"
Jul 10 02:07:52.361135 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.361131    2576 factory.go:223] Registration of the crio container factory successfully
Jul 10 02:07:52.361363 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.361184    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 10 02:07:52.361363 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.361192    2576 factory.go:55] Registering systemd factory
Jul 10 02:07:52.361363 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.361199    2576 factory.go:223] Registration of the systemd container factory successfully
Jul 10 02:07:52.361363 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.361223    2576 factory.go:103] Registering Raw factory
Jul 10 02:07:52.361363 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.361233    2576 manager.go:1196] Started watching for new ooms in manager
Jul 10 02:07:52.362015 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.362000    2576 manager.go:349] Starting recovery of all containers
Jul 10 02:07:52.363854 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:52.363817    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 10 02:07:52.364203 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:52.364156    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-215.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 10 02:07:52.364320 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.364303    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-215.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 10 02:07:52.366233 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:52.363881    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-215.ec2.internal.18c0cb90226e20a3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-215.ec2.internal,UID:ip-10-0-139-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-215.ec2.internal,},FirstTimestamp:2026-07-10 02:07:52.352088227 +0000 UTC m=+1.118000453,LastTimestamp:2026-07-10 02:07:52.352088227 +0000 UTC m=+1.118000453,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-215.ec2.internal,}"
Jul 10 02:07:52.370335 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.370304    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dmpsj"
Jul 10 02:07:52.374228 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.374208    2576 manager.go:354] Recovery completed
Jul 10 02:07:52.376800 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:52.376778    2576 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 10 02:07:52.380044 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.380030    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 02:07:52.382023 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.382004    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 02:07:52.382071 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.382038    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 02:07:52.382071 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.382049    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-215.ec2.internal" event="NodeHasSufficientPID"
Jul 10 02:07:52.382714 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.382699    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 10 02:07:52.382714 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.382712    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 02:07:52.382788 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.382713    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 10 02:07:52.382788 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.382743    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 02:07:52.383447 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.383431    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 02:07:52.383519 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.383461    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 02:07:52.383519 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.383477    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-215.ec2.internal" event="NodeHasSufficientPID"
Jul 10 02:07:52.384081 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:52.383977    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-215.ec2.internal.18c0cb902436e853  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-215.ec2.internal,UID:ip-10-0-139-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-215.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-215.ec2.internal,},FirstTimestamp:2026-07-10 02:07:52.382023763 +0000 UTC m=+1.147935989,LastTimestamp:2026-07-10 02:07:52.382023763 +0000 UTC m=+1.147935989,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-215.ec2.internal,}"
Jul 10 02:07:52.384199 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.384087    2576 policy_none.go:49] "None policy: Start"
Jul 10 02:07:52.384199 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.384104    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 10 02:07:52.384199 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.384116    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 10 02:07:52.385278 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.385264    2576 policy_none.go:47] "Start"
Jul 10 02:07:52.425641 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.425430    2576 manager.go:337] "Starting Device Plugin manager"
Jul 10 02:07:52.425746 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:52.425669    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 10 02:07:52.425746 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.425683    2576 server.go:87] "Starting device plugin registration server"
Jul 10 02:07:52.426234 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.426219    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 10 02:07:52.426289 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.426239    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 10 02:07:52.426373 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.426350    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 10 02:07:52.426596 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.426580    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 10 02:07:52.426742 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.426730    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 10 02:07:52.427073 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:52.427041    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 10 02:07:52.427162 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:52.427104    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-215.ec2.internal\" not found"
Jul 10 02:07:52.528737 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.528651    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 02:07:52.529899 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.529761    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 02:07:52.529899 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.529804    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 02:07:52.529899 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.529823    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-215.ec2.internal" event="NodeHasSufficientPID"
Jul 10 02:07:52.529899 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.529870    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-215.ec2.internal"
Jul 10 02:07:52.536496 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.536464    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 10 02:07:52.537807 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.537778    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 10 02:07:52.537919 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.537828    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 10 02:07:52.537919 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.537856    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 10 02:07:52.537919 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:52.537899    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 10 02:07:52.540435 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.540410    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 02:07:52.560389 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.560364    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-215.ec2.internal"
Jul 10 02:07:52.560389 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:52.560393    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-215.ec2.internal\": node \"ip-10-0-139-215.ec2.internal\" not found"
Jul 10 02:07:52.600279 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:52.600246    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-215.ec2.internal\" not found"
Jul 10 02:07:52.639086 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.639046    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-215.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-215.ec2.internal"]
Jul 10 02:07:52.639226 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.639133    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 02:07:52.640453 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.640437    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 02:07:52.640559 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.640465    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 02:07:52.640559 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.640475    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-215.ec2.internal" event="NodeHasSufficientPID"
Jul 10 02:07:52.641956 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.641942    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 02:07:52.642123 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.642106    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-215.ec2.internal"
Jul 10 02:07:52.642167 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.642140    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 02:07:52.642760 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.642743    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 02:07:52.642760 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.642762    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 02:07:52.642901 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.642772    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-215.ec2.internal" event="NodeHasSufficientPID"
Jul 10 02:07:52.642901 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.642810    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 02:07:52.642901 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.642831    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 02:07:52.642901 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.642849    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-215.ec2.internal" event="NodeHasSufficientPID"
Jul 10 02:07:52.644202 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.644186    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-215.ec2.internal"
Jul 10 02:07:52.644250 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.644214    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 02:07:52.644970 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.644953    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 02:07:52.645081 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.644977    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 02:07:52.645081 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.644988    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-215.ec2.internal" event="NodeHasSufficientPID"
Jul 10 02:07:52.668296 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:52.668259    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-215.ec2.internal\" not found" node="ip-10-0-139-215.ec2.internal"
Jul 10 02:07:52.673117 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:52.673087    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-215.ec2.internal\" not found" node="ip-10-0-139-215.ec2.internal"
Jul 10 02:07:52.701380 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:52.701349    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-215.ec2.internal\" not found"
Jul 10 02:07:52.762423 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.762391    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/97dee57ee5977c3e44d2e1bf00b10f09-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-215.ec2.internal\" (UID: \"97dee57ee5977c3e44d2e1bf00b10f09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-215.ec2.internal"
Jul 10 02:07:52.762552 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.762426    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97dee57ee5977c3e44d2e1bf00b10f09-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-215.ec2.internal\" (UID: \"97dee57ee5977c3e44d2e1bf00b10f09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-215.ec2.internal"
Jul 10 02:07:52.762552 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.762447    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7e242c33d17613db0772626c3ed59e80-config\") pod \"kube-apiserver-proxy-ip-10-0-139-215.ec2.internal\" (UID: \"7e242c33d17613db0772626c3ed59e80\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-215.ec2.internal"
Jul 10 02:07:52.802263 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:52.802192    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-215.ec2.internal\" not found"
Jul 10 02:07:52.862887 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.862859    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/97dee57ee5977c3e44d2e1bf00b10f09-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-215.ec2.internal\" (UID: \"97dee57ee5977c3e44d2e1bf00b10f09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-215.ec2.internal"
Jul 10 02:07:52.863022 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.862911    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97dee57ee5977c3e44d2e1bf00b10f09-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-215.ec2.internal\" (UID: \"97dee57ee5977c3e44d2e1bf00b10f09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-215.ec2.internal"
Jul 10 02:07:52.863022 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.862930    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7e242c33d17613db0772626c3ed59e80-config\") pod \"kube-apiserver-proxy-ip-10-0-139-215.ec2.internal\" (UID: \"7e242c33d17613db0772626c3ed59e80\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-215.ec2.internal"
Jul 10 02:07:52.863022 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.862969    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7e242c33d17613db0772626c3ed59e80-config\") pod \"kube-apiserver-proxy-ip-10-0-139-215.ec2.internal\" (UID: \"7e242c33d17613db0772626c3ed59e80\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-215.ec2.internal"
Jul 10 02:07:52.863022 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.862981    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97dee57ee5977c3e44d2e1bf00b10f09-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-215.ec2.internal\" (UID: \"97dee57ee5977c3e44d2e1bf00b10f09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-215.ec2.internal"
Jul 10 02:07:52.863207 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.862981    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/97dee57ee5977c3e44d2e1bf00b10f09-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-215.ec2.internal\" (UID: \"97dee57ee5977c3e44d2e1bf00b10f09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-215.ec2.internal"
Jul 10 02:07:52.903467 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:52.903426    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-215.ec2.internal\" not found"
Jul 10 02:07:52.970946 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.970902    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-215.ec2.internal"
Jul 10 02:07:52.976256 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:52.976231    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-215.ec2.internal"
Jul 10 02:07:53.004323 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:53.004290    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-215.ec2.internal\" not found"
Jul 10 02:07:53.107847 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:53.107748    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-215.ec2.internal\" not found"
Jul 10 02:07:53.210007 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:53.209979    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-215.ec2.internal\" not found"
Jul 10 02:07:53.292778 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:53.292744    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 10 02:07:53.293258 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:53.292901    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 02:07:53.310969 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:53.310939    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-215.ec2.internal\" not found"
Jul 10 02:07:53.375132 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:53.375013    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 02:02:53 +0000 UTC" deadline="2028-02-15 22:17:17.680892243 +0000 UTC"
Jul 10 02:07:53.375132 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:53.375074    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14060h9m24.305821967s"
Jul 10 02:07:53.412092 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:53.412027    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-215.ec2.internal\" not found"
Jul 10 02:07:53.512825 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:53.512785    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-215.ec2.internal\" not found"
Jul 10 02:07:53.598859 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:53.598821    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97dee57ee5977c3e44d2e1bf00b10f09.slice/crio-c03cb5b16546479239fc434665450a9a48fc1b93f1cd7bcde0309d0c6cb80523 WatchSource:0}: Error finding container c03cb5b16546479239fc434665450a9a48fc1b93f1cd7bcde0309d0c6cb80523: Status 404 returned error can't find the container with id c03cb5b16546479239fc434665450a9a48fc1b93f1cd7bcde0309d0c6cb80523
Jul 10 02:07:53.599381 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:53.599359    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e242c33d17613db0772626c3ed59e80.slice/crio-44547da7d996816423d963e8ff0bb0d941b1ab9a7730b7cf39f9129f837805e4 WatchSource:0}: Error finding container 44547da7d996816423d963e8ff0bb0d941b1ab9a7730b7cf39f9129f837805e4: Status 404 returned error can't find the container with id 44547da7d996816423d963e8ff0bb0d941b1ab9a7730b7cf39f9129f837805e4
Jul 10 02:07:53.604801 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:53.604782    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 02:07:53.613591 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:53.613572    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-215.ec2.internal\" not found"
Jul 10 02:07:53.709450 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:53.709352    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 02:07:53.762362 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:53.762324    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-215.ec2.internal"
Jul 10 02:07:53.777461 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:53.777436    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 02:07:53.779641 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:53.779626    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-215.ec2.internal"
Jul 10 02:07:53.790552 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:53.790531    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 02:07:53.878119 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:53.878088    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 02:07:53.941959 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:53.941931    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 02:07:54.340508 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.340450    2576 apiserver.go:52] "Watching apiserver"
Jul 10 02:07:54.360049 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.359823    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 10 02:07:54.361133 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.361051    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 10 02:07:54.362664 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.362132    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-kczv8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p","openshift-image-registry/node-ca-8kqm6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-215.ec2.internal","openshift-multus/multus-additional-cni-plugins-wk2hr","openshift-ovn-kubernetes/ovnkube-node-kt7wb","kube-system/kube-apiserver-proxy-ip-10-0-139-215.ec2.internal","openshift-cluster-node-tuning-operator/tuned-tbknz","openshift-dns/node-resolver-tbgpl","openshift-multus/multus-6qdlk","openshift-multus/network-metrics-daemon-gsnvh","openshift-network-diagnostics/network-check-target-9kgfv","openshift-network-operator/iptables-alerter-q59sc","kube-system/global-pull-secret-syncer-v2d92"]
Jul 10 02:07:54.364925 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.364351    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q59sc"
Jul 10 02:07:54.367515 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.367304    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 10 02:07:54.367626 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.367555    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6lp6p\""
Jul 10 02:07:54.367886 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.367870    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 10 02:07:54.368242 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.368223    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 10 02:07:54.368486 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.368470    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p"
Jul 10 02:07:54.369140 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.369123    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8kqm6"
Jul 10 02:07:54.369911 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.369893    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kczv8"
Jul 10 02:07:54.372176 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.371234    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wk2hr"
Jul 10 02:07:54.373792 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.372603    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 10 02:07:54.373792 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.372818    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 10 02:07:54.373792 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.372948    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 10 02:07:54.373792 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.373066    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dbjd8\""
Jul 10 02:07:54.373792 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.373188    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-z5f8w\""
Jul 10 02:07:54.373792 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.373408    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 10 02:07:54.373792 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.373424    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 10 02:07:54.373792 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.373478    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 10 02:07:54.374358 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.374338    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 10 02:07:54.374614 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.374598    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z7w5m\""
Jul 10 02:07:54.374876 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.374852    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 10 02:07:54.375678 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.375114    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 10 02:07:54.375678 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.375352    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2vqc6\""
Jul 10 02:07:54.375678 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.375561    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 10 02:07:54.375887 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.375801    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.377674 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.377646    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:07:54.377774 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.377680    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 10 02:07:54.377774 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:54.377726    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2d92" podUID="087c6267-c774-4dbc-ab49-e5bf96684f7c"
Jul 10 02:07:54.377974 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.377955    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 10 02:07:54.378070 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.378013    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 10 02:07:54.378516 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.378492    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 10 02:07:54.378961 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.378933    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 10 02:07:54.379192 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.379170    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x42mc\""
Jul 10 02:07:54.379303 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.379280    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 10 02:07:54.379399 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.379381    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.379756 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.379726    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 10 02:07:54.379833 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.379739    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 10 02:07:54.380251 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.380023    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 10 02:07:54.381332 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.380521    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tbgpl"
Jul 10 02:07:54.381612 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.381590    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 02:07:54.382144 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.381904    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.382144 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.382139    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 10 02:07:54.382917 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.382521    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hblbw\""
Jul 10 02:07:54.382917 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.382756    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 10 02:07:54.383781 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.383613    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 10 02:07:54.383888 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.383857    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qf5w9\""
Jul 10 02:07:54.384223 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.384023    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:07:54.384223 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.384119    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 10 02:07:54.384223 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:54.384112    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsnvh" podUID="d04041a2-0cc9-4917-919a-a6a8e26cad05"
Jul 10 02:07:54.384854 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.384837    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-x95k8\""
Jul 10 02:07:54.385414 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.385134    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:07:54.385414 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:54.385212    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kgfv" podUID="694129e7-b596-48fc-80f6-af7f756f1e90"
Jul 10 02:07:54.385414 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.385264    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 10 02:07:54.409716 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.409696    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wcrf4"
Jul 10 02:07:54.423048 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.423008    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wcrf4"
Jul 10 02:07:54.462528 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.462508    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 10 02:07:54.474133 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474107    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-run-systemd\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.474251 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474148    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-host-kubelet\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.474251 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474176    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-host-var-lib-cni-multus\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.474251 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474203    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/64a64f56-9355-45c6-8426-d960c1a88d49-multus-daemon-config\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.474251 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474233    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz67b\" (UniqueName: \"kubernetes.io/projected/d04041a2-0cc9-4917-919a-a6a8e26cad05-kube-api-access-kz67b\") pod \"network-metrics-daemon-gsnvh\" (UID: \"d04041a2-0cc9-4917-919a-a6a8e26cad05\") " pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:07:54.474472 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474259    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/21bf7d5b-52c0-4394-bd43-6a47f793fd21-sys-fs\") pod \"aws-ebs-csi-driver-node-m865p\" (UID: \"21bf7d5b-52c0-4394-bd43-6a47f793fd21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p"
Jul 10 02:07:54.474472 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474284    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-system-cni-dir\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.474472 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474309    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkkm5\" (UniqueName: \"kubernetes.io/projected/64a64f56-9355-45c6-8426-d960c1a88d49-kube-api-access-tkkm5\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.474472 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474334    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/21bf7d5b-52c0-4394-bd43-6a47f793fd21-etc-selinux\") pod \"aws-ebs-csi-driver-node-m865p\" (UID: \"21bf7d5b-52c0-4394-bd43-6a47f793fd21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p"
Jul 10 02:07:54.474472 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474429    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2c011ac-1205-440e-a107-06bd0b702a48-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wk2hr\" (UID: \"c2c011ac-1205-440e-a107-06bd0b702a48\") " pod="openshift-multus/multus-additional-cni-plugins-wk2hr"
Jul 10 02:07:54.474472 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474462    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c2c011ac-1205-440e-a107-06bd0b702a48-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wk2hr\" (UID: \"c2c011ac-1205-440e-a107-06bd0b702a48\") " pod="openshift-multus/multus-additional-cni-plugins-wk2hr"
Jul 10 02:07:54.474783 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474490    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-host-slash\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.474783 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474532    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-host-run-netns\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.474783 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474569    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/087c6267-c774-4dbc-ab49-e5bf96684f7c-dbus\") pod \"global-pull-secret-syncer-v2d92\" (UID: \"087c6267-c774-4dbc-ab49-e5bf96684f7c\") " pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:07:54.474783 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474599    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-os-release\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.474783 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474627    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-host-var-lib-kubelet\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.474783 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474682    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/21bf7d5b-52c0-4394-bd43-6a47f793fd21-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m865p\" (UID: \"21bf7d5b-52c0-4394-bd43-6a47f793fd21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p"
Jul 10 02:07:54.474783 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474721    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2c011ac-1205-440e-a107-06bd0b702a48-cni-binary-copy\") pod \"multus-additional-cni-plugins-wk2hr\" (UID: \"c2c011ac-1205-440e-a107-06bd0b702a48\") " pod="openshift-multus/multus-additional-cni-plugins-wk2hr"
Jul 10 02:07:54.474783 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474752    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-host-cni-netd\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.474783 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474778    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/087c6267-c774-4dbc-ab49-e5bf96684f7c-original-pull-secret\") pod \"global-pull-secret-syncer-v2d92\" (UID: \"087c6267-c774-4dbc-ab49-e5bf96684f7c\") " pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:07:54.475249 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474802    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-run\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.475249 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474838    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-var-lib-kubelet\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.475249 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474869    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c8008ea1-c003-4a8d-a86d-1a01372d6ec3-iptables-alerter-script\") pod \"iptables-alerter-q59sc\" (UID: \"c8008ea1-c003-4a8d-a86d-1a01372d6ec3\") " pod="openshift-network-operator/iptables-alerter-q59sc"
Jul 10 02:07:54.475249 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474898    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80b5bdb5-3660-434c-9384-84014e3dcf5b-konnectivity-ca\") pod \"konnectivity-agent-kczv8\" (UID: \"80b5bdb5-3660-434c-9384-84014e3dcf5b\") " pod="kube-system/konnectivity-agent-kczv8"
Jul 10 02:07:54.475249 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474922    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-host-cni-bin\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.475249 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474956    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-etc-modprobe-d\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.475249 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.474987    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2c011ac-1205-440e-a107-06bd0b702a48-os-release\") pod \"multus-additional-cni-plugins-wk2hr\" (UID: \"c2c011ac-1205-440e-a107-06bd0b702a48\") " pod="openshift-multus/multus-additional-cni-plugins-wk2hr"
Jul 10 02:07:54.475249 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475013    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-log-socket\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.475249 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475065    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-etc-sysctl-conf\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.475249 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475089    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-sys\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.475249 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475119    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-host\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.475249 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475156    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd032043-9d19-4516-b808-365276e33254-hosts-file\") pod \"node-resolver-tbgpl\" (UID: \"cd032043-9d19-4516-b808-365276e33254\") " pod="openshift-dns/node-resolver-tbgpl"
Jul 10 02:07:54.475249 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475198    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/64a64f56-9355-45c6-8426-d960c1a88d49-cni-binary-copy\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.475249 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475223    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-host-run-ovn-kubernetes\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.475249 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475254    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-ovn-node-metrics-cert\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.475908 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475280    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-ovnkube-script-lib\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.475908 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475305    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c2c011ac-1205-440e-a107-06bd0b702a48-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wk2hr\" (UID: \"c2c011ac-1205-440e-a107-06bd0b702a48\") " pod="openshift-multus/multus-additional-cni-plugins-wk2hr"
Jul 10 02:07:54.475908 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475349    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-env-overrides\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.475908 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475385    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-etc-kubernetes\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.475908 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475411    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-etc-systemd\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.475908 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475442    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-var-lib-openvswitch\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.475908 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475469    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqkg5\" (UniqueName: \"kubernetes.io/projected/c8008ea1-c003-4a8d-a86d-1a01372d6ec3-kube-api-access-wqkg5\") pod \"iptables-alerter-q59sc\" (UID: \"c8008ea1-c003-4a8d-a86d-1a01372d6ec3\") " pod="openshift-network-operator/iptables-alerter-q59sc"
Jul 10 02:07:54.475908 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475493    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-host-run-netns\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.475908 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475549    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxfrc\" (UniqueName: \"kubernetes.io/projected/21bf7d5b-52c0-4394-bd43-6a47f793fd21-kube-api-access-lxfrc\") pod \"aws-ebs-csi-driver-node-m865p\" (UID: \"21bf7d5b-52c0-4394-bd43-6a47f793fd21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p"
Jul 10 02:07:54.475908 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475587    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2c011ac-1205-440e-a107-06bd0b702a48-system-cni-dir\") pod \"multus-additional-cni-plugins-wk2hr\" (UID: \"c2c011ac-1205-440e-a107-06bd0b702a48\") " pod="openshift-multus/multus-additional-cni-plugins-wk2hr"
Jul 10 02:07:54.475908 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475612    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2b040543-891b-4498-a5d8-345354096a26-etc-tuned\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.475908 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475642    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn9jz\" (UniqueName: \"kubernetes.io/projected/c2c011ac-1205-440e-a107-06bd0b702a48-kube-api-access-qn9jz\") pod \"multus-additional-cni-plugins-wk2hr\" (UID: \"c2c011ac-1205-440e-a107-06bd0b702a48\") " pod="openshift-multus/multus-additional-cni-plugins-wk2hr"
Jul 10 02:07:54.475908 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475673    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8008ea1-c003-4a8d-a86d-1a01372d6ec3-host-slash\") pod \"iptables-alerter-q59sc\" (UID: \"c8008ea1-c003-4a8d-a86d-1a01372d6ec3\") " pod="openshift-network-operator/iptables-alerter-q59sc"
Jul 10 02:07:54.475908 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475700    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-cnibin\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.475908 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475725    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-host-var-lib-cni-bin\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.475908 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475786    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z46z\" (UniqueName: \"kubernetes.io/projected/2b040543-891b-4498-a5d8-345354096a26-kube-api-access-5z46z\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.476675 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475817    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd032043-9d19-4516-b808-365276e33254-tmp-dir\") pod \"node-resolver-tbgpl\" (UID: \"cd032043-9d19-4516-b808-365276e33254\") " pod="openshift-dns/node-resolver-tbgpl"
Jul 10 02:07:54.476675 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475841    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dphvc\" (UniqueName: \"kubernetes.io/projected/cd032043-9d19-4516-b808-365276e33254-kube-api-access-dphvc\") pod \"node-resolver-tbgpl\" (UID: \"cd032043-9d19-4516-b808-365276e33254\") " pod="openshift-dns/node-resolver-tbgpl"
Jul 10 02:07:54.476675 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475871    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-host-run-k8s-cni-cncf-io\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.476675 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475912    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qz58\" (UniqueName: \"kubernetes.io/projected/694129e7-b596-48fc-80f6-af7f756f1e90-kube-api-access-5qz58\") pod \"network-check-target-9kgfv\" (UID: \"694129e7-b596-48fc-80f6-af7f756f1e90\") " pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:07:54.476675 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.475940    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/21bf7d5b-52c0-4394-bd43-6a47f793fd21-registration-dir\") pod \"aws-ebs-csi-driver-node-m865p\" (UID: \"21bf7d5b-52c0-4394-bd43-6a47f793fd21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p"
Jul 10 02:07:54.476675 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476005    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80b5bdb5-3660-434c-9384-84014e3dcf5b-agent-certs\") pod \"konnectivity-agent-kczv8\" (UID: \"80b5bdb5-3660-434c-9384-84014e3dcf5b\") " pod="kube-system/konnectivity-agent-kczv8"
Jul 10 02:07:54.476675 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476073    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-hostroot\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.476675 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476100    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-host-run-multus-certs\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.476675 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476139    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0177cb8b-5ebf-4268-81a4-25476eae55ea-serviceca\") pod \"node-ca-8kqm6\" (UID: \"0177cb8b-5ebf-4268-81a4-25476eae55ea\") " pod="openshift-image-registry/node-ca-8kqm6"
Jul 10 02:07:54.476675 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476187    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfq4p\" (UniqueName: \"kubernetes.io/projected/0177cb8b-5ebf-4268-81a4-25476eae55ea-kube-api-access-bfq4p\") pod \"node-ca-8kqm6\" (UID: \"0177cb8b-5ebf-4268-81a4-25476eae55ea\") " pod="openshift-image-registry/node-ca-8kqm6"
Jul 10 02:07:54.476675 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476221    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-run-ovn\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.476675 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476254    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-etc-sysconfig\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.476675 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476279    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-multus-socket-dir-parent\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.476675 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476304    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0177cb8b-5ebf-4268-81a4-25476eae55ea-host\") pod \"node-ca-8kqm6\" (UID: \"0177cb8b-5ebf-4268-81a4-25476eae55ea\") " pod="openshift-image-registry/node-ca-8kqm6"
Jul 10 02:07:54.476675 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476329    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-systemd-units\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.476675 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476376    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-etc-openvswitch\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.476675 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476402    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-ovnkube-config\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.477513 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476427    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-etc-sysctl-d\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.477513 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476453    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.477513 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476480    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85gdk\" (UniqueName: \"kubernetes.io/projected/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-kube-api-access-85gdk\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.477513 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476505    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/087c6267-c774-4dbc-ab49-e5bf96684f7c-kubelet-config\") pod \"global-pull-secret-syncer-v2d92\" (UID: \"087c6267-c774-4dbc-ab49-e5bf96684f7c\") " pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:07:54.477513 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476528    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b040543-891b-4498-a5d8-345354096a26-tmp\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.477513 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476554    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs\") pod \"network-metrics-daemon-gsnvh\" (UID: \"d04041a2-0cc9-4917-919a-a6a8e26cad05\") " pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:07:54.477513 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476621    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-run-openvswitch\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.477513 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476677    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-node-log\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.477513 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476703    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-multus-cni-dir\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.477513 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476729    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-multus-conf-dir\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.477513 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476754    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/21bf7d5b-52c0-4394-bd43-6a47f793fd21-socket-dir\") pod \"aws-ebs-csi-driver-node-m865p\" (UID: \"21bf7d5b-52c0-4394-bd43-6a47f793fd21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p"
Jul 10 02:07:54.477513 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476783    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2c011ac-1205-440e-a107-06bd0b702a48-cnibin\") pod \"multus-additional-cni-plugins-wk2hr\" (UID: \"c2c011ac-1205-440e-a107-06bd0b702a48\") " pod="openshift-multus/multus-additional-cni-plugins-wk2hr"
Jul 10 02:07:54.477513 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476808    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-lib-modules\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.477513 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476835    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-etc-kubernetes\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.477513 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.476861    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/21bf7d5b-52c0-4394-bd43-6a47f793fd21-device-dir\") pod \"aws-ebs-csi-driver-node-m865p\" (UID: \"21bf7d5b-52c0-4394-bd43-6a47f793fd21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p"
Jul 10 02:07:54.544355 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.544289    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-215.ec2.internal" event={"ID":"97dee57ee5977c3e44d2e1bf00b10f09","Type":"ContainerStarted","Data":"c03cb5b16546479239fc434665450a9a48fc1b93f1cd7bcde0309d0c6cb80523"}
Jul 10 02:07:54.546241 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.546207    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-215.ec2.internal" event={"ID":"7e242c33d17613db0772626c3ed59e80","Type":"ContainerStarted","Data":"44547da7d996816423d963e8ff0bb0d941b1ab9a7730b7cf39f9129f837805e4"}
Jul 10 02:07:54.577164 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577127    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-host-kubelet\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.577370 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577176    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-host-var-lib-cni-multus\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.577370 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577202    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/64a64f56-9355-45c6-8426-d960c1a88d49-multus-daemon-config\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.577370 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577232    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz67b\" (UniqueName: \"kubernetes.io/projected/d04041a2-0cc9-4917-919a-a6a8e26cad05-kube-api-access-kz67b\") pod \"network-metrics-daemon-gsnvh\" (UID: \"d04041a2-0cc9-4917-919a-a6a8e26cad05\") " pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:07:54.577370 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577258    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/21bf7d5b-52c0-4394-bd43-6a47f793fd21-sys-fs\") pod \"aws-ebs-csi-driver-node-m865p\" (UID: \"21bf7d5b-52c0-4394-bd43-6a47f793fd21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p"
Jul 10 02:07:54.577370 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577283    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-system-cni-dir\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.577370 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577308    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkkm5\" (UniqueName: \"kubernetes.io/projected/64a64f56-9355-45c6-8426-d960c1a88d49-kube-api-access-tkkm5\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.577370 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577333    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/21bf7d5b-52c0-4394-bd43-6a47f793fd21-etc-selinux\") pod \"aws-ebs-csi-driver-node-m865p\" (UID: \"21bf7d5b-52c0-4394-bd43-6a47f793fd21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p"
Jul 10 02:07:54.577693 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577358    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2c011ac-1205-440e-a107-06bd0b702a48-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wk2hr\" (UID: \"c2c011ac-1205-440e-a107-06bd0b702a48\") " pod="openshift-multus/multus-additional-cni-plugins-wk2hr"
Jul 10 02:07:54.577693 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577401    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c2c011ac-1205-440e-a107-06bd0b702a48-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wk2hr\" (UID: \"c2c011ac-1205-440e-a107-06bd0b702a48\") " pod="openshift-multus/multus-additional-cni-plugins-wk2hr"
Jul 10 02:07:54.577693 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577439    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-host-slash\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.577693 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577468    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-host-run-netns\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.577693 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577494    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/087c6267-c774-4dbc-ab49-e5bf96684f7c-dbus\") pod \"global-pull-secret-syncer-v2d92\" (UID: \"087c6267-c774-4dbc-ab49-e5bf96684f7c\") " pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:07:54.577693 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577519    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-os-release\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.577693 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577543    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-host-var-lib-kubelet\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.577693 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577566    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/21bf7d5b-52c0-4394-bd43-6a47f793fd21-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m865p\" (UID: \"21bf7d5b-52c0-4394-bd43-6a47f793fd21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p"
Jul 10 02:07:54.577693 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577595    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2c011ac-1205-440e-a107-06bd0b702a48-cni-binary-copy\") pod \"multus-additional-cni-plugins-wk2hr\" (UID: \"c2c011ac-1205-440e-a107-06bd0b702a48\") " pod="openshift-multus/multus-additional-cni-plugins-wk2hr"
Jul 10 02:07:54.577693 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577618    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-host-cni-netd\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.577693 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577635    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/087c6267-c774-4dbc-ab49-e5bf96684f7c-original-pull-secret\") pod \"global-pull-secret-syncer-v2d92\" (UID: \"087c6267-c774-4dbc-ab49-e5bf96684f7c\") " pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:07:54.577693 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577650    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-run\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.577693 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577665    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-var-lib-kubelet\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.577693 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577680    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c8008ea1-c003-4a8d-a86d-1a01372d6ec3-iptables-alerter-script\") pod \"iptables-alerter-q59sc\" (UID: \"c8008ea1-c003-4a8d-a86d-1a01372d6ec3\") " pod="openshift-network-operator/iptables-alerter-q59sc"
Jul 10 02:07:54.578310 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577709    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80b5bdb5-3660-434c-9384-84014e3dcf5b-konnectivity-ca\") pod \"konnectivity-agent-kczv8\" (UID: \"80b5bdb5-3660-434c-9384-84014e3dcf5b\") " pod="kube-system/konnectivity-agent-kczv8"
Jul 10 02:07:54.578310 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577735    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-host-cni-bin\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.578310 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577813    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-system-cni-dir\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.578310 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577825    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-host-slash\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.578310 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577814    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-host-var-lib-cni-multus\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.578310 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577814    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-host-run-netns\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.578310 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577859    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-host-var-lib-kubelet\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.578310 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577913    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-os-release\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.578310 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577920    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-host-cni-bin\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.578310 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577988    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/21bf7d5b-52c0-4394-bd43-6a47f793fd21-sys-fs\") pod \"aws-ebs-csi-driver-node-m865p\" (UID: \"21bf7d5b-52c0-4394-bd43-6a47f793fd21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p"
Jul 10 02:07:54.578310 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.577999    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/087c6267-c774-4dbc-ab49-e5bf96684f7c-dbus\") pod \"global-pull-secret-syncer-v2d92\" (UID: \"087c6267-c774-4dbc-ab49-e5bf96684f7c\") " pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:07:54.578310 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578068    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/21bf7d5b-52c0-4394-bd43-6a47f793fd21-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m865p\" (UID: \"21bf7d5b-52c0-4394-bd43-6a47f793fd21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p"
Jul 10 02:07:54.578310 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578111    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-host-cni-netd\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.578310 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578143    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-etc-modprobe-d\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.578310 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578161    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-var-lib-kubelet\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.578310 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578175    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2c011ac-1205-440e-a107-06bd0b702a48-os-release\") pod \"multus-additional-cni-plugins-wk2hr\" (UID: \"c2c011ac-1205-440e-a107-06bd0b702a48\") " pod="openshift-multus/multus-additional-cni-plugins-wk2hr"
Jul 10 02:07:54.578310 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578203    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-log-socket\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.578310 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578228    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-etc-sysctl-conf\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.579209 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578252    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-sys\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.579209 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578277    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-host\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.579209 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578305    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd032043-9d19-4516-b808-365276e33254-hosts-file\") pod \"node-resolver-tbgpl\" (UID: \"cd032043-9d19-4516-b808-365276e33254\") " pod="openshift-dns/node-resolver-tbgpl"
Jul 10 02:07:54.579209 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578330    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/64a64f56-9355-45c6-8426-d960c1a88d49-cni-binary-copy\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.579209 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578365    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-host-run-ovn-kubernetes\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.579209 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578386    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80b5bdb5-3660-434c-9384-84014e3dcf5b-konnectivity-ca\") pod \"konnectivity-agent-kczv8\" (UID: \"80b5bdb5-3660-434c-9384-84014e3dcf5b\") " pod="kube-system/konnectivity-agent-kczv8"
Jul 10 02:07:54.579209 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578385    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/21bf7d5b-52c0-4394-bd43-6a47f793fd21-etc-selinux\") pod \"aws-ebs-csi-driver-node-m865p\" (UID: \"21bf7d5b-52c0-4394-bd43-6a47f793fd21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p"
Jul 10 02:07:54.579209 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578393    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-ovn-node-metrics-cert\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.579209 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578450    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-ovnkube-script-lib\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.579209 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578463    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-run\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.579209 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578485    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c2c011ac-1205-440e-a107-06bd0b702a48-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wk2hr\" (UID: \"c2c011ac-1205-440e-a107-06bd0b702a48\") " pod="openshift-multus/multus-additional-cni-plugins-wk2hr"
Jul 10 02:07:54.579209 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578513    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-env-overrides\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.579209 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578580    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-etc-kubernetes\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.579209 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578595    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c2c011ac-1205-440e-a107-06bd0b702a48-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wk2hr\" (UID: \"c2c011ac-1205-440e-a107-06bd0b702a48\") " pod="openshift-multus/multus-additional-cni-plugins-wk2hr"
Jul 10 02:07:54.579209 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578609    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c8008ea1-c003-4a8d-a86d-1a01372d6ec3-iptables-alerter-script\") pod \"iptables-alerter-q59sc\" (UID: \"c8008ea1-c003-4a8d-a86d-1a01372d6ec3\") " pod="openshift-network-operator/iptables-alerter-q59sc"
Jul 10 02:07:54.579209 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578610    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-etc-systemd\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.579209 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578663    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-var-lib-openvswitch\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.580069 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578666    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-etc-systemd\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.580069 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578712    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-var-lib-openvswitch\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.580069 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:54.578740    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 02:07:54.580069 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578773    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2c011ac-1205-440e-a107-06bd0b702a48-cni-binary-copy\") pod \"multus-additional-cni-plugins-wk2hr\" (UID: \"c2c011ac-1205-440e-a107-06bd0b702a48\") " pod="openshift-multus/multus-additional-cni-plugins-wk2hr"
Jul 10 02:07:54.580069 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578763    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 10 02:07:54.580069 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:54.578845    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/087c6267-c774-4dbc-ab49-e5bf96684f7c-original-pull-secret podName:087c6267-c774-4dbc-ab49-e5bf96684f7c nodeName:}" failed. No retries permitted until 2026-07-10 02:07:55.078799898 +0000 UTC m=+3.844712126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/087c6267-c774-4dbc-ab49-e5bf96684f7c-original-pull-secret") pod "global-pull-secret-syncer-v2d92" (UID: "087c6267-c774-4dbc-ab49-e5bf96684f7c") : object "kube-system"/"original-pull-secret" not registered
Jul 10 02:07:54.580069 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578866    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-etc-kubernetes\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.580069 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578866    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2c011ac-1205-440e-a107-06bd0b702a48-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wk2hr\" (UID: \"c2c011ac-1205-440e-a107-06bd0b702a48\") " pod="openshift-multus/multus-additional-cni-plugins-wk2hr"
Jul 10 02:07:54.580069 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578888    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-host-kubelet\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.580069 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578903    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqkg5\" (UniqueName: \"kubernetes.io/projected/c8008ea1-c003-4a8d-a86d-1a01372d6ec3-kube-api-access-wqkg5\") pod \"iptables-alerter-q59sc\" (UID: \"c8008ea1-c003-4a8d-a86d-1a01372d6ec3\") " pod="openshift-network-operator/iptables-alerter-q59sc"
Jul 10 02:07:54.580069 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578939    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-sys\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.580069 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578952    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-host-run-netns\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.580069 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578977    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxfrc\" (UniqueName: \"kubernetes.io/projected/21bf7d5b-52c0-4394-bd43-6a47f793fd21-kube-api-access-lxfrc\") pod \"aws-ebs-csi-driver-node-m865p\" (UID: \"21bf7d5b-52c0-4394-bd43-6a47f793fd21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p"
Jul 10 02:07:54.580069 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.578978    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2c011ac-1205-440e-a107-06bd0b702a48-os-release\") pod \"multus-additional-cni-plugins-wk2hr\" (UID: \"c2c011ac-1205-440e-a107-06bd0b702a48\") " pod="openshift-multus/multus-additional-cni-plugins-wk2hr"
Jul 10 02:07:54.580069 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579044    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-env-overrides\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.580069 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579133    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-etc-sysctl-conf\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.580069 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579155    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c2c011ac-1205-440e-a107-06bd0b702a48-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wk2hr\" (UID: \"c2c011ac-1205-440e-a107-06bd0b702a48\") " pod="openshift-multus/multus-additional-cni-plugins-wk2hr"
Jul 10 02:07:54.580924 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579170    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-etc-modprobe-d\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.580924 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579190    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd032043-9d19-4516-b808-365276e33254-hosts-file\") pod \"node-resolver-tbgpl\" (UID: \"cd032043-9d19-4516-b808-365276e33254\") " pod="openshift-dns/node-resolver-tbgpl"
Jul 10 02:07:54.580924 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579208    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2c011ac-1205-440e-a107-06bd0b702a48-system-cni-dir\") pod \"multus-additional-cni-plugins-wk2hr\" (UID: \"c2c011ac-1205-440e-a107-06bd0b702a48\") " pod="openshift-multus/multus-additional-cni-plugins-wk2hr"
Jul 10 02:07:54.580924 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579236    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-host\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.580924 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579265    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2b040543-891b-4498-a5d8-345354096a26-etc-tuned\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.580924 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579294    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn9jz\" (UniqueName: \"kubernetes.io/projected/c2c011ac-1205-440e-a107-06bd0b702a48-kube-api-access-qn9jz\") pod \"multus-additional-cni-plugins-wk2hr\" (UID: \"c2c011ac-1205-440e-a107-06bd0b702a48\") " pod="openshift-multus/multus-additional-cni-plugins-wk2hr"
Jul 10 02:07:54.580924 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579302    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-log-socket\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.580924 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579322    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8008ea1-c003-4a8d-a86d-1a01372d6ec3-host-slash\") pod \"iptables-alerter-q59sc\" (UID: \"c8008ea1-c003-4a8d-a86d-1a01372d6ec3\") " pod="openshift-network-operator/iptables-alerter-q59sc"
Jul 10 02:07:54.580924 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579348    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-cnibin\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.580924 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579353    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2c011ac-1205-440e-a107-06bd0b702a48-system-cni-dir\") pod \"multus-additional-cni-plugins-wk2hr\" (UID: \"c2c011ac-1205-440e-a107-06bd0b702a48\") " pod="openshift-multus/multus-additional-cni-plugins-wk2hr"
Jul 10 02:07:54.580924 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579372    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-host-var-lib-cni-bin\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.580924 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579398    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-host-run-netns\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.580924 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z46z\" (UniqueName: \"kubernetes.io/projected/2b040543-891b-4498-a5d8-345354096a26-kube-api-access-5z46z\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.580924 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579455    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd032043-9d19-4516-b808-365276e33254-tmp-dir\") pod \"node-resolver-tbgpl\" (UID: \"cd032043-9d19-4516-b808-365276e33254\") " pod="openshift-dns/node-resolver-tbgpl"
Jul 10 02:07:54.580924 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579486    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dphvc\" (UniqueName: \"kubernetes.io/projected/cd032043-9d19-4516-b808-365276e33254-kube-api-access-dphvc\") pod \"node-resolver-tbgpl\" (UID: \"cd032043-9d19-4516-b808-365276e33254\") " pod="openshift-dns/node-resolver-tbgpl"
Jul 10 02:07:54.580924 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579491    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8008ea1-c003-4a8d-a86d-1a01372d6ec3-host-slash\") pod \"iptables-alerter-q59sc\" (UID: \"c8008ea1-c003-4a8d-a86d-1a01372d6ec3\") " pod="openshift-network-operator/iptables-alerter-q59sc"
Jul 10 02:07:54.580924 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579500    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/64a64f56-9355-45c6-8426-d960c1a88d49-multus-daemon-config\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.580924 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579516    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-host-run-k8s-cni-cncf-io\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.581897 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579549    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qz58\" (UniqueName: \"kubernetes.io/projected/694129e7-b596-48fc-80f6-af7f756f1e90-kube-api-access-5qz58\") pod \"network-check-target-9kgfv\" (UID: \"694129e7-b596-48fc-80f6-af7f756f1e90\") " pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:07:54.581897 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579558    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-cnibin\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.581897 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579578    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/21bf7d5b-52c0-4394-bd43-6a47f793fd21-registration-dir\") pod \"aws-ebs-csi-driver-node-m865p\" (UID: \"21bf7d5b-52c0-4394-bd43-6a47f793fd21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p"
Jul 10 02:07:54.581897 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579609    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80b5bdb5-3660-434c-9384-84014e3dcf5b-agent-certs\") pod \"konnectivity-agent-kczv8\" (UID: \"80b5bdb5-3660-434c-9384-84014e3dcf5b\") " pod="kube-system/konnectivity-agent-kczv8"
Jul 10 02:07:54.581897 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579634    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-hostroot\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.581897 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579663    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-host-run-multus-certs\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.581897 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579688    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0177cb8b-5ebf-4268-81a4-25476eae55ea-serviceca\") pod \"node-ca-8kqm6\" (UID: \"0177cb8b-5ebf-4268-81a4-25476eae55ea\") " pod="openshift-image-registry/node-ca-8kqm6"
Jul 10 02:07:54.581897 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579740    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfq4p\" (UniqueName: \"kubernetes.io/projected/0177cb8b-5ebf-4268-81a4-25476eae55ea-kube-api-access-bfq4p\") pod \"node-ca-8kqm6\" (UID: \"0177cb8b-5ebf-4268-81a4-25476eae55ea\") " pod="openshift-image-registry/node-ca-8kqm6"
Jul 10 02:07:54.581897 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579767    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-run-ovn\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.581897 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579797    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-etc-sysconfig\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.581897 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579825    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-multus-socket-dir-parent\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.581897 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579842    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-host-run-ovn-kubernetes\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.581897 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579850    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0177cb8b-5ebf-4268-81a4-25476eae55ea-host\") pod \"node-ca-8kqm6\" (UID: \"0177cb8b-5ebf-4268-81a4-25476eae55ea\") " pod="openshift-image-registry/node-ca-8kqm6"
Jul 10 02:07:54.581897 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579878    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-systemd-units\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.581897 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579899    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-host-run-k8s-cni-cncf-io\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.581897 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579902    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/21bf7d5b-52c0-4394-bd43-6a47f793fd21-registration-dir\") pod \"aws-ebs-csi-driver-node-m865p\" (UID: \"21bf7d5b-52c0-4394-bd43-6a47f793fd21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p"
Jul 10 02:07:54.581897 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579915    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd032043-9d19-4516-b808-365276e33254-tmp-dir\") pod \"node-resolver-tbgpl\" (UID: \"cd032043-9d19-4516-b808-365276e33254\") " pod="openshift-dns/node-resolver-tbgpl"
Jul 10 02:07:54.581897 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579903    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-etc-openvswitch\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.582912 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579943    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-etc-openvswitch\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.582912 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579953    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-hostroot\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.582912 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579947    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-ovnkube-config\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.582912 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579991    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-host-run-multus-certs\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.582912 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580001    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-etc-sysctl-d\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.582912 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580035    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.582912 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580066    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85gdk\" (UniqueName: \"kubernetes.io/projected/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-kube-api-access-85gdk\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.582912 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580082    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-host-var-lib-cni-bin\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.582912 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580131    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-etc-sysctl-d\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.582912 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580162    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/087c6267-c774-4dbc-ab49-e5bf96684f7c-kubelet-config\") pod \"global-pull-secret-syncer-v2d92\" (UID: \"087c6267-c774-4dbc-ab49-e5bf96684f7c\") " pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:07:54.582912 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580090    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/087c6267-c774-4dbc-ab49-e5bf96684f7c-kubelet-config\") pod \"global-pull-secret-syncer-v2d92\" (UID: \"087c6267-c774-4dbc-ab49-e5bf96684f7c\") " pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:07:54.582912 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.579846    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/64a64f56-9355-45c6-8426-d960c1a88d49-cni-binary-copy\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.582912 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580196    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b040543-891b-4498-a5d8-345354096a26-tmp\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.582912 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580221    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0177cb8b-5ebf-4268-81a4-25476eae55ea-host\") pod \"node-ca-8kqm6\" (UID: \"0177cb8b-5ebf-4268-81a4-25476eae55ea\") " pod="openshift-image-registry/node-ca-8kqm6"
Jul 10 02:07:54.582912 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580228    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs\") pod \"network-metrics-daemon-gsnvh\" (UID: \"d04041a2-0cc9-4917-919a-a6a8e26cad05\") " pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:07:54.582912 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580255    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-run-openvswitch\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.582912 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580269    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-run-ovn\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.582912 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580304    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-ovnkube-config\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.583838 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580310    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-etc-sysconfig\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.583838 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580281    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-node-log\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.583838 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580346    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-multus-cni-dir\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.583838 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580385    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-node-log\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.583838 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580518    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-systemd-units\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.583838 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580534    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0177cb8b-5ebf-4268-81a4-25476eae55ea-serviceca\") pod \"node-ca-8kqm6\" (UID: \"0177cb8b-5ebf-4268-81a4-25476eae55ea\") " pod="openshift-image-registry/node-ca-8kqm6"
Jul 10 02:07:54.583838 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580566    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.583838 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580584    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-multus-conf-dir\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.583838 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580612    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/21bf7d5b-52c0-4394-bd43-6a47f793fd21-socket-dir\") pod \"aws-ebs-csi-driver-node-m865p\" (UID: \"21bf7d5b-52c0-4394-bd43-6a47f793fd21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p"
Jul 10 02:07:54.583838 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580641    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2c011ac-1205-440e-a107-06bd0b702a48-cnibin\") pod \"multus-additional-cni-plugins-wk2hr\" (UID: \"c2c011ac-1205-440e-a107-06bd0b702a48\") " pod="openshift-multus/multus-additional-cni-plugins-wk2hr"
Jul 10 02:07:54.583838 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:54.580644    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:07:54.583838 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580672    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-run-openvswitch\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.583838 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580726    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-lib-modules\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.583838 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580756    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-etc-kubernetes\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.583838 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580782    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2c011ac-1205-440e-a107-06bd0b702a48-cnibin\") pod \"multus-additional-cni-plugins-wk2hr\" (UID: \"c2c011ac-1205-440e-a107-06bd0b702a48\") " pod="openshift-multus/multus-additional-cni-plugins-wk2hr"
Jul 10 02:07:54.583838 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580830    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/21bf7d5b-52c0-4394-bd43-6a47f793fd21-device-dir\") pod \"aws-ebs-csi-driver-node-m865p\" (UID: \"21bf7d5b-52c0-4394-bd43-6a47f793fd21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p"
Jul 10 02:07:54.583838 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580785    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/21bf7d5b-52c0-4394-bd43-6a47f793fd21-device-dir\") pod \"aws-ebs-csi-driver-node-m865p\" (UID: \"21bf7d5b-52c0-4394-bd43-6a47f793fd21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p"
Jul 10 02:07:54.583838 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580839    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-multus-cni-dir\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.584753 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580884    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-multus-socket-dir-parent\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.584753 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:54.580904    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs podName:d04041a2-0cc9-4917-919a-a6a8e26cad05 nodeName:}" failed. No retries permitted until 2026-07-10 02:07:55.080887357 +0000 UTC m=+3.846799577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs") pod "network-metrics-daemon-gsnvh" (UID: "d04041a2-0cc9-4917-919a-a6a8e26cad05") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:07:54.584753 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.580921    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-multus-conf-dir\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.584753 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.581006    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b040543-891b-4498-a5d8-345354096a26-lib-modules\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.584753 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.581017    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/21bf7d5b-52c0-4394-bd43-6a47f793fd21-socket-dir\") pod \"aws-ebs-csi-driver-node-m865p\" (UID: \"21bf7d5b-52c0-4394-bd43-6a47f793fd21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p"
Jul 10 02:07:54.584753 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.581061    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-run-systemd\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.584753 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.581069    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64a64f56-9355-45c6-8426-d960c1a88d49-etc-kubernetes\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.584753 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.581125    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-run-systemd\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.584753 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.581365    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-ovnkube-script-lib\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.584753 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.583763    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b040543-891b-4498-a5d8-345354096a26-tmp\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.584753 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.583801    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2b040543-891b-4498-a5d8-345354096a26-etc-tuned\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.584753 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.583879    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-ovn-node-metrics-cert\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.584753 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.584444    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80b5bdb5-3660-434c-9384-84014e3dcf5b-agent-certs\") pod \"konnectivity-agent-kczv8\" (UID: \"80b5bdb5-3660-434c-9384-84014e3dcf5b\") " pod="kube-system/konnectivity-agent-kczv8"
Jul 10 02:07:54.593266 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.593174    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkkm5\" (UniqueName: \"kubernetes.io/projected/64a64f56-9355-45c6-8426-d960c1a88d49-kube-api-access-tkkm5\") pod \"multus-6qdlk\" (UID: \"64a64f56-9355-45c6-8426-d960c1a88d49\") " pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:54.593431 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.593407    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz67b\" (UniqueName: \"kubernetes.io/projected/d04041a2-0cc9-4917-919a-a6a8e26cad05-kube-api-access-kz67b\") pod \"network-metrics-daemon-gsnvh\" (UID: \"d04041a2-0cc9-4917-919a-a6a8e26cad05\") " pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:07:54.593576 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:54.593551    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 02:07:54.593657 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:54.593641    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 02:07:54.593734 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:54.593665    2576 projected.go:196] Error preparing data for projected volume kube-api-access-5qz58 for pod openshift-network-diagnostics/network-check-target-9kgfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:07:54.593734 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:54.593724    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/694129e7-b596-48fc-80f6-af7f756f1e90-kube-api-access-5qz58 podName:694129e7-b596-48fc-80f6-af7f756f1e90 nodeName:}" failed. No retries permitted until 2026-07-10 02:07:55.093706449 +0000 UTC m=+3.859618663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5qz58" (UniqueName: "kubernetes.io/projected/694129e7-b596-48fc-80f6-af7f756f1e90-kube-api-access-5qz58") pod "network-check-target-9kgfv" (UID: "694129e7-b596-48fc-80f6-af7f756f1e90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:07:54.594424 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.594377    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqkg5\" (UniqueName: \"kubernetes.io/projected/c8008ea1-c003-4a8d-a86d-1a01372d6ec3-kube-api-access-wqkg5\") pod \"iptables-alerter-q59sc\" (UID: \"c8008ea1-c003-4a8d-a86d-1a01372d6ec3\") " pod="openshift-network-operator/iptables-alerter-q59sc"
Jul 10 02:07:54.600868 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.600830    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z46z\" (UniqueName: \"kubernetes.io/projected/2b040543-891b-4498-a5d8-345354096a26-kube-api-access-5z46z\") pod \"tuned-tbknz\" (UID: \"2b040543-891b-4498-a5d8-345354096a26\") " pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.601264 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.601238    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxfrc\" (UniqueName: \"kubernetes.io/projected/21bf7d5b-52c0-4394-bd43-6a47f793fd21-kube-api-access-lxfrc\") pod \"aws-ebs-csi-driver-node-m865p\" (UID: \"21bf7d5b-52c0-4394-bd43-6a47f793fd21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p"
Jul 10 02:07:54.601349 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.601278    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dphvc\" (UniqueName: \"kubernetes.io/projected/cd032043-9d19-4516-b808-365276e33254-kube-api-access-dphvc\") pod \"node-resolver-tbgpl\" (UID: \"cd032043-9d19-4516-b808-365276e33254\") " pod="openshift-dns/node-resolver-tbgpl"
Jul 10 02:07:54.601791 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.601769    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn9jz\" (UniqueName: \"kubernetes.io/projected/c2c011ac-1205-440e-a107-06bd0b702a48-kube-api-access-qn9jz\") pod \"multus-additional-cni-plugins-wk2hr\" (UID: \"c2c011ac-1205-440e-a107-06bd0b702a48\") " pod="openshift-multus/multus-additional-cni-plugins-wk2hr"
Jul 10 02:07:54.601866 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.601794    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85gdk\" (UniqueName: \"kubernetes.io/projected/164f62ad-8b5b-4a66-9bfe-17d863ddeeea-kube-api-access-85gdk\") pod \"ovnkube-node-kt7wb\" (UID: \"164f62ad-8b5b-4a66-9bfe-17d863ddeeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.601978 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.601937    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfq4p\" (UniqueName: \"kubernetes.io/projected/0177cb8b-5ebf-4268-81a4-25476eae55ea-kube-api-access-bfq4p\") pod \"node-ca-8kqm6\" (UID: \"0177cb8b-5ebf-4268-81a4-25476eae55ea\") " pod="openshift-image-registry/node-ca-8kqm6"
Jul 10 02:07:54.627991 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.627956    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 02:07:54.690745 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.690708    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q59sc"
Jul 10 02:07:54.700637 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.700611    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p"
Jul 10 02:07:54.709818 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.709795    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8kqm6"
Jul 10 02:07:54.717667 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.717646    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kczv8"
Jul 10 02:07:54.725583 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.725557    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wk2hr"
Jul 10 02:07:54.737883 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.737857    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:07:54.746010 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.745990    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tbknz"
Jul 10 02:07:54.752979 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.752959    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tbgpl"
Jul 10 02:07:54.759986 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:54.759967    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6qdlk"
Jul 10 02:07:55.085503 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:55.085405    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs\") pod \"network-metrics-daemon-gsnvh\" (UID: \"d04041a2-0cc9-4917-919a-a6a8e26cad05\") " pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:07:55.085503 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:55.085459    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/087c6267-c774-4dbc-ab49-e5bf96684f7c-original-pull-secret\") pod \"global-pull-secret-syncer-v2d92\" (UID: \"087c6267-c774-4dbc-ab49-e5bf96684f7c\") " pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:07:55.085730 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:55.085580    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 02:07:55.085730 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:55.085641    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/087c6267-c774-4dbc-ab49-e5bf96684f7c-original-pull-secret podName:087c6267-c774-4dbc-ab49-e5bf96684f7c nodeName:}" failed. No retries permitted until 2026-07-10 02:07:56.085626562 +0000 UTC m=+4.851538776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/087c6267-c774-4dbc-ab49-e5bf96684f7c-original-pull-secret") pod "global-pull-secret-syncer-v2d92" (UID: "087c6267-c774-4dbc-ab49-e5bf96684f7c") : object "kube-system"/"original-pull-secret" not registered
Jul 10 02:07:55.085730 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:55.085582    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:07:55.085867 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:55.085752    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs podName:d04041a2-0cc9-4917-919a-a6a8e26cad05 nodeName:}" failed. No retries permitted until 2026-07-10 02:07:56.085734157 +0000 UTC m=+4.851646395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs") pod "network-metrics-daemon-gsnvh" (UID: "d04041a2-0cc9-4917-919a-a6a8e26cad05") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:07:55.186307 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:55.186264    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qz58\" (UniqueName: \"kubernetes.io/projected/694129e7-b596-48fc-80f6-af7f756f1e90-kube-api-access-5qz58\") pod \"network-check-target-9kgfv\" (UID: \"694129e7-b596-48fc-80f6-af7f756f1e90\") " pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:07:55.186475 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:55.186446    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 02:07:55.186475 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:55.186466    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 02:07:55.186475 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:55.186475    2576 projected.go:196] Error preparing data for projected volume kube-api-access-5qz58 for pod openshift-network-diagnostics/network-check-target-9kgfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:07:55.186637 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:55.186541    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/694129e7-b596-48fc-80f6-af7f756f1e90-kube-api-access-5qz58 podName:694129e7-b596-48fc-80f6-af7f756f1e90 nodeName:}" failed. No retries permitted until 2026-07-10 02:07:56.18652471 +0000 UTC m=+4.952436930 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5qz58" (UniqueName: "kubernetes.io/projected/694129e7-b596-48fc-80f6-af7f756f1e90-kube-api-access-5qz58") pod "network-check-target-9kgfv" (UID: "694129e7-b596-48fc-80f6-af7f756f1e90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:07:55.427873 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:55.427787    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 02:02:54 +0000 UTC" deadline="2027-12-30 23:13:04.175057358 +0000 UTC"
Jul 10 02:07:55.427873 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:55.427823    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12933h5m8.747239283s"
Jul 10 02:07:55.700651 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:55.700614    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80b5bdb5_3660_434c_9384_84014e3dcf5b.slice/crio-2b98ce5c47665c9528bd7c5357cd9f9f940ba7063796f093c69c066272bbf23b WatchSource:0}: Error finding container 2b98ce5c47665c9528bd7c5357cd9f9f940ba7063796f093c69c066272bbf23b: Status 404 returned error can't find the container with id 2b98ce5c47665c9528bd7c5357cd9f9f940ba7063796f093c69c066272bbf23b
Jul 10 02:07:55.706629 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:55.706597    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a64f56_9355_45c6_8426_d960c1a88d49.slice/crio-a1322a4dee3e8180c5f4c2ff130bc832b2cd079aa918d145c45e309edb79e88f WatchSource:0}: Error finding container a1322a4dee3e8180c5f4c2ff130bc832b2cd079aa918d145c45e309edb79e88f: Status 404 returned error can't find the container with id a1322a4dee3e8180c5f4c2ff130bc832b2cd079aa918d145c45e309edb79e88f
Jul 10 02:07:55.726528 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:55.726492    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8008ea1_c003_4a8d_a86d_1a01372d6ec3.slice/crio-f886bd2d4080490d1d6a9db591ad26e40b6ece72000ce52dd266b22d9cc542ed WatchSource:0}: Error finding container f886bd2d4080490d1d6a9db591ad26e40b6ece72000ce52dd266b22d9cc542ed: Status 404 returned error can't find the container with id f886bd2d4080490d1d6a9db591ad26e40b6ece72000ce52dd266b22d9cc542ed
Jul 10 02:07:55.727431 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:55.727303    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0177cb8b_5ebf_4268_81a4_25476eae55ea.slice/crio-57caec839c8282d974bcf55011aafe4a55e89ce23e3134cd8f32967356517e33 WatchSource:0}: Error finding container 57caec839c8282d974bcf55011aafe4a55e89ce23e3134cd8f32967356517e33: Status 404 returned error can't find the container with id 57caec839c8282d974bcf55011aafe4a55e89ce23e3134cd8f32967356517e33
Jul 10 02:07:55.728170 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:55.728147    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b040543_891b_4498_a5d8_345354096a26.slice/crio-fd2656739d7e890c96326ce328c5f3bc97dcc4724b826dc9b33ea813ae5dc3da WatchSource:0}: Error finding container fd2656739d7e890c96326ce328c5f3bc97dcc4724b826dc9b33ea813ae5dc3da: Status 404 returned error can't find the container with id fd2656739d7e890c96326ce328c5f3bc97dcc4724b826dc9b33ea813ae5dc3da
Jul 10 02:07:55.729173 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:55.728959    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2c011ac_1205_440e_a107_06bd0b702a48.slice/crio-3d85702e58be911f90826c157a2ebec339f9a9780d9fb15fc5999bce047f5c6f WatchSource:0}: Error finding container 3d85702e58be911f90826c157a2ebec339f9a9780d9fb15fc5999bce047f5c6f: Status 404 returned error can't find the container with id 3d85702e58be911f90826c157a2ebec339f9a9780d9fb15fc5999bce047f5c6f
Jul 10 02:07:55.730729 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:55.730707    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21bf7d5b_52c0_4394_bd43_6a47f793fd21.slice/crio-b8454347262c8d7282e631d318d4a7c8a7e41aea77eb5c1cfab604aa80deb113 WatchSource:0}: Error finding container b8454347262c8d7282e631d318d4a7c8a7e41aea77eb5c1cfab604aa80deb113: Status 404 returned error can't find the container with id b8454347262c8d7282e631d318d4a7c8a7e41aea77eb5c1cfab604aa80deb113
Jul 10 02:07:55.731629 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:55.731601    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd032043_9d19_4516_b808_365276e33254.slice/crio-c43242293abcb4824005cb9773546b9e4f4f6c9f2634289a2d1b3f912a184a71 WatchSource:0}: Error finding container c43242293abcb4824005cb9773546b9e4f4f6c9f2634289a2d1b3f912a184a71: Status 404 returned error can't find the container with id c43242293abcb4824005cb9773546b9e4f4f6c9f2634289a2d1b3f912a184a71
Jul 10 02:07:55.735741 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:07:55.735573    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod164f62ad_8b5b_4a66_9bfe_17d863ddeeea.slice/crio-51fd2a7f0abf6f5a207f28e819ff9240a23503fce42061856faa48acc0ef27c3 WatchSource:0}: Error finding container 51fd2a7f0abf6f5a207f28e819ff9240a23503fce42061856faa48acc0ef27c3: Status 404 returned error can't find the container with id 51fd2a7f0abf6f5a207f28e819ff9240a23503fce42061856faa48acc0ef27c3
Jul 10 02:07:56.093579 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:56.093361    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs\") pod \"network-metrics-daemon-gsnvh\" (UID: \"d04041a2-0cc9-4917-919a-a6a8e26cad05\") " pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:07:56.093787 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:56.093601    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/087c6267-c774-4dbc-ab49-e5bf96684f7c-original-pull-secret\") pod \"global-pull-secret-syncer-v2d92\" (UID: \"087c6267-c774-4dbc-ab49-e5bf96684f7c\") " pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:07:56.093787 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:56.093526    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:07:56.093787 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:56.093714    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs podName:d04041a2-0cc9-4917-919a-a6a8e26cad05 nodeName:}" failed. No retries permitted until 2026-07-10 02:07:58.093695602 +0000 UTC m=+6.859607818 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs") pod "network-metrics-daemon-gsnvh" (UID: "d04041a2-0cc9-4917-919a-a6a8e26cad05") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:07:56.093787 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:56.093721    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 02:07:56.093787 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:56.093774    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/087c6267-c774-4dbc-ab49-e5bf96684f7c-original-pull-secret podName:087c6267-c774-4dbc-ab49-e5bf96684f7c nodeName:}" failed. No retries permitted until 2026-07-10 02:07:58.093759069 +0000 UTC m=+6.859671301 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/087c6267-c774-4dbc-ab49-e5bf96684f7c-original-pull-secret") pod "global-pull-secret-syncer-v2d92" (UID: "087c6267-c774-4dbc-ab49-e5bf96684f7c") : object "kube-system"/"original-pull-secret" not registered
Jul 10 02:07:56.194608 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:56.194504    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qz58\" (UniqueName: \"kubernetes.io/projected/694129e7-b596-48fc-80f6-af7f756f1e90-kube-api-access-5qz58\") pod \"network-check-target-9kgfv\" (UID: \"694129e7-b596-48fc-80f6-af7f756f1e90\") " pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:07:56.194806 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:56.194699    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 02:07:56.194806 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:56.194717    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 02:07:56.194806 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:56.194727    2576 projected.go:196] Error preparing data for projected volume kube-api-access-5qz58 for pod openshift-network-diagnostics/network-check-target-9kgfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:07:56.194806 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:56.194775    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/694129e7-b596-48fc-80f6-af7f756f1e90-kube-api-access-5qz58 podName:694129e7-b596-48fc-80f6-af7f756f1e90 nodeName:}" failed. No retries permitted until 2026-07-10 02:07:58.194761274 +0000 UTC m=+6.960673501 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5qz58" (UniqueName: "kubernetes.io/projected/694129e7-b596-48fc-80f6-af7f756f1e90-kube-api-access-5qz58") pod "network-check-target-9kgfv" (UID: "694129e7-b596-48fc-80f6-af7f756f1e90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:07:56.428561 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:56.428479    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 02:02:54 +0000 UTC" deadline="2028-03-20 01:19:53.301032092 +0000 UTC"
Jul 10 02:07:56.428561 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:56.428524    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14855h11m56.872513564s"
Jul 10 02:07:56.540801 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:56.540715    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:07:56.540971 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:56.540863    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kgfv" podUID="694129e7-b596-48fc-80f6-af7f756f1e90"
Jul 10 02:07:56.541041 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:56.540987    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:07:56.541129 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:56.541092    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsnvh" podUID="d04041a2-0cc9-4917-919a-a6a8e26cad05"
Jul 10 02:07:56.541203 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:56.541188    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:07:56.541293 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:56.541272    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2d92" podUID="087c6267-c774-4dbc-ab49-e5bf96684f7c"
Jul 10 02:07:56.563120 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:56.563068    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8kqm6" event={"ID":"0177cb8b-5ebf-4268-81a4-25476eae55ea","Type":"ContainerStarted","Data":"57caec839c8282d974bcf55011aafe4a55e89ce23e3134cd8f32967356517e33"}
Jul 10 02:07:56.566308 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:56.566273    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q59sc" event={"ID":"c8008ea1-c003-4a8d-a86d-1a01372d6ec3","Type":"ContainerStarted","Data":"f886bd2d4080490d1d6a9db591ad26e40b6ece72000ce52dd266b22d9cc542ed"}
Jul 10 02:07:56.586989 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:56.586672    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6qdlk" event={"ID":"64a64f56-9355-45c6-8426-d960c1a88d49","Type":"ContainerStarted","Data":"a1322a4dee3e8180c5f4c2ff130bc832b2cd079aa918d145c45e309edb79e88f"}
Jul 10 02:07:56.590070 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:56.590033    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kczv8" event={"ID":"80b5bdb5-3660-434c-9384-84014e3dcf5b","Type":"ContainerStarted","Data":"2b98ce5c47665c9528bd7c5357cd9f9f940ba7063796f093c69c066272bbf23b"}
Jul 10 02:07:56.599870 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:56.598712    2576 generic.go:356] "Generic (PLEG): container finished" podID="97dee57ee5977c3e44d2e1bf00b10f09" containerID="db3892a047d73a93838a180e5f12ff73967f454cf561228d195b29f23265f983" exitCode=0
Jul 10 02:07:56.599870 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:56.598857    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-215.ec2.internal" event={"ID":"97dee57ee5977c3e44d2e1bf00b10f09","Type":"ContainerDied","Data":"db3892a047d73a93838a180e5f12ff73967f454cf561228d195b29f23265f983"}
Jul 10 02:07:56.612862 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:56.611784    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-215.ec2.internal" event={"ID":"7e242c33d17613db0772626c3ed59e80","Type":"ContainerStarted","Data":"5c257f848be0d180475eb70697ec4d7d2c1029c588b93303437e6722eac912e9"}
Jul 10 02:07:56.625539 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:56.625499    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb" event={"ID":"164f62ad-8b5b-4a66-9bfe-17d863ddeeea","Type":"ContainerStarted","Data":"51fd2a7f0abf6f5a207f28e819ff9240a23503fce42061856faa48acc0ef27c3"}
Jul 10 02:07:56.632738 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:56.632633    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tbgpl" event={"ID":"cd032043-9d19-4516-b808-365276e33254","Type":"ContainerStarted","Data":"c43242293abcb4824005cb9773546b9e4f4f6c9f2634289a2d1b3f912a184a71"}
Jul 10 02:07:56.647385 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:56.647294    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wk2hr" event={"ID":"c2c011ac-1205-440e-a107-06bd0b702a48","Type":"ContainerStarted","Data":"3d85702e58be911f90826c157a2ebec339f9a9780d9fb15fc5999bce047f5c6f"}
Jul 10 02:07:56.655339 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:56.655300    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p" event={"ID":"21bf7d5b-52c0-4394-bd43-6a47f793fd21","Type":"ContainerStarted","Data":"b8454347262c8d7282e631d318d4a7c8a7e41aea77eb5c1cfab604aa80deb113"}
Jul 10 02:07:56.669764 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:56.669718    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tbknz" event={"ID":"2b040543-891b-4498-a5d8-345354096a26","Type":"ContainerStarted","Data":"fd2656739d7e890c96326ce328c5f3bc97dcc4724b826dc9b33ea813ae5dc3da"}
Jul 10 02:07:57.694416 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:57.694199    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-215.ec2.internal" event={"ID":"97dee57ee5977c3e44d2e1bf00b10f09","Type":"ContainerStarted","Data":"bb6620154513973f181d207997499410ff029f7b20b77cf728b79034c5500b1b"}
Jul 10 02:07:57.714877 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:57.713668    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-215.ec2.internal" podStartSLOduration=3.713643436 podStartE2EDuration="3.713643436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:07:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:07:56.642897818 +0000 UTC m=+5.408810056" watchObservedRunningTime="2026-07-10 02:07:57.713643436 +0000 UTC m=+6.479555675"
Jul 10 02:07:58.113440 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:58.112550    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs\") pod \"network-metrics-daemon-gsnvh\" (UID: \"d04041a2-0cc9-4917-919a-a6a8e26cad05\") " pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:07:58.113440 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:58.112620    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/087c6267-c774-4dbc-ab49-e5bf96684f7c-original-pull-secret\") pod \"global-pull-secret-syncer-v2d92\" (UID: \"087c6267-c774-4dbc-ab49-e5bf96684f7c\") " pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:07:58.113440 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:58.112753    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 02:07:58.113440 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:58.112828    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/087c6267-c774-4dbc-ab49-e5bf96684f7c-original-pull-secret podName:087c6267-c774-4dbc-ab49-e5bf96684f7c nodeName:}" failed. No retries permitted until 2026-07-10 02:08:02.1127999 +0000 UTC m=+10.878712130 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/087c6267-c774-4dbc-ab49-e5bf96684f7c-original-pull-secret") pod "global-pull-secret-syncer-v2d92" (UID: "087c6267-c774-4dbc-ab49-e5bf96684f7c") : object "kube-system"/"original-pull-secret" not registered
Jul 10 02:07:58.113440 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:58.113263    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:07:58.113440 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:58.113325    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs podName:d04041a2-0cc9-4917-919a-a6a8e26cad05 nodeName:}" failed. No retries permitted until 2026-07-10 02:08:02.113305314 +0000 UTC m=+10.879217534 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs") pod "network-metrics-daemon-gsnvh" (UID: "d04041a2-0cc9-4917-919a-a6a8e26cad05") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:07:58.213840 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:58.213801    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qz58\" (UniqueName: \"kubernetes.io/projected/694129e7-b596-48fc-80f6-af7f756f1e90-kube-api-access-5qz58\") pod \"network-check-target-9kgfv\" (UID: \"694129e7-b596-48fc-80f6-af7f756f1e90\") " pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:07:58.214126 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:58.213977    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 02:07:58.214126 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:58.214001    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 02:07:58.214126 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:58.214025    2576 projected.go:196] Error preparing data for projected volume kube-api-access-5qz58 for pod openshift-network-diagnostics/network-check-target-9kgfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:07:58.214126 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:58.214117    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/694129e7-b596-48fc-80f6-af7f756f1e90-kube-api-access-5qz58 podName:694129e7-b596-48fc-80f6-af7f756f1e90 nodeName:}" failed. No retries permitted until 2026-07-10 02:08:02.214070793 +0000 UTC m=+10.979983026 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5qz58" (UniqueName: "kubernetes.io/projected/694129e7-b596-48fc-80f6-af7f756f1e90-kube-api-access-5qz58") pod "network-check-target-9kgfv" (UID: "694129e7-b596-48fc-80f6-af7f756f1e90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:07:58.539987 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:58.539220    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:07:58.539987 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:58.539370    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsnvh" podUID="d04041a2-0cc9-4917-919a-a6a8e26cad05"
Jul 10 02:07:58.539987 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:58.539767    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:07:58.539987 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:58.539861    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kgfv" podUID="694129e7-b596-48fc-80f6-af7f756f1e90"
Jul 10 02:07:58.540330 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:07:58.539997    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:07:58.540330 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:07:58.540107    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2d92" podUID="087c6267-c774-4dbc-ab49-e5bf96684f7c"
Jul 10 02:08:00.538865 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:00.538824    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:08:00.539364 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:00.538987    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsnvh" podUID="d04041a2-0cc9-4917-919a-a6a8e26cad05"
Jul 10 02:08:00.539364 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:00.539329    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:08:00.539487 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:00.539461    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kgfv" podUID="694129e7-b596-48fc-80f6-af7f756f1e90"
Jul 10 02:08:00.539541 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:00.539520    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:08:00.539604 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:00.539577    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2d92" podUID="087c6267-c774-4dbc-ab49-e5bf96684f7c"
Jul 10 02:08:02.150300 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:02.150040    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs\") pod \"network-metrics-daemon-gsnvh\" (UID: \"d04041a2-0cc9-4917-919a-a6a8e26cad05\") " pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:08:02.150300 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:02.150130    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/087c6267-c774-4dbc-ab49-e5bf96684f7c-original-pull-secret\") pod \"global-pull-secret-syncer-v2d92\" (UID: \"087c6267-c774-4dbc-ab49-e5bf96684f7c\") " pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:08:02.150300 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:02.150244    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 02:08:02.150852 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:02.150312    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/087c6267-c774-4dbc-ab49-e5bf96684f7c-original-pull-secret podName:087c6267-c774-4dbc-ab49-e5bf96684f7c nodeName:}" failed. No retries permitted until 2026-07-10 02:08:10.150292135 +0000 UTC m=+18.916204349 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/087c6267-c774-4dbc-ab49-e5bf96684f7c-original-pull-secret") pod "global-pull-secret-syncer-v2d92" (UID: "087c6267-c774-4dbc-ab49-e5bf96684f7c") : object "kube-system"/"original-pull-secret" not registered
Jul 10 02:08:02.150852 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:02.150246    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:08:02.150852 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:02.150387    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs podName:d04041a2-0cc9-4917-919a-a6a8e26cad05 nodeName:}" failed. No retries permitted until 2026-07-10 02:08:10.150366276 +0000 UTC m=+18.916278504 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs") pod "network-metrics-daemon-gsnvh" (UID: "d04041a2-0cc9-4917-919a-a6a8e26cad05") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:08:02.251381 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:02.251338    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qz58\" (UniqueName: \"kubernetes.io/projected/694129e7-b596-48fc-80f6-af7f756f1e90-kube-api-access-5qz58\") pod \"network-check-target-9kgfv\" (UID: \"694129e7-b596-48fc-80f6-af7f756f1e90\") " pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:08:02.251546 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:02.251525    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 02:08:02.251546 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:02.251543    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 02:08:02.251657 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:02.251557    2576 projected.go:196] Error preparing data for projected volume kube-api-access-5qz58 for pod openshift-network-diagnostics/network-check-target-9kgfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:08:02.251657 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:02.251619    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/694129e7-b596-48fc-80f6-af7f756f1e90-kube-api-access-5qz58 podName:694129e7-b596-48fc-80f6-af7f756f1e90 nodeName:}" failed. No retries permitted until 2026-07-10 02:08:10.251601066 +0000 UTC m=+19.017513283 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5qz58" (UniqueName: "kubernetes.io/projected/694129e7-b596-48fc-80f6-af7f756f1e90-kube-api-access-5qz58") pod "network-check-target-9kgfv" (UID: "694129e7-b596-48fc-80f6-af7f756f1e90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:08:02.540101 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:02.539054    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:08:02.540101 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:02.539158    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2d92" podUID="087c6267-c774-4dbc-ab49-e5bf96684f7c"
Jul 10 02:08:02.540101 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:02.539203    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:08:02.540101 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:02.539342    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsnvh" podUID="d04041a2-0cc9-4917-919a-a6a8e26cad05"
Jul 10 02:08:02.540101 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:02.539387    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:08:02.540101 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:02.539468    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kgfv" podUID="694129e7-b596-48fc-80f6-af7f756f1e90"
Jul 10 02:08:04.540480 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:04.540440    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:08:04.541012 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:04.540591    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsnvh" podUID="d04041a2-0cc9-4917-919a-a6a8e26cad05"
Jul 10 02:08:04.541120 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:04.541020    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:08:04.541120 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:04.541070    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:08:04.541234 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:04.541145    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2d92" podUID="087c6267-c774-4dbc-ab49-e5bf96684f7c"
Jul 10 02:08:04.541234 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:04.541222    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kgfv" podUID="694129e7-b596-48fc-80f6-af7f756f1e90"
Jul 10 02:08:06.538236 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:06.538200    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:08:06.538236 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:06.538222    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:08:06.538618 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:06.538304    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:08:06.538618 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:06.538320    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2d92" podUID="087c6267-c774-4dbc-ab49-e5bf96684f7c"
Jul 10 02:08:06.538618 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:06.538413    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsnvh" podUID="d04041a2-0cc9-4917-919a-a6a8e26cad05"
Jul 10 02:08:06.538618 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:06.538499    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kgfv" podUID="694129e7-b596-48fc-80f6-af7f756f1e90"
Jul 10 02:08:08.538836 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:08.538797    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:08:08.538836 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:08.538833    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:08:08.539365 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:08.538808    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:08:08.539365 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:08.538917    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2d92" podUID="087c6267-c774-4dbc-ab49-e5bf96684f7c"
Jul 10 02:08:08.539365 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:08.539019    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsnvh" podUID="d04041a2-0cc9-4917-919a-a6a8e26cad05"
Jul 10 02:08:08.539365 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:08.539125    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kgfv" podUID="694129e7-b596-48fc-80f6-af7f756f1e90"
Jul 10 02:08:10.212349 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:10.212277    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs\") pod \"network-metrics-daemon-gsnvh\" (UID: \"d04041a2-0cc9-4917-919a-a6a8e26cad05\") " pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:08:10.212349 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:10.212348    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/087c6267-c774-4dbc-ab49-e5bf96684f7c-original-pull-secret\") pod \"global-pull-secret-syncer-v2d92\" (UID: \"087c6267-c774-4dbc-ab49-e5bf96684f7c\") " pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:08:10.212890 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:10.212472    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:08:10.212890 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:10.212522    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 02:08:10.212890 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:10.212553    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs podName:d04041a2-0cc9-4917-919a-a6a8e26cad05 nodeName:}" failed. No retries permitted until 2026-07-10 02:08:26.212531301 +0000 UTC m=+34.978443518 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs") pod "network-metrics-daemon-gsnvh" (UID: "d04041a2-0cc9-4917-919a-a6a8e26cad05") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:08:10.212890 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:10.212576    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/087c6267-c774-4dbc-ab49-e5bf96684f7c-original-pull-secret podName:087c6267-c774-4dbc-ab49-e5bf96684f7c nodeName:}" failed. No retries permitted until 2026-07-10 02:08:26.212560449 +0000 UTC m=+34.978472672 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/087c6267-c774-4dbc-ab49-e5bf96684f7c-original-pull-secret") pod "global-pull-secret-syncer-v2d92" (UID: "087c6267-c774-4dbc-ab49-e5bf96684f7c") : object "kube-system"/"original-pull-secret" not registered
Jul 10 02:08:10.313069 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:10.313014    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qz58\" (UniqueName: \"kubernetes.io/projected/694129e7-b596-48fc-80f6-af7f756f1e90-kube-api-access-5qz58\") pod \"network-check-target-9kgfv\" (UID: \"694129e7-b596-48fc-80f6-af7f756f1e90\") " pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:08:10.313243 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:10.313224    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 02:08:10.313286 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:10.313254    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 02:08:10.313286 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:10.313269    2576 projected.go:196] Error preparing data for projected volume kube-api-access-5qz58 for pod openshift-network-diagnostics/network-check-target-9kgfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:08:10.313347 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:10.313335    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/694129e7-b596-48fc-80f6-af7f756f1e90-kube-api-access-5qz58 podName:694129e7-b596-48fc-80f6-af7f756f1e90 nodeName:}" failed. No retries permitted until 2026-07-10 02:08:26.313315042 +0000 UTC m=+35.079227259 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5qz58" (UniqueName: "kubernetes.io/projected/694129e7-b596-48fc-80f6-af7f756f1e90-kube-api-access-5qz58") pod "network-check-target-9kgfv" (UID: "694129e7-b596-48fc-80f6-af7f756f1e90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:08:10.539015 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:10.538934    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:08:10.539210 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:10.538935    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:08:10.539210 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:10.539084    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2d92" podUID="087c6267-c774-4dbc-ab49-e5bf96684f7c"
Jul 10 02:08:10.539210 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:10.539094    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:08:10.539210 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:10.539189    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsnvh" podUID="d04041a2-0cc9-4917-919a-a6a8e26cad05"
Jul 10 02:08:10.539381 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:10.539268    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kgfv" podUID="694129e7-b596-48fc-80f6-af7f756f1e90"
Jul 10 02:08:12.542094 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:12.542021    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:08:12.542505 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:12.542147    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:08:12.542505 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:12.542159    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:08:12.542505 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:12.542153    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kgfv" podUID="694129e7-b596-48fc-80f6-af7f756f1e90"
Jul 10 02:08:12.542505 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:12.542261    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2d92" podUID="087c6267-c774-4dbc-ab49-e5bf96684f7c"
Jul 10 02:08:12.542505 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:12.542358    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsnvh" podUID="d04041a2-0cc9-4917-919a-a6a8e26cad05"
Jul 10 02:08:14.538545 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:14.538505    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:08:14.538545 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:14.538529    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:08:14.539161 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:14.538505    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:08:14.539161 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:14.538651    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2d92" podUID="087c6267-c774-4dbc-ab49-e5bf96684f7c"
Jul 10 02:08:14.539161 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:14.538731    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kgfv" podUID="694129e7-b596-48fc-80f6-af7f756f1e90"
Jul 10 02:08:14.539161 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:14.538825    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsnvh" podUID="d04041a2-0cc9-4917-919a-a6a8e26cad05"
Jul 10 02:08:15.735068 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:15.734851    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb" event={"ID":"164f62ad-8b5b-4a66-9bfe-17d863ddeeea","Type":"ContainerStarted","Data":"c033563fc374cd8d238b1403697a2dbb8c07d61cf2640265797edb59af0dc262"}
Jul 10 02:08:15.735587 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:15.735155    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb" event={"ID":"164f62ad-8b5b-4a66-9bfe-17d863ddeeea","Type":"ContainerStarted","Data":"b945feca8779efcdf19a0652d7f2b0efbe399d6a838e69459e68785f52bb8b4b"}
Jul 10 02:08:15.736472 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:15.736441    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tbgpl" event={"ID":"cd032043-9d19-4516-b808-365276e33254","Type":"ContainerStarted","Data":"1bcb40049099070070b4b55cc115165f0ec2d3f4c215517cf642dcc2c34b56d3"}
Jul 10 02:08:15.738601 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:15.738566    2576 generic.go:356] "Generic (PLEG): container finished" podID="c2c011ac-1205-440e-a107-06bd0b702a48" containerID="f399959cb31848e3c2c4ae56113d3da283176b63ba97259699debabc6177314d" exitCode=0
Jul 10 02:08:15.738705 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:15.738651    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wk2hr" event={"ID":"c2c011ac-1205-440e-a107-06bd0b702a48","Type":"ContainerDied","Data":"f399959cb31848e3c2c4ae56113d3da283176b63ba97259699debabc6177314d"}
Jul 10 02:08:15.740501 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:15.740278    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p" event={"ID":"21bf7d5b-52c0-4394-bd43-6a47f793fd21","Type":"ContainerStarted","Data":"2a7016082ca153251aeb12bb22cd09849bee5ec7d267cd77f2efd5d0dde3ba0f"}
Jul 10 02:08:15.745707 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:15.745680    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tbknz" event={"ID":"2b040543-891b-4498-a5d8-345354096a26","Type":"ContainerStarted","Data":"222831b5eb4675986dace7e8e399d8eb32467189ad8f0ac149a7543ee0594d2a"}
Jul 10 02:08:15.747374 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:15.747351    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8kqm6" event={"ID":"0177cb8b-5ebf-4268-81a4-25476eae55ea","Type":"ContainerStarted","Data":"9b517a7d90daf7bf5550abfef20461ed85a6d308d3c90d2fe0bf3d470249234c"}
Jul 10 02:08:15.748783 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:15.748756    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6qdlk" event={"ID":"64a64f56-9355-45c6-8426-d960c1a88d49","Type":"ContainerStarted","Data":"6f945263fad4a49fc796d4f9ebcfea4fb01d1b2d95b0f5fd5b5622b8e8e1cff2"}
Jul 10 02:08:15.750338 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:15.750315    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kczv8" event={"ID":"80b5bdb5-3660-434c-9384-84014e3dcf5b","Type":"ContainerStarted","Data":"ba3e50cf32dd4bc2c3b68ea555cd077654c4b18286004e40572ec164b2228574"}
Jul 10 02:08:15.757954 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:15.757915    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-215.ec2.internal" podStartSLOduration=21.75790305 podStartE2EDuration="21.75790305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:07:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:07:57.714857674 +0000 UTC m=+6.480769914" watchObservedRunningTime="2026-07-10 02:08:15.75790305 +0000 UTC m=+24.523815282"
Jul 10 02:08:15.758316 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:15.758290    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tbgpl" podStartSLOduration=3.079887541 podStartE2EDuration="22.7582823s" totalImagesPullingTime="19.678394759s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:08:15.757539115 +0000 UTC m=+24.523451350" watchObservedRunningTime="2026-07-10 02:08:15.7582823 +0000 UTC m=+24.524194532"
Jul 10 02:08:15.774214 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:15.774155    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kczv8" podStartSLOduration=3.091457677 podStartE2EDuration="22.774134872s" totalImagesPullingTime="19.682677195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:08:15.773896155 +0000 UTC m=+24.539808401" watchObservedRunningTime="2026-07-10 02:08:15.774134872 +0000 UTC m=+24.540047106"
Jul 10 02:08:15.793704 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:15.793660    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tbknz" podStartSLOduration=3.111397956 podStartE2EDuration="22.793644676s" totalImagesPullingTime="19.68224672s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:08:15.792746092 +0000 UTC m=+24.558658326" watchObservedRunningTime="2026-07-10 02:08:15.793644676 +0000 UTC m=+24.559556909"
Jul 10 02:08:15.814860 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:15.814818    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6qdlk" podStartSLOduration=3.068346216 podStartE2EDuration="22.814800934s" totalImagesPullingTime="19.746454718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:08:15.814151643 +0000 UTC m=+24.580063876" watchObservedRunningTime="2026-07-10 02:08:15.814800934 +0000 UTC m=+24.580713167"
Jul 10 02:08:15.864281 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:15.864238    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8kqm6" podStartSLOduration=3.235141668 podStartE2EDuration="22.864222774s" totalImagesPullingTime="19.629081106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:08:15.83792687 +0000 UTC m=+24.603839103" watchObservedRunningTime="2026-07-10 02:08:15.864222774 +0000 UTC m=+24.630135006"
Jul 10 02:08:16.538746 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:16.538553    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:08:16.538933 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:16.538553    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:08:16.538933 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:16.538863    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsnvh" podUID="d04041a2-0cc9-4917-919a-a6a8e26cad05"
Jul 10 02:08:16.538933 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:16.538578    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:08:16.539124 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:16.538895    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kgfv" podUID="694129e7-b596-48fc-80f6-af7f756f1e90"
Jul 10 02:08:16.539124 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:16.539002    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2d92" podUID="087c6267-c774-4dbc-ab49-e5bf96684f7c"
Jul 10 02:08:16.755113 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:16.755092    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt7wb_164f62ad-8b5b-4a66-9bfe-17d863ddeeea/ovn-acl-logging/0.log"
Jul 10 02:08:16.755530 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:16.755392    2576 generic.go:356] "Generic (PLEG): container finished" podID="164f62ad-8b5b-4a66-9bfe-17d863ddeeea" containerID="c033563fc374cd8d238b1403697a2dbb8c07d61cf2640265797edb59af0dc262" exitCode=1
Jul 10 02:08:16.755530 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:16.755459    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb" event={"ID":"164f62ad-8b5b-4a66-9bfe-17d863ddeeea","Type":"ContainerDied","Data":"c033563fc374cd8d238b1403697a2dbb8c07d61cf2640265797edb59af0dc262"}
Jul 10 02:08:16.755530 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:16.755524    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb" event={"ID":"164f62ad-8b5b-4a66-9bfe-17d863ddeeea","Type":"ContainerStarted","Data":"73d7f8a265e029152e2bbfa83bc6ee4053a7dc14ca699135c95d85a1706cbec0"}
Jul 10 02:08:16.755656 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:16.755564    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb" event={"ID":"164f62ad-8b5b-4a66-9bfe-17d863ddeeea","Type":"ContainerStarted","Data":"7ec1ebe589294e496cb707e17ad660387b1eb17e5d2977a5c7bc746bff67afad"}
Jul 10 02:08:16.755656 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:16.755602    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb" event={"ID":"164f62ad-8b5b-4a66-9bfe-17d863ddeeea","Type":"ContainerStarted","Data":"8c909c249cfcf318a936e0b419611625599093b04bd5742782ec7d191197a894"}
Jul 10 02:08:16.755656 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:16.755650    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb" event={"ID":"164f62ad-8b5b-4a66-9bfe-17d863ddeeea","Type":"ContainerStarted","Data":"9063a29246f417d60bcb3b107e7a1da0746be54936a20840607a75066abd540a"}
Jul 10 02:08:17.028650 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:17.028578    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kczv8"
Jul 10 02:08:17.029265 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:17.029243    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kczv8"
Jul 10 02:08:17.245050 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:17.244992    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 10 02:08:17.443173 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:17.443039    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T02:08:17.245018868Z","UUID":"4dda3210-9e34-48a3-bf3f-c1be1ea5bd83","Handler":null,"Name":"","Endpoint":""}
Jul 10 02:08:17.444643 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:17.444625    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 10 02:08:17.444744 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:17.444659    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 10 02:08:17.761281 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:17.761199    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p" event={"ID":"21bf7d5b-52c0-4394-bd43-6a47f793fd21","Type":"ContainerStarted","Data":"070bbee31646c50f518abb7f6f6ac7c56866e440e3ea76806f32559a7552ea09"}
Jul 10 02:08:17.762895 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:17.762858    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q59sc" event={"ID":"c8008ea1-c003-4a8d-a86d-1a01372d6ec3","Type":"ContainerStarted","Data":"ac40674738519e4f6b6db4ab59950115aded03fbfe125c5b679bbc310b6390c4"}
Jul 10 02:08:17.763250 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:17.763234    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kczv8"
Jul 10 02:08:17.763630 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:17.763610    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kczv8"
Jul 10 02:08:17.780885 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:17.780825    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q59sc" podStartSLOduration=5.101098375 podStartE2EDuration="24.780804654s" totalImagesPullingTime="19.679706279s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:08:17.780614621 +0000 UTC m=+26.546526854" watchObservedRunningTime="2026-07-10 02:08:17.780804654 +0000 UTC m=+26.546716889"
Jul 10 02:08:18.538956 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:18.538932    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:08:18.539089 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:18.538932    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:08:18.539142 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:18.539093    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsnvh" podUID="d04041a2-0cc9-4917-919a-a6a8e26cad05"
Jul 10 02:08:18.539142 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:18.538938    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:08:18.539248 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:18.539163    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kgfv" podUID="694129e7-b596-48fc-80f6-af7f756f1e90"
Jul 10 02:08:18.539248 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:18.539228    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2d92" podUID="087c6267-c774-4dbc-ab49-e5bf96684f7c"
Jul 10 02:08:18.768181 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:18.767955    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt7wb_164f62ad-8b5b-4a66-9bfe-17d863ddeeea/ovn-acl-logging/0.log"
Jul 10 02:08:18.768549 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:18.768478    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb" event={"ID":"164f62ad-8b5b-4a66-9bfe-17d863ddeeea","Type":"ContainerStarted","Data":"bcd469fe4b4b577fa991ed100bbb9aa812ce511d8e98994f87fcabc1a1fd0504"}
Jul 10 02:08:18.770393 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:18.770361    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p" event={"ID":"21bf7d5b-52c0-4394-bd43-6a47f793fd21","Type":"ContainerStarted","Data":"b821d9701bd9be9266d6b74b9d80a85fddd10b6cdf2249565ace2c50ecd1c593"}
Jul 10 02:08:18.792780 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:18.792736    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m865p" podStartSLOduration=3.441488204 podStartE2EDuration="25.79272189s" totalImagesPullingTime="22.351233686s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:07:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:08:18.792526485 +0000 UTC m=+27.558438718" watchObservedRunningTime="2026-07-10 02:08:18.79272189 +0000 UTC m=+27.558634154"
Jul 10 02:08:20.538481 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:20.538441    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:08:20.538481 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:20.538482    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:08:20.539207 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:20.538441    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:08:20.539207 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:20.538562    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2d92" podUID="087c6267-c774-4dbc-ab49-e5bf96684f7c"
Jul 10 02:08:20.539207 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:20.538663    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsnvh" podUID="d04041a2-0cc9-4917-919a-a6a8e26cad05"
Jul 10 02:08:20.539207 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:20.538752    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kgfv" podUID="694129e7-b596-48fc-80f6-af7f756f1e90"
Jul 10 02:08:20.778099 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:20.778075    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt7wb_164f62ad-8b5b-4a66-9bfe-17d863ddeeea/ovn-acl-logging/0.log"
Jul 10 02:08:20.778428 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:20.778401    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb" event={"ID":"164f62ad-8b5b-4a66-9bfe-17d863ddeeea","Type":"ContainerStarted","Data":"8030ba7939730d6334d581fd04e6c076d09587a75885b1ee23014fb342292dfd"}
Jul 10 02:08:20.778682 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:20.778662    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:08:20.778765 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:20.778724    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:08:20.778821 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:20.778769    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:08:20.778869 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:20.778861    2576 scope.go:117] "RemoveContainer" containerID="c033563fc374cd8d238b1403697a2dbb8c07d61cf2640265797edb59af0dc262"
Jul 10 02:08:20.794543 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:20.794522    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:08:20.794845 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:20.794826    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:08:21.785114 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:21.784762    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt7wb_164f62ad-8b5b-4a66-9bfe-17d863ddeeea/ovn-acl-logging/0.log"
Jul 10 02:08:21.785975 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:21.785510    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb" event={"ID":"164f62ad-8b5b-4a66-9bfe-17d863ddeeea","Type":"ContainerStarted","Data":"6effa517b3832f4560e44cf37bcdfb5eb9bf516221c77e5945d0c9e09c02cc5b"}
Jul 10 02:08:21.816175 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:21.816115    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb" podStartSLOduration=9.067268333 podStartE2EDuration="28.816096919s" totalImagesPullingTime="19.748828586s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:08:21.814151385 +0000 UTC m=+30.580063629" watchObservedRunningTime="2026-07-10 02:08:21.816096919 +0000 UTC m=+30.582009557"
Jul 10 02:08:22.539956 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:22.539924    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:08:22.540158 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:22.540066    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsnvh" podUID="d04041a2-0cc9-4917-919a-a6a8e26cad05"
Jul 10 02:08:22.540547 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:22.540525    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:08:22.540651 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:22.540618    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kgfv" podUID="694129e7-b596-48fc-80f6-af7f756f1e90"
Jul 10 02:08:22.540738 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:22.540663    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:08:22.540738 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:22.540719    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2d92" podUID="087c6267-c774-4dbc-ab49-e5bf96684f7c"
Jul 10 02:08:22.792445 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:22.792363    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v2d92"]
Jul 10 02:08:22.792818 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:22.792467    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:08:22.792818 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:22.792549    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2d92" podUID="087c6267-c774-4dbc-ab49-e5bf96684f7c"
Jul 10 02:08:22.795273 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:22.795238    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9kgfv"]
Jul 10 02:08:22.795416 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:22.795328    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:08:22.795464 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:22.795419    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kgfv" podUID="694129e7-b596-48fc-80f6-af7f756f1e90"
Jul 10 02:08:22.795781 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:22.795766    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gsnvh"]
Jul 10 02:08:22.795848 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:22.795839    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:08:22.795948 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:22.795928    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsnvh" podUID="d04041a2-0cc9-4917-919a-a6a8e26cad05"
Jul 10 02:08:23.791769 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:23.791734    2576 generic.go:356] "Generic (PLEG): container finished" podID="c2c011ac-1205-440e-a107-06bd0b702a48" containerID="cd95de3735e9e20953e61f7ff1fb9bc8167a63e2cd0fb3b5d519c9260c767067" exitCode=0
Jul 10 02:08:23.791915 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:23.791794    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wk2hr" event={"ID":"c2c011ac-1205-440e-a107-06bd0b702a48","Type":"ContainerDied","Data":"cd95de3735e9e20953e61f7ff1fb9bc8167a63e2cd0fb3b5d519c9260c767067"}
Jul 10 02:08:24.538711 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:24.538684    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:08:24.539043 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:24.538687    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:08:24.539043 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:24.538779    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kgfv" podUID="694129e7-b596-48fc-80f6-af7f756f1e90"
Jul 10 02:08:24.539043 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:24.538899    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsnvh" podUID="d04041a2-0cc9-4917-919a-a6a8e26cad05"
Jul 10 02:08:24.539043 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:24.538931    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:08:24.539043 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:24.539008    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2d92" podUID="087c6267-c774-4dbc-ab49-e5bf96684f7c"
Jul 10 02:08:24.796947 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:24.796916    2576 generic.go:356] "Generic (PLEG): container finished" podID="c2c011ac-1205-440e-a107-06bd0b702a48" containerID="a161b32401cf904ba84167adfa509472f20afd10b345ed33cafcd5f737cec38e" exitCode=0
Jul 10 02:08:24.797127 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:24.796968    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wk2hr" event={"ID":"c2c011ac-1205-440e-a107-06bd0b702a48","Type":"ContainerDied","Data":"a161b32401cf904ba84167adfa509472f20afd10b345ed33cafcd5f737cec38e"}
Jul 10 02:08:25.802095 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:25.801993    2576 generic.go:356] "Generic (PLEG): container finished" podID="c2c011ac-1205-440e-a107-06bd0b702a48" containerID="833c6d6a329acb2bfb1300a71ca61b8a7da9fe0703ff44344d99cac65082d311" exitCode=0
Jul 10 02:08:25.802095 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:25.802058    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wk2hr" event={"ID":"c2c011ac-1205-440e-a107-06bd0b702a48","Type":"ContainerDied","Data":"833c6d6a329acb2bfb1300a71ca61b8a7da9fe0703ff44344d99cac65082d311"}
Jul 10 02:08:26.235524 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:26.235493    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs\") pod \"network-metrics-daemon-gsnvh\" (UID: \"d04041a2-0cc9-4917-919a-a6a8e26cad05\") " pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:08:26.235670 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:26.235538    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/087c6267-c774-4dbc-ab49-e5bf96684f7c-original-pull-secret\") pod \"global-pull-secret-syncer-v2d92\" (UID: \"087c6267-c774-4dbc-ab49-e5bf96684f7c\") " pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:08:26.235670 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:26.235646    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 02:08:26.235761 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:26.235663    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:08:26.235761 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:26.235697    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/087c6267-c774-4dbc-ab49-e5bf96684f7c-original-pull-secret podName:087c6267-c774-4dbc-ab49-e5bf96684f7c nodeName:}" failed. No retries permitted until 2026-07-10 02:08:58.235684858 +0000 UTC m=+67.001597069 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/087c6267-c774-4dbc-ab49-e5bf96684f7c-original-pull-secret") pod "global-pull-secret-syncer-v2d92" (UID: "087c6267-c774-4dbc-ab49-e5bf96684f7c") : object "kube-system"/"original-pull-secret" not registered
Jul 10 02:08:26.235761 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:26.235725    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs podName:d04041a2-0cc9-4917-919a-a6a8e26cad05 nodeName:}" failed. No retries permitted until 2026-07-10 02:08:58.235713005 +0000 UTC m=+67.001625218 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs") pod "network-metrics-daemon-gsnvh" (UID: "d04041a2-0cc9-4917-919a-a6a8e26cad05") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:08:26.336298 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:26.336261    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qz58\" (UniqueName: \"kubernetes.io/projected/694129e7-b596-48fc-80f6-af7f756f1e90-kube-api-access-5qz58\") pod \"network-check-target-9kgfv\" (UID: \"694129e7-b596-48fc-80f6-af7f756f1e90\") " pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:08:26.336490 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:26.336451    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 02:08:26.336490 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:26.336471    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 02:08:26.336490 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:26.336481    2576 projected.go:196] Error preparing data for projected volume kube-api-access-5qz58 for pod openshift-network-diagnostics/network-check-target-9kgfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:08:26.336764 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:26.336536    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/694129e7-b596-48fc-80f6-af7f756f1e90-kube-api-access-5qz58 podName:694129e7-b596-48fc-80f6-af7f756f1e90 nodeName:}" failed. No retries permitted until 2026-07-10 02:08:58.336518263 +0000 UTC m=+67.102430476 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5qz58" (UniqueName: "kubernetes.io/projected/694129e7-b596-48fc-80f6-af7f756f1e90-kube-api-access-5qz58") pod "network-check-target-9kgfv" (UID: "694129e7-b596-48fc-80f6-af7f756f1e90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:08:26.538216 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:26.538125    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:08:26.538216 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:26.538167    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:08:26.538478 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:26.538125    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:08:26.538478 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:26.538259    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsnvh" podUID="d04041a2-0cc9-4917-919a-a6a8e26cad05"
Jul 10 02:08:26.538478 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:26.538332    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kgfv" podUID="694129e7-b596-48fc-80f6-af7f756f1e90"
Jul 10 02:08:26.538478 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:26.538415    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2d92" podUID="087c6267-c774-4dbc-ab49-e5bf96684f7c"
Jul 10 02:08:28.427935 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.427903    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-215.ec2.internal" event="NodeReady"
Jul 10 02:08:28.428536 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.428077    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 10 02:08:28.475274 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.475244    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cdrpn"]
Jul 10 02:08:28.478630 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.478607    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-84rg4"]
Jul 10 02:08:28.478754 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.478733    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:08:28.481427 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.481402    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 10 02:08:28.481560 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.481476    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g8kf5\""
Jul 10 02:08:28.481748 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.481732    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 10 02:08:28.481831 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.481771    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-84rg4"
Jul 10 02:08:28.484336 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.484317    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zpbsc\""
Jul 10 02:08:28.484489 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.484471    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 10 02:08:28.484605 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.484589    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 10 02:08:28.484702 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.484673    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 10 02:08:28.489638 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.489069    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cdrpn"]
Jul 10 02:08:28.491539 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.491490    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-84rg4"]
Jul 10 02:08:28.538969 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.538931    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:08:28.538969 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.538968    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:08:28.539470 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.539447    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:08:28.542126 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.542105    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 02:08:28.542245 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.542220    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 02:08:28.542560 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.542336    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dzm46\""
Jul 10 02:08:28.542560 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.542393    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 02:08:28.542560 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.542403    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 02:08:28.542560 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.542402    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-chbtx\""
Jul 10 02:08:28.653729 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.653702    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2de5e788-9b05-474d-9225-752dc7d291a6-config-volume\") pod \"dns-default-cdrpn\" (UID: \"2de5e788-9b05-474d-9225-752dc7d291a6\") " pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:08:28.653900 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.653737    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hpnb\" (UniqueName: \"kubernetes.io/projected/2de5e788-9b05-474d-9225-752dc7d291a6-kube-api-access-4hpnb\") pod \"dns-default-cdrpn\" (UID: \"2de5e788-9b05-474d-9225-752dc7d291a6\") " pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:08:28.653900 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.653824    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2hvt\" (UniqueName: \"kubernetes.io/projected/669ccaa9-c014-4d81-95b5-ef08cb4a8cd1-kube-api-access-n2hvt\") pod \"ingress-canary-84rg4\" (UID: \"669ccaa9-c014-4d81-95b5-ef08cb4a8cd1\") " pod="openshift-ingress-canary/ingress-canary-84rg4"
Jul 10 02:08:28.653900 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.653847    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2de5e788-9b05-474d-9225-752dc7d291a6-tmp-dir\") pod \"dns-default-cdrpn\" (UID: \"2de5e788-9b05-474d-9225-752dc7d291a6\") " pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:08:28.653900 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.653872    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/669ccaa9-c014-4d81-95b5-ef08cb4a8cd1-cert\") pod \"ingress-canary-84rg4\" (UID: \"669ccaa9-c014-4d81-95b5-ef08cb4a8cd1\") " pod="openshift-ingress-canary/ingress-canary-84rg4"
Jul 10 02:08:28.654082 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.653925    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls\") pod \"dns-default-cdrpn\" (UID: \"2de5e788-9b05-474d-9225-752dc7d291a6\") " pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:08:28.755112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.755009    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2de5e788-9b05-474d-9225-752dc7d291a6-config-volume\") pod \"dns-default-cdrpn\" (UID: \"2de5e788-9b05-474d-9225-752dc7d291a6\") " pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:08:28.755112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.755067    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hpnb\" (UniqueName: \"kubernetes.io/projected/2de5e788-9b05-474d-9225-752dc7d291a6-kube-api-access-4hpnb\") pod \"dns-default-cdrpn\" (UID: \"2de5e788-9b05-474d-9225-752dc7d291a6\") " pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:08:28.755338 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.755144    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2hvt\" (UniqueName: \"kubernetes.io/projected/669ccaa9-c014-4d81-95b5-ef08cb4a8cd1-kube-api-access-n2hvt\") pod \"ingress-canary-84rg4\" (UID: \"669ccaa9-c014-4d81-95b5-ef08cb4a8cd1\") " pod="openshift-ingress-canary/ingress-canary-84rg4"
Jul 10 02:08:28.755338 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.755166    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2de5e788-9b05-474d-9225-752dc7d291a6-tmp-dir\") pod \"dns-default-cdrpn\" (UID: \"2de5e788-9b05-474d-9225-752dc7d291a6\") " pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:08:28.755338 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.755192    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/669ccaa9-c014-4d81-95b5-ef08cb4a8cd1-cert\") pod \"ingress-canary-84rg4\" (UID: \"669ccaa9-c014-4d81-95b5-ef08cb4a8cd1\") " pod="openshift-ingress-canary/ingress-canary-84rg4"
Jul 10 02:08:28.755338 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.755217    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls\") pod \"dns-default-cdrpn\" (UID: \"2de5e788-9b05-474d-9225-752dc7d291a6\") " pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:08:28.755338 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:28.755321    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 02:08:28.755562 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:28.755381    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls podName:2de5e788-9b05-474d-9225-752dc7d291a6 nodeName:}" failed. No retries permitted until 2026-07-10 02:08:29.255360555 +0000 UTC m=+38.021272767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls") pod "dns-default-cdrpn" (UID: "2de5e788-9b05-474d-9225-752dc7d291a6") : secret "dns-default-metrics-tls" not found
Jul 10 02:08:28.755675 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.755646    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2de5e788-9b05-474d-9225-752dc7d291a6-tmp-dir\") pod \"dns-default-cdrpn\" (UID: \"2de5e788-9b05-474d-9225-752dc7d291a6\") " pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:08:28.755798 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.755685    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2de5e788-9b05-474d-9225-752dc7d291a6-config-volume\") pod \"dns-default-cdrpn\" (UID: \"2de5e788-9b05-474d-9225-752dc7d291a6\") " pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:08:28.759991 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.759969    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/669ccaa9-c014-4d81-95b5-ef08cb4a8cd1-cert\") pod \"ingress-canary-84rg4\" (UID: \"669ccaa9-c014-4d81-95b5-ef08cb4a8cd1\") " pod="openshift-ingress-canary/ingress-canary-84rg4"
Jul 10 02:08:28.765892 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.765844    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hpnb\" (UniqueName: \"kubernetes.io/projected/2de5e788-9b05-474d-9225-752dc7d291a6-kube-api-access-4hpnb\") pod \"dns-default-cdrpn\" (UID: \"2de5e788-9b05-474d-9225-752dc7d291a6\") " pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:08:28.766037 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.765953    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2hvt\" (UniqueName: \"kubernetes.io/projected/669ccaa9-c014-4d81-95b5-ef08cb4a8cd1-kube-api-access-n2hvt\") pod \"ingress-canary-84rg4\" (UID: \"669ccaa9-c014-4d81-95b5-ef08cb4a8cd1\") " pod="openshift-ingress-canary/ingress-canary-84rg4"
Jul 10 02:08:28.799008 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.798975    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-84rg4"
Jul 10 02:08:28.967683 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:28.967465    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-84rg4"]
Jul 10 02:08:29.258390 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:29.258351    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls\") pod \"dns-default-cdrpn\" (UID: \"2de5e788-9b05-474d-9225-752dc7d291a6\") " pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:08:29.258537 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:29.258500    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 02:08:29.258601 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:29.258569    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls podName:2de5e788-9b05-474d-9225-752dc7d291a6 nodeName:}" failed. No retries permitted until 2026-07-10 02:08:30.258550474 +0000 UTC m=+39.024462685 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls") pod "dns-default-cdrpn" (UID: "2de5e788-9b05-474d-9225-752dc7d291a6") : secret "dns-default-metrics-tls" not found
Jul 10 02:08:30.267334 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:30.267293    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls\") pod \"dns-default-cdrpn\" (UID: \"2de5e788-9b05-474d-9225-752dc7d291a6\") " pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:08:30.267974 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:30.267487    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 02:08:30.267974 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:30.267570    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls podName:2de5e788-9b05-474d-9225-752dc7d291a6 nodeName:}" failed. No retries permitted until 2026-07-10 02:08:32.267549101 +0000 UTC m=+41.033461334 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls") pod "dns-default-cdrpn" (UID: "2de5e788-9b05-474d-9225-752dc7d291a6") : secret "dns-default-metrics-tls" not found
Jul 10 02:08:30.406022 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:08:30.405981    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod669ccaa9_c014_4d81_95b5_ef08cb4a8cd1.slice/crio-b1eed0f154b4dd9d74308fb5596f4d988289b65cc71795f5c61b1c9cfbda449a WatchSource:0}: Error finding container b1eed0f154b4dd9d74308fb5596f4d988289b65cc71795f5c61b1c9cfbda449a: Status 404 returned error can't find the container with id b1eed0f154b4dd9d74308fb5596f4d988289b65cc71795f5c61b1c9cfbda449a
Jul 10 02:08:30.816295 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:30.816262    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-84rg4" event={"ID":"669ccaa9-c014-4d81-95b5-ef08cb4a8cd1","Type":"ContainerStarted","Data":"b1eed0f154b4dd9d74308fb5596f4d988289b65cc71795f5c61b1c9cfbda449a"}
Jul 10 02:08:31.821352 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:31.821316    2576 generic.go:356] "Generic (PLEG): container finished" podID="c2c011ac-1205-440e-a107-06bd0b702a48" containerID="8fe40a3985a7d7519a5f75d3755b6c137a39c172694d30586afa7df2bb0463e5" exitCode=0
Jul 10 02:08:31.821818 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:31.821373    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wk2hr" event={"ID":"c2c011ac-1205-440e-a107-06bd0b702a48","Type":"ContainerDied","Data":"8fe40a3985a7d7519a5f75d3755b6c137a39c172694d30586afa7df2bb0463e5"}
Jul 10 02:08:32.283585 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:32.283505    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls\") pod \"dns-default-cdrpn\" (UID: \"2de5e788-9b05-474d-9225-752dc7d291a6\") " pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:08:32.283721 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:32.283624    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 02:08:32.283721 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:32.283682    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls podName:2de5e788-9b05-474d-9225-752dc7d291a6 nodeName:}" failed. No retries permitted until 2026-07-10 02:08:36.283666889 +0000 UTC m=+45.049579105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls") pod "dns-default-cdrpn" (UID: "2de5e788-9b05-474d-9225-752dc7d291a6") : secret "dns-default-metrics-tls" not found
Jul 10 02:08:32.826822 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:32.826782    2576 generic.go:356] "Generic (PLEG): container finished" podID="c2c011ac-1205-440e-a107-06bd0b702a48" containerID="e746b082858760109a2c9124d39f5cad0c9395a77fa7d919056228e1f2b2e4a3" exitCode=0
Jul 10 02:08:32.826822 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:32.826827    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wk2hr" event={"ID":"c2c011ac-1205-440e-a107-06bd0b702a48","Type":"ContainerDied","Data":"e746b082858760109a2c9124d39f5cad0c9395a77fa7d919056228e1f2b2e4a3"}
Jul 10 02:08:33.832985 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:33.832733    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wk2hr" event={"ID":"c2c011ac-1205-440e-a107-06bd0b702a48","Type":"ContainerStarted","Data":"ad3d107046e3b87b1c109edabad4db79a22ab9d76379a7172311e6061268bc68"}
Jul 10 02:08:33.855720 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:33.855674    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wk2hr" podStartSLOduration=7.440263226 podStartE2EDuration="40.855657589s" totalImagesPullingTime="33.415394363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:07:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:08:33.855564621 +0000 UTC m=+42.621476866" watchObservedRunningTime="2026-07-10 02:08:33.855657589 +0000 UTC m=+42.621569820"
Jul 10 02:08:34.836431 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:34.836372    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-84rg4" event={"ID":"669ccaa9-c014-4d81-95b5-ef08cb4a8cd1","Type":"ContainerStarted","Data":"c8a1bbea1ffb7058289cdb66a246bd6ff773b24761961b8b661bab736295bd75"}
Jul 10 02:08:34.856379 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:34.856326    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-84rg4" podStartSLOduration=3.358569046 podStartE2EDuration="6.856310322s" totalImagesPullingTime="3.497741276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:08:34.854745881 +0000 UTC m=+43.620658115" watchObservedRunningTime="2026-07-10 02:08:34.856310322 +0000 UTC m=+43.622222553"
Jul 10 02:08:36.308776 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:36.308746    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls\") pod \"dns-default-cdrpn\" (UID: \"2de5e788-9b05-474d-9225-752dc7d291a6\") " pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:08:36.309141 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:36.308864    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 02:08:36.309141 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:36.308913    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls podName:2de5e788-9b05-474d-9225-752dc7d291a6 nodeName:}" failed. No retries permitted until 2026-07-10 02:08:44.30889997 +0000 UTC m=+53.074812181 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls") pod "dns-default-cdrpn" (UID: "2de5e788-9b05-474d-9225-752dc7d291a6") : secret "dns-default-metrics-tls" not found
Jul 10 02:08:44.363565 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:44.363526    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls\") pod \"dns-default-cdrpn\" (UID: \"2de5e788-9b05-474d-9225-752dc7d291a6\") " pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:08:44.363962 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:44.363683    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 02:08:44.363962 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:44.363744    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls podName:2de5e788-9b05-474d-9225-752dc7d291a6 nodeName:}" failed. No retries permitted until 2026-07-10 02:09:00.36372846 +0000 UTC m=+69.129640672 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls") pod "dns-default-cdrpn" (UID: "2de5e788-9b05-474d-9225-752dc7d291a6") : secret "dns-default-metrics-tls" not found
Jul 10 02:08:52.798016 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:52.797988    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kt7wb"
Jul 10 02:08:58.253959 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:58.253922    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs\") pod \"network-metrics-daemon-gsnvh\" (UID: \"d04041a2-0cc9-4917-919a-a6a8e26cad05\") " pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:08:58.253959 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:58.253968    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/087c6267-c774-4dbc-ab49-e5bf96684f7c-original-pull-secret\") pod \"global-pull-secret-syncer-v2d92\" (UID: \"087c6267-c774-4dbc-ab49-e5bf96684f7c\") " pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:08:58.257313 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:58.257291    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 02:08:58.257368 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:58.257315    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 02:08:58.264889 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:58.264865    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 10 02:08:58.264944 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:08:58.264930    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs podName:d04041a2-0cc9-4917-919a-a6a8e26cad05 nodeName:}" failed. No retries permitted until 2026-07-10 02:10:02.264912818 +0000 UTC m=+131.030825029 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs") pod "network-metrics-daemon-gsnvh" (UID: "d04041a2-0cc9-4917-919a-a6a8e26cad05") : secret "metrics-daemon-secret" not found
Jul 10 02:08:58.268518 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:58.268500    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/087c6267-c774-4dbc-ab49-e5bf96684f7c-original-pull-secret\") pod \"global-pull-secret-syncer-v2d92\" (UID: \"087c6267-c774-4dbc-ab49-e5bf96684f7c\") " pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:08:58.355139 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:58.355098    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qz58\" (UniqueName: \"kubernetes.io/projected/694129e7-b596-48fc-80f6-af7f756f1e90-kube-api-access-5qz58\") pod \"network-check-target-9kgfv\" (UID: \"694129e7-b596-48fc-80f6-af7f756f1e90\") " pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:08:58.358515 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:58.358493    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 02:08:58.369119 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:58.369094    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 02:08:58.378857 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:58.378831    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qz58\" (UniqueName: \"kubernetes.io/projected/694129e7-b596-48fc-80f6-af7f756f1e90-kube-api-access-5qz58\") pod \"network-check-target-9kgfv\" (UID: \"694129e7-b596-48fc-80f6-af7f756f1e90\") " pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:08:58.550917 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:58.550839    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2d92"
Jul 10 02:08:58.560871 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:58.560830    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-chbtx\""
Jul 10 02:08:58.568525 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:58.568501    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:08:58.682266 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:08:58.682213    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod087c6267_c774_4dbc_ab49_e5bf96684f7c.slice/crio-7fdbbcd45c61f6eafffaea364077933f3e986afb1b84ee5578f44b3528d5f7cd WatchSource:0}: Error finding container 7fdbbcd45c61f6eafffaea364077933f3e986afb1b84ee5578f44b3528d5f7cd: Status 404 returned error can't find the container with id 7fdbbcd45c61f6eafffaea364077933f3e986afb1b84ee5578f44b3528d5f7cd
Jul 10 02:08:58.683444 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:58.683419    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v2d92"]
Jul 10 02:08:58.696955 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:58.696930    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9kgfv"]
Jul 10 02:08:58.699997 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:08:58.699971    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod694129e7_b596_48fc_80f6_af7f756f1e90.slice/crio-b834c7cdc94e48501692201e009490c7d4c0cec2346840689f12a6cbc0e6aee8 WatchSource:0}: Error finding container b834c7cdc94e48501692201e009490c7d4c0cec2346840689f12a6cbc0e6aee8: Status 404 returned error can't find the container with id b834c7cdc94e48501692201e009490c7d4c0cec2346840689f12a6cbc0e6aee8
Jul 10 02:08:58.891343 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:58.891307    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9kgfv" event={"ID":"694129e7-b596-48fc-80f6-af7f756f1e90","Type":"ContainerStarted","Data":"b834c7cdc94e48501692201e009490c7d4c0cec2346840689f12a6cbc0e6aee8"}
Jul 10 02:08:58.892436 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:08:58.892411    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v2d92" event={"ID":"087c6267-c774-4dbc-ab49-e5bf96684f7c","Type":"ContainerStarted","Data":"7fdbbcd45c61f6eafffaea364077933f3e986afb1b84ee5578f44b3528d5f7cd"}
Jul 10 02:09:00.370180 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:09:00.370061    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls\") pod \"dns-default-cdrpn\" (UID: \"2de5e788-9b05-474d-9225-752dc7d291a6\") " pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:09:00.370659 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:09:00.370221    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 02:09:00.370659 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:09:00.370304    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls podName:2de5e788-9b05-474d-9225-752dc7d291a6 nodeName:}" failed. No retries permitted until 2026-07-10 02:09:32.370282231 +0000 UTC m=+101.136194453 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls") pod "dns-default-cdrpn" (UID: "2de5e788-9b05-474d-9225-752dc7d291a6") : secret "dns-default-metrics-tls" not found
Jul 10 02:09:03.907807 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:09:03.907764    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9kgfv" event={"ID":"694129e7-b596-48fc-80f6-af7f756f1e90","Type":"ContainerStarted","Data":"189b49a2f724294c362dba5d2dbf71f6467539109eb89ea3ed92343c3afd5f7d"}
Jul 10 02:09:03.908265 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:09:03.908165    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:09:03.909569 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:09:03.909542    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v2d92" event={"ID":"087c6267-c774-4dbc-ab49-e5bf96684f7c","Type":"ContainerStarted","Data":"03ed10f3b992964422670b4a365f5c2fcb750324ce41169af85337763effc21c"}
Jul 10 02:09:03.926007 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:09:03.925958    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9kgfv" podStartSLOduration=66.514093362 podStartE2EDuration="1m10.925946588s" totalImagesPullingTime="4.411853226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:09:03.925223362 +0000 UTC m=+72.691135594" watchObservedRunningTime="2026-07-10 02:09:03.925946588 +0000 UTC m=+72.691858820"
Jul 10 02:09:03.941017 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:09:03.940974    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-v2d92" podStartSLOduration=66.507622038 podStartE2EDuration="1m10.940961739s" totalImagesPullingTime="4.433339701s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:09:03.94078134 +0000 UTC m=+72.706693575" watchObservedRunningTime="2026-07-10 02:09:03.940961739 +0000 UTC m=+72.706873972"
Jul 10 02:09:32.387414 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:09:32.387380    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls\") pod \"dns-default-cdrpn\" (UID: \"2de5e788-9b05-474d-9225-752dc7d291a6\") " pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:09:32.387753 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:09:32.387499    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 02:09:32.387753 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:09:32.387554    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls podName:2de5e788-9b05-474d-9225-752dc7d291a6 nodeName:}" failed. No retries permitted until 2026-07-10 02:10:36.387537117 +0000 UTC m=+165.153449343 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls") pod "dns-default-cdrpn" (UID: "2de5e788-9b05-474d-9225-752dc7d291a6") : secret "dns-default-metrics-tls" not found
Jul 10 02:09:34.914828 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:09:34.914799    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9kgfv"
Jul 10 02:10:02.282964 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:10:02.282914    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs\") pod \"network-metrics-daemon-gsnvh\" (UID: \"d04041a2-0cc9-4917-919a-a6a8e26cad05\") " pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:10:02.283436 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:10:02.283081    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 10 02:10:02.283436 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:10:02.283152    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs podName:d04041a2-0cc9-4917-919a-a6a8e26cad05 nodeName:}" failed. No retries permitted until 2026-07-10 02:12:04.283137189 +0000 UTC m=+253.049049400 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs") pod "network-metrics-daemon-gsnvh" (UID: "d04041a2-0cc9-4917-919a-a6a8e26cad05") : secret "metrics-daemon-secret" not found
Jul 10 02:10:31.491376 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:10:31.491333    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cdrpn" podUID="2de5e788-9b05-474d-9225-752dc7d291a6"
Jul 10 02:10:31.563241 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:10:31.563191    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gsnvh" podUID="d04041a2-0cc9-4917-919a-a6a8e26cad05"
Jul 10 02:10:32.122210 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:10:32.122175    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:10:36.417328 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:10:36.417273    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls\") pod \"dns-default-cdrpn\" (UID: \"2de5e788-9b05-474d-9225-752dc7d291a6\") " pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:10:36.417719 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:10:36.417437    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 02:10:36.417719 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:10:36.417503    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls podName:2de5e788-9b05-474d-9225-752dc7d291a6 nodeName:}" failed. No retries permitted until 2026-07-10 02:12:38.417485452 +0000 UTC m=+287.183397662 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls") pod "dns-default-cdrpn" (UID: "2de5e788-9b05-474d-9225-752dc7d291a6") : secret "dns-default-metrics-tls" not found
Jul 10 02:10:45.538138 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:10:45.538055    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:11:45.112297 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.112256    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-wlk8h"]
Jul 10 02:11:45.114145 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.114124    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-x76pk"]
Jul 10 02:11:45.114274 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.114257    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-wlk8h"
Jul 10 02:11:45.115811 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.115793    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-j6scc"]
Jul 10 02:11:45.115909 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.115897    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-x76pk"
Jul 10 02:11:45.117481 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.117467    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-j6scc"
Jul 10 02:11:45.117629 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.117614    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 10 02:11:45.117997 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.117982    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 10 02:11:45.118849 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.118837    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-v6rtz\""
Jul 10 02:11:45.119295 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.119279    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 10 02:11:45.119731 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.119716    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 10 02:11:45.121296 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.121275    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 10 02:11:45.121422 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.121319    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 10 02:11:45.121422 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.121408    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gtrw5\""
Jul 10 02:11:45.121874 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.121857    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 10 02:11:45.123484 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.123468    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-ztgzj\""
Jul 10 02:11:45.124008 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.123994    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 10 02:11:45.130204 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.130187    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 10 02:11:45.130318 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.130300    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-x76pk"]
Jul 10 02:11:45.132489 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.132469    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-j6scc"]
Jul 10 02:11:45.135962 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.135941    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-wlk8h"]
Jul 10 02:11:45.158495 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.158460    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzt77\" (UniqueName: \"kubernetes.io/projected/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-kube-api-access-kzt77\") pod \"cluster-monitoring-operator-5f7f494dd4-j6scc\" (UID: \"3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-j6scc"
Jul 10 02:11:45.158643 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.158527    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-j6scc\" (UID: \"3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-j6scc"
Jul 10 02:11:45.158643 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.158554    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2e5ea06-8452-4568-88b8-d907a1e2c864-config\") pod \"console-operator-7866497494-wlk8h\" (UID: \"b2e5ea06-8452-4568-88b8-d907a1e2c864\") " pod="openshift-console-operator/console-operator-7866497494-wlk8h"
Jul 10 02:11:45.158643 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.158574    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vrgd\" (UniqueName: \"kubernetes.io/projected/b2e5ea06-8452-4568-88b8-d907a1e2c864-kube-api-access-8vrgd\") pod \"console-operator-7866497494-wlk8h\" (UID: \"b2e5ea06-8452-4568-88b8-d907a1e2c864\") " pod="openshift-console-operator/console-operator-7866497494-wlk8h"
Jul 10 02:11:45.158643 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.158603    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2e5ea06-8452-4568-88b8-d907a1e2c864-serving-cert\") pod \"console-operator-7866497494-wlk8h\" (UID: \"b2e5ea06-8452-4568-88b8-d907a1e2c864\") " pod="openshift-console-operator/console-operator-7866497494-wlk8h"
Jul 10 02:11:45.158643 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.158622    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2e5ea06-8452-4568-88b8-d907a1e2c864-trusted-ca\") pod \"console-operator-7866497494-wlk8h\" (UID: \"b2e5ea06-8452-4568-88b8-d907a1e2c864\") " pod="openshift-console-operator/console-operator-7866497494-wlk8h"
Jul 10 02:11:45.158802 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.158682    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxbjt\" (UniqueName: \"kubernetes.io/projected/a4edd2c1-6c23-40bc-bf93-87a0fa42396a-kube-api-access-mxbjt\") pod \"network-check-source-869dcfcdcd-x76pk\" (UID: \"a4edd2c1-6c23-40bc-bf93-87a0fa42396a\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-x76pk"
Jul 10 02:11:45.158802 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.158729    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-j6scc\" (UID: \"3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-j6scc"
Jul 10 02:11:45.205211 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.205180    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-fsvq7"]
Jul 10 02:11:45.207084 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.207068    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7464fbc79c-59k4p"]
Jul 10 02:11:45.207197 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.207182    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-fsvq7"
Jul 10 02:11:45.208826 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.208809    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:45.210480 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.210464    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 10 02:11:45.210854 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.210833    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 10 02:11:45.210950 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.210839    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 10 02:11:45.210950 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.210930    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 10 02:11:45.211373 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.211344    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 10 02:11:45.211756 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.211669    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 10 02:11:45.212344 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.212326    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-sswxm\""
Jul 10 02:11:45.213358 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.213317    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g79n9\""
Jul 10 02:11:45.213997 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.213968    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 10 02:11:45.219965 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.219946    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 10 02:11:45.222757 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.222734    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-fsvq7"]
Jul 10 02:11:45.225577 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.225536    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7464fbc79c-59k4p"]
Jul 10 02:11:45.226306 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.226287    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 10 02:11:45.259500 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.259474    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzt77\" (UniqueName: \"kubernetes.io/projected/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-kube-api-access-kzt77\") pod \"cluster-monitoring-operator-5f7f494dd4-j6scc\" (UID: \"3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-j6scc"
Jul 10 02:11:45.259653 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.259506    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5f363ba9-996c-4350-8d76-4f039314fec2-trusted-ca\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:45.259653 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.259526    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5f363ba9-996c-4350-8d76-4f039314fec2-installation-pull-secrets\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:45.259653 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.259550    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-j6scc\" (UID: \"3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-j6scc"
Jul 10 02:11:45.259653 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.259575    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vrgd\" (UniqueName: \"kubernetes.io/projected/b2e5ea06-8452-4568-88b8-d907a1e2c864-kube-api-access-8vrgd\") pod \"console-operator-7866497494-wlk8h\" (UID: \"b2e5ea06-8452-4568-88b8-d907a1e2c864\") " pod="openshift-console-operator/console-operator-7866497494-wlk8h"
Jul 10 02:11:45.259653 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.259625    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d28e2125-12b1-44e4-be4e-92556f9092aa-tmp\") pod \"insights-operator-68d9dd94cf-fsvq7\" (UID: \"d28e2125-12b1-44e4-be4e-92556f9092aa\") " pod="openshift-insights/insights-operator-68d9dd94cf-fsvq7"
Jul 10 02:11:45.259835 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.259672    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxbjt\" (UniqueName: \"kubernetes.io/projected/a4edd2c1-6c23-40bc-bf93-87a0fa42396a-kube-api-access-mxbjt\") pod \"network-check-source-869dcfcdcd-x76pk\" (UID: \"a4edd2c1-6c23-40bc-bf93-87a0fa42396a\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-x76pk"
Jul 10 02:11:45.259835 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.259701    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d28e2125-12b1-44e4-be4e-92556f9092aa-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-fsvq7\" (UID: \"d28e2125-12b1-44e4-be4e-92556f9092aa\") " pod="openshift-insights/insights-operator-68d9dd94cf-fsvq7"
Jul 10 02:11:45.259835 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.259729    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2e5ea06-8452-4568-88b8-d907a1e2c864-trusted-ca\") pod \"console-operator-7866497494-wlk8h\" (UID: \"b2e5ea06-8452-4568-88b8-d907a1e2c864\") " pod="openshift-console-operator/console-operator-7866497494-wlk8h"
Jul 10 02:11:45.259835 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.259764    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5f363ba9-996c-4350-8d76-4f039314fec2-image-registry-private-configuration\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:45.259835 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.259785    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-j6scc\" (UID: \"3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-j6scc"
Jul 10 02:11:45.259835 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.259808    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5f363ba9-996c-4350-8d76-4f039314fec2-ca-trust-extracted\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:45.260200 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.259835    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-registry-tls\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:45.260200 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.259857    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d28e2125-12b1-44e4-be4e-92556f9092aa-snapshots\") pod \"insights-operator-68d9dd94cf-fsvq7\" (UID: \"d28e2125-12b1-44e4-be4e-92556f9092aa\") " pod="openshift-insights/insights-operator-68d9dd94cf-fsvq7"
Jul 10 02:11:45.260200 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.259884    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-bound-sa-token\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:45.260200 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.259916    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d28e2125-12b1-44e4-be4e-92556f9092aa-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-fsvq7\" (UID: \"d28e2125-12b1-44e4-be4e-92556f9092aa\") " pod="openshift-insights/insights-operator-68d9dd94cf-fsvq7"
Jul 10 02:11:45.260200 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:45.259947    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 02:11:45.260200 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.259960    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr78m\" (UniqueName: \"kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-kube-api-access-lr78m\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:45.260200 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.259999    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2e5ea06-8452-4568-88b8-d907a1e2c864-config\") pod \"console-operator-7866497494-wlk8h\" (UID: \"b2e5ea06-8452-4568-88b8-d907a1e2c864\") " pod="openshift-console-operator/console-operator-7866497494-wlk8h"
Jul 10 02:11:45.260200 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:45.260018    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-cluster-monitoring-operator-tls podName:3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd nodeName:}" failed. No retries permitted until 2026-07-10 02:11:45.759996812 +0000 UTC m=+234.525909038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-j6scc" (UID: "3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd") : secret "cluster-monitoring-operator-tls" not found
Jul 10 02:11:45.260200 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.260071    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9r4f\" (UniqueName: \"kubernetes.io/projected/d28e2125-12b1-44e4-be4e-92556f9092aa-kube-api-access-g9r4f\") pod \"insights-operator-68d9dd94cf-fsvq7\" (UID: \"d28e2125-12b1-44e4-be4e-92556f9092aa\") " pod="openshift-insights/insights-operator-68d9dd94cf-fsvq7"
Jul 10 02:11:45.260200 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.260108    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2e5ea06-8452-4568-88b8-d907a1e2c864-serving-cert\") pod \"console-operator-7866497494-wlk8h\" (UID: \"b2e5ea06-8452-4568-88b8-d907a1e2c864\") " pod="openshift-console-operator/console-operator-7866497494-wlk8h"
Jul 10 02:11:45.260200 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.260138    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5f363ba9-996c-4350-8d76-4f039314fec2-registry-certificates\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:45.260594 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.260282    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d28e2125-12b1-44e4-be4e-92556f9092aa-serving-cert\") pod \"insights-operator-68d9dd94cf-fsvq7\" (UID: \"d28e2125-12b1-44e4-be4e-92556f9092aa\") " pod="openshift-insights/insights-operator-68d9dd94cf-fsvq7"
Jul 10 02:11:45.260594 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.260407    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-j6scc\" (UID: \"3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-j6scc"
Jul 10 02:11:45.260594 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.260547    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2e5ea06-8452-4568-88b8-d907a1e2c864-config\") pod \"console-operator-7866497494-wlk8h\" (UID: \"b2e5ea06-8452-4568-88b8-d907a1e2c864\") " pod="openshift-console-operator/console-operator-7866497494-wlk8h"
Jul 10 02:11:45.260727 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.260706    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2e5ea06-8452-4568-88b8-d907a1e2c864-trusted-ca\") pod \"console-operator-7866497494-wlk8h\" (UID: \"b2e5ea06-8452-4568-88b8-d907a1e2c864\") " pod="openshift-console-operator/console-operator-7866497494-wlk8h"
Jul 10 02:11:45.262512 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.262490    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2e5ea06-8452-4568-88b8-d907a1e2c864-serving-cert\") pod \"console-operator-7866497494-wlk8h\" (UID: \"b2e5ea06-8452-4568-88b8-d907a1e2c864\") " pod="openshift-console-operator/console-operator-7866497494-wlk8h"
Jul 10 02:11:45.273591 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.273561    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxbjt\" (UniqueName: \"kubernetes.io/projected/a4edd2c1-6c23-40bc-bf93-87a0fa42396a-kube-api-access-mxbjt\") pod \"network-check-source-869dcfcdcd-x76pk\" (UID: \"a4edd2c1-6c23-40bc-bf93-87a0fa42396a\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-x76pk"
Jul 10 02:11:45.273698 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.273635    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vrgd\" (UniqueName: \"kubernetes.io/projected/b2e5ea06-8452-4568-88b8-d907a1e2c864-kube-api-access-8vrgd\") pod \"console-operator-7866497494-wlk8h\" (UID: \"b2e5ea06-8452-4568-88b8-d907a1e2c864\") " pod="openshift-console-operator/console-operator-7866497494-wlk8h"
Jul 10 02:11:45.274561 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.274541    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzt77\" (UniqueName: \"kubernetes.io/projected/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-kube-api-access-kzt77\") pod \"cluster-monitoring-operator-5f7f494dd4-j6scc\" (UID: \"3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-j6scc"
Jul 10 02:11:45.361122 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.361084    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d28e2125-12b1-44e4-be4e-92556f9092aa-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-fsvq7\" (UID: \"d28e2125-12b1-44e4-be4e-92556f9092aa\") " pod="openshift-insights/insights-operator-68d9dd94cf-fsvq7"
Jul 10 02:11:45.361122 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.361127    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr78m\" (UniqueName: \"kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-kube-api-access-lr78m\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:45.361398 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.361146    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9r4f\" (UniqueName: \"kubernetes.io/projected/d28e2125-12b1-44e4-be4e-92556f9092aa-kube-api-access-g9r4f\") pod \"insights-operator-68d9dd94cf-fsvq7\" (UID: \"d28e2125-12b1-44e4-be4e-92556f9092aa\") " pod="openshift-insights/insights-operator-68d9dd94cf-fsvq7"
Jul 10 02:11:45.361398 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.361200    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5f363ba9-996c-4350-8d76-4f039314fec2-registry-certificates\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:45.361398 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.361238    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d28e2125-12b1-44e4-be4e-92556f9092aa-serving-cert\") pod \"insights-operator-68d9dd94cf-fsvq7\" (UID: \"d28e2125-12b1-44e4-be4e-92556f9092aa\") " pod="openshift-insights/insights-operator-68d9dd94cf-fsvq7"
Jul 10 02:11:45.361398 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.361269    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5f363ba9-996c-4350-8d76-4f039314fec2-trusted-ca\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:45.361398 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.361283    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5f363ba9-996c-4350-8d76-4f039314fec2-installation-pull-secrets\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:45.361398 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.361304    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d28e2125-12b1-44e4-be4e-92556f9092aa-tmp\") pod \"insights-operator-68d9dd94cf-fsvq7\" (UID: \"d28e2125-12b1-44e4-be4e-92556f9092aa\") " pod="openshift-insights/insights-operator-68d9dd94cf-fsvq7"
Jul 10 02:11:45.361398 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.361321    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d28e2125-12b1-44e4-be4e-92556f9092aa-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-fsvq7\" (UID: \"d28e2125-12b1-44e4-be4e-92556f9092aa\") " pod="openshift-insights/insights-operator-68d9dd94cf-fsvq7"
Jul 10 02:11:45.361398 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.361363    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5f363ba9-996c-4350-8d76-4f039314fec2-image-registry-private-configuration\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:45.361790 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.361695    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d28e2125-12b1-44e4-be4e-92556f9092aa-tmp\") pod \"insights-operator-68d9dd94cf-fsvq7\" (UID: \"d28e2125-12b1-44e4-be4e-92556f9092aa\") " pod="openshift-insights/insights-operator-68d9dd94cf-fsvq7"
Jul 10 02:11:45.361790 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.361754    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5f363ba9-996c-4350-8d76-4f039314fec2-ca-trust-extracted\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:45.361887 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.361790    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-registry-tls\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:45.361887 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.361813    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d28e2125-12b1-44e4-be4e-92556f9092aa-snapshots\") pod \"insights-operator-68d9dd94cf-fsvq7\" (UID: \"d28e2125-12b1-44e4-be4e-92556f9092aa\") " pod="openshift-insights/insights-operator-68d9dd94cf-fsvq7"
Jul 10 02:11:45.361887 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.361838    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-bound-sa-token\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:45.362070 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.361883    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5f363ba9-996c-4350-8d76-4f039314fec2-registry-certificates\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:45.362070 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.361935    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d28e2125-12b1-44e4-be4e-92556f9092aa-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-fsvq7\" (UID: \"d28e2125-12b1-44e4-be4e-92556f9092aa\") " pod="openshift-insights/insights-operator-68d9dd94cf-fsvq7"
Jul 10 02:11:45.362070 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:45.361979    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 02:11:45.362070 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:45.361994    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7464fbc79c-59k4p: secret "image-registry-tls" not found
Jul 10 02:11:45.362252 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:45.362090    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-registry-tls podName:5f363ba9-996c-4350-8d76-4f039314fec2 nodeName:}" failed. No retries permitted until 2026-07-10 02:11:45.862069399 +0000 UTC m=+234.627981613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-registry-tls") pod "image-registry-7464fbc79c-59k4p" (UID: "5f363ba9-996c-4350-8d76-4f039314fec2") : secret "image-registry-tls" not found
Jul 10 02:11:45.362252 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.362177    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d28e2125-12b1-44e4-be4e-92556f9092aa-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-fsvq7\" (UID: \"d28e2125-12b1-44e4-be4e-92556f9092aa\") " pod="openshift-insights/insights-operator-68d9dd94cf-fsvq7"
Jul 10 02:11:45.362252 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.362242    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5f363ba9-996c-4350-8d76-4f039314fec2-trusted-ca\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:45.362518 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.362467    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5f363ba9-996c-4350-8d76-4f039314fec2-ca-trust-extracted\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:45.362575 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.362521    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d28e2125-12b1-44e4-be4e-92556f9092aa-snapshots\") pod \"insights-operator-68d9dd94cf-fsvq7\" (UID: \"d28e2125-12b1-44e4-be4e-92556f9092aa\") " pod="openshift-insights/insights-operator-68d9dd94cf-fsvq7"
Jul 10 02:11:45.363863 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.363841    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5f363ba9-996c-4350-8d76-4f039314fec2-image-registry-private-configuration\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:45.363976 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.363960    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d28e2125-12b1-44e4-be4e-92556f9092aa-serving-cert\") pod \"insights-operator-68d9dd94cf-fsvq7\" (UID: \"d28e2125-12b1-44e4-be4e-92556f9092aa\") " pod="openshift-insights/insights-operator-68d9dd94cf-fsvq7"
Jul 10 02:11:45.364274 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.364257    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5f363ba9-996c-4350-8d76-4f039314fec2-installation-pull-secrets\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:45.373492 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.373470    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9r4f\" (UniqueName: \"kubernetes.io/projected/d28e2125-12b1-44e4-be4e-92556f9092aa-kube-api-access-g9r4f\") pod \"insights-operator-68d9dd94cf-fsvq7\" (UID: \"d28e2125-12b1-44e4-be4e-92556f9092aa\") " pod="openshift-insights/insights-operator-68d9dd94cf-fsvq7"
Jul 10 02:11:45.373834 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.373811    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-bound-sa-token\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:45.374153 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.374139    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr78m\" (UniqueName: \"kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-kube-api-access-lr78m\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:45.425051 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.425011    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-wlk8h"
Jul 10 02:11:45.436936 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.436913    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-x76pk"
Jul 10 02:11:45.519533 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.519499    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-fsvq7"
Jul 10 02:11:45.555174 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.555140    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-wlk8h"]
Jul 10 02:11:45.558374 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:11:45.558349    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e5ea06_8452_4568_88b8_d907a1e2c864.slice/crio-d1d01562735d05ab94905d50f3402b36fbcc6af59b2cf5641be3fe8543337c3b WatchSource:0}: Error finding container d1d01562735d05ab94905d50f3402b36fbcc6af59b2cf5641be3fe8543337c3b: Status 404 returned error can't find the container with id d1d01562735d05ab94905d50f3402b36fbcc6af59b2cf5641be3fe8543337c3b
Jul 10 02:11:45.572294 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.572268    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-x76pk"]
Jul 10 02:11:45.574886 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:11:45.574844    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4edd2c1_6c23_40bc_bf93_87a0fa42396a.slice/crio-07e5500eccb8bd81d8e96477e1dfc0a97cf22a4cdfe0a8cf5b1e7cde39069716 WatchSource:0}: Error finding container 07e5500eccb8bd81d8e96477e1dfc0a97cf22a4cdfe0a8cf5b1e7cde39069716: Status 404 returned error can't find the container with id 07e5500eccb8bd81d8e96477e1dfc0a97cf22a4cdfe0a8cf5b1e7cde39069716
Jul 10 02:11:45.651334 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.651173    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-fsvq7"]
Jul 10 02:11:45.654184 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:11:45.654158    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd28e2125_12b1_44e4_be4e_92556f9092aa.slice/crio-434729325d1133199c69514e0a053a2297270a553bcf661f6be0679d09a31c0a WatchSource:0}: Error finding container 434729325d1133199c69514e0a053a2297270a553bcf661f6be0679d09a31c0a: Status 404 returned error can't find the container with id 434729325d1133199c69514e0a053a2297270a553bcf661f6be0679d09a31c0a
Jul 10 02:11:45.766781 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.766747    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-j6scc\" (UID: \"3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-j6scc"
Jul 10 02:11:45.767010 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:45.766909    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 02:11:45.767010 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:45.766973    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-cluster-monitoring-operator-tls podName:3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd nodeName:}" failed. No retries permitted until 2026-07-10 02:11:46.76695771 +0000 UTC m=+235.532869921 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-j6scc" (UID: "3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd") : secret "cluster-monitoring-operator-tls" not found
Jul 10 02:11:45.867263 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:45.867234    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-registry-tls\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:45.867414 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:45.867375    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 02:11:45.867414 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:45.867389    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7464fbc79c-59k4p: secret "image-registry-tls" not found
Jul 10 02:11:45.867542 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:45.867440    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-registry-tls podName:5f363ba9-996c-4350-8d76-4f039314fec2 nodeName:}" failed. No retries permitted until 2026-07-10 02:11:46.867424544 +0000 UTC m=+235.633336773 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-registry-tls") pod "image-registry-7464fbc79c-59k4p" (UID: "5f363ba9-996c-4350-8d76-4f039314fec2") : secret "image-registry-tls" not found
Jul 10 02:11:46.293984 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:46.293899    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-fsvq7" event={"ID":"d28e2125-12b1-44e4-be4e-92556f9092aa","Type":"ContainerStarted","Data":"434729325d1133199c69514e0a053a2297270a553bcf661f6be0679d09a31c0a"}
Jul 10 02:11:46.295556 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:46.295531    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-x76pk" event={"ID":"a4edd2c1-6c23-40bc-bf93-87a0fa42396a","Type":"ContainerStarted","Data":"7d90c4c0db859c45f257546074de3bcedd7061f79f94d5c289011197144b2987"}
Jul 10 02:11:46.295687 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:46.295577    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-x76pk" event={"ID":"a4edd2c1-6c23-40bc-bf93-87a0fa42396a","Type":"ContainerStarted","Data":"07e5500eccb8bd81d8e96477e1dfc0a97cf22a4cdfe0a8cf5b1e7cde39069716"}
Jul 10 02:11:46.296883 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:46.296849    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-wlk8h" event={"ID":"b2e5ea06-8452-4568-88b8-d907a1e2c864","Type":"ContainerStarted","Data":"d1d01562735d05ab94905d50f3402b36fbcc6af59b2cf5641be3fe8543337c3b"}
Jul 10 02:11:46.773698 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:46.773596    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-j6scc\" (UID: \"3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-j6scc"
Jul 10 02:11:46.773867 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:46.773763    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 02:11:46.773867 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:46.773841    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-cluster-monitoring-operator-tls podName:3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd nodeName:}" failed. No retries permitted until 2026-07-10 02:11:48.773821261 +0000 UTC m=+237.539733474 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-j6scc" (UID: "3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd") : secret "cluster-monitoring-operator-tls" not found
Jul 10 02:11:46.874721 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:46.874681    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-registry-tls\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:46.874909 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:46.874848    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 02:11:46.874909 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:46.874870    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7464fbc79c-59k4p: secret "image-registry-tls" not found
Jul 10 02:11:46.875019 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:46.874933    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-registry-tls podName:5f363ba9-996c-4350-8d76-4f039314fec2 nodeName:}" failed. No retries permitted until 2026-07-10 02:11:48.874913562 +0000 UTC m=+237.640825792 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-registry-tls") pod "image-registry-7464fbc79c-59k4p" (UID: "5f363ba9-996c-4350-8d76-4f039314fec2") : secret "image-registry-tls" not found
Jul 10 02:11:48.304313 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:48.304289    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/0.log"
Jul 10 02:11:48.304708 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:48.304329    2576 generic.go:356] "Generic (PLEG): container finished" podID="b2e5ea06-8452-4568-88b8-d907a1e2c864" containerID="1dc26133193322e71fd9854ae4ba712f472f360e8965e1846c2ce02cfb520804" exitCode=255
Jul 10 02:11:48.304708 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:48.304360    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-wlk8h" event={"ID":"b2e5ea06-8452-4568-88b8-d907a1e2c864","Type":"ContainerDied","Data":"1dc26133193322e71fd9854ae4ba712f472f360e8965e1846c2ce02cfb520804"}
Jul 10 02:11:48.304708 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:48.304663    2576 scope.go:117] "RemoveContainer" containerID="1dc26133193322e71fd9854ae4ba712f472f360e8965e1846c2ce02cfb520804"
Jul 10 02:11:48.306006 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:48.305983    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-fsvq7" event={"ID":"d28e2125-12b1-44e4-be4e-92556f9092aa","Type":"ContainerStarted","Data":"30c3dfdd478fed047bd5d7eb7cdada70b6d45572e47f73bb9885c2b07a73b5fc"}
Jul 10 02:11:48.322936 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:48.322895    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-x76pk" podStartSLOduration=3.322877616 podStartE2EDuration="3.322877616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:11:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:11:46.313735339 +0000 UTC m=+235.079647571" watchObservedRunningTime="2026-07-10 02:11:48.322877616 +0000 UTC m=+237.088789849"
Jul 10 02:11:48.340838 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:48.340789    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-fsvq7" podStartSLOduration=0.844472791 podStartE2EDuration="3.340770708s" totalImagesPullingTime="2.496297917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:11:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:11:48.339833153 +0000 UTC m=+237.105745390" watchObservedRunningTime="2026-07-10 02:11:48.340770708 +0000 UTC m=+237.106682942"
Jul 10 02:11:48.790906 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:48.790821    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-j6scc\" (UID: \"3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-j6scc"
Jul 10 02:11:48.791066 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:48.790946    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 02:11:48.791066 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:48.790995    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-cluster-monitoring-operator-tls podName:3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd nodeName:}" failed. No retries permitted until 2026-07-10 02:11:52.790982939 +0000 UTC m=+241.556895149 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-j6scc" (UID: "3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd") : secret "cluster-monitoring-operator-tls" not found
Jul 10 02:11:48.891440 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:48.891411    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-registry-tls\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:48.891597 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:48.891574    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 02:11:48.891632 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:48.891599    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7464fbc79c-59k4p: secret "image-registry-tls" not found
Jul 10 02:11:48.891680 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:48.891671    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-registry-tls podName:5f363ba9-996c-4350-8d76-4f039314fec2 nodeName:}" failed. No retries permitted until 2026-07-10 02:11:52.891655516 +0000 UTC m=+241.657567728 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-registry-tls") pod "image-registry-7464fbc79c-59k4p" (UID: "5f363ba9-996c-4350-8d76-4f039314fec2") : secret "image-registry-tls" not found
Jul 10 02:11:49.312759 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:49.312727    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/1.log"
Jul 10 02:11:49.313415 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:49.313391    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/0.log"
Jul 10 02:11:49.313504 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:49.313433    2576 generic.go:356] "Generic (PLEG): container finished" podID="b2e5ea06-8452-4568-88b8-d907a1e2c864" containerID="111c6daa79a4ef3e69d6b05f448ab652a5bced1fccef3cec54e5a615b1ee185b" exitCode=255
Jul 10 02:11:49.313733 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:49.313708    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-wlk8h" event={"ID":"b2e5ea06-8452-4568-88b8-d907a1e2c864","Type":"ContainerDied","Data":"111c6daa79a4ef3e69d6b05f448ab652a5bced1fccef3cec54e5a615b1ee185b"}
Jul 10 02:11:49.313903 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:49.313889    2576 scope.go:117] "RemoveContainer" containerID="1dc26133193322e71fd9854ae4ba712f472f360e8965e1846c2ce02cfb520804"
Jul 10 02:11:49.314447 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:49.314429    2576 scope.go:117] "RemoveContainer" containerID="111c6daa79a4ef3e69d6b05f448ab652a5bced1fccef3cec54e5a615b1ee185b"
Jul 10 02:11:49.314703 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:49.314669    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-wlk8h_openshift-console-operator(b2e5ea06-8452-4568-88b8-d907a1e2c864)\"" pod="openshift-console-operator/console-operator-7866497494-wlk8h" podUID="b2e5ea06-8452-4568-88b8-d907a1e2c864"
Jul 10 02:11:49.341739 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:49.341711    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xxng6"]
Jul 10 02:11:49.346650 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:49.346629    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:11:49.350849 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:49.350826    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 10 02:11:49.350975 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:49.350833    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 10 02:11:49.350975 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:49.350932    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pk9p4\""
Jul 10 02:11:49.360552 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:49.360530    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xxng6"]
Jul 10 02:11:49.396946 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:49.396905    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bc0704bf-e998-412b-94ee-8ab671baade7-crio-socket\") pod \"insights-runtime-extractor-xxng6\" (UID: \"bc0704bf-e998-412b-94ee-8ab671baade7\") " pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:11:49.396946 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:49.396948    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc0704bf-e998-412b-94ee-8ab671baade7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxng6\" (UID: \"bc0704bf-e998-412b-94ee-8ab671baade7\") " pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:11:49.397244 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:49.397147    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc0704bf-e998-412b-94ee-8ab671baade7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxng6\" (UID: \"bc0704bf-e998-412b-94ee-8ab671baade7\") " pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:11:49.397244 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:49.397229    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc0704bf-e998-412b-94ee-8ab671baade7-data-volume\") pod \"insights-runtime-extractor-xxng6\" (UID: \"bc0704bf-e998-412b-94ee-8ab671baade7\") " pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:11:49.397351 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:49.397340    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkblw\" (UniqueName: \"kubernetes.io/projected/bc0704bf-e998-412b-94ee-8ab671baade7-kube-api-access-fkblw\") pod \"insights-runtime-extractor-xxng6\" (UID: \"bc0704bf-e998-412b-94ee-8ab671baade7\") " pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:11:49.498525 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:49.498486    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc0704bf-e998-412b-94ee-8ab671baade7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxng6\" (UID: \"bc0704bf-e998-412b-94ee-8ab671baade7\") " pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:11:49.498525 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:49.498532    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc0704bf-e998-412b-94ee-8ab671baade7-data-volume\") pod \"insights-runtime-extractor-xxng6\" (UID: \"bc0704bf-e998-412b-94ee-8ab671baade7\") " pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:11:49.498732 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:49.498588    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkblw\" (UniqueName: \"kubernetes.io/projected/bc0704bf-e998-412b-94ee-8ab671baade7-kube-api-access-fkblw\") pod \"insights-runtime-extractor-xxng6\" (UID: \"bc0704bf-e998-412b-94ee-8ab671baade7\") " pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:11:49.498732 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:49.498610    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bc0704bf-e998-412b-94ee-8ab671baade7-crio-socket\") pod \"insights-runtime-extractor-xxng6\" (UID: \"bc0704bf-e998-412b-94ee-8ab671baade7\") " pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:11:49.498732 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:49.498612    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 02:11:49.498732 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:49.498632    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc0704bf-e998-412b-94ee-8ab671baade7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxng6\" (UID: \"bc0704bf-e998-412b-94ee-8ab671baade7\") " pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:11:49.498732 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:49.498690    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bc0704bf-e998-412b-94ee-8ab671baade7-kube-rbac-proxy-cm podName:bc0704bf-e998-412b-94ee-8ab671baade7 nodeName:}" failed. No retries permitted until 2026-07-10 02:11:49.998669898 +0000 UTC m=+238.764582127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bc0704bf-e998-412b-94ee-8ab671baade7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xxng6" (UID: "bc0704bf-e998-412b-94ee-8ab671baade7") : configmap "kube-rbac-proxy" not found
Jul 10 02:11:49.498732 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:49.498714    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bc0704bf-e998-412b-94ee-8ab671baade7-crio-socket\") pod \"insights-runtime-extractor-xxng6\" (UID: \"bc0704bf-e998-412b-94ee-8ab671baade7\") " pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:11:49.498732 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:49.498732    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 02:11:49.498971 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:49.498782    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc0704bf-e998-412b-94ee-8ab671baade7-insights-runtime-extractor-tls podName:bc0704bf-e998-412b-94ee-8ab671baade7 nodeName:}" failed. No retries permitted until 2026-07-10 02:11:49.998771766 +0000 UTC m=+238.764683978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bc0704bf-e998-412b-94ee-8ab671baade7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xxng6" (UID: "bc0704bf-e998-412b-94ee-8ab671baade7") : secret "insights-runtime-extractor-tls" not found
Jul 10 02:11:49.498971 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:49.498959    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc0704bf-e998-412b-94ee-8ab671baade7-data-volume\") pod \"insights-runtime-extractor-xxng6\" (UID: \"bc0704bf-e998-412b-94ee-8ab671baade7\") " pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:11:49.508410 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:49.508379    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkblw\" (UniqueName: \"kubernetes.io/projected/bc0704bf-e998-412b-94ee-8ab671baade7-kube-api-access-fkblw\") pod \"insights-runtime-extractor-xxng6\" (UID: \"bc0704bf-e998-412b-94ee-8ab671baade7\") " pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:11:50.002640 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:50.002604    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc0704bf-e998-412b-94ee-8ab671baade7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxng6\" (UID: \"bc0704bf-e998-412b-94ee-8ab671baade7\") " pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:11:50.002820 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:50.002711    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc0704bf-e998-412b-94ee-8ab671baade7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxng6\" (UID: \"bc0704bf-e998-412b-94ee-8ab671baade7\") " pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:11:50.002820 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:50.002736    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 02:11:50.002820 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:50.002808    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bc0704bf-e998-412b-94ee-8ab671baade7-kube-rbac-proxy-cm podName:bc0704bf-e998-412b-94ee-8ab671baade7 nodeName:}" failed. No retries permitted until 2026-07-10 02:11:51.002790172 +0000 UTC m=+239.768702388 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bc0704bf-e998-412b-94ee-8ab671baade7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xxng6" (UID: "bc0704bf-e998-412b-94ee-8ab671baade7") : configmap "kube-rbac-proxy" not found
Jul 10 02:11:50.002928 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:50.002830    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 02:11:50.002928 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:50.002862    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc0704bf-e998-412b-94ee-8ab671baade7-insights-runtime-extractor-tls podName:bc0704bf-e998-412b-94ee-8ab671baade7 nodeName:}" failed. No retries permitted until 2026-07-10 02:11:51.002852021 +0000 UTC m=+239.768764231 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bc0704bf-e998-412b-94ee-8ab671baade7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xxng6" (UID: "bc0704bf-e998-412b-94ee-8ab671baade7") : secret "insights-runtime-extractor-tls" not found
Jul 10 02:11:50.317972 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:50.317897    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/1.log"
Jul 10 02:11:50.318346 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:50.318243    2576 scope.go:117] "RemoveContainer" containerID="111c6daa79a4ef3e69d6b05f448ab652a5bced1fccef3cec54e5a615b1ee185b"
Jul 10 02:11:50.318411 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:50.318393    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-wlk8h_openshift-console-operator(b2e5ea06-8452-4568-88b8-d907a1e2c864)\"" pod="openshift-console-operator/console-operator-7866497494-wlk8h" podUID="b2e5ea06-8452-4568-88b8-d907a1e2c864"
Jul 10 02:11:51.011823 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:51.011785    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc0704bf-e998-412b-94ee-8ab671baade7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxng6\" (UID: \"bc0704bf-e998-412b-94ee-8ab671baade7\") " pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:11:51.012091 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:51.011924    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 02:11:51.012091 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:51.011940    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc0704bf-e998-412b-94ee-8ab671baade7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxng6\" (UID: \"bc0704bf-e998-412b-94ee-8ab671baade7\") " pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:11:51.012091 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:51.011991    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bc0704bf-e998-412b-94ee-8ab671baade7-kube-rbac-proxy-cm podName:bc0704bf-e998-412b-94ee-8ab671baade7 nodeName:}" failed. No retries permitted until 2026-07-10 02:11:53.011974313 +0000 UTC m=+241.777886526 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bc0704bf-e998-412b-94ee-8ab671baade7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xxng6" (UID: "bc0704bf-e998-412b-94ee-8ab671baade7") : configmap "kube-rbac-proxy" not found
Jul 10 02:11:51.012091 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:51.012086    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 02:11:51.012228 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:51.012137    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc0704bf-e998-412b-94ee-8ab671baade7-insights-runtime-extractor-tls podName:bc0704bf-e998-412b-94ee-8ab671baade7 nodeName:}" failed. No retries permitted until 2026-07-10 02:11:53.012122078 +0000 UTC m=+241.778034290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bc0704bf-e998-412b-94ee-8ab671baade7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xxng6" (UID: "bc0704bf-e998-412b-94ee-8ab671baade7") : secret "insights-runtime-extractor-tls" not found
Jul 10 02:11:51.423604 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:51.423576    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tbgpl_cd032043-9d19-4516-b808-365276e33254/dns-node-resolver/0.log"
Jul 10 02:11:52.221487 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:52.221456    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8kqm6_0177cb8b-5ebf-4268-81a4-25476eae55ea/node-ca/0.log"
Jul 10 02:11:52.826042 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:52.825990    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-j6scc\" (UID: \"3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-j6scc"
Jul 10 02:11:52.826418 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:52.826143    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 02:11:52.826418 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:52.826206    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-cluster-monitoring-operator-tls podName:3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd nodeName:}" failed. No retries permitted until 2026-07-10 02:12:00.826191097 +0000 UTC m=+249.592103307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-j6scc" (UID: "3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd") : secret "cluster-monitoring-operator-tls" not found
Jul 10 02:11:52.927066 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:52.927008    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-registry-tls\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:11:52.927246 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:52.927178    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 02:11:52.927246 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:52.927198    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7464fbc79c-59k4p: secret "image-registry-tls" not found
Jul 10 02:11:52.927318 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:52.927255    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-registry-tls podName:5f363ba9-996c-4350-8d76-4f039314fec2 nodeName:}" failed. No retries permitted until 2026-07-10 02:12:00.927240077 +0000 UTC m=+249.693152298 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-registry-tls") pod "image-registry-7464fbc79c-59k4p" (UID: "5f363ba9-996c-4350-8d76-4f039314fec2") : secret "image-registry-tls" not found
Jul 10 02:11:53.023023 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:53.022998    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-84rg4_669ccaa9-c014-4d81-95b5-ef08cb4a8cd1/serve-healthcheck-canary/0.log"
Jul 10 02:11:53.028310 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:53.028277    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc0704bf-e998-412b-94ee-8ab671baade7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxng6\" (UID: \"bc0704bf-e998-412b-94ee-8ab671baade7\") " pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:11:53.028504 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:53.028330    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc0704bf-e998-412b-94ee-8ab671baade7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxng6\" (UID: \"bc0704bf-e998-412b-94ee-8ab671baade7\") " pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:11:53.028504 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:53.028403    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 02:11:53.028504 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:53.028473    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 02:11:53.028504 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:53.028488    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bc0704bf-e998-412b-94ee-8ab671baade7-kube-rbac-proxy-cm podName:bc0704bf-e998-412b-94ee-8ab671baade7 nodeName:}" failed. No retries permitted until 2026-07-10 02:11:57.028470755 +0000 UTC m=+245.794382966 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bc0704bf-e998-412b-94ee-8ab671baade7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xxng6" (UID: "bc0704bf-e998-412b-94ee-8ab671baade7") : configmap "kube-rbac-proxy" not found
Jul 10 02:11:53.028669 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:53.028533    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc0704bf-e998-412b-94ee-8ab671baade7-insights-runtime-extractor-tls podName:bc0704bf-e998-412b-94ee-8ab671baade7 nodeName:}" failed. No retries permitted until 2026-07-10 02:11:57.028516035 +0000 UTC m=+245.794428254 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bc0704bf-e998-412b-94ee-8ab671baade7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xxng6" (UID: "bc0704bf-e998-412b-94ee-8ab671baade7") : secret "insights-runtime-extractor-tls" not found
Jul 10 02:11:55.425328 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:55.425242    2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-wlk8h"
Jul 10 02:11:55.425328 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:55.425299    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-wlk8h"
Jul 10 02:11:55.425732 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:55.425609    2576 scope.go:117] "RemoveContainer" containerID="111c6daa79a4ef3e69d6b05f448ab652a5bced1fccef3cec54e5a615b1ee185b"
Jul 10 02:11:55.425776 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:55.425755    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-wlk8h_openshift-console-operator(b2e5ea06-8452-4568-88b8-d907a1e2c864)\"" pod="openshift-console-operator/console-operator-7866497494-wlk8h" podUID="b2e5ea06-8452-4568-88b8-d907a1e2c864"
Jul 10 02:11:57.058414 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:57.058373    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc0704bf-e998-412b-94ee-8ab671baade7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxng6\" (UID: \"bc0704bf-e998-412b-94ee-8ab671baade7\") " pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:11:57.058808 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:11:57.058438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc0704bf-e998-412b-94ee-8ab671baade7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxng6\" (UID: \"bc0704bf-e998-412b-94ee-8ab671baade7\") " pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:11:57.058808 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:57.058513    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 02:11:57.058808 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:57.058525    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 02:11:57.058808 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:57.058580    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bc0704bf-e998-412b-94ee-8ab671baade7-kube-rbac-proxy-cm podName:bc0704bf-e998-412b-94ee-8ab671baade7 nodeName:}" failed. No retries permitted until 2026-07-10 02:12:05.058563256 +0000 UTC m=+253.824475473 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bc0704bf-e998-412b-94ee-8ab671baade7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xxng6" (UID: "bc0704bf-e998-412b-94ee-8ab671baade7") : configmap "kube-rbac-proxy" not found
Jul 10 02:11:57.058808 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:11:57.058597    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc0704bf-e998-412b-94ee-8ab671baade7-insights-runtime-extractor-tls podName:bc0704bf-e998-412b-94ee-8ab671baade7 nodeName:}" failed. No retries permitted until 2026-07-10 02:12:05.058588969 +0000 UTC m=+253.824501179 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bc0704bf-e998-412b-94ee-8ab671baade7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xxng6" (UID: "bc0704bf-e998-412b-94ee-8ab671baade7") : secret "insights-runtime-extractor-tls" not found
Jul 10 02:12:00.888510 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:00.888477    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-j6scc\" (UID: \"3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-j6scc"
Jul 10 02:12:00.888872 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:12:00.888629    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 02:12:00.888872 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:12:00.888691    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-cluster-monitoring-operator-tls podName:3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd nodeName:}" failed. No retries permitted until 2026-07-10 02:12:16.888676404 +0000 UTC m=+265.654588618 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-j6scc" (UID: "3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd") : secret "cluster-monitoring-operator-tls" not found
Jul 10 02:12:00.989683 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:00.989632    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-registry-tls\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:12:00.993857 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:00.992958    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-registry-tls\") pod \"image-registry-7464fbc79c-59k4p\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") " pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:12:01.127184 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:01.127148    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g79n9\""
Jul 10 02:12:01.134769 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:01.134743    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:12:01.257842 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:01.257808    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7464fbc79c-59k4p"]
Jul 10 02:12:01.260616 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:12:01.260590    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f363ba9_996c_4350_8d76_4f039314fec2.slice/crio-8c10103a5b933fd0aa2a37ec3433adf4a0d8384be937c39015cde7378beffaab WatchSource:0}: Error finding container 8c10103a5b933fd0aa2a37ec3433adf4a0d8384be937c39015cde7378beffaab: Status 404 returned error can't find the container with id 8c10103a5b933fd0aa2a37ec3433adf4a0d8384be937c39015cde7378beffaab
Jul 10 02:12:01.349487 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:01.349460    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7464fbc79c-59k4p" event={"ID":"5f363ba9-996c-4350-8d76-4f039314fec2","Type":"ContainerStarted","Data":"e08b906779a708941beae15ff33927a3563d88f1a391b5193ad6773dcfdbd15b"}
Jul 10 02:12:01.349616 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:01.349509    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7464fbc79c-59k4p" event={"ID":"5f363ba9-996c-4350-8d76-4f039314fec2","Type":"ContainerStarted","Data":"8c10103a5b933fd0aa2a37ec3433adf4a0d8384be937c39015cde7378beffaab"}
Jul 10 02:12:01.349616 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:01.349582    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:12:01.369585 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:01.369542    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7464fbc79c-59k4p" podStartSLOduration=16.369528659 podStartE2EDuration="16.369528659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:11:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:12:01.368811711 +0000 UTC m=+250.134723945" watchObservedRunningTime="2026-07-10 02:12:01.369528659 +0000 UTC m=+250.135440893"
Jul 10 02:12:04.315869 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:04.315829    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs\") pod \"network-metrics-daemon-gsnvh\" (UID: \"d04041a2-0cc9-4917-919a-a6a8e26cad05\") " pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:12:04.318104 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:04.318085    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d04041a2-0cc9-4917-919a-a6a8e26cad05-metrics-certs\") pod \"network-metrics-daemon-gsnvh\" (UID: \"d04041a2-0cc9-4917-919a-a6a8e26cad05\") " pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:12:04.441626 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:04.441595    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dzm46\""
Jul 10 02:12:04.449244 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:04.449224    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsnvh"
Jul 10 02:12:04.571194 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:04.570963    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gsnvh"]
Jul 10 02:12:04.573509 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:12:04.573475    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd04041a2_0cc9_4917_919a_a6a8e26cad05.slice/crio-8728a135bd2b3487f399d3e7a20acc490e9108bb7b38462c6607c63e220e8dba WatchSource:0}: Error finding container 8728a135bd2b3487f399d3e7a20acc490e9108bb7b38462c6607c63e220e8dba: Status 404 returned error can't find the container with id 8728a135bd2b3487f399d3e7a20acc490e9108bb7b38462c6607c63e220e8dba
Jul 10 02:12:05.123717 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:05.123662    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc0704bf-e998-412b-94ee-8ab671baade7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxng6\" (UID: \"bc0704bf-e998-412b-94ee-8ab671baade7\") " pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:12:05.123919 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:05.123755    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc0704bf-e998-412b-94ee-8ab671baade7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxng6\" (UID: \"bc0704bf-e998-412b-94ee-8ab671baade7\") " pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:12:05.124363 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:05.124342    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc0704bf-e998-412b-94ee-8ab671baade7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxng6\" (UID: \"bc0704bf-e998-412b-94ee-8ab671baade7\") " pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:12:05.126012 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:05.125994    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc0704bf-e998-412b-94ee-8ab671baade7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxng6\" (UID: \"bc0704bf-e998-412b-94ee-8ab671baade7\") " pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:12:05.258387 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:05.258352    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pk9p4\""
Jul 10 02:12:05.265777 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:05.265753    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xxng6"
Jul 10 02:12:05.369924 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:05.369887    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gsnvh" event={"ID":"d04041a2-0cc9-4917-919a-a6a8e26cad05","Type":"ContainerStarted","Data":"8728a135bd2b3487f399d3e7a20acc490e9108bb7b38462c6607c63e220e8dba"}
Jul 10 02:12:05.392996 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:05.392971    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xxng6"]
Jul 10 02:12:05.395338 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:12:05.395313    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc0704bf_e998_412b_94ee_8ab671baade7.slice/crio-73552e94f63a541c958752b14f954985bfb4b509c3e48a68e9abc0191ebba110 WatchSource:0}: Error finding container 73552e94f63a541c958752b14f954985bfb4b509c3e48a68e9abc0191ebba110: Status 404 returned error can't find the container with id 73552e94f63a541c958752b14f954985bfb4b509c3e48a68e9abc0191ebba110
Jul 10 02:12:06.376745 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:06.376664    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xxng6" event={"ID":"bc0704bf-e998-412b-94ee-8ab671baade7","Type":"ContainerStarted","Data":"73552e94f63a541c958752b14f954985bfb4b509c3e48a68e9abc0191ebba110"}
Jul 10 02:12:07.381467 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:07.381424    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gsnvh" event={"ID":"d04041a2-0cc9-4917-919a-a6a8e26cad05","Type":"ContainerStarted","Data":"b48ffcb6e940488d6867269f74545466c01fba2ea14413f5f44034d3b7fb4d03"}
Jul 10 02:12:07.381901 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:07.381490    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gsnvh" event={"ID":"d04041a2-0cc9-4917-919a-a6a8e26cad05","Type":"ContainerStarted","Data":"a2a12766a059bb594a313ac47215a32ee3f739a2ddd29057bfacb0c141d6eef1"}
Jul 10 02:12:07.400803 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:07.400735    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gsnvh" podStartSLOduration=252.61779953 podStartE2EDuration="4m14.400719323s" totalImagesPullingTime="1.782919793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:12:07.398929256 +0000 UTC m=+256.164841489" watchObservedRunningTime="2026-07-10 02:12:07.400719323 +0000 UTC m=+256.166631593"
Jul 10 02:12:09.389741 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:09.389706    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xxng6" event={"ID":"bc0704bf-e998-412b-94ee-8ab671baade7","Type":"ContainerStarted","Data":"acbef73ca022db3d2c7b1a47353ae77c29c3b27910197d7f8f63c7ddcbcbe9f0"}
Jul 10 02:12:09.538469 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:09.538439    2576 scope.go:117] "RemoveContainer" containerID="111c6daa79a4ef3e69d6b05f448ab652a5bced1fccef3cec54e5a615b1ee185b"
Jul 10 02:12:10.395093 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:10.395069    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/2.log"
Jul 10 02:12:10.395539 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:10.395521    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/1.log"
Jul 10 02:12:10.395600 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:10.395565    2576 generic.go:356] "Generic (PLEG): container finished" podID="b2e5ea06-8452-4568-88b8-d907a1e2c864" containerID="989ced6337269827370623231ddcff7f04102575216ee4d53ceae93bf8aee2c9" exitCode=255
Jul 10 02:12:10.395695 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:10.395671    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-wlk8h" event={"ID":"b2e5ea06-8452-4568-88b8-d907a1e2c864","Type":"ContainerDied","Data":"989ced6337269827370623231ddcff7f04102575216ee4d53ceae93bf8aee2c9"}
Jul 10 02:12:10.395764 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:10.395749    2576 scope.go:117] "RemoveContainer" containerID="111c6daa79a4ef3e69d6b05f448ab652a5bced1fccef3cec54e5a615b1ee185b"
Jul 10 02:12:10.396099 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:10.396080    2576 scope.go:117] "RemoveContainer" containerID="989ced6337269827370623231ddcff7f04102575216ee4d53ceae93bf8aee2c9"
Jul 10 02:12:10.396288 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:12:10.396262    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-wlk8h_openshift-console-operator(b2e5ea06-8452-4568-88b8-d907a1e2c864)\"" pod="openshift-console-operator/console-operator-7866497494-wlk8h" podUID="b2e5ea06-8452-4568-88b8-d907a1e2c864"
Jul 10 02:12:10.397559 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:10.397524    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xxng6" event={"ID":"bc0704bf-e998-412b-94ee-8ab671baade7","Type":"ContainerStarted","Data":"6e29d100dc9dc8f4391bb1be7cb38b2a0857b92d47dde2045d27d2722ebbdf8d"}
Jul 10 02:12:11.402367 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:11.402338    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/2.log"
Jul 10 02:12:12.407203 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.407177    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xxng6" event={"ID":"bc0704bf-e998-412b-94ee-8ab671baade7","Type":"ContainerStarted","Data":"78bae738716e01fd66db557f68c05adfa4a71194b6c275bb40d1817985399a37"}
Jul 10 02:12:12.433056 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.432584    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xxng6" podStartSLOduration=16.774249075 podStartE2EDuration="23.432564658s" totalImagesPullingTime="6.658315583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:11:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:12:12.43085136 +0000 UTC m=+261.196763593" watchObservedRunningTime="2026-07-10 02:12:12.432564658 +0000 UTC m=+261.198476893"
Jul 10 02:12:12.528830 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.528741    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7464fbc79c-59k4p"]
Jul 10 02:12:12.562215 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.562187    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-749655cb8c-htw78"]
Jul 10 02:12:12.565064 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.565050    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:12.579388 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.579366    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-749655cb8c-htw78"]
Jul 10 02:12:12.686602 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.686574    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/37215647-0029-42ce-a079-cf630e544aed-bound-sa-token\") pod \"image-registry-749655cb8c-htw78\" (UID: \"37215647-0029-42ce-a079-cf630e544aed\") " pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:12.686602 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.686605    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/37215647-0029-42ce-a079-cf630e544aed-ca-trust-extracted\") pod \"image-registry-749655cb8c-htw78\" (UID: \"37215647-0029-42ce-a079-cf630e544aed\") " pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:12.686821 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.686631    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/37215647-0029-42ce-a079-cf630e544aed-trusted-ca\") pod \"image-registry-749655cb8c-htw78\" (UID: \"37215647-0029-42ce-a079-cf630e544aed\") " pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:12.686821 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.686703    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/37215647-0029-42ce-a079-cf630e544aed-image-registry-private-configuration\") pod \"image-registry-749655cb8c-htw78\" (UID: \"37215647-0029-42ce-a079-cf630e544aed\") " pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:12.686821 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.686726    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/37215647-0029-42ce-a079-cf630e544aed-installation-pull-secrets\") pod \"image-registry-749655cb8c-htw78\" (UID: \"37215647-0029-42ce-a079-cf630e544aed\") " pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:12.686821 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.686774    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b2q9\" (UniqueName: \"kubernetes.io/projected/37215647-0029-42ce-a079-cf630e544aed-kube-api-access-7b2q9\") pod \"image-registry-749655cb8c-htw78\" (UID: \"37215647-0029-42ce-a079-cf630e544aed\") " pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:12.686821 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.686791    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/37215647-0029-42ce-a079-cf630e544aed-registry-tls\") pod \"image-registry-749655cb8c-htw78\" (UID: \"37215647-0029-42ce-a079-cf630e544aed\") " pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:12.686963 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.686842    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/37215647-0029-42ce-a079-cf630e544aed-registry-certificates\") pod \"image-registry-749655cb8c-htw78\" (UID: \"37215647-0029-42ce-a079-cf630e544aed\") " pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:12.787739 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.787655    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/37215647-0029-42ce-a079-cf630e544aed-image-registry-private-configuration\") pod \"image-registry-749655cb8c-htw78\" (UID: \"37215647-0029-42ce-a079-cf630e544aed\") " pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:12.787739 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.787689    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/37215647-0029-42ce-a079-cf630e544aed-installation-pull-secrets\") pod \"image-registry-749655cb8c-htw78\" (UID: \"37215647-0029-42ce-a079-cf630e544aed\") " pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:12.787739 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.787722    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b2q9\" (UniqueName: \"kubernetes.io/projected/37215647-0029-42ce-a079-cf630e544aed-kube-api-access-7b2q9\") pod \"image-registry-749655cb8c-htw78\" (UID: \"37215647-0029-42ce-a079-cf630e544aed\") " pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:12.788039 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.787744    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/37215647-0029-42ce-a079-cf630e544aed-registry-tls\") pod \"image-registry-749655cb8c-htw78\" (UID: \"37215647-0029-42ce-a079-cf630e544aed\") " pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:12.788039 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.787791    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/37215647-0029-42ce-a079-cf630e544aed-registry-certificates\") pod \"image-registry-749655cb8c-htw78\" (UID: \"37215647-0029-42ce-a079-cf630e544aed\") " pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:12.788039 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.787825    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/37215647-0029-42ce-a079-cf630e544aed-bound-sa-token\") pod \"image-registry-749655cb8c-htw78\" (UID: \"37215647-0029-42ce-a079-cf630e544aed\") " pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:12.788039 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.787845    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/37215647-0029-42ce-a079-cf630e544aed-ca-trust-extracted\") pod \"image-registry-749655cb8c-htw78\" (UID: \"37215647-0029-42ce-a079-cf630e544aed\") " pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:12.788039 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.787883    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/37215647-0029-42ce-a079-cf630e544aed-trusted-ca\") pod \"image-registry-749655cb8c-htw78\" (UID: \"37215647-0029-42ce-a079-cf630e544aed\") " pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:12.788383 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.788357    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/37215647-0029-42ce-a079-cf630e544aed-ca-trust-extracted\") pod \"image-registry-749655cb8c-htw78\" (UID: \"37215647-0029-42ce-a079-cf630e544aed\") " pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:12.788830 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.788800    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/37215647-0029-42ce-a079-cf630e544aed-registry-certificates\") pod \"image-registry-749655cb8c-htw78\" (UID: \"37215647-0029-42ce-a079-cf630e544aed\") " pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:12.788920 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.788829    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/37215647-0029-42ce-a079-cf630e544aed-trusted-ca\") pod \"image-registry-749655cb8c-htw78\" (UID: \"37215647-0029-42ce-a079-cf630e544aed\") " pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:12.790273 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.790248    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/37215647-0029-42ce-a079-cf630e544aed-image-registry-private-configuration\") pod \"image-registry-749655cb8c-htw78\" (UID: \"37215647-0029-42ce-a079-cf630e544aed\") " pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:12.790273 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.790269    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/37215647-0029-42ce-a079-cf630e544aed-installation-pull-secrets\") pod \"image-registry-749655cb8c-htw78\" (UID: \"37215647-0029-42ce-a079-cf630e544aed\") " pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:12.790388 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.790317    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/37215647-0029-42ce-a079-cf630e544aed-registry-tls\") pod \"image-registry-749655cb8c-htw78\" (UID: \"37215647-0029-42ce-a079-cf630e544aed\") " pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:12.797549 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.797525    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/37215647-0029-42ce-a079-cf630e544aed-bound-sa-token\") pod \"image-registry-749655cb8c-htw78\" (UID: \"37215647-0029-42ce-a079-cf630e544aed\") " pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:12.797771 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.797753    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b2q9\" (UniqueName: \"kubernetes.io/projected/37215647-0029-42ce-a079-cf630e544aed-kube-api-access-7b2q9\") pod \"image-registry-749655cb8c-htw78\" (UID: \"37215647-0029-42ce-a079-cf630e544aed\") " pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:12.872848 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.872814    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:12.999101 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:12.999077    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-749655cb8c-htw78"]
Jul 10 02:12:13.001010 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:12:13.000988    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37215647_0029_42ce_a079_cf630e544aed.slice/crio-086b66b605d0926bc565199c27a57ab8776226e2aa99e5cc1f7dd18f69cefe02 WatchSource:0}: Error finding container 086b66b605d0926bc565199c27a57ab8776226e2aa99e5cc1f7dd18f69cefe02: Status 404 returned error can't find the container with id 086b66b605d0926bc565199c27a57ab8776226e2aa99e5cc1f7dd18f69cefe02
Jul 10 02:12:13.411872 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:13.411836    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-749655cb8c-htw78" event={"ID":"37215647-0029-42ce-a079-cf630e544aed","Type":"ContainerStarted","Data":"f05aa29754cf5048234596a982dc46d975637b668f7c0384d8b00f412ff88e0c"}
Jul 10 02:12:13.412253 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:13.411895    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-749655cb8c-htw78" event={"ID":"37215647-0029-42ce-a079-cf630e544aed","Type":"ContainerStarted","Data":"086b66b605d0926bc565199c27a57ab8776226e2aa99e5cc1f7dd18f69cefe02"}
Jul 10 02:12:13.412253 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:13.412047    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:13.433112 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:13.433074    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-749655cb8c-htw78" podStartSLOduration=1.433059558 podStartE2EDuration="1.433059558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:12:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:12:13.431947391 +0000 UTC m=+262.197859625" watchObservedRunningTime="2026-07-10 02:12:13.433059558 +0000 UTC m=+262.198971791"
Jul 10 02:12:15.425654 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:15.425624    2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-wlk8h"
Jul 10 02:12:15.426104 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:15.425673    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-wlk8h"
Jul 10 02:12:15.426104 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:15.425974    2576 scope.go:117] "RemoveContainer" containerID="989ced6337269827370623231ddcff7f04102575216ee4d53ceae93bf8aee2c9"
Jul 10 02:12:15.426198 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:12:15.426178    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-wlk8h_openshift-console-operator(b2e5ea06-8452-4568-88b8-d907a1e2c864)\"" pod="openshift-console-operator/console-operator-7866497494-wlk8h" podUID="b2e5ea06-8452-4568-88b8-d907a1e2c864"
Jul 10 02:12:16.920985 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:16.920946    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-j6scc\" (UID: \"3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-j6scc"
Jul 10 02:12:16.923434 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:16.923407    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-j6scc\" (UID: \"3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-j6scc"
Jul 10 02:12:16.935138 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:16.935114    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gtrw5\""
Jul 10 02:12:16.942476 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:16.942458    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-j6scc"
Jul 10 02:12:17.088141 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:17.088117    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-j6scc"]
Jul 10 02:12:17.090272 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:12:17.090240    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f52d95a_6ca8_4b73_b8ba_1b25f6b1e0dd.slice/crio-e7eac2fb00d54213e36990a1cbc6b080c8ac3a2e3aedb4418c028ca93d720dc7 WatchSource:0}: Error finding container e7eac2fb00d54213e36990a1cbc6b080c8ac3a2e3aedb4418c028ca93d720dc7: Status 404 returned error can't find the container with id e7eac2fb00d54213e36990a1cbc6b080c8ac3a2e3aedb4418c028ca93d720dc7
Jul 10 02:12:17.424972 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:17.424940    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-j6scc" event={"ID":"3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd","Type":"ContainerStarted","Data":"e7eac2fb00d54213e36990a1cbc6b080c8ac3a2e3aedb4418c028ca93d720dc7"}
Jul 10 02:12:19.434037 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:19.433994    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-j6scc" event={"ID":"3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd","Type":"ContainerStarted","Data":"95ecf75781a3f40a26e4f7d0871cd19611b88cd6549148fed07fc3dbb5b158fc"}
Jul 10 02:12:19.452713 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:19.452660    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-j6scc" podStartSLOduration=32.432676309 podStartE2EDuration="34.452644695s" totalImagesPullingTime="2.019968386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:11:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:12:19.451795916 +0000 UTC m=+268.217708182" watchObservedRunningTime="2026-07-10 02:12:19.452644695 +0000 UTC m=+268.218556969"
Jul 10 02:12:19.653888 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:19.653858    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5dmr6"]
Jul 10 02:12:19.656923 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:19.656908    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5dmr6"
Jul 10 02:12:19.659434 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:19.659409    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 10 02:12:19.659549 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:19.659487    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-glxwj\""
Jul 10 02:12:19.664954 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:19.664923    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5dmr6"]
Jul 10 02:12:19.743238 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:19.743173    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5d2a5df5-fb8d-4d21-9e91-382d2b964442-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-5dmr6\" (UID: \"5d2a5df5-fb8d-4d21-9e91-382d2b964442\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5dmr6"
Jul 10 02:12:19.843954 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:19.843926    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5d2a5df5-fb8d-4d21-9e91-382d2b964442-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-5dmr6\" (UID: \"5d2a5df5-fb8d-4d21-9e91-382d2b964442\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5dmr6"
Jul 10 02:12:19.846325 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:19.846301    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5d2a5df5-fb8d-4d21-9e91-382d2b964442-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-5dmr6\" (UID: \"5d2a5df5-fb8d-4d21-9e91-382d2b964442\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5dmr6"
Jul 10 02:12:19.966081 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:19.966045    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5dmr6"
Jul 10 02:12:20.086571 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:20.086541    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5dmr6"]
Jul 10 02:12:20.089285 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:12:20.089252    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d2a5df5_fb8d_4d21_9e91_382d2b964442.slice/crio-d3003466ce140c073aff16c64701a84ab4582082d7d9ed5d414da84610829400 WatchSource:0}: Error finding container d3003466ce140c073aff16c64701a84ab4582082d7d9ed5d414da84610829400: Status 404 returned error can't find the container with id d3003466ce140c073aff16c64701a84ab4582082d7d9ed5d414da84610829400
Jul 10 02:12:20.439095 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:20.439065    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5dmr6" event={"ID":"5d2a5df5-fb8d-4d21-9e91-382d2b964442","Type":"ContainerStarted","Data":"d3003466ce140c073aff16c64701a84ab4582082d7d9ed5d414da84610829400"}
Jul 10 02:12:21.443312 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:21.443277    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5dmr6" event={"ID":"5d2a5df5-fb8d-4d21-9e91-382d2b964442","Type":"ContainerStarted","Data":"67d928bc7d7ed5ab94f8cc171bb148e90843cc845022afbe0b063db674d4a564"}
Jul 10 02:12:21.443732 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:21.443473    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5dmr6"
Jul 10 02:12:21.447947 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:21.447926    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5dmr6"
Jul 10 02:12:21.463688 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:21.463040    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5dmr6" podStartSLOduration=1.333485949 podStartE2EDuration="2.462996793s" totalImagesPullingTime="1.129510844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:12:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:12:21.461266305 +0000 UTC m=+270.227178542" watchObservedRunningTime="2026-07-10 02:12:21.462996793 +0000 UTC m=+270.228909025"
Jul 10 02:12:21.719177 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:21.719145    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-27s4m"]
Jul 10 02:12:21.723228 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:21.723212    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-27s4m"
Jul 10 02:12:21.725873 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:21.725851    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 10 02:12:21.725992 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:21.725973    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-l2tn6\""
Jul 10 02:12:21.726055 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:21.726044    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 10 02:12:21.727209 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:21.727194    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 10 02:12:21.731532 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:21.731509    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-27s4m"]
Jul 10 02:12:21.860127 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:21.860088    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/acf46b9f-c04d-46f2-9efb-e0fa86578baa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-27s4m\" (UID: \"acf46b9f-c04d-46f2-9efb-e0fa86578baa\") " pod="openshift-monitoring/prometheus-operator-64785b6675-27s4m"
Jul 10 02:12:21.860362 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:21.860136    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acf46b9f-c04d-46f2-9efb-e0fa86578baa-metrics-client-ca\") pod \"prometheus-operator-64785b6675-27s4m\" (UID: \"acf46b9f-c04d-46f2-9efb-e0fa86578baa\") " pod="openshift-monitoring/prometheus-operator-64785b6675-27s4m"
Jul 10 02:12:21.860362 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:21.860184    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/acf46b9f-c04d-46f2-9efb-e0fa86578baa-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-27s4m\" (UID: \"acf46b9f-c04d-46f2-9efb-e0fa86578baa\") " pod="openshift-monitoring/prometheus-operator-64785b6675-27s4m"
Jul 10 02:12:21.860362 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:21.860202    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n6cn\" (UniqueName: \"kubernetes.io/projected/acf46b9f-c04d-46f2-9efb-e0fa86578baa-kube-api-access-2n6cn\") pod \"prometheus-operator-64785b6675-27s4m\" (UID: \"acf46b9f-c04d-46f2-9efb-e0fa86578baa\") " pod="openshift-monitoring/prometheus-operator-64785b6675-27s4m"
Jul 10 02:12:21.960907 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:21.960873    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/acf46b9f-c04d-46f2-9efb-e0fa86578baa-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-27s4m\" (UID: \"acf46b9f-c04d-46f2-9efb-e0fa86578baa\") " pod="openshift-monitoring/prometheus-operator-64785b6675-27s4m"
Jul 10 02:12:21.960907 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:21.960910    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n6cn\" (UniqueName: \"kubernetes.io/projected/acf46b9f-c04d-46f2-9efb-e0fa86578baa-kube-api-access-2n6cn\") pod \"prometheus-operator-64785b6675-27s4m\" (UID: \"acf46b9f-c04d-46f2-9efb-e0fa86578baa\") " pod="openshift-monitoring/prometheus-operator-64785b6675-27s4m"
Jul 10 02:12:21.961194 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:21.960985    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/acf46b9f-c04d-46f2-9efb-e0fa86578baa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-27s4m\" (UID: \"acf46b9f-c04d-46f2-9efb-e0fa86578baa\") " pod="openshift-monitoring/prometheus-operator-64785b6675-27s4m"
Jul 10 02:12:21.961194 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:21.961011    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acf46b9f-c04d-46f2-9efb-e0fa86578baa-metrics-client-ca\") pod \"prometheus-operator-64785b6675-27s4m\" (UID: \"acf46b9f-c04d-46f2-9efb-e0fa86578baa\") " pod="openshift-monitoring/prometheus-operator-64785b6675-27s4m"
Jul 10 02:12:21.961194 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:12:21.961036    2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 10 02:12:21.961194 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:12:21.961118    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acf46b9f-c04d-46f2-9efb-e0fa86578baa-prometheus-operator-tls podName:acf46b9f-c04d-46f2-9efb-e0fa86578baa nodeName:}" failed. No retries permitted until 2026-07-10 02:12:22.461097438 +0000 UTC m=+271.227009664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/acf46b9f-c04d-46f2-9efb-e0fa86578baa-prometheus-operator-tls") pod "prometheus-operator-64785b6675-27s4m" (UID: "acf46b9f-c04d-46f2-9efb-e0fa86578baa") : secret "prometheus-operator-tls" not found
Jul 10 02:12:21.961760 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:21.961739    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acf46b9f-c04d-46f2-9efb-e0fa86578baa-metrics-client-ca\") pod \"prometheus-operator-64785b6675-27s4m\" (UID: \"acf46b9f-c04d-46f2-9efb-e0fa86578baa\") " pod="openshift-monitoring/prometheus-operator-64785b6675-27s4m"
Jul 10 02:12:21.963373 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:21.963354    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/acf46b9f-c04d-46f2-9efb-e0fa86578baa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-27s4m\" (UID: \"acf46b9f-c04d-46f2-9efb-e0fa86578baa\") " pod="openshift-monitoring/prometheus-operator-64785b6675-27s4m"
Jul 10 02:12:21.972314 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:21.972265    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n6cn\" (UniqueName: \"kubernetes.io/projected/acf46b9f-c04d-46f2-9efb-e0fa86578baa-kube-api-access-2n6cn\") pod \"prometheus-operator-64785b6675-27s4m\" (UID: \"acf46b9f-c04d-46f2-9efb-e0fa86578baa\") " pod="openshift-monitoring/prometheus-operator-64785b6675-27s4m"
Jul 10 02:12:22.465270 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:22.465237    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/acf46b9f-c04d-46f2-9efb-e0fa86578baa-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-27s4m\" (UID: \"acf46b9f-c04d-46f2-9efb-e0fa86578baa\") " pod="openshift-monitoring/prometheus-operator-64785b6675-27s4m"
Jul 10 02:12:22.467540 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:22.467522    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/acf46b9f-c04d-46f2-9efb-e0fa86578baa-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-27s4m\" (UID: \"acf46b9f-c04d-46f2-9efb-e0fa86578baa\") " pod="openshift-monitoring/prometheus-operator-64785b6675-27s4m"
Jul 10 02:12:22.534236 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:22.534195    2576 patch_prober.go:28] interesting pod/image-registry-7464fbc79c-59k4p container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 10 02:12:22.534376 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:22.534263    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7464fbc79c-59k4p" podUID="5f363ba9-996c-4350-8d76-4f039314fec2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 02:12:22.632457 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:22.632415    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-27s4m"
Jul 10 02:12:22.756004 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:22.755979    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-27s4m"]
Jul 10 02:12:22.758169 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:12:22.758143    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf46b9f_c04d_46f2_9efb_e0fa86578baa.slice/crio-18118f56ac852ea62a0c2a11dce3042ecd194e6b97b7ff6112c3c15e9ff04c89 WatchSource:0}: Error finding container 18118f56ac852ea62a0c2a11dce3042ecd194e6b97b7ff6112c3c15e9ff04c89: Status 404 returned error can't find the container with id 18118f56ac852ea62a0c2a11dce3042ecd194e6b97b7ff6112c3c15e9ff04c89
Jul 10 02:12:23.451437 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:23.451387    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-27s4m" event={"ID":"acf46b9f-c04d-46f2-9efb-e0fa86578baa","Type":"ContainerStarted","Data":"18118f56ac852ea62a0c2a11dce3042ecd194e6b97b7ff6112c3c15e9ff04c89"}
Jul 10 02:12:24.456718 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:24.456686    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-27s4m" event={"ID":"acf46b9f-c04d-46f2-9efb-e0fa86578baa","Type":"ContainerStarted","Data":"632ab20b35edc76b89d0d74e0c50c4aa1355fa212f2b4b6752bd349a81c482e4"}
Jul 10 02:12:24.457158 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:24.456736    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-27s4m" event={"ID":"acf46b9f-c04d-46f2-9efb-e0fa86578baa","Type":"ContainerStarted","Data":"878d1f167e1f318436e014c5306bc45b8b7bc7826a636fe3287d2fa06bf28167"}
Jul 10 02:12:24.477835 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:24.477791    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-27s4m" podStartSLOduration=2.244349845 podStartE2EDuration="3.477777098s" totalImagesPullingTime="1.233427253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:12:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:12:24.475767675 +0000 UTC m=+273.241679907" watchObservedRunningTime="2026-07-10 02:12:24.477777098 +0000 UTC m=+273.243689328"
Jul 10 02:12:26.126430 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.126384    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k2bxj"]
Jul 10 02:12:26.128771 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.128752    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.131567 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.131548    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 10 02:12:26.131655 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.131578    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 10 02:12:26.131655 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.131616    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hg988\""
Jul 10 02:12:26.131845 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.131833    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 10 02:12:26.298719 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.298671    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-node-exporter-wtmp\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.298719 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.298718    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-metrics-client-ca\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.298927 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.298740    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbnm9\" (UniqueName: \"kubernetes.io/projected/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-kube-api-access-hbnm9\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.298927 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.298800    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-sys\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.298927 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.298839    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-node-exporter-textfile\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.298927 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.298862    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.299073 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.298927    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-node-exporter-accelerators-collector-config\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.299073 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.298959    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-root\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.299073 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.298979    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-node-exporter-tls\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.400077 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.399981    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-sys\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.400077 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.400019    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-node-exporter-textfile\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.400077 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.400055    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.400346 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.400093    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-sys\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.400346 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.400106    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-node-exporter-accelerators-collector-config\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.400346 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.400154    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-root\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.400346 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.400172    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-node-exporter-tls\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.400346 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.400212    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-node-exporter-wtmp\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.400346 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.400255    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-root\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.400346 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:12:26.400305    2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 10 02:12:26.400346 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.400332    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-node-exporter-wtmp\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.400346 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.400306    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-metrics-client-ca\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.400755 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:12:26.400368    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-node-exporter-tls podName:a9b3945f-9aa5-4ae0-820d-0f71abb3150c nodeName:}" failed. No retries permitted until 2026-07-10 02:12:26.900349208 +0000 UTC m=+275.666261424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-node-exporter-tls") pod "node-exporter-k2bxj" (UID: "a9b3945f-9aa5-4ae0-820d-0f71abb3150c") : secret "node-exporter-tls" not found
Jul 10 02:12:26.400755 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.400385    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-node-exporter-textfile\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.400755 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.400389    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbnm9\" (UniqueName: \"kubernetes.io/projected/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-kube-api-access-hbnm9\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.400755 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.400737    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-node-exporter-accelerators-collector-config\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.400895 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.400798    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-metrics-client-ca\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.402466 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.402442    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.409645 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.409622    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbnm9\" (UniqueName: \"kubernetes.io/projected/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-kube-api-access-hbnm9\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.902504 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.902471    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-node-exporter-tls\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:26.904644 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:26.904625    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a9b3945f-9aa5-4ae0-820d-0f71abb3150c-node-exporter-tls\") pod \"node-exporter-k2bxj\" (UID: \"a9b3945f-9aa5-4ae0-820d-0f71abb3150c\") " pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:27.037102 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.037070    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k2bxj"
Jul 10 02:12:27.046593 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:12:27.046567    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9b3945f_9aa5_4ae0_820d_0f71abb3150c.slice/crio-fc95c9063709ed402afa69cff00e1c7987ba1ac7c17b89ece2b31309d33593ee WatchSource:0}: Error finding container fc95c9063709ed402afa69cff00e1c7987ba1ac7c17b89ece2b31309d33593ee: Status 404 returned error can't find the container with id fc95c9063709ed402afa69cff00e1c7987ba1ac7c17b89ece2b31309d33593ee
Jul 10 02:12:27.210602 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.210530    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:12:27.214036 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.214010    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.216936 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.216905    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rpsmk\""
Jul 10 02:12:27.217071 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.216963    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 10 02:12:27.217223 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.217207    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 10 02:12:27.217296 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.217237    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 10 02:12:27.217349 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.217311    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 10 02:12:27.217402 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.217323    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 10 02:12:27.217448 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.217434    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 10 02:12:27.217656 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.217642    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 10 02:12:27.217738 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.217641    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 10 02:12:27.221613 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.221597    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 10 02:12:27.232497 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.232451    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:12:27.305619 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.305588    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.305619 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.305622    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.305819 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.305651    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.305819 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.305718    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-config-volume\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.305819 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.305746    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-web-config\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.305819 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.305775    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.305819 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.305795    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.305819 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.305810    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffgqt\" (UniqueName: \"kubernetes.io/projected/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-kube-api-access-ffgqt\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.305997 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.305826    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.305997 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.305904    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.305997 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.305941    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-config-out\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.305997 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.305965    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.305997 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.305984    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.406763 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.406728    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.406763 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.406764    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-config-out\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.406977 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.406781    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.406977 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.406801    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.406977 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.406839    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.406977 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.406869    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.406977 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.406908    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.407238 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.407052    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-config-volume\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.407238 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.407082    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-web-config\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.407238 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.407112    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.407238 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.407144    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.407238 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.407168    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffgqt\" (UniqueName: \"kubernetes.io/projected/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-kube-api-access-ffgqt\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.407238 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.407196    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.408074 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.408050    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.409288 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.409265    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.410366 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.410316    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.410468 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.410387    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-config-out\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.410468 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.410391    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.410572 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.410548    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.410754 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.410725    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.410850 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.410739    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.410961 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.410942    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.411073 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.411057    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.411554 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.411537    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-config-volume\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.412272 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.412240    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-web-config\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.420153 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.420133    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffgqt\" (UniqueName: \"kubernetes.io/projected/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-kube-api-access-ffgqt\") pod \"alertmanager-main-0\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.468443 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.468365    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k2bxj" event={"ID":"a9b3945f-9aa5-4ae0-820d-0f71abb3150c","Type":"ContainerStarted","Data":"fc95c9063709ed402afa69cff00e1c7987ba1ac7c17b89ece2b31309d33593ee"}
Jul 10 02:12:27.526255 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.526229    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:12:27.539510 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.539428    2576 scope.go:117] "RemoveContainer" containerID="989ced6337269827370623231ddcff7f04102575216ee4d53ceae93bf8aee2c9"
Jul 10 02:12:27.539661 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:12:27.539636    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-wlk8h_openshift-console-operator(b2e5ea06-8452-4568-88b8-d907a1e2c864)\"" pod="openshift-console-operator/console-operator-7866497494-wlk8h" podUID="b2e5ea06-8452-4568-88b8-d907a1e2c864"
Jul 10 02:12:27.663723 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:27.663692    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:12:27.666387 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:12:27.666358    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e28e33e_cfd2_4b83_863d_4ce9abadbcdc.slice/crio-188362653e5d1184b84fb16e30e96f021165dd37af7b07bee5e8f5a3f7dafcd5 WatchSource:0}: Error finding container 188362653e5d1184b84fb16e30e96f021165dd37af7b07bee5e8f5a3f7dafcd5: Status 404 returned error can't find the container with id 188362653e5d1184b84fb16e30e96f021165dd37af7b07bee5e8f5a3f7dafcd5
Jul 10 02:12:28.110699 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.110665    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-856fbf494b-qfdth"]
Jul 10 02:12:28.114731 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.114704    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:28.117762 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.117733    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 10 02:12:28.117882 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.117808    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-d8bdpf49gjv1n\""
Jul 10 02:12:28.117968 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.117944    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 10 02:12:28.118085 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.117974    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 10 02:12:28.118085 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.118069    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-z68wf\""
Jul 10 02:12:28.118202 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.118186    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 10 02:12:28.118242 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.118226    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 10 02:12:28.132845 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.132822    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-856fbf494b-qfdth"]
Jul 10 02:12:28.214796 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.214764    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b622a8a0-d0e8-4c36-a2bc-a373194624cf-secret-grpc-tls\") pod \"thanos-querier-856fbf494b-qfdth\" (UID: \"b622a8a0-d0e8-4c36-a2bc-a373194624cf\") " pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:28.215183 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.214831    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zvxx\" (UniqueName: \"kubernetes.io/projected/b622a8a0-d0e8-4c36-a2bc-a373194624cf-kube-api-access-4zvxx\") pod \"thanos-querier-856fbf494b-qfdth\" (UID: \"b622a8a0-d0e8-4c36-a2bc-a373194624cf\") " pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:28.215183 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.214901    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b622a8a0-d0e8-4c36-a2bc-a373194624cf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-856fbf494b-qfdth\" (UID: \"b622a8a0-d0e8-4c36-a2bc-a373194624cf\") " pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:28.215183 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.214930    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b622a8a0-d0e8-4c36-a2bc-a373194624cf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-856fbf494b-qfdth\" (UID: \"b622a8a0-d0e8-4c36-a2bc-a373194624cf\") " pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:28.215183 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.214958    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b622a8a0-d0e8-4c36-a2bc-a373194624cf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-856fbf494b-qfdth\" (UID: \"b622a8a0-d0e8-4c36-a2bc-a373194624cf\") " pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:28.215183 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.214983    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b622a8a0-d0e8-4c36-a2bc-a373194624cf-secret-thanos-querier-tls\") pod \"thanos-querier-856fbf494b-qfdth\" (UID: \"b622a8a0-d0e8-4c36-a2bc-a373194624cf\") " pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:28.215183 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.215054    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b622a8a0-d0e8-4c36-a2bc-a373194624cf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-856fbf494b-qfdth\" (UID: \"b622a8a0-d0e8-4c36-a2bc-a373194624cf\") " pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:28.215183 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.215075    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b622a8a0-d0e8-4c36-a2bc-a373194624cf-metrics-client-ca\") pod \"thanos-querier-856fbf494b-qfdth\" (UID: \"b622a8a0-d0e8-4c36-a2bc-a373194624cf\") " pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:28.316557 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.316494    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b622a8a0-d0e8-4c36-a2bc-a373194624cf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-856fbf494b-qfdth\" (UID: \"b622a8a0-d0e8-4c36-a2bc-a373194624cf\") " pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:28.316728 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.316564    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b622a8a0-d0e8-4c36-a2bc-a373194624cf-metrics-client-ca\") pod \"thanos-querier-856fbf494b-qfdth\" (UID: \"b622a8a0-d0e8-4c36-a2bc-a373194624cf\") " pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:28.316728 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.316598    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b622a8a0-d0e8-4c36-a2bc-a373194624cf-secret-grpc-tls\") pod \"thanos-querier-856fbf494b-qfdth\" (UID: \"b622a8a0-d0e8-4c36-a2bc-a373194624cf\") " pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:28.316728 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.316676    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zvxx\" (UniqueName: \"kubernetes.io/projected/b622a8a0-d0e8-4c36-a2bc-a373194624cf-kube-api-access-4zvxx\") pod \"thanos-querier-856fbf494b-qfdth\" (UID: \"b622a8a0-d0e8-4c36-a2bc-a373194624cf\") " pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:28.316891 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.316739    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b622a8a0-d0e8-4c36-a2bc-a373194624cf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-856fbf494b-qfdth\" (UID: \"b622a8a0-d0e8-4c36-a2bc-a373194624cf\") " pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:28.316891 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.316768    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b622a8a0-d0e8-4c36-a2bc-a373194624cf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-856fbf494b-qfdth\" (UID: \"b622a8a0-d0e8-4c36-a2bc-a373194624cf\") " pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:28.316891 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.316793    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b622a8a0-d0e8-4c36-a2bc-a373194624cf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-856fbf494b-qfdth\" (UID: \"b622a8a0-d0e8-4c36-a2bc-a373194624cf\") " pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:28.316891 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.316822    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b622a8a0-d0e8-4c36-a2bc-a373194624cf-secret-thanos-querier-tls\") pod \"thanos-querier-856fbf494b-qfdth\" (UID: \"b622a8a0-d0e8-4c36-a2bc-a373194624cf\") " pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:28.317936 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.317882    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b622a8a0-d0e8-4c36-a2bc-a373194624cf-metrics-client-ca\") pod \"thanos-querier-856fbf494b-qfdth\" (UID: \"b622a8a0-d0e8-4c36-a2bc-a373194624cf\") " pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:28.319800 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.319775    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b622a8a0-d0e8-4c36-a2bc-a373194624cf-secret-thanos-querier-tls\") pod \"thanos-querier-856fbf494b-qfdth\" (UID: \"b622a8a0-d0e8-4c36-a2bc-a373194624cf\") " pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:28.319965 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.319941    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b622a8a0-d0e8-4c36-a2bc-a373194624cf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-856fbf494b-qfdth\" (UID: \"b622a8a0-d0e8-4c36-a2bc-a373194624cf\") " pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:28.320514 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.320435    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b622a8a0-d0e8-4c36-a2bc-a373194624cf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-856fbf494b-qfdth\" (UID: \"b622a8a0-d0e8-4c36-a2bc-a373194624cf\") " pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:28.321075 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.321049    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b622a8a0-d0e8-4c36-a2bc-a373194624cf-secret-grpc-tls\") pod \"thanos-querier-856fbf494b-qfdth\" (UID: \"b622a8a0-d0e8-4c36-a2bc-a373194624cf\") " pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:28.321182 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.321155    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b622a8a0-d0e8-4c36-a2bc-a373194624cf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-856fbf494b-qfdth\" (UID: \"b622a8a0-d0e8-4c36-a2bc-a373194624cf\") " pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:28.321438 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.321409    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b622a8a0-d0e8-4c36-a2bc-a373194624cf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-856fbf494b-qfdth\" (UID: \"b622a8a0-d0e8-4c36-a2bc-a373194624cf\") " pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:28.326898 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.326879    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zvxx\" (UniqueName: \"kubernetes.io/projected/b622a8a0-d0e8-4c36-a2bc-a373194624cf-kube-api-access-4zvxx\") pod \"thanos-querier-856fbf494b-qfdth\" (UID: \"b622a8a0-d0e8-4c36-a2bc-a373194624cf\") " pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:28.426759 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.426717    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:28.474972 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.474936    2576 generic.go:356] "Generic (PLEG): container finished" podID="a9b3945f-9aa5-4ae0-820d-0f71abb3150c" containerID="16b09db182f4f666664d94e8ee4ee5e83e6c4aa797f644fd8dbefc626a9e382f" exitCode=0
Jul 10 02:12:28.475170 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.475020    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k2bxj" event={"ID":"a9b3945f-9aa5-4ae0-820d-0f71abb3150c","Type":"ContainerDied","Data":"16b09db182f4f666664d94e8ee4ee5e83e6c4aa797f644fd8dbefc626a9e382f"}
Jul 10 02:12:28.476410 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.476334    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc","Type":"ContainerStarted","Data":"188362653e5d1184b84fb16e30e96f021165dd37af7b07bee5e8f5a3f7dafcd5"}
Jul 10 02:12:28.573599 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:28.573561    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-856fbf494b-qfdth"]
Jul 10 02:12:28.755964 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:12:28.755938    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb622a8a0_d0e8_4c36_a2bc_a373194624cf.slice/crio-b4ccada8db9a8fb0d9e05e17aeb14e78fc1c0a8d20adee59e1ba7deb0a5477c8 WatchSource:0}: Error finding container b4ccada8db9a8fb0d9e05e17aeb14e78fc1c0a8d20adee59e1ba7deb0a5477c8: Status 404 returned error can't find the container with id b4ccada8db9a8fb0d9e05e17aeb14e78fc1c0a8d20adee59e1ba7deb0a5477c8
Jul 10 02:12:29.481094 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:29.481049    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth" event={"ID":"b622a8a0-d0e8-4c36-a2bc-a373194624cf","Type":"ContainerStarted","Data":"b4ccada8db9a8fb0d9e05e17aeb14e78fc1c0a8d20adee59e1ba7deb0a5477c8"}
Jul 10 02:12:29.483396 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:29.483354    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k2bxj" event={"ID":"a9b3945f-9aa5-4ae0-820d-0f71abb3150c","Type":"ContainerStarted","Data":"1643725db46e1b951214dbd15aaf3e26ec8e81d0714bbb3514af0405b071d796"}
Jul 10 02:12:29.483535 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:29.483401    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k2bxj" event={"ID":"a9b3945f-9aa5-4ae0-820d-0f71abb3150c","Type":"ContainerStarted","Data":"3bbfa20124b84ef49e38d4444a0858be5539b872b37a47f5cfc64c6311709cf9"}
Jul 10 02:12:29.484885 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:29.484857    2576 generic.go:356] "Generic (PLEG): container finished" podID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerID="cbb24095f9ba7f6ee3f23094d028b5f57afe27507ac1736d7d3e907b20715778" exitCode=0
Jul 10 02:12:29.484990 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:29.484897    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc","Type":"ContainerDied","Data":"cbb24095f9ba7f6ee3f23094d028b5f57afe27507ac1736d7d3e907b20715778"}
Jul 10 02:12:29.505265 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:29.505211    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k2bxj" podStartSLOduration=2.272532231 podStartE2EDuration="3.505191462s" totalImagesPullingTime="1.157691749s" totalInitContainerRuntime="74.967482ms" isStatefulPod=true podCreationTimestamp="2026-07-10 02:12:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:12:29.50354967 +0000 UTC m=+278.269461898" watchObservedRunningTime="2026-07-10 02:12:29.505191462 +0000 UTC m=+278.271103697"
Jul 10 02:12:30.490705 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:30.490679    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth" event={"ID":"b622a8a0-d0e8-4c36-a2bc-a373194624cf","Type":"ContainerStarted","Data":"0586a9c29395b11177a9a383adae6773b237048b5114666b0762db4fef05c08e"}
Jul 10 02:12:31.330140 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.330109    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-79786975d5-89z7z"]
Jul 10 02:12:31.334853 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.334830    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-79786975d5-89z7z"
Jul 10 02:12:31.337842 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.337819    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rbnkx\""
Jul 10 02:12:31.337842 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.337832    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 10 02:12:31.338051 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.337833    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 10 02:12:31.338051 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.337900    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 10 02:12:31.338167 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.338152    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 10 02:12:31.338234 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.338184    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 10 02:12:31.348991 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.348966    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-79786975d5-89z7z"]
Jul 10 02:12:31.351712 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.351686    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 10 02:12:31.451009 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.450972    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e269305b-e873-4bb2-b660-91cf256329ed-serving-certs-ca-bundle\") pod \"telemeter-client-79786975d5-89z7z\" (UID: \"e269305b-e873-4bb2-b660-91cf256329ed\") " pod="openshift-monitoring/telemeter-client-79786975d5-89z7z"
Jul 10 02:12:31.451203 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.451075    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsshd\" (UniqueName: \"kubernetes.io/projected/e269305b-e873-4bb2-b660-91cf256329ed-kube-api-access-gsshd\") pod \"telemeter-client-79786975d5-89z7z\" (UID: \"e269305b-e873-4bb2-b660-91cf256329ed\") " pod="openshift-monitoring/telemeter-client-79786975d5-89z7z"
Jul 10 02:12:31.451203 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.451106    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e269305b-e873-4bb2-b660-91cf256329ed-telemeter-client-tls\") pod \"telemeter-client-79786975d5-89z7z\" (UID: \"e269305b-e873-4bb2-b660-91cf256329ed\") " pod="openshift-monitoring/telemeter-client-79786975d5-89z7z"
Jul 10 02:12:31.451203 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.451130    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e269305b-e873-4bb2-b660-91cf256329ed-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-79786975d5-89z7z\" (UID: \"e269305b-e873-4bb2-b660-91cf256329ed\") " pod="openshift-monitoring/telemeter-client-79786975d5-89z7z"
Jul 10 02:12:31.451203 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.451167    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e269305b-e873-4bb2-b660-91cf256329ed-metrics-client-ca\") pod \"telemeter-client-79786975d5-89z7z\" (UID: \"e269305b-e873-4bb2-b660-91cf256329ed\") " pod="openshift-monitoring/telemeter-client-79786975d5-89z7z"
Jul 10 02:12:31.451203 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.451187    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e269305b-e873-4bb2-b660-91cf256329ed-telemeter-trusted-ca-bundle\") pod \"telemeter-client-79786975d5-89z7z\" (UID: \"e269305b-e873-4bb2-b660-91cf256329ed\") " pod="openshift-monitoring/telemeter-client-79786975d5-89z7z"
Jul 10 02:12:31.451414 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.451244    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e269305b-e873-4bb2-b660-91cf256329ed-secret-telemeter-client\") pod \"telemeter-client-79786975d5-89z7z\" (UID: \"e269305b-e873-4bb2-b660-91cf256329ed\") " pod="openshift-monitoring/telemeter-client-79786975d5-89z7z"
Jul 10 02:12:31.451414 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.451277    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e269305b-e873-4bb2-b660-91cf256329ed-federate-client-tls\") pod \"telemeter-client-79786975d5-89z7z\" (UID: \"e269305b-e873-4bb2-b660-91cf256329ed\") " pod="openshift-monitoring/telemeter-client-79786975d5-89z7z"
Jul 10 02:12:31.497539 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.497496    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth" event={"ID":"b622a8a0-d0e8-4c36-a2bc-a373194624cf","Type":"ContainerStarted","Data":"22f45fc6426404541530489d2bceb73508a41714cc35aeb491ecff036168e07c"}
Jul 10 02:12:31.498001 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.497570    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth" event={"ID":"b622a8a0-d0e8-4c36-a2bc-a373194624cf","Type":"ContainerStarted","Data":"740aa6ddb275305ab89cd8962a64c7a3ecbbc162063462f80cf1e66842cf589f"}
Jul 10 02:12:31.552493 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.552426    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e269305b-e873-4bb2-b660-91cf256329ed-secret-telemeter-client\") pod \"telemeter-client-79786975d5-89z7z\" (UID: \"e269305b-e873-4bb2-b660-91cf256329ed\") " pod="openshift-monitoring/telemeter-client-79786975d5-89z7z"
Jul 10 02:12:31.552657 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.552509    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e269305b-e873-4bb2-b660-91cf256329ed-federate-client-tls\") pod \"telemeter-client-79786975d5-89z7z\" (UID: \"e269305b-e873-4bb2-b660-91cf256329ed\") " pod="openshift-monitoring/telemeter-client-79786975d5-89z7z"
Jul 10 02:12:31.552657 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.552562    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e269305b-e873-4bb2-b660-91cf256329ed-serving-certs-ca-bundle\") pod \"telemeter-client-79786975d5-89z7z\" (UID: \"e269305b-e873-4bb2-b660-91cf256329ed\") " pod="openshift-monitoring/telemeter-client-79786975d5-89z7z"
Jul 10 02:12:31.552657 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.552613    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsshd\" (UniqueName: \"kubernetes.io/projected/e269305b-e873-4bb2-b660-91cf256329ed-kube-api-access-gsshd\") pod \"telemeter-client-79786975d5-89z7z\" (UID: \"e269305b-e873-4bb2-b660-91cf256329ed\") " pod="openshift-monitoring/telemeter-client-79786975d5-89z7z"
Jul 10 02:12:31.552657 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.552652    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e269305b-e873-4bb2-b660-91cf256329ed-telemeter-client-tls\") pod \"telemeter-client-79786975d5-89z7z\" (UID: \"e269305b-e873-4bb2-b660-91cf256329ed\") " pod="openshift-monitoring/telemeter-client-79786975d5-89z7z"
Jul 10 02:12:31.552887 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.552675    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e269305b-e873-4bb2-b660-91cf256329ed-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-79786975d5-89z7z\" (UID: \"e269305b-e873-4bb2-b660-91cf256329ed\") " pod="openshift-monitoring/telemeter-client-79786975d5-89z7z"
Jul 10 02:12:31.552887 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.552708    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e269305b-e873-4bb2-b660-91cf256329ed-metrics-client-ca\") pod \"telemeter-client-79786975d5-89z7z\" (UID: \"e269305b-e873-4bb2-b660-91cf256329ed\") " pod="openshift-monitoring/telemeter-client-79786975d5-89z7z"
Jul 10 02:12:31.552887 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.552732    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e269305b-e873-4bb2-b660-91cf256329ed-telemeter-trusted-ca-bundle\") pod \"telemeter-client-79786975d5-89z7z\" (UID: \"e269305b-e873-4bb2-b660-91cf256329ed\") " pod="openshift-monitoring/telemeter-client-79786975d5-89z7z"
Jul 10 02:12:31.553475 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.553423    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e269305b-e873-4bb2-b660-91cf256329ed-serving-certs-ca-bundle\") pod \"telemeter-client-79786975d5-89z7z\" (UID: \"e269305b-e873-4bb2-b660-91cf256329ed\") " pod="openshift-monitoring/telemeter-client-79786975d5-89z7z"
Jul 10 02:12:31.553678 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.553635    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e269305b-e873-4bb2-b660-91cf256329ed-telemeter-trusted-ca-bundle\") pod \"telemeter-client-79786975d5-89z7z\" (UID: \"e269305b-e873-4bb2-b660-91cf256329ed\") " pod="openshift-monitoring/telemeter-client-79786975d5-89z7z"
Jul 10 02:12:31.554262 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.554229    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e269305b-e873-4bb2-b660-91cf256329ed-metrics-client-ca\") pod \"telemeter-client-79786975d5-89z7z\" (UID: \"e269305b-e873-4bb2-b660-91cf256329ed\") " pod="openshift-monitoring/telemeter-client-79786975d5-89z7z"
Jul 10 02:12:31.555518 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.555463    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e269305b-e873-4bb2-b660-91cf256329ed-secret-telemeter-client\") pod \"telemeter-client-79786975d5-89z7z\" (UID: \"e269305b-e873-4bb2-b660-91cf256329ed\") " pod="openshift-monitoring/telemeter-client-79786975d5-89z7z"
Jul 10 02:12:31.555614 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.555555    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e269305b-e873-4bb2-b660-91cf256329ed-telemeter-client-tls\") pod \"telemeter-client-79786975d5-89z7z\" (UID: \"e269305b-e873-4bb2-b660-91cf256329ed\") " pod="openshift-monitoring/telemeter-client-79786975d5-89z7z"
Jul 10 02:12:31.555614 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.555581    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e269305b-e873-4bb2-b660-91cf256329ed-federate-client-tls\") pod \"telemeter-client-79786975d5-89z7z\" (UID: \"e269305b-e873-4bb2-b660-91cf256329ed\") " pod="openshift-monitoring/telemeter-client-79786975d5-89z7z"
Jul 10 02:12:31.555825 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.555801    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e269305b-e873-4bb2-b660-91cf256329ed-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-79786975d5-89z7z\" (UID: \"e269305b-e873-4bb2-b660-91cf256329ed\") " pod="openshift-monitoring/telemeter-client-79786975d5-89z7z"
Jul 10 02:12:31.562771 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.562752    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsshd\" (UniqueName: \"kubernetes.io/projected/e269305b-e873-4bb2-b660-91cf256329ed-kube-api-access-gsshd\") pod \"telemeter-client-79786975d5-89z7z\" (UID: \"e269305b-e873-4bb2-b660-91cf256329ed\") " pod="openshift-monitoring/telemeter-client-79786975d5-89z7z"
Jul 10 02:12:31.649708 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.649661    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-79786975d5-89z7z"
Jul 10 02:12:31.804338 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:31.804272    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-79786975d5-89z7z"]
Jul 10 02:12:31.806394 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:12:31.806371    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode269305b_e873_4bb2_b660_91cf256329ed.slice/crio-ce1f5ada24fc53511b5cf10b325153c9e33ef28c79fed8aa883cc5a5adacbb57 WatchSource:0}: Error finding container ce1f5ada24fc53511b5cf10b325153c9e33ef28c79fed8aa883cc5a5adacbb57: Status 404 returned error can't find the container with id ce1f5ada24fc53511b5cf10b325153c9e33ef28c79fed8aa883cc5a5adacbb57
Jul 10 02:12:32.402587 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.402555    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:12:32.406411 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.406386    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.409878 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.409857    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 10 02:12:32.409878 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.409860    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 10 02:12:32.410094 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.409930    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5grrepu8mldnl\""
Jul 10 02:12:32.410151 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.410134    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 10 02:12:32.410234 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.410134    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 10 02:12:32.410299 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.410136    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 10 02:12:32.410355 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.410219    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 10 02:12:32.410355 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.410310    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 10 02:12:32.410591 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.410572    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 10 02:12:32.410658 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.410601    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ng78g\""
Jul 10 02:12:32.410658 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.410639    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 10 02:12:32.411596 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.411577    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 10 02:12:32.411690 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.411660    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 10 02:12:32.411811 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.411796    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 10 02:12:32.411869 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.411855    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 10 02:12:32.413835 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.413663    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 10 02:12:32.418477 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.418458    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 10 02:12:32.424838 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.424817    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:12:32.462997 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.462955    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.463210 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.463015    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50830e83-234c-4622-a682-b21d5249f234-config-out\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.463210 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.463061    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/50830e83-234c-4622-a682-b21d5249f234-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.463210 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.463100    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.463210 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.463137    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.463210 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.463160    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.463451 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.463209    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.463451 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.463267    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.463451 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.463294    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-web-config\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.463451 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.463328    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-config\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.463451 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.463351    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.463451 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.463391    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.463451 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.463415    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50830e83-234c-4622-a682-b21d5249f234-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.463451 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.463432    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.463451 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.463448    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.463935 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.463477    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.463935 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.463498    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.463935 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.463514    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.463935 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.463541    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjnsj\" (UniqueName: \"kubernetes.io/projected/50830e83-234c-4622-a682-b21d5249f234-kube-api-access-jjnsj\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.463935 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.463632    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.507198 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.507163    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79786975d5-89z7z" event={"ID":"e269305b-e873-4bb2-b660-91cf256329ed","Type":"ContainerStarted","Data":"ce1f5ada24fc53511b5cf10b325153c9e33ef28c79fed8aa883cc5a5adacbb57"}
Jul 10 02:12:32.511079 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.510981    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc","Type":"ContainerStarted","Data":"c61cd71281e345ed3472a07000ef2c464bc796815bb15975485df70327be4368"}
Jul 10 02:12:32.511079 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.511067    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc","Type":"ContainerStarted","Data":"5761468b2cd05bbf75d872e8c8c2d28cd8c94719071d71d2427d8bb48406b1d5"}
Jul 10 02:12:32.511249 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.511108    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc","Type":"ContainerStarted","Data":"1a8f6e97543f42bc4687acc67bdce99cfca42642b8e8213d2bebb934da39a3cc"}
Jul 10 02:12:32.511249 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.511133    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc","Type":"ContainerStarted","Data":"c9d8b8c54a75f7844f7e53f0b80f7615a939c55c84db57e7e84c9740bdfab1a1"}
Jul 10 02:12:32.511249 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.511155    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc","Type":"ContainerStarted","Data":"9c6b0620c932c0877ed13d461ba8f5c60c7bd6236df1ee940cab3aa187b2111e"}
Jul 10 02:12:32.511249 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.511184    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc","Type":"ContainerStarted","Data":"e3a338d3fef00e3b18ec2115f2375998489620ae399f84c8b06046d200eee902"}
Jul 10 02:12:32.514379 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.514307    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth" event={"ID":"b622a8a0-d0e8-4c36-a2bc-a373194624cf","Type":"ContainerStarted","Data":"589139f9854a026b806950c1f7e48d8dd8fcce4a8aba6be6c9e2da5d9799d8cc"}
Jul 10 02:12:32.514379 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.514374    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth" event={"ID":"b622a8a0-d0e8-4c36-a2bc-a373194624cf","Type":"ContainerStarted","Data":"1ca4d15d94057d9dc8347187f145c031472ab3c291f1b7f4048fd56d0cb063d2"}
Jul 10 02:12:32.514520 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.514412    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth" event={"ID":"b622a8a0-d0e8-4c36-a2bc-a373194624cf","Type":"ContainerStarted","Data":"c20a130812591b3b4a5b028149bbf10cc08be7f8ece42056725933caddba1f3e"}
Jul 10 02:12:32.514659 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.514639    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:32.534351 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.534332    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:12:32.539881 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.539839    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.235359817 podStartE2EDuration="5.539826744s" totalImagesPullingTime="3.289642631s" totalInitContainerRuntime="14.824296ms" isStatefulPod=false podCreationTimestamp="2026-07-10 02:12:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:12:32.536530528 +0000 UTC m=+281.302442754" watchObservedRunningTime="2026-07-10 02:12:32.539826744 +0000 UTC m=+281.305738976"
Jul 10 02:12:32.565413 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.564813    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.565568 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.565445    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.566184 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.565745    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.566184 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.566129    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.566184 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.565476    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.566413 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.566234    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.566599 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.566262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-web-config\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.566656 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.566646    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-config\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.566716 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.566672    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.570424 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.567056    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.570424 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.567092    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50830e83-234c-4622-a682-b21d5249f234-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.570424 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.567118    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.570424 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.567142    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.570424 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.567228    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.570424 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.567278    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.570424 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.567302    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.570424 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.567302    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.570424 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.568178    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjnsj\" (UniqueName: \"kubernetes.io/projected/50830e83-234c-4622-a682-b21d5249f234-kube-api-access-jjnsj\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.570424 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.568206    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.570424 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.568256    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.570424 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.568303    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.570424 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.568361    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50830e83-234c-4622-a682-b21d5249f234-config-out\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.570424 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.568390    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/50830e83-234c-4622-a682-b21d5249f234-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.570424 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.568523    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.571322 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.571289    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.571657 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.571553    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.573470 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.573123    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.573470 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.573385    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/50830e83-234c-4622-a682-b21d5249f234-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.579230 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.579181    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.580460 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.579920    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.580460 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.580175    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.580460 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.580181    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-config\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.580460 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.580392    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.580722 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.580580    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.582047 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.581972    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.582529 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.582287    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50830e83-234c-4622-a682-b21d5249f234-config-out\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.583759 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.582951    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50830e83-234c-4622-a682-b21d5249f234-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.583759 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.583076    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-web-config\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.583759 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.583700    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjnsj\" (UniqueName: \"kubernetes.io/projected/50830e83-234c-4622-a682-b21d5249f234-kube-api-access-jjnsj\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.584930 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.584537    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.718100 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.717996    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:32.879776 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.879745    2576 patch_prober.go:28] interesting pod/image-registry-749655cb8c-htw78 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 10 02:12:32.879909 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.879798    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-749655cb8c-htw78" podUID="37215647-0029-42ce-a079-cf630e544aed" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 02:12:32.892137 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.891224    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth" podStartSLOduration=2.220544926 podStartE2EDuration="4.891204506s" totalImagesPullingTime="2.67065958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:12:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:12:32.584864637 +0000 UTC m=+281.350776870" watchObservedRunningTime="2026-07-10 02:12:32.891204506 +0000 UTC m=+281.657116738"
Jul 10 02:12:32.892137 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:32.892055    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:12:32.894087 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:12:32.894064    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50830e83_234c_4622_a682_b21d5249f234.slice/crio-99ef88f45aed5ad2e016ca0c42b2a8c5c66c44e84ac7ad4af4e1a08c0ddc872f WatchSource:0}: Error finding container 99ef88f45aed5ad2e016ca0c42b2a8c5c66c44e84ac7ad4af4e1a08c0ddc872f: Status 404 returned error can't find the container with id 99ef88f45aed5ad2e016ca0c42b2a8c5c66c44e84ac7ad4af4e1a08c0ddc872f
Jul 10 02:12:33.523354 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:33.523322    2576 generic.go:356] "Generic (PLEG): container finished" podID="50830e83-234c-4622-a682-b21d5249f234" containerID="18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492" exitCode=0
Jul 10 02:12:33.523778 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:33.523413    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50830e83-234c-4622-a682-b21d5249f234","Type":"ContainerDied","Data":"18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492"}
Jul 10 02:12:33.523778 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:33.523492    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50830e83-234c-4622-a682-b21d5249f234","Type":"ContainerStarted","Data":"99ef88f45aed5ad2e016ca0c42b2a8c5c66c44e84ac7ad4af4e1a08c0ddc872f"}
Jul 10 02:12:34.419371 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:34.419345    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-749655cb8c-htw78"
Jul 10 02:12:34.530221 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:34.530185    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79786975d5-89z7z" event={"ID":"e269305b-e873-4bb2-b660-91cf256329ed","Type":"ContainerStarted","Data":"ce02788464f37468672e24914888dc2df725cab4b5ee827078ee49fb8d39c347"}
Jul 10 02:12:34.530619 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:34.530251    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79786975d5-89z7z" event={"ID":"e269305b-e873-4bb2-b660-91cf256329ed","Type":"ContainerStarted","Data":"069fc9e14a899081954a089dce27cd490560a8ec6767e955cbcca4ef79ea7310"}
Jul 10 02:12:34.530619 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:34.530276    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79786975d5-89z7z" event={"ID":"e269305b-e873-4bb2-b660-91cf256329ed","Type":"ContainerStarted","Data":"c35132704c4e57792b7f86cad8eadd7c26302c60b876dcb3d01eb83d6ac6ecda"}
Jul 10 02:12:34.566021 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:34.565971    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-79786975d5-89z7z" podStartSLOduration=1.291693288 podStartE2EDuration="3.565954154s" totalImagesPullingTime="2.274260866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:12:34.565584835 +0000 UTC m=+283.331497080" watchObservedRunningTime="2026-07-10 02:12:34.565954154 +0000 UTC m=+283.331866387"
Jul 10 02:12:35.123110 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:12:35.123069    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cdrpn" podUID="2de5e788-9b05-474d-9225-752dc7d291a6"
Jul 10 02:12:35.535660 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:35.535567    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:12:37.547859 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:37.547802    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7464fbc79c-59k4p" podUID="5f363ba9-996c-4350-8d76-4f039314fec2" containerName="registry" containerID="cri-o://e08b906779a708941beae15ff33927a3563d88f1a391b5193ad6773dcfdbd15b" gracePeriod=30
Jul 10 02:12:37.797196 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:37.797164    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:12:37.925338 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:37.925315    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-registry-tls\") pod \"5f363ba9-996c-4350-8d76-4f039314fec2\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") "
Jul 10 02:12:37.925429 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:37.925362    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lr78m\" (UniqueName: \"kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-kube-api-access-lr78m\") pod \"5f363ba9-996c-4350-8d76-4f039314fec2\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") "
Jul 10 02:12:37.925511 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:37.925493    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-bound-sa-token\") pod \"5f363ba9-996c-4350-8d76-4f039314fec2\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") "
Jul 10 02:12:37.925564 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:37.925549    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5f363ba9-996c-4350-8d76-4f039314fec2-registry-certificates\") pod \"5f363ba9-996c-4350-8d76-4f039314fec2\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") "
Jul 10 02:12:37.925613 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:37.925586    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5f363ba9-996c-4350-8d76-4f039314fec2-image-registry-private-configuration\") pod \"5f363ba9-996c-4350-8d76-4f039314fec2\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") "
Jul 10 02:12:37.925667 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:37.925622    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5f363ba9-996c-4350-8d76-4f039314fec2-installation-pull-secrets\") pod \"5f363ba9-996c-4350-8d76-4f039314fec2\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") "
Jul 10 02:12:37.925667 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:37.925649    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5f363ba9-996c-4350-8d76-4f039314fec2-ca-trust-extracted\") pod \"5f363ba9-996c-4350-8d76-4f039314fec2\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") "
Jul 10 02:12:37.925776 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:37.925710    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5f363ba9-996c-4350-8d76-4f039314fec2-trusted-ca\") pod \"5f363ba9-996c-4350-8d76-4f039314fec2\" (UID: \"5f363ba9-996c-4350-8d76-4f039314fec2\") "
Jul 10 02:12:37.926493 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:37.925975    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f363ba9-996c-4350-8d76-4f039314fec2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5f363ba9-996c-4350-8d76-4f039314fec2" (UID: "5f363ba9-996c-4350-8d76-4f039314fec2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:12:37.926493 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:37.926445    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f363ba9-996c-4350-8d76-4f039314fec2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5f363ba9-996c-4350-8d76-4f039314fec2" (UID: "5f363ba9-996c-4350-8d76-4f039314fec2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:12:37.928157 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:37.928129    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5f363ba9-996c-4350-8d76-4f039314fec2" (UID: "5f363ba9-996c-4350-8d76-4f039314fec2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:12:37.928250 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:37.928149    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-kube-api-access-lr78m" (OuterVolumeSpecName: "kube-api-access-lr78m") pod "5f363ba9-996c-4350-8d76-4f039314fec2" (UID: "5f363ba9-996c-4350-8d76-4f039314fec2"). InnerVolumeSpecName "kube-api-access-lr78m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:12:37.929836 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:37.929811    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5f363ba9-996c-4350-8d76-4f039314fec2" (UID: "5f363ba9-996c-4350-8d76-4f039314fec2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:12:37.930185 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:37.930117    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f363ba9-996c-4350-8d76-4f039314fec2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5f363ba9-996c-4350-8d76-4f039314fec2" (UID: "5f363ba9-996c-4350-8d76-4f039314fec2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:12:37.930556 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:37.930529    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f363ba9-996c-4350-8d76-4f039314fec2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5f363ba9-996c-4350-8d76-4f039314fec2" (UID: "5f363ba9-996c-4350-8d76-4f039314fec2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:12:37.937307 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:37.937288    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f363ba9-996c-4350-8d76-4f039314fec2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5f363ba9-996c-4350-8d76-4f039314fec2" (UID: "5f363ba9-996c-4350-8d76-4f039314fec2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:12:38.026976 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.026953    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-registry-tls\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:12:38.027108 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.026980    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lr78m\" (UniqueName: \"kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-kube-api-access-lr78m\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:12:38.027108 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.026995    2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f363ba9-996c-4350-8d76-4f039314fec2-bound-sa-token\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:12:38.027108 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.027004    2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5f363ba9-996c-4350-8d76-4f039314fec2-registry-certificates\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:12:38.027108 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.027014    2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5f363ba9-996c-4350-8d76-4f039314fec2-image-registry-private-configuration\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:12:38.027108 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.027036    2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5f363ba9-996c-4350-8d76-4f039314fec2-installation-pull-secrets\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:12:38.027108 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.027048    2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5f363ba9-996c-4350-8d76-4f039314fec2-ca-trust-extracted\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:12:38.027108 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.027056    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5f363ba9-996c-4350-8d76-4f039314fec2-trusted-ca\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:12:38.429957 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.429922    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls\") pod \"dns-default-cdrpn\" (UID: \"2de5e788-9b05-474d-9225-752dc7d291a6\") " pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:12:38.432181 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.432144    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2de5e788-9b05-474d-9225-752dc7d291a6-metrics-tls\") pod \"dns-default-cdrpn\" (UID: \"2de5e788-9b05-474d-9225-752dc7d291a6\") " pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:12:38.530640 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.530613    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-856fbf494b-qfdth"
Jul 10 02:12:38.538870 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.538848    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g8kf5\""
Jul 10 02:12:38.546178 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.546141    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:12:38.549132 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.549100    2576 generic.go:356] "Generic (PLEG): container finished" podID="5f363ba9-996c-4350-8d76-4f039314fec2" containerID="e08b906779a708941beae15ff33927a3563d88f1a391b5193ad6773dcfdbd15b" exitCode=0
Jul 10 02:12:38.549489 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.549144    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7464fbc79c-59k4p"
Jul 10 02:12:38.549489 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.549219    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7464fbc79c-59k4p" event={"ID":"5f363ba9-996c-4350-8d76-4f039314fec2","Type":"ContainerDied","Data":"e08b906779a708941beae15ff33927a3563d88f1a391b5193ad6773dcfdbd15b"}
Jul 10 02:12:38.549489 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.549268    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7464fbc79c-59k4p" event={"ID":"5f363ba9-996c-4350-8d76-4f039314fec2","Type":"ContainerDied","Data":"8c10103a5b933fd0aa2a37ec3433adf4a0d8384be937c39015cde7378beffaab"}
Jul 10 02:12:38.549489 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.549295    2576 scope.go:117] "RemoveContainer" containerID="e08b906779a708941beae15ff33927a3563d88f1a391b5193ad6773dcfdbd15b"
Jul 10 02:12:38.553309 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.553285    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50830e83-234c-4622-a682-b21d5249f234","Type":"ContainerStarted","Data":"afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55"}
Jul 10 02:12:38.553420 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.553355    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50830e83-234c-4622-a682-b21d5249f234","Type":"ContainerStarted","Data":"7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe"}
Jul 10 02:12:38.553420 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.553407    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50830e83-234c-4622-a682-b21d5249f234","Type":"ContainerStarted","Data":"79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4"}
Jul 10 02:12:38.553506 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.553449    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50830e83-234c-4622-a682-b21d5249f234","Type":"ContainerStarted","Data":"97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c"}
Jul 10 02:12:38.553506 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.553494    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50830e83-234c-4622-a682-b21d5249f234","Type":"ContainerStarted","Data":"cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11"}
Jul 10 02:12:38.553590 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.553532    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50830e83-234c-4622-a682-b21d5249f234","Type":"ContainerStarted","Data":"2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b"}
Jul 10 02:12:38.559797 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.559778    2576 scope.go:117] "RemoveContainer" containerID="e08b906779a708941beae15ff33927a3563d88f1a391b5193ad6773dcfdbd15b"
Jul 10 02:12:38.560160 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:12:38.560131    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e08b906779a708941beae15ff33927a3563d88f1a391b5193ad6773dcfdbd15b\": container with ID starting with e08b906779a708941beae15ff33927a3563d88f1a391b5193ad6773dcfdbd15b not found: ID does not exist" containerID="e08b906779a708941beae15ff33927a3563d88f1a391b5193ad6773dcfdbd15b"
Jul 10 02:12:38.560256 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.560169    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e08b906779a708941beae15ff33927a3563d88f1a391b5193ad6773dcfdbd15b"} err="failed to get container status \"e08b906779a708941beae15ff33927a3563d88f1a391b5193ad6773dcfdbd15b\": rpc error: code = NotFound desc = could not find container \"e08b906779a708941beae15ff33927a3563d88f1a391b5193ad6773dcfdbd15b\": container with ID starting with e08b906779a708941beae15ff33927a3563d88f1a391b5193ad6773dcfdbd15b not found: ID does not exist"
Jul 10 02:12:38.583756 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.583337    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.6053962889999998 podStartE2EDuration="6.583317582s" totalImagesPullingTime="3.961412606s" totalInitContainerRuntime="16.508687ms" isStatefulPod=false podCreationTimestamp="2026-07-10 02:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:12:38.582234117 +0000 UTC m=+287.348146350" watchObservedRunningTime="2026-07-10 02:12:38.583317582 +0000 UTC m=+287.349229814"
Jul 10 02:12:38.602236 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.602213    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7464fbc79c-59k4p"]
Jul 10 02:12:38.609269 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.609241    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7464fbc79c-59k4p"]
Jul 10 02:12:38.712648 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:38.712621    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cdrpn"]
Jul 10 02:12:38.713847 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:12:38.713818    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2de5e788_9b05_474d_9225_752dc7d291a6.slice/crio-f47c9e2b6cc6cf8bf25ba57ea27f6d5a9cdc9041b401f64fd08bbe42fd337ab5 WatchSource:0}: Error finding container f47c9e2b6cc6cf8bf25ba57ea27f6d5a9cdc9041b401f64fd08bbe42fd337ab5: Status 404 returned error can't find the container with id f47c9e2b6cc6cf8bf25ba57ea27f6d5a9cdc9041b401f64fd08bbe42fd337ab5
Jul 10 02:12:39.564074 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:39.564020    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cdrpn" event={"ID":"2de5e788-9b05-474d-9225-752dc7d291a6","Type":"ContainerStarted","Data":"f47c9e2b6cc6cf8bf25ba57ea27f6d5a9cdc9041b401f64fd08bbe42fd337ab5"}
Jul 10 02:12:40.539656 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:40.539629    2576 scope.go:117] "RemoveContainer" containerID="989ced6337269827370623231ddcff7f04102575216ee4d53ceae93bf8aee2c9"
Jul 10 02:12:40.547419 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:40.547306    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f363ba9-996c-4350-8d76-4f039314fec2" path="/var/lib/kubelet/pods/5f363ba9-996c-4350-8d76-4f039314fec2/volumes"
Jul 10 02:12:40.572319 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:40.571715    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cdrpn" event={"ID":"2de5e788-9b05-474d-9225-752dc7d291a6","Type":"ContainerStarted","Data":"206f4974c9da5c8146af68f33323d7702a06c128c7513e7978fc49c8d78279d4"}
Jul 10 02:12:41.578172 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:41.578147    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/2.log"
Jul 10 02:12:41.578552 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:41.578237    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-wlk8h" event={"ID":"b2e5ea06-8452-4568-88b8-d907a1e2c864","Type":"ContainerStarted","Data":"477fb1991536d5ce7cae2e8a96f28c9e087c8e474e1ed3a7855a1d8a4e86c972"}
Jul 10 02:12:41.578552 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:41.578518    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-wlk8h"
Jul 10 02:12:41.580141 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:41.580114    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cdrpn" event={"ID":"2de5e788-9b05-474d-9225-752dc7d291a6","Type":"ContainerStarted","Data":"ace6b4de07bf95943844ccd0cd2dac66f6f5c81cc99bf385e134f7a7d1a844fb"}
Jul 10 02:12:41.580239 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:41.580226    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:12:41.583500 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:41.583479    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-wlk8h"
Jul 10 02:12:41.597533 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:41.597491    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-wlk8h" podStartSLOduration=54.005465697 podStartE2EDuration="56.597478119s" totalImagesPullingTime="2.592012422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:11:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:12:41.596679401 +0000 UTC m=+290.362591635" watchObservedRunningTime="2026-07-10 02:12:41.597478119 +0000 UTC m=+290.363390330"
Jul 10 02:12:41.614448 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:41.614405    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cdrpn" podStartSLOduration=251.888965024 podStartE2EDuration="4m13.614390972s" totalImagesPullingTime="1.725425948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:12:41.613775704 +0000 UTC m=+290.379687935" watchObservedRunningTime="2026-07-10 02:12:41.614390972 +0000 UTC m=+290.380303206"
Jul 10 02:12:42.718121 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:42.718081    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:12:51.585909 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:51.585880    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cdrpn"
Jul 10 02:12:52.389228 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:52.389200    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/2.log"
Jul 10 02:12:52.390206 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:52.390184    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/2.log"
Jul 10 02:12:52.392196 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:52.392178    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt7wb_164f62ad-8b5b-4a66-9bfe-17d863ddeeea/ovn-acl-logging/0.log"
Jul 10 02:12:52.394157 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:52.394137    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt7wb_164f62ad-8b5b-4a66-9bfe-17d863ddeeea/ovn-acl-logging/0.log"
Jul 10 02:12:52.399737 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:12:52.399722    2576 kubelet.go:1648] "Image garbage collection succeeded"
Jul 10 02:13:19.730042 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:19.729994    2576 generic.go:356] "Generic (PLEG): container finished" podID="d28e2125-12b1-44e4-be4e-92556f9092aa" containerID="30c3dfdd478fed047bd5d7eb7cdada70b6d45572e47f73bb9885c2b07a73b5fc" exitCode=0
Jul 10 02:13:19.730430 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:19.730072    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-fsvq7" event={"ID":"d28e2125-12b1-44e4-be4e-92556f9092aa","Type":"ContainerDied","Data":"30c3dfdd478fed047bd5d7eb7cdada70b6d45572e47f73bb9885c2b07a73b5fc"}
Jul 10 02:13:19.730430 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:19.730392    2576 scope.go:117] "RemoveContainer" containerID="30c3dfdd478fed047bd5d7eb7cdada70b6d45572e47f73bb9885c2b07a73b5fc"
Jul 10 02:13:20.735536 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:20.735502    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-fsvq7" event={"ID":"d28e2125-12b1-44e4-be4e-92556f9092aa","Type":"ContainerStarted","Data":"e1c3bc3f5026eef2b295876d0cb6817cf630f2ecec97906653f53da76e880db2"}
Jul 10 02:13:32.718723 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:32.718687    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:32.738348 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:32.738322    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:32.795621 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:32.795594    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:46.564045 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:46.563954    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:13:46.564514 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:46.564298    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerName="alertmanager" containerID="cri-o://e3a338d3fef00e3b18ec2115f2375998489620ae399f84c8b06046d200eee902" gracePeriod=120
Jul 10 02:13:46.564514 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:46.564346    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerName="kube-rbac-proxy-metric" containerID="cri-o://5761468b2cd05bbf75d872e8c8c2d28cd8c94719071d71d2427d8bb48406b1d5" gracePeriod=120
Jul 10 02:13:46.564514 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:46.564354    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerName="kube-rbac-proxy-web" containerID="cri-o://c9d8b8c54a75f7844f7e53f0b80f7615a939c55c84db57e7e84c9740bdfab1a1" gracePeriod=120
Jul 10 02:13:46.564514 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:46.564402    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerName="config-reloader" containerID="cri-o://9c6b0620c932c0877ed13d461ba8f5c60c7bd6236df1ee940cab3aa187b2111e" gracePeriod=120
Jul 10 02:13:46.564514 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:46.564449    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerName="kube-rbac-proxy" containerID="cri-o://1a8f6e97543f42bc4687acc67bdce99cfca42642b8e8213d2bebb934da39a3cc" gracePeriod=120
Jul 10 02:13:46.564514 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:46.564403    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerName="prom-label-proxy" containerID="cri-o://c61cd71281e345ed3472a07000ef2c464bc796815bb15975485df70327be4368" gracePeriod=120
Jul 10 02:13:46.839655 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:46.839573    2576 generic.go:356] "Generic (PLEG): container finished" podID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerID="c61cd71281e345ed3472a07000ef2c464bc796815bb15975485df70327be4368" exitCode=0
Jul 10 02:13:46.839655 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:46.839597    2576 generic.go:356] "Generic (PLEG): container finished" podID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerID="1a8f6e97543f42bc4687acc67bdce99cfca42642b8e8213d2bebb934da39a3cc" exitCode=0
Jul 10 02:13:46.839655 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:46.839604    2576 generic.go:356] "Generic (PLEG): container finished" podID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerID="9c6b0620c932c0877ed13d461ba8f5c60c7bd6236df1ee940cab3aa187b2111e" exitCode=0
Jul 10 02:13:46.839655 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:46.839610    2576 generic.go:356] "Generic (PLEG): container finished" podID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerID="e3a338d3fef00e3b18ec2115f2375998489620ae399f84c8b06046d200eee902" exitCode=0
Jul 10 02:13:46.839655 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:46.839641    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc","Type":"ContainerDied","Data":"c61cd71281e345ed3472a07000ef2c464bc796815bb15975485df70327be4368"}
Jul 10 02:13:46.839911 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:46.839703    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc","Type":"ContainerDied","Data":"1a8f6e97543f42bc4687acc67bdce99cfca42642b8e8213d2bebb934da39a3cc"}
Jul 10 02:13:46.839911 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:46.839729    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc","Type":"ContainerDied","Data":"9c6b0620c932c0877ed13d461ba8f5c60c7bd6236df1ee940cab3aa187b2111e"}
Jul 10 02:13:46.839911 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:46.839752    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc","Type":"ContainerDied","Data":"e3a338d3fef00e3b18ec2115f2375998489620ae399f84c8b06046d200eee902"}
Jul 10 02:13:47.848019 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.847983    2576 generic.go:356] "Generic (PLEG): container finished" podID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerID="5761468b2cd05bbf75d872e8c8c2d28cd8c94719071d71d2427d8bb48406b1d5" exitCode=0
Jul 10 02:13:47.848019 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.848015    2576 generic.go:356] "Generic (PLEG): container finished" podID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerID="c9d8b8c54a75f7844f7e53f0b80f7615a939c55c84db57e7e84c9740bdfab1a1" exitCode=0
Jul 10 02:13:47.848427 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.848063    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc","Type":"ContainerDied","Data":"5761468b2cd05bbf75d872e8c8c2d28cd8c94719071d71d2427d8bb48406b1d5"}
Jul 10 02:13:47.848427 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.848147    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc","Type":"ContainerDied","Data":"c9d8b8c54a75f7844f7e53f0b80f7615a939c55c84db57e7e84c9740bdfab1a1"}
Jul 10 02:13:47.902971 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.902949    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:47.941363 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.941327    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") "
Jul 10 02:13:47.941534 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.941371    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-config-out\") pod \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") "
Jul 10 02:13:47.941534 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.941401    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-alertmanager-trusted-ca-bundle\") pod \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") "
Jul 10 02:13:47.941534 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.941429    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-secret-alertmanager-kube-rbac-proxy-web\") pod \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") "
Jul 10 02:13:47.941534 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.941452    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-web-config\") pod \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") "
Jul 10 02:13:47.941534 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.941483    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-alertmanager-main-db\") pod \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") "
Jul 10 02:13:47.941534 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.941508    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-metrics-client-ca\") pod \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") "
Jul 10 02:13:47.941834 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.941550    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-config-volume\") pod \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") "
Jul 10 02:13:47.941834 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.941576    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-tls-assets\") pod \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") "
Jul 10 02:13:47.941834 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.941619    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-secret-alertmanager-kube-rbac-proxy\") pod \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") "
Jul 10 02:13:47.941834 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.941655    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-cluster-tls-config\") pod \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") "
Jul 10 02:13:47.941834 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.941694    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-secret-alertmanager-main-tls\") pod \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") "
Jul 10 02:13:47.942100 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.941866    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" (UID: "5e28e33e-cfd2-4b83-863d-4ce9abadbcdc"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:13:47.942100 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.941973    2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:47.943009 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.942338    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" (UID: "5e28e33e-cfd2-4b83-863d-4ce9abadbcdc"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:13:47.943009 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.942790    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" (UID: "5e28e33e-cfd2-4b83-863d-4ce9abadbcdc"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:13:47.944307 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.944266    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-config-out" (OuterVolumeSpecName: "config-out") pod "5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" (UID: "5e28e33e-cfd2-4b83-863d-4ce9abadbcdc"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:13:47.944429 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.944352    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" (UID: "5e28e33e-cfd2-4b83-863d-4ce9abadbcdc"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:13:47.946261 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.946234    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" (UID: "5e28e33e-cfd2-4b83-863d-4ce9abadbcdc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:13:47.946611 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.946583    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" (UID: "5e28e33e-cfd2-4b83-863d-4ce9abadbcdc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:13:47.947958 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.947924    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" (UID: "5e28e33e-cfd2-4b83-863d-4ce9abadbcdc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:13:47.948071 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.947987    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-config-volume" (OuterVolumeSpecName: "config-volume") pod "5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" (UID: "5e28e33e-cfd2-4b83-863d-4ce9abadbcdc"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:13:47.948383 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.948361    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" (UID: "5e28e33e-cfd2-4b83-863d-4ce9abadbcdc"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:13:47.953475 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.953451    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" (UID: "5e28e33e-cfd2-4b83-863d-4ce9abadbcdc"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:13:47.958615 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:47.958594    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-web-config" (OuterVolumeSpecName: "web-config") pod "5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" (UID: "5e28e33e-cfd2-4b83-863d-4ce9abadbcdc"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:13:48.042799 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.042765    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffgqt\" (UniqueName: \"kubernetes.io/projected/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-kube-api-access-ffgqt\") pod \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\" (UID: \"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc\") "
Jul 10 02:13:48.042949 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.042931    2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-config-volume\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:48.042949 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.042942    2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-tls-assets\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:48.043020 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.042951    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:48.043020 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.042960    2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-cluster-tls-config\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:48.043020 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.042970    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-secret-alertmanager-main-tls\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:48.043020 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.042978    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:48.043020 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.042986    2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-config-out\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:48.043020 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.042995    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:48.043020 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.043003    2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-web-config\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:48.043020 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.043011    2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-alertmanager-main-db\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:48.043020 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.043018    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-metrics-client-ca\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:48.044690 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.044668    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-kube-api-access-ffgqt" (OuterVolumeSpecName: "kube-api-access-ffgqt") pod "5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" (UID: "5e28e33e-cfd2-4b83-863d-4ce9abadbcdc"). InnerVolumeSpecName "kube-api-access-ffgqt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:13:48.144369 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.144291    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffgqt\" (UniqueName: \"kubernetes.io/projected/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc-kube-api-access-ffgqt\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:48.854496 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.854416    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e28e33e-cfd2-4b83-863d-4ce9abadbcdc","Type":"ContainerDied","Data":"188362653e5d1184b84fb16e30e96f021165dd37af7b07bee5e8f5a3f7dafcd5"}
Jul 10 02:13:48.854496 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.854446    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:48.854496 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.854489    2576 scope.go:117] "RemoveContainer" containerID="c61cd71281e345ed3472a07000ef2c464bc796815bb15975485df70327be4368"
Jul 10 02:13:48.862053 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.861982    2576 scope.go:117] "RemoveContainer" containerID="5761468b2cd05bbf75d872e8c8c2d28cd8c94719071d71d2427d8bb48406b1d5"
Jul 10 02:13:48.868958 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.868938    2576 scope.go:117] "RemoveContainer" containerID="1a8f6e97543f42bc4687acc67bdce99cfca42642b8e8213d2bebb934da39a3cc"
Jul 10 02:13:48.875526 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.875506    2576 scope.go:117] "RemoveContainer" containerID="c9d8b8c54a75f7844f7e53f0b80f7615a939c55c84db57e7e84c9740bdfab1a1"
Jul 10 02:13:48.882661 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.882637    2576 scope.go:117] "RemoveContainer" containerID="9c6b0620c932c0877ed13d461ba8f5c60c7bd6236df1ee940cab3aa187b2111e"
Jul 10 02:13:48.884640 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.884617    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:13:48.891590 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.891558    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:13:48.894441 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.894424    2576 scope.go:117] "RemoveContainer" containerID="e3a338d3fef00e3b18ec2115f2375998489620ae399f84c8b06046d200eee902"
Jul 10 02:13:48.901592 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.901568    2576 scope.go:117] "RemoveContainer" containerID="cbb24095f9ba7f6ee3f23094d028b5f57afe27507ac1736d7d3e907b20715778"
Jul 10 02:13:48.922245 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.922221    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:13:48.922533 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.922522    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerName="kube-rbac-proxy"
Jul 10 02:13:48.922573 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.922535    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerName="kube-rbac-proxy"
Jul 10 02:13:48.922573 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.922544    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerName="kube-rbac-proxy-metric"
Jul 10 02:13:48.922573 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.922549    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerName="kube-rbac-proxy-metric"
Jul 10 02:13:48.922573 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.922564    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerName="config-reloader"
Jul 10 02:13:48.922573 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.922569    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerName="config-reloader"
Jul 10 02:13:48.922709 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.922577    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerName="init-config-reloader"
Jul 10 02:13:48.922709 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.922582    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerName="init-config-reloader"
Jul 10 02:13:48.922709 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.922589    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerName="kube-rbac-proxy-web"
Jul 10 02:13:48.922709 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.922594    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerName="kube-rbac-proxy-web"
Jul 10 02:13:48.922709 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.922602    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f363ba9-996c-4350-8d76-4f039314fec2" containerName="registry"
Jul 10 02:13:48.922709 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.922608    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f363ba9-996c-4350-8d76-4f039314fec2" containerName="registry"
Jul 10 02:13:48.922709 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.922615    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerName="alertmanager"
Jul 10 02:13:48.922709 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.922620    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerName="alertmanager"
Jul 10 02:13:48.922709 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.922627    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerName="prom-label-proxy"
Jul 10 02:13:48.922709 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.922632    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerName="prom-label-proxy"
Jul 10 02:13:48.922709 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.922672    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f363ba9-996c-4350-8d76-4f039314fec2" containerName="registry"
Jul 10 02:13:48.922709 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.922680    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerName="kube-rbac-proxy"
Jul 10 02:13:48.922709 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.922687    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerName="alertmanager"
Jul 10 02:13:48.922709 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.922694    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerName="config-reloader"
Jul 10 02:13:48.922709 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.922700    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerName="kube-rbac-proxy-metric"
Jul 10 02:13:48.922709 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.922705    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerName="prom-label-proxy"
Jul 10 02:13:48.922709 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.922710    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" containerName="kube-rbac-proxy-web"
Jul 10 02:13:48.926417 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.926400    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:48.930476 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.930457    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 10 02:13:48.930576 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.930457    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 10 02:13:48.930576 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.930501    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 10 02:13:48.930576 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.930510    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 10 02:13:48.930576 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.930525    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rpsmk\""
Jul 10 02:13:48.930831 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.930816    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 10 02:13:48.930831 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.930826    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 10 02:13:48.930932 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.930817    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 10 02:13:48.930932 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.930848    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 10 02:13:48.935933 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.935913    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 10 02:13:48.943475 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.943448    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:13:48.949733 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.949709    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-web-config\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:48.949821 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.949759    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:48.949821 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.949789    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-config-out\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:48.949821 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.949812    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:48.949932 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.949870    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:48.949932 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.949900    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:48.949992 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.949947    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q59qj\" (UniqueName: \"kubernetes.io/projected/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-kube-api-access-q59qj\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:48.950050 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.949993    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:48.950050 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.950019    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:48.950118 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.950084    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:48.950154 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.950116    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:48.950154 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.950144    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-config-volume\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:48.950223 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:48.950165    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.051359 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.051326    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-config-volume\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.051359 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.051359    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.051578 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.051394    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-web-config\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.051578 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.051432    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.051578 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.051455    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-config-out\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.051578 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.051477    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.051578 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.051514    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.051578 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.051542    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.051578 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.051565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q59qj\" (UniqueName: \"kubernetes.io/projected/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-kube-api-access-q59qj\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.051917 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.051614    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.051917 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.051643    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.051917 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.051671    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.051917 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.051703    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.051917 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.051804    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.052413 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.052387    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.053279 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.053218    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.054570 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.054526    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.054752 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.054728    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-config-out\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.054752 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.054741    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.054918 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.054887    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.055356 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.055325    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.055356 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.055351    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-web-config\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.055498 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.055370    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-config-volume\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.055733 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.055711    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.056395 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.056379    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.062956 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.062928    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q59qj\" (UniqueName: \"kubernetes.io/projected/85a84e10-28de-4faa-9fcd-a2a7d24ca78f-kube-api-access-q59qj\") pod \"alertmanager-main-0\" (UID: \"85a84e10-28de-4faa-9fcd-a2a7d24ca78f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.236425 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.236391    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:13:49.368720 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.368571    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:13:49.370683 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:13:49.370662    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85a84e10_28de_4faa_9fcd_a2a7d24ca78f.slice/crio-744309120ae513e703c69c6fb61301da6e063a6929eac8eeab14612ae03484b7 WatchSource:0}: Error finding container 744309120ae513e703c69c6fb61301da6e063a6929eac8eeab14612ae03484b7: Status 404 returned error can't find the container with id 744309120ae513e703c69c6fb61301da6e063a6929eac8eeab14612ae03484b7
Jul 10 02:13:49.860513 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.860453    2576 generic.go:356] "Generic (PLEG): container finished" podID="85a84e10-28de-4faa-9fcd-a2a7d24ca78f" containerID="78a5094faf1854acd8cc593b585cc19906e4f1fc5863a8203de661929127fabc" exitCode=0
Jul 10 02:13:49.860883 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.860549    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85a84e10-28de-4faa-9fcd-a2a7d24ca78f","Type":"ContainerDied","Data":"78a5094faf1854acd8cc593b585cc19906e4f1fc5863a8203de661929127fabc"}
Jul 10 02:13:49.860883 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:49.860617    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85a84e10-28de-4faa-9fcd-a2a7d24ca78f","Type":"ContainerStarted","Data":"744309120ae513e703c69c6fb61301da6e063a6929eac8eeab14612ae03484b7"}
Jul 10 02:13:50.543863 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:50.543787    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e28e33e-cfd2-4b83-863d-4ce9abadbcdc" path="/var/lib/kubelet/pods/5e28e33e-cfd2-4b83-863d-4ce9abadbcdc/volumes"
Jul 10 02:13:50.796886 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:50.796808    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:13:50.797395 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:50.797206    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="50830e83-234c-4622-a682-b21d5249f234" containerName="prometheus" containerID="cri-o://2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b" gracePeriod=600
Jul 10 02:13:50.797395 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:50.797249    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="50830e83-234c-4622-a682-b21d5249f234" containerName="thanos-sidecar" containerID="cri-o://97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c" gracePeriod=600
Jul 10 02:13:50.797395 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:50.797254    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="50830e83-234c-4622-a682-b21d5249f234" containerName="config-reloader" containerID="cri-o://cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11" gracePeriod=600
Jul 10 02:13:50.797395 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:50.797271    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="50830e83-234c-4622-a682-b21d5249f234" containerName="kube-rbac-proxy-web" containerID="cri-o://79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4" gracePeriod=600
Jul 10 02:13:50.797395 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:50.797270    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="50830e83-234c-4622-a682-b21d5249f234" containerName="kube-rbac-proxy-thanos" containerID="cri-o://afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55" gracePeriod=600
Jul 10 02:13:50.797395 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:50.797216    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="50830e83-234c-4622-a682-b21d5249f234" containerName="kube-rbac-proxy" containerID="cri-o://7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe" gracePeriod=600
Jul 10 02:13:50.868731 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:50.868701    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85a84e10-28de-4faa-9fcd-a2a7d24ca78f","Type":"ContainerStarted","Data":"89202438dc2aaf866f7427e465c2e03d625143d9401246db799d5ef7308774a1"}
Jul 10 02:13:50.869178 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:50.868771    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85a84e10-28de-4faa-9fcd-a2a7d24ca78f","Type":"ContainerStarted","Data":"1cc8215d342586909d11df36050d9d28384064a9172c1ed1a0008071039bd174"}
Jul 10 02:13:50.869178 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:50.868797    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85a84e10-28de-4faa-9fcd-a2a7d24ca78f","Type":"ContainerStarted","Data":"fe125bb57ec6040cb0b9bed5edea8ecdb1a5bbeaa77795e296af4c11908da139"}
Jul 10 02:13:50.869178 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:50.868830    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85a84e10-28de-4faa-9fcd-a2a7d24ca78f","Type":"ContainerStarted","Data":"7abd962cdce78a47e0dd2ea35501965527bd8d98bd862d732526799e8b949d52"}
Jul 10 02:13:50.869178 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:50.868859    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85a84e10-28de-4faa-9fcd-a2a7d24ca78f","Type":"ContainerStarted","Data":"b4ca3b5d116c89a3f2667c53a5b4ec749e10ac1badf088869ecb3d118753a4dc"}
Jul 10 02:13:50.869178 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:50.868883    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85a84e10-28de-4faa-9fcd-a2a7d24ca78f","Type":"ContainerStarted","Data":"1c008b3278f7074a9c7632d5d0598ea1840eec61aa7b0760163f035ef19d7fe9"}
Jul 10 02:13:50.897063 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:50.896990    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.880934575 podStartE2EDuration="2.896973817s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.039242ms" isStatefulPod=false podCreationTimestamp="2026-07-10 02:13:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:13:50.895651629 +0000 UTC m=+359.661563862" watchObservedRunningTime="2026-07-10 02:13:50.896973817 +0000 UTC m=+359.662886050"
Jul 10 02:13:51.054921 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.054865    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:51.067636 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.067607    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-configmap-kubelet-serving-ca-bundle\") pod \"50830e83-234c-4622-a682-b21d5249f234\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") "
Jul 10 02:13:51.067782 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.067649    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50830e83-234c-4622-a682-b21d5249f234-tls-assets\") pod \"50830e83-234c-4622-a682-b21d5249f234\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") "
Jul 10 02:13:51.067782 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.067678    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-config\") pod \"50830e83-234c-4622-a682-b21d5249f234\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") "
Jul 10 02:13:51.067981 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.067959    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"50830e83-234c-4622-a682-b21d5249f234\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") "
Jul 10 02:13:51.067981 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.067974    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "50830e83-234c-4622-a682-b21d5249f234" (UID: "50830e83-234c-4622-a682-b21d5249f234"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:13:51.068151 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.067999    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"50830e83-234c-4622-a682-b21d5249f234\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") "
Jul 10 02:13:51.068151 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.068041    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-configmap-serving-certs-ca-bundle\") pod \"50830e83-234c-4622-a682-b21d5249f234\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") "
Jul 10 02:13:51.068151 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.068072    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjnsj\" (UniqueName: \"kubernetes.io/projected/50830e83-234c-4622-a682-b21d5249f234-kube-api-access-jjnsj\") pod \"50830e83-234c-4622-a682-b21d5249f234\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") "
Jul 10 02:13:51.068151 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.068099    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-grpc-tls\") pod \"50830e83-234c-4622-a682-b21d5249f234\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") "
Jul 10 02:13:51.068151 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.068124    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-prometheus-trusted-ca-bundle\") pod \"50830e83-234c-4622-a682-b21d5249f234\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") "
Jul 10 02:13:51.068377 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.068165    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-prometheus-k8s-rulefiles-2\") pod \"50830e83-234c-4622-a682-b21d5249f234\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") "
Jul 10 02:13:51.068377 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.068190    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-prometheus-k8s-rulefiles-1\") pod \"50830e83-234c-4622-a682-b21d5249f234\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") "
Jul 10 02:13:51.068377 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.068214    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-configmap-metrics-client-ca\") pod \"50830e83-234c-4622-a682-b21d5249f234\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") "
Jul 10 02:13:51.068377 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.068243    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/50830e83-234c-4622-a682-b21d5249f234-prometheus-k8s-db\") pod \"50830e83-234c-4622-a682-b21d5249f234\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") "
Jul 10 02:13:51.068377 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.068266    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-metrics-client-certs\") pod \"50830e83-234c-4622-a682-b21d5249f234\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") "
Jul 10 02:13:51.068377 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.068296    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-prometheus-k8s-tls\") pod \"50830e83-234c-4622-a682-b21d5249f234\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") "
Jul 10 02:13:51.068377 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.068356    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50830e83-234c-4622-a682-b21d5249f234-config-out\") pod \"50830e83-234c-4622-a682-b21d5249f234\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") "
Jul 10 02:13:51.068377 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.068356    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "50830e83-234c-4622-a682-b21d5249f234" (UID: "50830e83-234c-4622-a682-b21d5249f234"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:13:51.068760 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.068406    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-prometheus-k8s-rulefiles-0\") pod \"50830e83-234c-4622-a682-b21d5249f234\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") "
Jul 10 02:13:51.068760 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.068435    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-kube-rbac-proxy\") pod \"50830e83-234c-4622-a682-b21d5249f234\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") "
Jul 10 02:13:51.068760 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.068481    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-web-config\") pod \"50830e83-234c-4622-a682-b21d5249f234\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") "
Jul 10 02:13:51.068760 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.068546    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-thanos-prometheus-http-client-file\") pod \"50830e83-234c-4622-a682-b21d5249f234\" (UID: \"50830e83-234c-4622-a682-b21d5249f234\") "
Jul 10 02:13:51.068760 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.068605    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "50830e83-234c-4622-a682-b21d5249f234" (UID: "50830e83-234c-4622-a682-b21d5249f234"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:13:51.068989 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.068832    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:51.068989 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.068851    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:51.068989 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.068866    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:51.069643 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.069611    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "50830e83-234c-4622-a682-b21d5249f234" (UID: "50830e83-234c-4622-a682-b21d5249f234"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:13:51.071141 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.070372    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "50830e83-234c-4622-a682-b21d5249f234" (UID: "50830e83-234c-4622-a682-b21d5249f234"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:13:51.071141 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.070575    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "50830e83-234c-4622-a682-b21d5249f234" (UID: "50830e83-234c-4622-a682-b21d5249f234"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:13:51.071141 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.070646    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "50830e83-234c-4622-a682-b21d5249f234" (UID: "50830e83-234c-4622-a682-b21d5249f234"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:13:51.071141 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.070702    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-config" (OuterVolumeSpecName: "config") pod "50830e83-234c-4622-a682-b21d5249f234" (UID: "50830e83-234c-4622-a682-b21d5249f234"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:13:51.071141 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.070832    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50830e83-234c-4622-a682-b21d5249f234-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "50830e83-234c-4622-a682-b21d5249f234" (UID: "50830e83-234c-4622-a682-b21d5249f234"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:13:51.071440 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.071391    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50830e83-234c-4622-a682-b21d5249f234-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "50830e83-234c-4622-a682-b21d5249f234" (UID: "50830e83-234c-4622-a682-b21d5249f234"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:13:51.071605 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.071576    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "50830e83-234c-4622-a682-b21d5249f234" (UID: "50830e83-234c-4622-a682-b21d5249f234"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:13:51.071793 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.071772    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "50830e83-234c-4622-a682-b21d5249f234" (UID: "50830e83-234c-4622-a682-b21d5249f234"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:13:51.072572 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.072534    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "50830e83-234c-4622-a682-b21d5249f234" (UID: "50830e83-234c-4622-a682-b21d5249f234"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:13:51.072772 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.072737    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "50830e83-234c-4622-a682-b21d5249f234" (UID: "50830e83-234c-4622-a682-b21d5249f234"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:13:51.073044 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.073006    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "50830e83-234c-4622-a682-b21d5249f234" (UID: "50830e83-234c-4622-a682-b21d5249f234"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:13:51.075444 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.075419    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "50830e83-234c-4622-a682-b21d5249f234" (UID: "50830e83-234c-4622-a682-b21d5249f234"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:13:51.075581 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.075437    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "50830e83-234c-4622-a682-b21d5249f234" (UID: "50830e83-234c-4622-a682-b21d5249f234"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:13:51.075581 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.075480    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50830e83-234c-4622-a682-b21d5249f234-config-out" (OuterVolumeSpecName: "config-out") pod "50830e83-234c-4622-a682-b21d5249f234" (UID: "50830e83-234c-4622-a682-b21d5249f234"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:13:51.076247 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.076223    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50830e83-234c-4622-a682-b21d5249f234-kube-api-access-jjnsj" (OuterVolumeSpecName: "kube-api-access-jjnsj") pod "50830e83-234c-4622-a682-b21d5249f234" (UID: "50830e83-234c-4622-a682-b21d5249f234"). InnerVolumeSpecName "kube-api-access-jjnsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:13:51.087185 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.087151    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-web-config" (OuterVolumeSpecName: "web-config") pod "50830e83-234c-4622-a682-b21d5249f234" (UID: "50830e83-234c-4622-a682-b21d5249f234"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:13:51.170113 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.170077    2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-grpc-tls\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:51.170113 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.170110    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:51.170113 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.170121    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:51.170349 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.170130    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-configmap-metrics-client-ca\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:51.170349 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.170139    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/50830e83-234c-4622-a682-b21d5249f234-prometheus-k8s-db\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:51.170349 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.170147    2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-metrics-client-certs\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:51.170349 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.170155    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:51.170349 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.170163    2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50830e83-234c-4622-a682-b21d5249f234-config-out\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:51.170349 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.170173    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/50830e83-234c-4622-a682-b21d5249f234-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:51.170349 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.170181    2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-kube-rbac-proxy\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:51.170349 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.170188    2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-web-config\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:51.170349 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.170196    2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:51.170349 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.170204    2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50830e83-234c-4622-a682-b21d5249f234-tls-assets\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:51.170349 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.170211    2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-config\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:51.170349 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.170219    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:51.170349 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.170228    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/50830e83-234c-4622-a682-b21d5249f234-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:51.170349 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.170236    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjnsj\" (UniqueName: \"kubernetes.io/projected/50830e83-234c-4622-a682-b21d5249f234-kube-api-access-jjnsj\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:13:51.875679 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.875643    2576 generic.go:356] "Generic (PLEG): container finished" podID="50830e83-234c-4622-a682-b21d5249f234" containerID="afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55" exitCode=0
Jul 10 02:13:51.875679 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.875672    2576 generic.go:356] "Generic (PLEG): container finished" podID="50830e83-234c-4622-a682-b21d5249f234" containerID="7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe" exitCode=0
Jul 10 02:13:51.875679 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.875680    2576 generic.go:356] "Generic (PLEG): container finished" podID="50830e83-234c-4622-a682-b21d5249f234" containerID="79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4" exitCode=0
Jul 10 02:13:51.875679 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.875686    2576 generic.go:356] "Generic (PLEG): container finished" podID="50830e83-234c-4622-a682-b21d5249f234" containerID="97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c" exitCode=0
Jul 10 02:13:51.876262 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.875693    2576 generic.go:356] "Generic (PLEG): container finished" podID="50830e83-234c-4622-a682-b21d5249f234" containerID="cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11" exitCode=0
Jul 10 02:13:51.876262 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.875698    2576 generic.go:356] "Generic (PLEG): container finished" podID="50830e83-234c-4622-a682-b21d5249f234" containerID="2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b" exitCode=0
Jul 10 02:13:51.876262 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.875720    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:51.876262 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.875726    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50830e83-234c-4622-a682-b21d5249f234","Type":"ContainerDied","Data":"afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55"}
Jul 10 02:13:51.876262 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.875800    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50830e83-234c-4622-a682-b21d5249f234","Type":"ContainerDied","Data":"7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe"}
Jul 10 02:13:51.876262 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.875840    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50830e83-234c-4622-a682-b21d5249f234","Type":"ContainerDied","Data":"79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4"}
Jul 10 02:13:51.876262 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.875881    2576 scope.go:117] "RemoveContainer" containerID="afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55"
Jul 10 02:13:51.876262 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.875880    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50830e83-234c-4622-a682-b21d5249f234","Type":"ContainerDied","Data":"97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c"}
Jul 10 02:13:51.876262 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.875982    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50830e83-234c-4622-a682-b21d5249f234","Type":"ContainerDied","Data":"cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11"}
Jul 10 02:13:51.876262 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.876021    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50830e83-234c-4622-a682-b21d5249f234","Type":"ContainerDied","Data":"2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b"}
Jul 10 02:13:51.876262 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.876073    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50830e83-234c-4622-a682-b21d5249f234","Type":"ContainerDied","Data":"99ef88f45aed5ad2e016ca0c42b2a8c5c66c44e84ac7ad4af4e1a08c0ddc872f"}
Jul 10 02:13:51.884302 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.884285    2576 scope.go:117] "RemoveContainer" containerID="7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe"
Jul 10 02:13:51.891853 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.891837    2576 scope.go:117] "RemoveContainer" containerID="79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4"
Jul 10 02:13:51.898529 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.898513    2576 scope.go:117] "RemoveContainer" containerID="97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c"
Jul 10 02:13:51.902760 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.902741    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:13:51.905822 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.905791    2576 scope.go:117] "RemoveContainer" containerID="cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11"
Jul 10 02:13:51.908097 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.908078    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:13:51.912816 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.912666    2576 scope.go:117] "RemoveContainer" containerID="2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b"
Jul 10 02:13:51.919764 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.919743    2576 scope.go:117] "RemoveContainer" containerID="18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492"
Jul 10 02:13:51.926784 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.926765    2576 scope.go:117] "RemoveContainer" containerID="afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55"
Jul 10 02:13:51.927012 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:13:51.926994    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55\": container with ID starting with afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55 not found: ID does not exist" containerID="afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55"
Jul 10 02:13:51.927102 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.927049    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55"} err="failed to get container status \"afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55\": rpc error: code = NotFound desc = could not find container \"afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55\": container with ID starting with afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55 not found: ID does not exist"
Jul 10 02:13:51.927102 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.927077    2576 scope.go:117] "RemoveContainer" containerID="7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe"
Jul 10 02:13:51.927344 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:13:51.927326    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe\": container with ID starting with 7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe not found: ID does not exist" containerID="7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe"
Jul 10 02:13:51.927386 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.927351    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe"} err="failed to get container status \"7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe\": rpc error: code = NotFound desc = could not find container \"7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe\": container with ID starting with 7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe not found: ID does not exist"
Jul 10 02:13:51.927386 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.927368    2576 scope.go:117] "RemoveContainer" containerID="79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4"
Jul 10 02:13:51.927591 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:13:51.927574    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4\": container with ID starting with 79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4 not found: ID does not exist" containerID="79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4"
Jul 10 02:13:51.927696 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.927600    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4"} err="failed to get container status \"79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4\": rpc error: code = NotFound desc = could not find container \"79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4\": container with ID starting with 79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4 not found: ID does not exist"
Jul 10 02:13:51.927696 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.927621    2576 scope.go:117] "RemoveContainer" containerID="97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c"
Jul 10 02:13:51.927862 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:13:51.927847    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c\": container with ID starting with 97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c not found: ID does not exist" containerID="97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c"
Jul 10 02:13:51.927907 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.927867    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c"} err="failed to get container status \"97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c\": rpc error: code = NotFound desc = could not find container \"97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c\": container with ID starting with 97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c not found: ID does not exist"
Jul 10 02:13:51.927907 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.927888    2576 scope.go:117] "RemoveContainer" containerID="cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11"
Jul 10 02:13:51.928105 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:13:51.928087    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11\": container with ID starting with cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11 not found: ID does not exist" containerID="cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11"
Jul 10 02:13:51.928201 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.928104    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11"} err="failed to get container status \"cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11\": rpc error: code = NotFound desc = could not find container \"cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11\": container with ID starting with cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11 not found: ID does not exist"
Jul 10 02:13:51.928201 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.928124    2576 scope.go:117] "RemoveContainer" containerID="2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b"
Jul 10 02:13:51.928345 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:13:51.928330    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b\": container with ID starting with 2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b not found: ID does not exist" containerID="2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b"
Jul 10 02:13:51.928380 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.928350    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b"} err="failed to get container status \"2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b\": rpc error: code = NotFound desc = could not find container \"2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b\": container with ID starting with 2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b not found: ID does not exist"
Jul 10 02:13:51.928380 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.928363    2576 scope.go:117] "RemoveContainer" containerID="18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492"
Jul 10 02:13:51.928624 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:13:51.928604    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492\": container with ID starting with 18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492 not found: ID does not exist" containerID="18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492"
Jul 10 02:13:51.928670 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.928630    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492"} err="failed to get container status \"18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492\": rpc error: code = NotFound desc = could not find container \"18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492\": container with ID starting with 18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492 not found: ID does not exist"
Jul 10 02:13:51.928670 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.928644    2576 scope.go:117] "RemoveContainer" containerID="afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55"
Jul 10 02:13:51.928885 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.928868    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55"} err="failed to get container status \"afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55\": rpc error: code = NotFound desc = could not find container \"afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55\": container with ID starting with afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55 not found: ID does not exist"
Jul 10 02:13:51.928934 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.928885    2576 scope.go:117] "RemoveContainer" containerID="7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe"
Jul 10 02:13:51.929132 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.929115    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe"} err="failed to get container status \"7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe\": rpc error: code = NotFound desc = could not find container \"7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe\": container with ID starting with 7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe not found: ID does not exist"
Jul 10 02:13:51.929192 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.929132    2576 scope.go:117] "RemoveContainer" containerID="79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4"
Jul 10 02:13:51.929359 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.929343    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4"} err="failed to get container status \"79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4\": rpc error: code = NotFound desc = could not find container \"79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4\": container with ID starting with 79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4 not found: ID does not exist"
Jul 10 02:13:51.929405 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.929360    2576 scope.go:117] "RemoveContainer" containerID="97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c"
Jul 10 02:13:51.929574 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.929558    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c"} err="failed to get container status \"97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c\": rpc error: code = NotFound desc = could not find container \"97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c\": container with ID starting with 97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c not found: ID does not exist"
Jul 10 02:13:51.929613 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.929575    2576 scope.go:117] "RemoveContainer" containerID="cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11"
Jul 10 02:13:51.929810 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.929793    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11"} err="failed to get container status \"cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11\": rpc error: code = NotFound desc = could not find container \"cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11\": container with ID starting with cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11 not found: ID does not exist"
Jul 10 02:13:51.929855 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.929811    2576 scope.go:117] "RemoveContainer" containerID="2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b"
Jul 10 02:13:51.930000 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.929984    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b"} err="failed to get container status \"2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b\": rpc error: code = NotFound desc = could not find container \"2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b\": container with ID starting with 2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b not found: ID does not exist"
Jul 10 02:13:51.930060 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.930001    2576 scope.go:117] "RemoveContainer" containerID="18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492"
Jul 10 02:13:51.930234 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.930218    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492"} err="failed to get container status \"18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492\": rpc error: code = NotFound desc = could not find container \"18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492\": container with ID starting with 18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492 not found: ID does not exist"
Jul 10 02:13:51.930234 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.930233    2576 scope.go:117] "RemoveContainer" containerID="afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55"
Jul 10 02:13:51.930426 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.930410    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55"} err="failed to get container status \"afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55\": rpc error: code = NotFound desc = could not find container \"afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55\": container with ID starting with afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55 not found: ID does not exist"
Jul 10 02:13:51.930471 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.930427    2576 scope.go:117] "RemoveContainer" containerID="7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe"
Jul 10 02:13:51.930614 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.930600    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe"} err="failed to get container status \"7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe\": rpc error: code = NotFound desc = could not find container \"7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe\": container with ID starting with 7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe not found: ID does not exist"
Jul 10 02:13:51.930651 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.930614    2576 scope.go:117] "RemoveContainer" containerID="79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4"
Jul 10 02:13:51.930783 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.930765    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4"} err="failed to get container status \"79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4\": rpc error: code = NotFound desc = could not find container \"79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4\": container with ID starting with 79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4 not found: ID does not exist"
Jul 10 02:13:51.930821 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.930785    2576 scope.go:117] "RemoveContainer" containerID="97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c"
Jul 10 02:13:51.930982 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.930963    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c"} err="failed to get container status \"97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c\": rpc error: code = NotFound desc = could not find container \"97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c\": container with ID starting with 97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c not found: ID does not exist"
Jul 10 02:13:51.931046 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.930983    2576 scope.go:117] "RemoveContainer" containerID="cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11"
Jul 10 02:13:51.931200 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.931187    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11"} err="failed to get container status \"cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11\": rpc error: code = NotFound desc = could not find container \"cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11\": container with ID starting with cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11 not found: ID does not exist"
Jul 10 02:13:51.931248 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.931200    2576 scope.go:117] "RemoveContainer" containerID="2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b"
Jul 10 02:13:51.931396 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.931374    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b"} err="failed to get container status \"2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b\": rpc error: code = NotFound desc = could not find container \"2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b\": container with ID starting with 2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b not found: ID does not exist"
Jul 10 02:13:51.931396 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.931392    2576 scope.go:117] "RemoveContainer" containerID="18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492"
Jul 10 02:13:51.931600 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.931581    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492"} err="failed to get container status \"18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492\": rpc error: code = NotFound desc = could not find container \"18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492\": container with ID starting with 18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492 not found: ID does not exist"
Jul 10 02:13:51.931679 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.931602    2576 scope.go:117] "RemoveContainer" containerID="afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55"
Jul 10 02:13:51.931863 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.931841    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55"} err="failed to get container status \"afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55\": rpc error: code = NotFound desc = could not find container \"afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55\": container with ID starting with afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55 not found: ID does not exist"
Jul 10 02:13:51.931863 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.931862    2576 scope.go:117] "RemoveContainer" containerID="7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe"
Jul 10 02:13:51.932175 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.932148    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe"} err="failed to get container status \"7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe\": rpc error: code = NotFound desc = could not find container \"7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe\": container with ID starting with 7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe not found: ID does not exist"
Jul 10 02:13:51.932175 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.932174    2576 scope.go:117] "RemoveContainer" containerID="79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4"
Jul 10 02:13:51.932420 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.932402    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4"} err="failed to get container status \"79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4\": rpc error: code = NotFound desc = could not find container \"79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4\": container with ID starting with 79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4 not found: ID does not exist"
Jul 10 02:13:51.932420 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.932421    2576 scope.go:117] "RemoveContainer" containerID="97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c"
Jul 10 02:13:51.932701 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.932671    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c"} err="failed to get container status \"97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c\": rpc error: code = NotFound desc = could not find container \"97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c\": container with ID starting with 97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c not found: ID does not exist"
Jul 10 02:13:51.932701 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.932690    2576 scope.go:117] "RemoveContainer" containerID="cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11"
Jul 10 02:13:51.932902 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.932885    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11"} err="failed to get container status \"cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11\": rpc error: code = NotFound desc = could not find container \"cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11\": container with ID starting with cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11 not found: ID does not exist"
Jul 10 02:13:51.932979 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.932903    2576 scope.go:117] "RemoveContainer" containerID="2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b"
Jul 10 02:13:51.933234 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.933208    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b"} err="failed to get container status \"2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b\": rpc error: code = NotFound desc = could not find container \"2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b\": container with ID starting with 2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b not found: ID does not exist"
Jul 10 02:13:51.933340 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.933235    2576 scope.go:117] "RemoveContainer" containerID="18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492"
Jul 10 02:13:51.933498 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.933478    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492"} err="failed to get container status \"18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492\": rpc error: code = NotFound desc = could not find container \"18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492\": container with ID starting with 18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492 not found: ID does not exist"
Jul 10 02:13:51.933556 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.933499    2576 scope.go:117] "RemoveContainer" containerID="afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55"
Jul 10 02:13:51.933747 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.933730    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55"} err="failed to get container status \"afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55\": rpc error: code = NotFound desc = could not find container \"afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55\": container with ID starting with afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55 not found: ID does not exist"
Jul 10 02:13:51.933808 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.933755    2576 scope.go:117] "RemoveContainer" containerID="7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe"
Jul 10 02:13:51.933962 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.933948    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe"} err="failed to get container status \"7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe\": rpc error: code = NotFound desc = could not find container \"7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe\": container with ID starting with 7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe not found: ID does not exist"
Jul 10 02:13:51.934003 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.933963    2576 scope.go:117] "RemoveContainer" containerID="79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4"
Jul 10 02:13:51.934204 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934187    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4"} err="failed to get container status \"79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4\": rpc error: code = NotFound desc = could not find container \"79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4\": container with ID starting with 79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4 not found: ID does not exist"
Jul 10 02:13:51.934262 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934204    2576 scope.go:117] "RemoveContainer" containerID="97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c"
Jul 10 02:13:51.934262 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934206    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:13:51.934401 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934383    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c"} err="failed to get container status \"97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c\": rpc error: code = NotFound desc = could not find container \"97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c\": container with ID starting with 97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c not found: ID does not exist"
Jul 10 02:13:51.934446 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934402    2576 scope.go:117] "RemoveContainer" containerID="cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11"
Jul 10 02:13:51.934533 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934521    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50830e83-234c-4622-a682-b21d5249f234" containerName="thanos-sidecar"
Jul 10 02:13:51.934577 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934535    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="50830e83-234c-4622-a682-b21d5249f234" containerName="thanos-sidecar"
Jul 10 02:13:51.934577 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934545    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50830e83-234c-4622-a682-b21d5249f234" containerName="kube-rbac-proxy-web"
Jul 10 02:13:51.934577 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934553    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="50830e83-234c-4622-a682-b21d5249f234" containerName="kube-rbac-proxy-web"
Jul 10 02:13:51.934577 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934567    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50830e83-234c-4622-a682-b21d5249f234" containerName="kube-rbac-proxy"
Jul 10 02:13:51.934577 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934575    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="50830e83-234c-4622-a682-b21d5249f234" containerName="kube-rbac-proxy"
Jul 10 02:13:51.934733 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934576    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11"} err="failed to get container status \"cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11\": rpc error: code = NotFound desc = could not find container \"cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11\": container with ID starting with cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11 not found: ID does not exist"
Jul 10 02:13:51.934733 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934599    2576 scope.go:117] "RemoveContainer" containerID="2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b"
Jul 10 02:13:51.934733 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934585    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50830e83-234c-4622-a682-b21d5249f234" containerName="kube-rbac-proxy-thanos"
Jul 10 02:13:51.934733 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934644    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="50830e83-234c-4622-a682-b21d5249f234" containerName="kube-rbac-proxy-thanos"
Jul 10 02:13:51.934733 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934666    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50830e83-234c-4622-a682-b21d5249f234" containerName="prometheus"
Jul 10 02:13:51.934733 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934675    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="50830e83-234c-4622-a682-b21d5249f234" containerName="prometheus"
Jul 10 02:13:51.934733 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934688    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50830e83-234c-4622-a682-b21d5249f234" containerName="init-config-reloader"
Jul 10 02:13:51.934733 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934695    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="50830e83-234c-4622-a682-b21d5249f234" containerName="init-config-reloader"
Jul 10 02:13:51.934733 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934701    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50830e83-234c-4622-a682-b21d5249f234" containerName="config-reloader"
Jul 10 02:13:51.934733 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934707    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="50830e83-234c-4622-a682-b21d5249f234" containerName="config-reloader"
Jul 10 02:13:51.935077 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934787    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="50830e83-234c-4622-a682-b21d5249f234" containerName="kube-rbac-proxy-web"
Jul 10 02:13:51.935077 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934795    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b"} err="failed to get container status \"2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b\": rpc error: code = NotFound desc = could not find container \"2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b\": container with ID starting with 2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b not found: ID does not exist"
Jul 10 02:13:51.935077 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934819    2576 scope.go:117] "RemoveContainer" containerID="18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492"
Jul 10 02:13:51.935077 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934805    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="50830e83-234c-4622-a682-b21d5249f234" containerName="config-reloader"
Jul 10 02:13:51.935077 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934862    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="50830e83-234c-4622-a682-b21d5249f234" containerName="kube-rbac-proxy"
Jul 10 02:13:51.935077 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934869    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="50830e83-234c-4622-a682-b21d5249f234" containerName="kube-rbac-proxy-thanos"
Jul 10 02:13:51.935077 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934879    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="50830e83-234c-4622-a682-b21d5249f234" containerName="prometheus"
Jul 10 02:13:51.935077 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.934888    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="50830e83-234c-4622-a682-b21d5249f234" containerName="thanos-sidecar"
Jul 10 02:13:51.935077 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.935058    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492"} err="failed to get container status \"18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492\": rpc error: code = NotFound desc = could not find container \"18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492\": container with ID starting with 18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492 not found: ID does not exist"
Jul 10 02:13:51.935077 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.935078    2576 scope.go:117] "RemoveContainer" containerID="afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55"
Jul 10 02:13:51.935391 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.935291    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55"} err="failed to get container status \"afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55\": rpc error: code = NotFound desc = could not find container \"afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55\": container with ID starting with afb46fd8545f1c2a989dc6a9f6e383fd1d57633fe6c4b6f453a74b246a3dac55 not found: ID does not exist"
Jul 10 02:13:51.935391 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.935308    2576 scope.go:117] "RemoveContainer" containerID="7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe"
Jul 10 02:13:51.935516 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.935491    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe"} err="failed to get container status \"7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe\": rpc error: code = NotFound desc = could not find container \"7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe\": container with ID starting with 7001a925e00ebcb1958f3a7de5961a3f16e7d7b2b5b6667b52556dfee0731afe not found: ID does not exist"
Jul 10 02:13:51.935558 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.935519    2576 scope.go:117] "RemoveContainer" containerID="79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4"
Jul 10 02:13:51.935734 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.935715    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4"} err="failed to get container status \"79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4\": rpc error: code = NotFound desc = could not find container \"79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4\": container with ID starting with 79e1710f73ed6564717eee87c5fa6d9125e2aed76b8d9451f7edd81f71d3b3f4 not found: ID does not exist"
Jul 10 02:13:51.935775 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.935734    2576 scope.go:117] "RemoveContainer" containerID="97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c"
Jul 10 02:13:51.935949 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.935925    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c"} err="failed to get container status \"97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c\": rpc error: code = NotFound desc = could not find container \"97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c\": container with ID starting with 97abee6a114bafbff39cd47df6d475e88b3f47cd91fef1f3d6e1d0e1f9f8a50c not found: ID does not exist"
Jul 10 02:13:51.935949 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.935949    2576 scope.go:117] "RemoveContainer" containerID="cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11"
Jul 10 02:13:51.936180 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.936157    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11"} err="failed to get container status \"cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11\": rpc error: code = NotFound desc = could not find container \"cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11\": container with ID starting with cbdd9bb1c04d4cf11e3fbfbd06c609060e34e1f347102c8ca8ea6a9e06d15d11 not found: ID does not exist"
Jul 10 02:13:51.936237 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.936181    2576 scope.go:117] "RemoveContainer" containerID="2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b"
Jul 10 02:13:51.936390 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.936372    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b"} err="failed to get container status \"2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b\": rpc error: code = NotFound desc = could not find container \"2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b\": container with ID starting with 2552a2e529923e44c9d19847462c2fc860b52972cfe7ea78688d6ae64234ff1b not found: ID does not exist"
Jul 10 02:13:51.936465 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.936391    2576 scope.go:117] "RemoveContainer" containerID="18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492"
Jul 10 02:13:51.936619 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.936603    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492"} err="failed to get container status \"18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492\": rpc error: code = NotFound desc = could not find container \"18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492\": container with ID starting with 18dda5b50b081ac07f97a50d6bbd129198fe68477fe754a86f6435fb9fd68492 not found: ID does not exist"
Jul 10 02:13:51.938110 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.938096    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:51.941892 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.941876    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 10 02:13:51.941986 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.941891    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 10 02:13:51.942086 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.942064    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 10 02:13:51.942182 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.942100    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5grrepu8mldnl\""
Jul 10 02:13:51.942308 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.942291    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 10 02:13:51.942354 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.942308    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 10 02:13:51.942537 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.942520    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 10 02:13:51.942639 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.942544    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 10 02:13:51.942639 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.942623    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 10 02:13:51.942763 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.942665    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 10 02:13:51.942763 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.942675    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 10 02:13:51.942979 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.942962    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 10 02:13:51.943066 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.942963    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 10 02:13:51.943066 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.943012    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ng78g\""
Jul 10 02:13:51.943066 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.943016    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 10 02:13:51.945740 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.945722    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 10 02:13:51.947238 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.947222    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 10 02:13:51.960194 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.960167    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:13:51.977660 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.977630    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/beadaae9-d8d8-494c-a330-4d8133514326-config-out\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:51.977857 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.977670    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:51.977857 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.977809    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-web-config\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:51.977977 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.977868    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-config\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:51.977977 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.977892    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:51.977977 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.977920    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/beadaae9-d8d8-494c-a330-4d8133514326-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:51.977977 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.977952    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:51.978183 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.978020    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/beadaae9-d8d8-494c-a330-4d8133514326-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:51.978183 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.978092    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beadaae9-d8d8-494c-a330-4d8133514326-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:51.978320 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.978266    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:51.978445 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.978366    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:51.978562 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.978426    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:51.978636 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.978603    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/beadaae9-d8d8-494c-a330-4d8133514326-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:51.978689 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.978633    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beadaae9-d8d8-494c-a330-4d8133514326-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:51.978689 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.978662    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beadaae9-d8d8-494c-a330-4d8133514326-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:51.978790 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.978691    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beadaae9-d8d8-494c-a330-4d8133514326-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:51.978790 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.978745    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:51.978790 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.978774    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xslw\" (UniqueName: \"kubernetes.io/projected/beadaae9-d8d8-494c-a330-4d8133514326-kube-api-access-8xslw\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:51.978937 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.978801    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/beadaae9-d8d8-494c-a330-4d8133514326-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:51.978937 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:51.978866    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/beadaae9-d8d8-494c-a330-4d8133514326-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.079912 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.079869    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beadaae9-d8d8-494c-a330-4d8133514326-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.079912 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.079913    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beadaae9-d8d8-494c-a330-4d8133514326-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.080202 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.079940    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beadaae9-d8d8-494c-a330-4d8133514326-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.080202 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.079975    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.080202 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.080000    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xslw\" (UniqueName: \"kubernetes.io/projected/beadaae9-d8d8-494c-a330-4d8133514326-kube-api-access-8xslw\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.080202 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.080069    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/beadaae9-d8d8-494c-a330-4d8133514326-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.080381 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.080335    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/beadaae9-d8d8-494c-a330-4d8133514326-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.080381 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.080364    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/beadaae9-d8d8-494c-a330-4d8133514326-config-out\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.080496 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.080389    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.080496 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.080443    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-web-config\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.080496 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.080489    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-config\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.080662 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.080530    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.080662 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.080554    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/beadaae9-d8d8-494c-a330-4d8133514326-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.080662 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.080586    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.080662 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.080626    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/beadaae9-d8d8-494c-a330-4d8133514326-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.080662 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.080661    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beadaae9-d8d8-494c-a330-4d8133514326-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.080913 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.080692    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.080913 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.080726    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.080913 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.080754    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beadaae9-d8d8-494c-a330-4d8133514326-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.080913 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.080774    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.080913 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.080834    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beadaae9-d8d8-494c-a330-4d8133514326-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.081238 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.080932    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beadaae9-d8d8-494c-a330-4d8133514326-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.081238 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.080967    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/beadaae9-d8d8-494c-a330-4d8133514326-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.081351 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.081285    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/beadaae9-d8d8-494c-a330-4d8133514326-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.081351 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.081328    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/beadaae9-d8d8-494c-a330-4d8133514326-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.083667 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.083217    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.083667 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.083526    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-web-config\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.083667 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.083576    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/beadaae9-d8d8-494c-a330-4d8133514326-config-out\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.083915 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.083700    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.083915 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.083795    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beadaae9-d8d8-494c-a330-4d8133514326-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.084045 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.083965    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/beadaae9-d8d8-494c-a330-4d8133514326-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.084107 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.084058    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/beadaae9-d8d8-494c-a330-4d8133514326-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.084344 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.084295    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-config\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.084632 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.084609    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.084900 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.084878    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/beadaae9-d8d8-494c-a330-4d8133514326-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.085767 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.085743    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.085995 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.085961    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.086135 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.086121    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.086330 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.086314    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/beadaae9-d8d8-494c-a330-4d8133514326-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.094813 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.094791    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xslw\" (UniqueName: \"kubernetes.io/projected/beadaae9-d8d8-494c-a330-4d8133514326-kube-api-access-8xslw\") pod \"prometheus-k8s-0\" (UID: \"beadaae9-d8d8-494c-a330-4d8133514326\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.248225 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.248139    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:13:52.405595 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.405569    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:13:52.406979 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:13:52.406955    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeadaae9_d8d8_494c_a330_4d8133514326.slice/crio-09d80bc5ced13cd703426d2fad7762d345dcf49a6fe305030d4855ac22ffc995 WatchSource:0}: Error finding container 09d80bc5ced13cd703426d2fad7762d345dcf49a6fe305030d4855ac22ffc995: Status 404 returned error can't find the container with id 09d80bc5ced13cd703426d2fad7762d345dcf49a6fe305030d4855ac22ffc995
Jul 10 02:13:52.545724 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.545628    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50830e83-234c-4622-a682-b21d5249f234" path="/var/lib/kubelet/pods/50830e83-234c-4622-a682-b21d5249f234/volumes"
Jul 10 02:13:52.881084 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.881051    2576 generic.go:356] "Generic (PLEG): container finished" podID="beadaae9-d8d8-494c-a330-4d8133514326" containerID="a8a70c026910caac74ee0cd9be8b1a42be17cb5019118ad76ed74f91c08b65c2" exitCode=0
Jul 10 02:13:52.881447 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.881095    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"beadaae9-d8d8-494c-a330-4d8133514326","Type":"ContainerDied","Data":"a8a70c026910caac74ee0cd9be8b1a42be17cb5019118ad76ed74f91c08b65c2"}
Jul 10 02:13:52.881447 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:52.881144    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"beadaae9-d8d8-494c-a330-4d8133514326","Type":"ContainerStarted","Data":"09d80bc5ced13cd703426d2fad7762d345dcf49a6fe305030d4855ac22ffc995"}
Jul 10 02:13:53.889156 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:53.889124    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"beadaae9-d8d8-494c-a330-4d8133514326","Type":"ContainerStarted","Data":"ad2c50ccac292ca832a9c30c9f60efa306c7c90a98bb02bacfa43fc9a9341865"}
Jul 10 02:13:53.889513 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:53.889184    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"beadaae9-d8d8-494c-a330-4d8133514326","Type":"ContainerStarted","Data":"60dab9f36ad86653ae795071fd18fcf9c2f3fe9b905de14bba930862e14597d7"}
Jul 10 02:13:53.889513 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:53.889210    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"beadaae9-d8d8-494c-a330-4d8133514326","Type":"ContainerStarted","Data":"10c4de28be5a1d061e4892aebb3431e08a0293233e35e25dcdc048a86c1fc3b7"}
Jul 10 02:13:53.889513 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:53.889235    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"beadaae9-d8d8-494c-a330-4d8133514326","Type":"ContainerStarted","Data":"8e6a16a77b778238b89dba035626963a5def79de8177a102b26da4e50df19374"}
Jul 10 02:13:53.889513 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:53.889258    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"beadaae9-d8d8-494c-a330-4d8133514326","Type":"ContainerStarted","Data":"b0afbb3b907ac17651f465af7fb47930d1fc522371ce52f21f5389eeae6862df"}
Jul 10 02:13:53.889513 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:53.889279    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"beadaae9-d8d8-494c-a330-4d8133514326","Type":"ContainerStarted","Data":"08161b19a8204bfec85e46d8f47abaea4a8ad003409cd62ab453853cac39629a"}
Jul 10 02:13:53.921332 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:53.921273    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.902400047 podStartE2EDuration="2.921252956s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.852909ms" isStatefulPod=false podCreationTimestamp="2026-07-10 02:13:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:13:53.919147707 +0000 UTC m=+362.685059939" watchObservedRunningTime="2026-07-10 02:13:53.921252956 +0000 UTC m=+362.687165191"
Jul 10 02:13:57.249235 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:13:57.249187    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:14:52.249263 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:14:52.249214    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:14:52.264772 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:14:52.264744    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:14:53.143834 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:14:53.143808    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:15:39.498709 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:39.498675    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-cf9wr"]
Jul 10 02:15:39.502088 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:39.502072    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-cf9wr"
Jul 10 02:15:39.504897 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:39.504870    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 10 02:15:39.506217 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:39.506203    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 10 02:15:39.506287 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:39.506217    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-k94wm\""
Jul 10 02:15:39.511391 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:39.511368    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-cf9wr"]
Jul 10 02:15:39.580790 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:39.580757    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/710dfb61-174c-47d6-852a-e7a0360760d1-bound-sa-token\") pod \"cert-manager-55b4d954d5-cf9wr\" (UID: \"710dfb61-174c-47d6-852a-e7a0360760d1\") " pod="cert-manager/cert-manager-55b4d954d5-cf9wr"
Jul 10 02:15:39.580994 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:39.580903    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xklp4\" (UniqueName: \"kubernetes.io/projected/710dfb61-174c-47d6-852a-e7a0360760d1-kube-api-access-xklp4\") pod \"cert-manager-55b4d954d5-cf9wr\" (UID: \"710dfb61-174c-47d6-852a-e7a0360760d1\") " pod="cert-manager/cert-manager-55b4d954d5-cf9wr"
Jul 10 02:15:39.681373 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:39.681321    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/710dfb61-174c-47d6-852a-e7a0360760d1-bound-sa-token\") pod \"cert-manager-55b4d954d5-cf9wr\" (UID: \"710dfb61-174c-47d6-852a-e7a0360760d1\") " pod="cert-manager/cert-manager-55b4d954d5-cf9wr"
Jul 10 02:15:39.681556 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:39.681408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xklp4\" (UniqueName: \"kubernetes.io/projected/710dfb61-174c-47d6-852a-e7a0360760d1-kube-api-access-xklp4\") pod \"cert-manager-55b4d954d5-cf9wr\" (UID: \"710dfb61-174c-47d6-852a-e7a0360760d1\") " pod="cert-manager/cert-manager-55b4d954d5-cf9wr"
Jul 10 02:15:39.690790 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:39.690765    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/710dfb61-174c-47d6-852a-e7a0360760d1-bound-sa-token\") pod \"cert-manager-55b4d954d5-cf9wr\" (UID: \"710dfb61-174c-47d6-852a-e7a0360760d1\") " pod="cert-manager/cert-manager-55b4d954d5-cf9wr"
Jul 10 02:15:39.690988 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:39.690966    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xklp4\" (UniqueName: \"kubernetes.io/projected/710dfb61-174c-47d6-852a-e7a0360760d1-kube-api-access-xklp4\") pod \"cert-manager-55b4d954d5-cf9wr\" (UID: \"710dfb61-174c-47d6-852a-e7a0360760d1\") " pod="cert-manager/cert-manager-55b4d954d5-cf9wr"
Jul 10 02:15:39.825217 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:39.825131    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-cf9wr"
Jul 10 02:15:39.950663 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:39.950636    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-cf9wr"]
Jul 10 02:15:39.952724 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:15:39.952698    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod710dfb61_174c_47d6_852a_e7a0360760d1.slice/crio-8ded59081d7b8b862eb14607c87e4e05412c64fc27c6530e626963c792ca868a WatchSource:0}: Error finding container 8ded59081d7b8b862eb14607c87e4e05412c64fc27c6530e626963c792ca868a: Status 404 returned error can't find the container with id 8ded59081d7b8b862eb14607c87e4e05412c64fc27c6530e626963c792ca868a
Jul 10 02:15:39.954761 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:39.954741    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 02:15:40.322421 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:40.322389    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-cf9wr" event={"ID":"710dfb61-174c-47d6-852a-e7a0360760d1","Type":"ContainerStarted","Data":"8ded59081d7b8b862eb14607c87e4e05412c64fc27c6530e626963c792ca868a"}
Jul 10 02:15:43.338121 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:43.338011    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-cf9wr" event={"ID":"710dfb61-174c-47d6-852a-e7a0360760d1","Type":"ContainerStarted","Data":"8fc98b5062074ca575dc3a4ef7277562df1e5b880fc226aad6968fd5a17141eb"}
Jul 10 02:15:43.357071 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:43.356995    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-cf9wr" podStartSLOduration=1.2606427980000001 podStartE2EDuration="4.356980994s" totalImagesPullingTime="3.096338196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:15:43.356290831 +0000 UTC m=+472.122203062" watchObservedRunningTime="2026-07-10 02:15:43.356980994 +0000 UTC m=+472.122893227"
Jul 10 02:15:55.083643 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:55.083609    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-58d7cbdf66-z577x"]
Jul 10 02:15:55.086943 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:55.086924    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58d7cbdf66-z577x"
Jul 10 02:15:55.091362 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:55.091337    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 10 02:15:55.091362 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:55.091345    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 10 02:15:55.091552 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:55.091370    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-x9c97\""
Jul 10 02:15:55.091552 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:55.091385    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 10 02:15:55.091552 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:55.091451    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 10 02:15:55.091705 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:55.091573    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 10 02:15:55.099528 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:55.099507    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58d7cbdf66-z577x"]
Jul 10 02:15:55.225888 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:55.225847    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68472712-2e8f-414a-a95a-996b35174b2c-cert\") pod \"lws-controller-manager-58d7cbdf66-z577x\" (UID: \"68472712-2e8f-414a-a95a-996b35174b2c\") " pod="openshift-lws-operator/lws-controller-manager-58d7cbdf66-z577x"
Jul 10 02:15:55.225888 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:55.225891    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/68472712-2e8f-414a-a95a-996b35174b2c-metrics-cert\") pod \"lws-controller-manager-58d7cbdf66-z577x\" (UID: \"68472712-2e8f-414a-a95a-996b35174b2c\") " pod="openshift-lws-operator/lws-controller-manager-58d7cbdf66-z577x"
Jul 10 02:15:55.226133 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:55.225926    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/68472712-2e8f-414a-a95a-996b35174b2c-manager-config\") pod \"lws-controller-manager-58d7cbdf66-z577x\" (UID: \"68472712-2e8f-414a-a95a-996b35174b2c\") " pod="openshift-lws-operator/lws-controller-manager-58d7cbdf66-z577x"
Jul 10 02:15:55.226133 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:55.225977    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx6vk\" (UniqueName: \"kubernetes.io/projected/68472712-2e8f-414a-a95a-996b35174b2c-kube-api-access-kx6vk\") pod \"lws-controller-manager-58d7cbdf66-z577x\" (UID: \"68472712-2e8f-414a-a95a-996b35174b2c\") " pod="openshift-lws-operator/lws-controller-manager-58d7cbdf66-z577x"
Jul 10 02:15:55.326888 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:55.326845    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/68472712-2e8f-414a-a95a-996b35174b2c-manager-config\") pod \"lws-controller-manager-58d7cbdf66-z577x\" (UID: \"68472712-2e8f-414a-a95a-996b35174b2c\") " pod="openshift-lws-operator/lws-controller-manager-58d7cbdf66-z577x"
Jul 10 02:15:55.326888 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:55.326887    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx6vk\" (UniqueName: \"kubernetes.io/projected/68472712-2e8f-414a-a95a-996b35174b2c-kube-api-access-kx6vk\") pod \"lws-controller-manager-58d7cbdf66-z577x\" (UID: \"68472712-2e8f-414a-a95a-996b35174b2c\") " pod="openshift-lws-operator/lws-controller-manager-58d7cbdf66-z577x"
Jul 10 02:15:55.327209 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:55.326949    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68472712-2e8f-414a-a95a-996b35174b2c-cert\") pod \"lws-controller-manager-58d7cbdf66-z577x\" (UID: \"68472712-2e8f-414a-a95a-996b35174b2c\") " pod="openshift-lws-operator/lws-controller-manager-58d7cbdf66-z577x"
Jul 10 02:15:55.327209 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:55.326968    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/68472712-2e8f-414a-a95a-996b35174b2c-metrics-cert\") pod \"lws-controller-manager-58d7cbdf66-z577x\" (UID: \"68472712-2e8f-414a-a95a-996b35174b2c\") " pod="openshift-lws-operator/lws-controller-manager-58d7cbdf66-z577x"
Jul 10 02:15:55.327597 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:55.327571    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/68472712-2e8f-414a-a95a-996b35174b2c-manager-config\") pod \"lws-controller-manager-58d7cbdf66-z577x\" (UID: \"68472712-2e8f-414a-a95a-996b35174b2c\") " pod="openshift-lws-operator/lws-controller-manager-58d7cbdf66-z577x"
Jul 10 02:15:55.329330 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:55.329307    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/68472712-2e8f-414a-a95a-996b35174b2c-metrics-cert\") pod \"lws-controller-manager-58d7cbdf66-z577x\" (UID: \"68472712-2e8f-414a-a95a-996b35174b2c\") " pod="openshift-lws-operator/lws-controller-manager-58d7cbdf66-z577x"
Jul 10 02:15:55.329462 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:55.329440    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68472712-2e8f-414a-a95a-996b35174b2c-cert\") pod \"lws-controller-manager-58d7cbdf66-z577x\" (UID: \"68472712-2e8f-414a-a95a-996b35174b2c\") " pod="openshift-lws-operator/lws-controller-manager-58d7cbdf66-z577x"
Jul 10 02:15:55.349701 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:55.349640    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx6vk\" (UniqueName: \"kubernetes.io/projected/68472712-2e8f-414a-a95a-996b35174b2c-kube-api-access-kx6vk\") pod \"lws-controller-manager-58d7cbdf66-z577x\" (UID: \"68472712-2e8f-414a-a95a-996b35174b2c\") " pod="openshift-lws-operator/lws-controller-manager-58d7cbdf66-z577x"
Jul 10 02:15:55.396320 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:55.396293    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58d7cbdf66-z577x"
Jul 10 02:15:55.530891 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:55.530811    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58d7cbdf66-z577x"]
Jul 10 02:15:55.533165 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:15:55.533129    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68472712_2e8f_414a_a95a_996b35174b2c.slice/crio-44117c536b9198ad9325e238dbc818a6c802c5ff8d5964a674914a1891aa7fae WatchSource:0}: Error finding container 44117c536b9198ad9325e238dbc818a6c802c5ff8d5964a674914a1891aa7fae: Status 404 returned error can't find the container with id 44117c536b9198ad9325e238dbc818a6c802c5ff8d5964a674914a1891aa7fae
Jul 10 02:15:56.393589 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:56.393526    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58d7cbdf66-z577x" event={"ID":"68472712-2e8f-414a-a95a-996b35174b2c","Type":"ContainerStarted","Data":"44117c536b9198ad9325e238dbc818a6c802c5ff8d5964a674914a1891aa7fae"}
Jul 10 02:15:58.402856 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:58.402821    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58d7cbdf66-z577x" event={"ID":"68472712-2e8f-414a-a95a-996b35174b2c","Type":"ContainerStarted","Data":"a322ce3c56a44504935e51d12f755a2ffbd419ccb829ebeb285747b4bc655d22"}
Jul 10 02:15:58.403238 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:58.402886    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-58d7cbdf66-z577x"
Jul 10 02:15:58.422523 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:15:58.422477    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-58d7cbdf66-z577x" podStartSLOduration=1.036836166 podStartE2EDuration="3.422438685s" totalImagesPullingTime="2.385602519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:15:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:15:58.421459363 +0000 UTC m=+487.187371603" watchObservedRunningTime="2026-07-10 02:15:58.422438685 +0000 UTC m=+487.188350916"
Jul 10 02:16:09.217499 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:09.217466    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6"]
Jul 10 02:16:09.221799 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:09.221777    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6"
Jul 10 02:16:09.227965 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:09.227935    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rnfzq\""
Jul 10 02:16:09.228131 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:09.227981    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 10 02:16:09.228131 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:09.227991    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 10 02:16:09.228131 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:09.228118    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 10 02:16:09.228369 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:09.228238    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 10 02:16:09.237739 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:09.237710    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6"]
Jul 10 02:16:09.349003 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:09.348958    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a6a9fb6-c579-4ee6-8703-3eb27f550ee2-webhook-cert\") pod \"opendatahub-operator-controller-manager-78b9cbb96-vqvw6\" (UID: \"2a6a9fb6-c579-4ee6-8703-3eb27f550ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6"
Jul 10 02:16:09.349183 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:09.349019    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a6a9fb6-c579-4ee6-8703-3eb27f550ee2-tmp\") pod \"opendatahub-operator-controller-manager-78b9cbb96-vqvw6\" (UID: \"2a6a9fb6-c579-4ee6-8703-3eb27f550ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6"
Jul 10 02:16:09.349183 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:09.349122    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2a6a9fb6-c579-4ee6-8703-3eb27f550ee2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78b9cbb96-vqvw6\" (UID: \"2a6a9fb6-c579-4ee6-8703-3eb27f550ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6"
Jul 10 02:16:09.349183 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:09.349160    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfmck\" (UniqueName: \"kubernetes.io/projected/2a6a9fb6-c579-4ee6-8703-3eb27f550ee2-kube-api-access-mfmck\") pod \"opendatahub-operator-controller-manager-78b9cbb96-vqvw6\" (UID: \"2a6a9fb6-c579-4ee6-8703-3eb27f550ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6"
Jul 10 02:16:09.349312 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:09.349191    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2a6a9fb6-c579-4ee6-8703-3eb27f550ee2-manifests\") pod \"opendatahub-operator-controller-manager-78b9cbb96-vqvw6\" (UID: \"2a6a9fb6-c579-4ee6-8703-3eb27f550ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6"
Jul 10 02:16:09.409870 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:09.409842    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-58d7cbdf66-z577x"
Jul 10 02:16:09.450534 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:09.450500    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2a6a9fb6-c579-4ee6-8703-3eb27f550ee2-manifests\") pod \"opendatahub-operator-controller-manager-78b9cbb96-vqvw6\" (UID: \"2a6a9fb6-c579-4ee6-8703-3eb27f550ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6"
Jul 10 02:16:09.450699 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:09.450608    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a6a9fb6-c579-4ee6-8703-3eb27f550ee2-webhook-cert\") pod \"opendatahub-operator-controller-manager-78b9cbb96-vqvw6\" (UID: \"2a6a9fb6-c579-4ee6-8703-3eb27f550ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6"
Jul 10 02:16:09.450699 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:09.450690    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a6a9fb6-c579-4ee6-8703-3eb27f550ee2-tmp\") pod \"opendatahub-operator-controller-manager-78b9cbb96-vqvw6\" (UID: \"2a6a9fb6-c579-4ee6-8703-3eb27f550ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6"
Jul 10 02:16:09.450817 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:09.450732    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2a6a9fb6-c579-4ee6-8703-3eb27f550ee2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78b9cbb96-vqvw6\" (UID: \"2a6a9fb6-c579-4ee6-8703-3eb27f550ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6"
Jul 10 02:16:09.450817 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:09.450757    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfmck\" (UniqueName: \"kubernetes.io/projected/2a6a9fb6-c579-4ee6-8703-3eb27f550ee2-kube-api-access-mfmck\") pod \"opendatahub-operator-controller-manager-78b9cbb96-vqvw6\" (UID: \"2a6a9fb6-c579-4ee6-8703-3eb27f550ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6"
Jul 10 02:16:09.451245 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:09.451214    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2a6a9fb6-c579-4ee6-8703-3eb27f550ee2-manifests\") pod \"opendatahub-operator-controller-manager-78b9cbb96-vqvw6\" (UID: \"2a6a9fb6-c579-4ee6-8703-3eb27f550ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6"
Jul 10 02:16:09.453255 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:09.453221    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a6a9fb6-c579-4ee6-8703-3eb27f550ee2-webhook-cert\") pod \"opendatahub-operator-controller-manager-78b9cbb96-vqvw6\" (UID: \"2a6a9fb6-c579-4ee6-8703-3eb27f550ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6"
Jul 10 02:16:09.453514 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:09.453489    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a6a9fb6-c579-4ee6-8703-3eb27f550ee2-tmp\") pod \"opendatahub-operator-controller-manager-78b9cbb96-vqvw6\" (UID: \"2a6a9fb6-c579-4ee6-8703-3eb27f550ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6"
Jul 10 02:16:09.453610 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:09.453591    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2a6a9fb6-c579-4ee6-8703-3eb27f550ee2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78b9cbb96-vqvw6\" (UID: \"2a6a9fb6-c579-4ee6-8703-3eb27f550ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6"
Jul 10 02:16:09.460400 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:09.460357    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfmck\" (UniqueName: \"kubernetes.io/projected/2a6a9fb6-c579-4ee6-8703-3eb27f550ee2-kube-api-access-mfmck\") pod \"opendatahub-operator-controller-manager-78b9cbb96-vqvw6\" (UID: \"2a6a9fb6-c579-4ee6-8703-3eb27f550ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6"
Jul 10 02:16:09.532264 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:09.532145    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6"
Jul 10 02:16:09.671343 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:09.671317    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6"]
Jul 10 02:16:09.673604 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:16:09.673571    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a6a9fb6_c579_4ee6_8703_3eb27f550ee2.slice/crio-eaf292907fd0cffda4c902ec49e54de5018df30a60511d9292cd713ac07a95f2 WatchSource:0}: Error finding container eaf292907fd0cffda4c902ec49e54de5018df30a60511d9292cd713ac07a95f2: Status 404 returned error can't find the container with id eaf292907fd0cffda4c902ec49e54de5018df30a60511d9292cd713ac07a95f2
Jul 10 02:16:10.454100 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:10.454064    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6" event={"ID":"2a6a9fb6-c579-4ee6-8703-3eb27f550ee2","Type":"ContainerStarted","Data":"eaf292907fd0cffda4c902ec49e54de5018df30a60511d9292cd713ac07a95f2"}
Jul 10 02:16:13.472189 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:13.472145    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6" event={"ID":"2a6a9fb6-c579-4ee6-8703-3eb27f550ee2","Type":"ContainerStarted","Data":"ac487e429822bfc47ab416e3d468c51e704eac04afb7f018dddbe673381049db"}
Jul 10 02:16:14.478447 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:14.478416    2576 generic.go:356] "Generic (PLEG): container finished" podID="2a6a9fb6-c579-4ee6-8703-3eb27f550ee2" containerID="ac487e429822bfc47ab416e3d468c51e704eac04afb7f018dddbe673381049db" exitCode=0
Jul 10 02:16:14.478447 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:14.478452    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6" event={"ID":"2a6a9fb6-c579-4ee6-8703-3eb27f550ee2","Type":"ContainerDied","Data":"ac487e429822bfc47ab416e3d468c51e704eac04afb7f018dddbe673381049db"}
Jul 10 02:16:15.485588 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:15.485554    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6" event={"ID":"2a6a9fb6-c579-4ee6-8703-3eb27f550ee2","Type":"ContainerStarted","Data":"b286e47b27a8fadbebacf64dca46378b6d703b5eb859c128d21857e6f8abe51b"}
Jul 10 02:16:15.486039 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:15.485692    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6"
Jul 10 02:16:15.513124 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:15.513072    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6" podStartSLOduration=2.204591083 podStartE2EDuration="6.513054584s" totalImagesPullingTime="3.298661625s" totalInitContainerRuntime="1.009801876s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:16:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:16:15.510894932 +0000 UTC m=+504.276807162" watchObservedRunningTime="2026-07-10 02:16:15.513054584 +0000 UTC m=+504.278966816"
Jul 10 02:16:26.492421 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:26.492391    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-78b9cbb96-vqvw6"
Jul 10 02:16:28.835396 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:28.835366    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6cf46c8b8c-x4hnq"]
Jul 10 02:16:28.841331 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:28.841311    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6cf46c8b8c-x4hnq"
Jul 10 02:16:28.844014 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:28.843976    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 10 02:16:28.844181 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:28.844166    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 10 02:16:28.844255 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:28.844227    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9gm8x\""
Jul 10 02:16:28.845478 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:28.845457    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 10 02:16:28.845583 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:28.845497    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 10 02:16:28.849386 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:28.849366    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6cf46c8b8c-x4hnq"]
Jul 10 02:16:28.928335 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:28.928301    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5cf16ed2-2be5-4cb9-9a4e-4de146cd61b4-tmp\") pod \"kube-auth-proxy-6cf46c8b8c-x4hnq\" (UID: \"5cf16ed2-2be5-4cb9-9a4e-4de146cd61b4\") " pod="openshift-ingress/kube-auth-proxy-6cf46c8b8c-x4hnq"
Jul 10 02:16:28.928521 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:28.928368    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cf16ed2-2be5-4cb9-9a4e-4de146cd61b4-tls-certs\") pod \"kube-auth-proxy-6cf46c8b8c-x4hnq\" (UID: \"5cf16ed2-2be5-4cb9-9a4e-4de146cd61b4\") " pod="openshift-ingress/kube-auth-proxy-6cf46c8b8c-x4hnq"
Jul 10 02:16:28.928521 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:28.928388    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wkqr\" (UniqueName: \"kubernetes.io/projected/5cf16ed2-2be5-4cb9-9a4e-4de146cd61b4-kube-api-access-4wkqr\") pod \"kube-auth-proxy-6cf46c8b8c-x4hnq\" (UID: \"5cf16ed2-2be5-4cb9-9a4e-4de146cd61b4\") " pod="openshift-ingress/kube-auth-proxy-6cf46c8b8c-x4hnq"
Jul 10 02:16:29.029284 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:29.029251    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5cf16ed2-2be5-4cb9-9a4e-4de146cd61b4-tmp\") pod \"kube-auth-proxy-6cf46c8b8c-x4hnq\" (UID: \"5cf16ed2-2be5-4cb9-9a4e-4de146cd61b4\") " pod="openshift-ingress/kube-auth-proxy-6cf46c8b8c-x4hnq"
Jul 10 02:16:29.029451 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:29.029315    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cf16ed2-2be5-4cb9-9a4e-4de146cd61b4-tls-certs\") pod \"kube-auth-proxy-6cf46c8b8c-x4hnq\" (UID: \"5cf16ed2-2be5-4cb9-9a4e-4de146cd61b4\") " pod="openshift-ingress/kube-auth-proxy-6cf46c8b8c-x4hnq"
Jul 10 02:16:29.029451 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:29.029336    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wkqr\" (UniqueName: \"kubernetes.io/projected/5cf16ed2-2be5-4cb9-9a4e-4de146cd61b4-kube-api-access-4wkqr\") pod \"kube-auth-proxy-6cf46c8b8c-x4hnq\" (UID: \"5cf16ed2-2be5-4cb9-9a4e-4de146cd61b4\") " pod="openshift-ingress/kube-auth-proxy-6cf46c8b8c-x4hnq"
Jul 10 02:16:29.031480 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:29.031454    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5cf16ed2-2be5-4cb9-9a4e-4de146cd61b4-tmp\") pod \"kube-auth-proxy-6cf46c8b8c-x4hnq\" (UID: \"5cf16ed2-2be5-4cb9-9a4e-4de146cd61b4\") " pod="openshift-ingress/kube-auth-proxy-6cf46c8b8c-x4hnq"
Jul 10 02:16:29.031675 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:29.031658    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cf16ed2-2be5-4cb9-9a4e-4de146cd61b4-tls-certs\") pod \"kube-auth-proxy-6cf46c8b8c-x4hnq\" (UID: \"5cf16ed2-2be5-4cb9-9a4e-4de146cd61b4\") " pod="openshift-ingress/kube-auth-proxy-6cf46c8b8c-x4hnq"
Jul 10 02:16:29.040139 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:29.040114    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wkqr\" (UniqueName: \"kubernetes.io/projected/5cf16ed2-2be5-4cb9-9a4e-4de146cd61b4-kube-api-access-4wkqr\") pod \"kube-auth-proxy-6cf46c8b8c-x4hnq\" (UID: \"5cf16ed2-2be5-4cb9-9a4e-4de146cd61b4\") " pod="openshift-ingress/kube-auth-proxy-6cf46c8b8c-x4hnq"
Jul 10 02:16:29.151624 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:29.151592    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6cf46c8b8c-x4hnq"
Jul 10 02:16:29.286655 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:29.286620    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6cf46c8b8c-x4hnq"]
Jul 10 02:16:29.289872 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:16:29.289845    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cf16ed2_2be5_4cb9_9a4e_4de146cd61b4.slice/crio-496b1a82a852439d87b4a86c41fb1bfd5f37a611bea87044fd5f22b140b8d3a7 WatchSource:0}: Error finding container 496b1a82a852439d87b4a86c41fb1bfd5f37a611bea87044fd5f22b140b8d3a7: Status 404 returned error can't find the container with id 496b1a82a852439d87b4a86c41fb1bfd5f37a611bea87044fd5f22b140b8d3a7
Jul 10 02:16:29.555287 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:29.555210    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6cf46c8b8c-x4hnq" event={"ID":"5cf16ed2-2be5-4cb9-9a4e-4de146cd61b4","Type":"ContainerStarted","Data":"496b1a82a852439d87b4a86c41fb1bfd5f37a611bea87044fd5f22b140b8d3a7"}
Jul 10 02:16:32.571807 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:32.571773    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6cf46c8b8c-x4hnq" event={"ID":"5cf16ed2-2be5-4cb9-9a4e-4de146cd61b4","Type":"ContainerStarted","Data":"bd6b2840d120b0355fa41ba252a019945179813cc28f8a846da36bb4eb612f62"}
Jul 10 02:16:32.591422 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:16:32.591373    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6cf46c8b8c-x4hnq" podStartSLOduration=1.800528658 podStartE2EDuration="4.591355377s" totalImagesPullingTime="2.790826719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:16:32.589158043 +0000 UTC m=+521.355070276" watchObservedRunningTime="2026-07-10 02:16:32.591355377 +0000 UTC m=+521.357267631"
Jul 10 02:17:52.421155 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:17:52.421123    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/2.log"
Jul 10 02:17:52.422014 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:17:52.421992    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/2.log"
Jul 10 02:17:52.424528 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:17:52.424509    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt7wb_164f62ad-8b5b-4a66-9bfe-17d863ddeeea/ovn-acl-logging/0.log"
Jul 10 02:17:52.425400 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:17:52.425380    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt7wb_164f62ad-8b5b-4a66-9bfe-17d863ddeeea/ovn-acl-logging/0.log"
Jul 10 02:18:37.275195 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:18:37.275167    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-qqhvs"]
Jul 10 02:18:37.277589 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:18:37.277574    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qqhvs"
Jul 10 02:18:37.280527 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:18:37.280496    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 10 02:18:37.280657 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:18:37.280558    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 10 02:18:37.280916 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:18:37.280899    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 10 02:18:37.282067 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:18:37.282048    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dc49t\""
Jul 10 02:18:37.282159 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:18:37.282097    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 10 02:18:37.287625 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:18:37.287605    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-qqhvs"]
Jul 10 02:18:37.395139 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:18:37.395102    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a8f1aa2f-f5e3-435e-ae1c-e7c72e77fdaf-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-qqhvs\" (UID: \"a8f1aa2f-f5e3-435e-ae1c-e7c72e77fdaf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qqhvs"
Jul 10 02:18:37.395324 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:18:37.395148    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt2lp\" (UniqueName: \"kubernetes.io/projected/a8f1aa2f-f5e3-435e-ae1c-e7c72e77fdaf-kube-api-access-tt2lp\") pod \"kuadrant-console-plugin-66b5774985-qqhvs\" (UID: \"a8f1aa2f-f5e3-435e-ae1c-e7c72e77fdaf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qqhvs"
Jul 10 02:18:37.395324 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:18:37.395232    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8f1aa2f-f5e3-435e-ae1c-e7c72e77fdaf-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qqhvs\" (UID: \"a8f1aa2f-f5e3-435e-ae1c-e7c72e77fdaf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qqhvs"
Jul 10 02:18:37.495954 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:18:37.495919    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a8f1aa2f-f5e3-435e-ae1c-e7c72e77fdaf-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-qqhvs\" (UID: \"a8f1aa2f-f5e3-435e-ae1c-e7c72e77fdaf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qqhvs"
Jul 10 02:18:37.495954 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:18:37.495957    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt2lp\" (UniqueName: \"kubernetes.io/projected/a8f1aa2f-f5e3-435e-ae1c-e7c72e77fdaf-kube-api-access-tt2lp\") pod \"kuadrant-console-plugin-66b5774985-qqhvs\" (UID: \"a8f1aa2f-f5e3-435e-ae1c-e7c72e77fdaf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qqhvs"
Jul 10 02:18:37.496167 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:18:37.496067    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8f1aa2f-f5e3-435e-ae1c-e7c72e77fdaf-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qqhvs\" (UID: \"a8f1aa2f-f5e3-435e-ae1c-e7c72e77fdaf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qqhvs"
Jul 10 02:18:37.496645 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:18:37.496622    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a8f1aa2f-f5e3-435e-ae1c-e7c72e77fdaf-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-qqhvs\" (UID: \"a8f1aa2f-f5e3-435e-ae1c-e7c72e77fdaf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qqhvs"
Jul 10 02:18:37.498512 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:18:37.498491    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8f1aa2f-f5e3-435e-ae1c-e7c72e77fdaf-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qqhvs\" (UID: \"a8f1aa2f-f5e3-435e-ae1c-e7c72e77fdaf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qqhvs"
Jul 10 02:18:37.508174 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:18:37.508151    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt2lp\" (UniqueName: \"kubernetes.io/projected/a8f1aa2f-f5e3-435e-ae1c-e7c72e77fdaf-kube-api-access-tt2lp\") pod \"kuadrant-console-plugin-66b5774985-qqhvs\" (UID: \"a8f1aa2f-f5e3-435e-ae1c-e7c72e77fdaf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qqhvs"
Jul 10 02:18:37.586449 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:18:37.586370    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qqhvs"
Jul 10 02:18:37.718638 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:18:37.718603    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-qqhvs"]
Jul 10 02:18:37.721433 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:18:37.721399    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8f1aa2f_f5e3_435e_ae1c_e7c72e77fdaf.slice/crio-310e4c85cb6f87dd2b5c64d22e57f87a99934453c189fb222ae66ac120f04d0f WatchSource:0}: Error finding container 310e4c85cb6f87dd2b5c64d22e57f87a99934453c189fb222ae66ac120f04d0f: Status 404 returned error can't find the container with id 310e4c85cb6f87dd2b5c64d22e57f87a99934453c189fb222ae66ac120f04d0f
Jul 10 02:18:38.122458 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:18:38.122422    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qqhvs" event={"ID":"a8f1aa2f-f5e3-435e-ae1c-e7c72e77fdaf","Type":"ContainerStarted","Data":"310e4c85cb6f87dd2b5c64d22e57f87a99934453c189fb222ae66ac120f04d0f"}
Jul 10 02:19:02.247189 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:02.247153    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qqhvs" event={"ID":"a8f1aa2f-f5e3-435e-ae1c-e7c72e77fdaf","Type":"ContainerStarted","Data":"aef0cca79b9dd7b220e3f6d1cf4bf847036cdf4387e6749251acaaf693741b42"}
Jul 10 02:19:02.269452 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:02.269404    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qqhvs" podStartSLOduration=1.1741860100000001 podStartE2EDuration="25.269388429s" totalImagesPullingTime="24.095202419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:19:02.268846804 +0000 UTC m=+671.034759037" watchObservedRunningTime="2026-07-10 02:19:02.269388429 +0000 UTC m=+671.035300662"
Jul 10 02:19:19.309672 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:19.309641    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:19:19.312823 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:19.312807    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"
Jul 10 02:19:19.315489 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:19.315467    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 10 02:19:19.327774 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:19.322526    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:19:19.348137 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:19.348112    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:19:19.485510 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:19.485479    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/032a1714-d10b-411f-a950-7d0923333a6e-config-file\") pod \"limitador-limitador-54d6d988d5-8m4j5\" (UID: \"032a1714-d10b-411f-a950-7d0923333a6e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"
Jul 10 02:19:19.485510 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:19.485520    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd2bb\" (UniqueName: \"kubernetes.io/projected/032a1714-d10b-411f-a950-7d0923333a6e-kube-api-access-jd2bb\") pod \"limitador-limitador-54d6d988d5-8m4j5\" (UID: \"032a1714-d10b-411f-a950-7d0923333a6e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"
Jul 10 02:19:19.586434 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:19.586354    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/032a1714-d10b-411f-a950-7d0923333a6e-config-file\") pod \"limitador-limitador-54d6d988d5-8m4j5\" (UID: \"032a1714-d10b-411f-a950-7d0923333a6e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"
Jul 10 02:19:19.586434 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:19.586397    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd2bb\" (UniqueName: \"kubernetes.io/projected/032a1714-d10b-411f-a950-7d0923333a6e-kube-api-access-jd2bb\") pod \"limitador-limitador-54d6d988d5-8m4j5\" (UID: \"032a1714-d10b-411f-a950-7d0923333a6e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"
Jul 10 02:19:19.586979 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:19.586960    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/032a1714-d10b-411f-a950-7d0923333a6e-config-file\") pod \"limitador-limitador-54d6d988d5-8m4j5\" (UID: \"032a1714-d10b-411f-a950-7d0923333a6e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"
Jul 10 02:19:19.596343 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:19.596314    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd2bb\" (UniqueName: \"kubernetes.io/projected/032a1714-d10b-411f-a950-7d0923333a6e-kube-api-access-jd2bb\") pod \"limitador-limitador-54d6d988d5-8m4j5\" (UID: \"032a1714-d10b-411f-a950-7d0923333a6e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"
Jul 10 02:19:19.629043 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:19.629006    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"
Jul 10 02:19:19.758862 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:19.758839    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:19:19.760879 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:19:19.760851    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod032a1714_d10b_411f_a950_7d0923333a6e.slice/crio-015040b1e0945e37d7735516b44e3242950f30868f5a6fda64d96852e993e38d WatchSource:0}: Error finding container 015040b1e0945e37d7735516b44e3242950f30868f5a6fda64d96852e993e38d: Status 404 returned error can't find the container with id 015040b1e0945e37d7735516b44e3242950f30868f5a6fda64d96852e993e38d
Jul 10 02:19:20.040906 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:20.040862    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-sxnj9"]
Jul 10 02:19:20.045456 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:20.045440    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sxnj9"
Jul 10 02:19:20.048258 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:20.048238    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nwxtt\""
Jul 10 02:19:20.052010 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:20.051979    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sxnj9"]
Jul 10 02:19:20.191707 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:20.191672    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t65w5\" (UniqueName: \"kubernetes.io/projected/1dde115d-0851-4390-a4d8-d28b2fa0e2eb-kube-api-access-t65w5\") pod \"authorino-75d556bd77-sxnj9\" (UID: \"1dde115d-0851-4390-a4d8-d28b2fa0e2eb\") " pod="kuadrant-system/authorino-75d556bd77-sxnj9"
Jul 10 02:19:20.293117 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:20.293006    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t65w5\" (UniqueName: \"kubernetes.io/projected/1dde115d-0851-4390-a4d8-d28b2fa0e2eb-kube-api-access-t65w5\") pod \"authorino-75d556bd77-sxnj9\" (UID: \"1dde115d-0851-4390-a4d8-d28b2fa0e2eb\") " pod="kuadrant-system/authorino-75d556bd77-sxnj9"
Jul 10 02:19:20.303595 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:20.303569    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t65w5\" (UniqueName: \"kubernetes.io/projected/1dde115d-0851-4390-a4d8-d28b2fa0e2eb-kube-api-access-t65w5\") pod \"authorino-75d556bd77-sxnj9\" (UID: \"1dde115d-0851-4390-a4d8-d28b2fa0e2eb\") " pod="kuadrant-system/authorino-75d556bd77-sxnj9"
Jul 10 02:19:20.329012 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:20.328977    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-8m4j5" event={"ID":"032a1714-d10b-411f-a950-7d0923333a6e","Type":"ContainerStarted","Data":"015040b1e0945e37d7735516b44e3242950f30868f5a6fda64d96852e993e38d"}
Jul 10 02:19:20.356050 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:20.356003    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sxnj9"
Jul 10 02:19:20.517833 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:20.517772    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sxnj9"]
Jul 10 02:19:20.521688 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:19:20.521654    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1dde115d_0851_4390_a4d8_d28b2fa0e2eb.slice/crio-e8f952e5f5984873a4e118dcd7f97e6232625a435b7ac9a26fbe41a2a3db603d WatchSource:0}: Error finding container e8f952e5f5984873a4e118dcd7f97e6232625a435b7ac9a26fbe41a2a3db603d: Status 404 returned error can't find the container with id e8f952e5f5984873a4e118dcd7f97e6232625a435b7ac9a26fbe41a2a3db603d
Jul 10 02:19:21.336676 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:21.336636    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sxnj9" event={"ID":"1dde115d-0851-4390-a4d8-d28b2fa0e2eb","Type":"ContainerStarted","Data":"e8f952e5f5984873a4e118dcd7f97e6232625a435b7ac9a26fbe41a2a3db603d"}
Jul 10 02:19:25.358678 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:25.358644    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-8m4j5" event={"ID":"032a1714-d10b-411f-a950-7d0923333a6e","Type":"ContainerStarted","Data":"e187c53a0d7bfb69b095f20b83b06c9a3bbb410caef3ca478cdd96fa56f53f76"}
Jul 10 02:19:25.359156 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:25.358736    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"
Jul 10 02:19:25.360083 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:25.360060    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sxnj9" event={"ID":"1dde115d-0851-4390-a4d8-d28b2fa0e2eb","Type":"ContainerStarted","Data":"cc0cabc7cf656af803e0010a4b4304aa44fe04a41a40cf23bc13210b0891a857"}
Jul 10 02:19:25.378807 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:25.378758    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-8m4j5" podStartSLOduration=1.8403240410000001 podStartE2EDuration="6.37874425s" totalImagesPullingTime="4.538420209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:19:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:19:25.377168151 +0000 UTC m=+694.143080387" watchObservedRunningTime="2026-07-10 02:19:25.37874425 +0000 UTC m=+694.144656481"
Jul 10 02:19:25.394437 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:25.394394    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-sxnj9" podStartSLOduration=1.610004554 podStartE2EDuration="5.39438081s" totalImagesPullingTime="3.784376256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:19:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:19:25.392546457 +0000 UTC m=+694.158458672" watchObservedRunningTime="2026-07-10 02:19:25.39438081 +0000 UTC m=+694.160293089"
Jul 10 02:19:36.365975 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:36.365945    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"
Jul 10 02:19:56.050425 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:56.050395    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sxnj9"]
Jul 10 02:19:56.050866 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:56.050570    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-sxnj9" podUID="1dde115d-0851-4390-a4d8-d28b2fa0e2eb" containerName="authorino" containerID="cri-o://cc0cabc7cf656af803e0010a4b4304aa44fe04a41a40cf23bc13210b0891a857" gracePeriod=30
Jul 10 02:19:56.302380 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:56.302320    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sxnj9"
Jul 10 02:19:56.435552 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:56.435514    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t65w5\" (UniqueName: \"kubernetes.io/projected/1dde115d-0851-4390-a4d8-d28b2fa0e2eb-kube-api-access-t65w5\") pod \"1dde115d-0851-4390-a4d8-d28b2fa0e2eb\" (UID: \"1dde115d-0851-4390-a4d8-d28b2fa0e2eb\") "
Jul 10 02:19:56.437636 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:56.437614    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dde115d-0851-4390-a4d8-d28b2fa0e2eb-kube-api-access-t65w5" (OuterVolumeSpecName: "kube-api-access-t65w5") pod "1dde115d-0851-4390-a4d8-d28b2fa0e2eb" (UID: "1dde115d-0851-4390-a4d8-d28b2fa0e2eb"). InnerVolumeSpecName "kube-api-access-t65w5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:19:56.506227 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:56.506186    2576 generic.go:356] "Generic (PLEG): container finished" podID="1dde115d-0851-4390-a4d8-d28b2fa0e2eb" containerID="cc0cabc7cf656af803e0010a4b4304aa44fe04a41a40cf23bc13210b0891a857" exitCode=0
Jul 10 02:19:56.506417 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:56.506246    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sxnj9"
Jul 10 02:19:56.506417 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:56.506270    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sxnj9" event={"ID":"1dde115d-0851-4390-a4d8-d28b2fa0e2eb","Type":"ContainerDied","Data":"cc0cabc7cf656af803e0010a4b4304aa44fe04a41a40cf23bc13210b0891a857"}
Jul 10 02:19:56.506417 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:56.506327    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sxnj9" event={"ID":"1dde115d-0851-4390-a4d8-d28b2fa0e2eb","Type":"ContainerDied","Data":"e8f952e5f5984873a4e118dcd7f97e6232625a435b7ac9a26fbe41a2a3db603d"}
Jul 10 02:19:56.506417 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:56.506349    2576 scope.go:117] "RemoveContainer" containerID="cc0cabc7cf656af803e0010a4b4304aa44fe04a41a40cf23bc13210b0891a857"
Jul 10 02:19:56.515579 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:56.515515    2576 scope.go:117] "RemoveContainer" containerID="cc0cabc7cf656af803e0010a4b4304aa44fe04a41a40cf23bc13210b0891a857"
Jul 10 02:19:56.516403 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:19:56.515864    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc0cabc7cf656af803e0010a4b4304aa44fe04a41a40cf23bc13210b0891a857\": container with ID starting with cc0cabc7cf656af803e0010a4b4304aa44fe04a41a40cf23bc13210b0891a857 not found: ID does not exist" containerID="cc0cabc7cf656af803e0010a4b4304aa44fe04a41a40cf23bc13210b0891a857"
Jul 10 02:19:56.516403 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:56.515903    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc0cabc7cf656af803e0010a4b4304aa44fe04a41a40cf23bc13210b0891a857"} err="failed to get container status \"cc0cabc7cf656af803e0010a4b4304aa44fe04a41a40cf23bc13210b0891a857\": rpc error: code = NotFound desc = could not find container \"cc0cabc7cf656af803e0010a4b4304aa44fe04a41a40cf23bc13210b0891a857\": container with ID starting with cc0cabc7cf656af803e0010a4b4304aa44fe04a41a40cf23bc13210b0891a857 not found: ID does not exist"
Jul 10 02:19:56.529922 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:56.529895    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sxnj9"]
Jul 10 02:19:56.532697 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:56.532677    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sxnj9"]
Jul 10 02:19:56.536358 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:56.536337    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t65w5\" (UniqueName: \"kubernetes.io/projected/1dde115d-0851-4390-a4d8-d28b2fa0e2eb-kube-api-access-t65w5\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:19:56.544597 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:19:56.544573    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dde115d-0851-4390-a4d8-d28b2fa0e2eb" path="/var/lib/kubelet/pods/1dde115d-0851-4390-a4d8-d28b2fa0e2eb/volumes"
Jul 10 02:20:40.287695 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:20:40.287660    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:20:56.857399 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:20:56.857358    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:21:03.350880 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:03.350843    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:21:12.045684 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.045655    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"]
Jul 10 02:21:12.046172 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.045998    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dde115d-0851-4390-a4d8-d28b2fa0e2eb" containerName="authorino"
Jul 10 02:21:12.046172 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.046010    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dde115d-0851-4390-a4d8-d28b2fa0e2eb" containerName="authorino"
Jul 10 02:21:12.046172 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.046101    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dde115d-0851-4390-a4d8-d28b2fa0e2eb" containerName="authorino"
Jul 10 02:21:12.048802 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.048787    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"
Jul 10 02:21:12.051797 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.051709    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 10 02:21:12.051948 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.051908    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 10 02:21:12.053122 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.053103    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qlqbf\""
Jul 10 02:21:12.053233 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.053166    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 10 02:21:12.059758 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.059737    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"]
Jul 10 02:21:12.126896 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.126850    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcdc6b72-52f6-4d22-b439-f8cdef6b13c9-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8w9s2\" (UID: \"bcdc6b72-52f6-4d22-b439-f8cdef6b13c9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"
Jul 10 02:21:12.127102 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.126997    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcdc6b72-52f6-4d22-b439-f8cdef6b13c9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8w9s2\" (UID: \"bcdc6b72-52f6-4d22-b439-f8cdef6b13c9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"
Jul 10 02:21:12.127102 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.127037    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcdc6b72-52f6-4d22-b439-f8cdef6b13c9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8w9s2\" (UID: \"bcdc6b72-52f6-4d22-b439-f8cdef6b13c9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"
Jul 10 02:21:12.127102 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.127090    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcdc6b72-52f6-4d22-b439-f8cdef6b13c9-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8w9s2\" (UID: \"bcdc6b72-52f6-4d22-b439-f8cdef6b13c9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"
Jul 10 02:21:12.127230 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.127125    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcdc6b72-52f6-4d22-b439-f8cdef6b13c9-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8w9s2\" (UID: \"bcdc6b72-52f6-4d22-b439-f8cdef6b13c9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"
Jul 10 02:21:12.127230 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.127170    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q26x7\" (UniqueName: \"kubernetes.io/projected/bcdc6b72-52f6-4d22-b439-f8cdef6b13c9-kube-api-access-q26x7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8w9s2\" (UID: \"bcdc6b72-52f6-4d22-b439-f8cdef6b13c9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"
Jul 10 02:21:12.228194 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.228159    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcdc6b72-52f6-4d22-b439-f8cdef6b13c9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8w9s2\" (UID: \"bcdc6b72-52f6-4d22-b439-f8cdef6b13c9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"
Jul 10 02:21:12.228194 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.228201    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcdc6b72-52f6-4d22-b439-f8cdef6b13c9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8w9s2\" (UID: \"bcdc6b72-52f6-4d22-b439-f8cdef6b13c9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"
Jul 10 02:21:12.228395 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.228323    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcdc6b72-52f6-4d22-b439-f8cdef6b13c9-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8w9s2\" (UID: \"bcdc6b72-52f6-4d22-b439-f8cdef6b13c9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"
Jul 10 02:21:12.228395 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.228356    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcdc6b72-52f6-4d22-b439-f8cdef6b13c9-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8w9s2\" (UID: \"bcdc6b72-52f6-4d22-b439-f8cdef6b13c9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"
Jul 10 02:21:12.228395 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.228378    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q26x7\" (UniqueName: \"kubernetes.io/projected/bcdc6b72-52f6-4d22-b439-f8cdef6b13c9-kube-api-access-q26x7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8w9s2\" (UID: \"bcdc6b72-52f6-4d22-b439-f8cdef6b13c9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"
Jul 10 02:21:12.228561 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.228407    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcdc6b72-52f6-4d22-b439-f8cdef6b13c9-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8w9s2\" (UID: \"bcdc6b72-52f6-4d22-b439-f8cdef6b13c9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"
Jul 10 02:21:12.228678 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.228649    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcdc6b72-52f6-4d22-b439-f8cdef6b13c9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8w9s2\" (UID: \"bcdc6b72-52f6-4d22-b439-f8cdef6b13c9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"
Jul 10 02:21:12.228794 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.228744    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcdc6b72-52f6-4d22-b439-f8cdef6b13c9-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8w9s2\" (UID: \"bcdc6b72-52f6-4d22-b439-f8cdef6b13c9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"
Jul 10 02:21:12.228836 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.228816    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcdc6b72-52f6-4d22-b439-f8cdef6b13c9-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8w9s2\" (UID: \"bcdc6b72-52f6-4d22-b439-f8cdef6b13c9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"
Jul 10 02:21:12.230553 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.230535    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcdc6b72-52f6-4d22-b439-f8cdef6b13c9-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8w9s2\" (UID: \"bcdc6b72-52f6-4d22-b439-f8cdef6b13c9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"
Jul 10 02:21:12.230818 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.230799    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcdc6b72-52f6-4d22-b439-f8cdef6b13c9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8w9s2\" (UID: \"bcdc6b72-52f6-4d22-b439-f8cdef6b13c9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"
Jul 10 02:21:12.238344 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.238321    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q26x7\" (UniqueName: \"kubernetes.io/projected/bcdc6b72-52f6-4d22-b439-f8cdef6b13c9-kube-api-access-q26x7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8w9s2\" (UID: \"bcdc6b72-52f6-4d22-b439-f8cdef6b13c9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"
Jul 10 02:21:12.359059 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.358956    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"
Jul 10 02:21:12.491079 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.491052    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"]
Jul 10 02:21:12.492794 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:21:12.492766    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcdc6b72_52f6_4d22_b439_f8cdef6b13c9.slice/crio-e2c5cee841c48774925e936aff3ee2f53261ce4d2cbd4b37847874340847bcc5 WatchSource:0}: Error finding container e2c5cee841c48774925e936aff3ee2f53261ce4d2cbd4b37847874340847bcc5: Status 404 returned error can't find the container with id e2c5cee841c48774925e936aff3ee2f53261ce4d2cbd4b37847874340847bcc5
Jul 10 02:21:12.494227 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.494209    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 02:21:12.854975 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:12.854931    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2" event={"ID":"bcdc6b72-52f6-4d22-b439-f8cdef6b13c9","Type":"ContainerStarted","Data":"e2c5cee841c48774925e936aff3ee2f53261ce4d2cbd4b37847874340847bcc5"}
Jul 10 02:21:13.062937 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:13.062899    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:21:13.868236 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:13.868200    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2" event={"ID":"bcdc6b72-52f6-4d22-b439-f8cdef6b13c9","Type":"ContainerStarted","Data":"42c5204259c46be2f6c19149ceb0493916ee25d7a2d8b18345ba79f22ab91643"}
Jul 10 02:21:13.888137 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:13.888088    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2" podStartSLOduration=0.915844622 podStartE2EDuration="1.888072602s" totalImagesPullingTime="972.22798ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:21:13.886391398 +0000 UTC m=+802.652303630" watchObservedRunningTime="2026-07-10 02:21:13.888072602 +0000 UTC m=+802.653984834"
Jul 10 02:21:19.858002 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:19.857963    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:21:22.359206 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:22.359163    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"
Jul 10 02:21:22.359606 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:22.359232    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"
Jul 10 02:21:22.371963 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:22.371933    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"
Jul 10 02:21:22.922001 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:22.921975    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8w9s2"
Jul 10 02:21:30.154804 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.154774    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"]
Jul 10 02:21:30.157513 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.157494    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"
Jul 10 02:21:30.161999 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.161980    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 10 02:21:30.169509 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.169482    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"]
Jul 10 02:21:30.199841 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.199807    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63dc9af8-c708-4110-87fd-a6e1f50157c9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bgvnx\" (UID: \"63dc9af8-c708-4110-87fd-a6e1f50157c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"
Jul 10 02:21:30.200007 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.199857    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63dc9af8-c708-4110-87fd-a6e1f50157c9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bgvnx\" (UID: \"63dc9af8-c708-4110-87fd-a6e1f50157c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"
Jul 10 02:21:30.200007 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.199881    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63dc9af8-c708-4110-87fd-a6e1f50157c9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bgvnx\" (UID: \"63dc9af8-c708-4110-87fd-a6e1f50157c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"
Jul 10 02:21:30.200007 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.199916    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63dc9af8-c708-4110-87fd-a6e1f50157c9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bgvnx\" (UID: \"63dc9af8-c708-4110-87fd-a6e1f50157c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"
Jul 10 02:21:30.200007 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.199959    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63dc9af8-c708-4110-87fd-a6e1f50157c9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bgvnx\" (UID: \"63dc9af8-c708-4110-87fd-a6e1f50157c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"
Jul 10 02:21:30.200007 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.199979    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8kdr\" (UniqueName: \"kubernetes.io/projected/63dc9af8-c708-4110-87fd-a6e1f50157c9-kube-api-access-l8kdr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bgvnx\" (UID: \"63dc9af8-c708-4110-87fd-a6e1f50157c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"
Jul 10 02:21:30.300764 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.300730    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63dc9af8-c708-4110-87fd-a6e1f50157c9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bgvnx\" (UID: \"63dc9af8-c708-4110-87fd-a6e1f50157c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"
Jul 10 02:21:30.300942 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.300772    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63dc9af8-c708-4110-87fd-a6e1f50157c9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bgvnx\" (UID: \"63dc9af8-c708-4110-87fd-a6e1f50157c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"
Jul 10 02:21:30.300942 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.300799    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63dc9af8-c708-4110-87fd-a6e1f50157c9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bgvnx\" (UID: \"63dc9af8-c708-4110-87fd-a6e1f50157c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"
Jul 10 02:21:30.300942 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.300834    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63dc9af8-c708-4110-87fd-a6e1f50157c9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bgvnx\" (UID: \"63dc9af8-c708-4110-87fd-a6e1f50157c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"
Jul 10 02:21:30.300942 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.300875    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63dc9af8-c708-4110-87fd-a6e1f50157c9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bgvnx\" (UID: \"63dc9af8-c708-4110-87fd-a6e1f50157c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"
Jul 10 02:21:30.301177 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.301022    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8kdr\" (UniqueName: \"kubernetes.io/projected/63dc9af8-c708-4110-87fd-a6e1f50157c9-kube-api-access-l8kdr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bgvnx\" (UID: \"63dc9af8-c708-4110-87fd-a6e1f50157c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"
Jul 10 02:21:30.301226 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.301188    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63dc9af8-c708-4110-87fd-a6e1f50157c9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bgvnx\" (UID: \"63dc9af8-c708-4110-87fd-a6e1f50157c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"
Jul 10 02:21:30.301273 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.301237    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63dc9af8-c708-4110-87fd-a6e1f50157c9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bgvnx\" (UID: \"63dc9af8-c708-4110-87fd-a6e1f50157c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"
Jul 10 02:21:30.301336 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.301271    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63dc9af8-c708-4110-87fd-a6e1f50157c9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bgvnx\" (UID: \"63dc9af8-c708-4110-87fd-a6e1f50157c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"
Jul 10 02:21:30.303222 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.303200    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63dc9af8-c708-4110-87fd-a6e1f50157c9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bgvnx\" (UID: \"63dc9af8-c708-4110-87fd-a6e1f50157c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"
Jul 10 02:21:30.303489 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.303468    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63dc9af8-c708-4110-87fd-a6e1f50157c9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bgvnx\" (UID: \"63dc9af8-c708-4110-87fd-a6e1f50157c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"
Jul 10 02:21:30.310903 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.310878    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8kdr\" (UniqueName: \"kubernetes.io/projected/63dc9af8-c708-4110-87fd-a6e1f50157c9-kube-api-access-l8kdr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bgvnx\" (UID: \"63dc9af8-c708-4110-87fd-a6e1f50157c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"
Jul 10 02:21:30.468349 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.468255    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"
Jul 10 02:21:30.601445 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.601420    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"]
Jul 10 02:21:30.603786 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:21:30.603761    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63dc9af8_c708_4110_87fd_a6e1f50157c9.slice/crio-d36b63483e9f21456f23af408893d3c17f6f3e8535d2195d77177309e9c863fa WatchSource:0}: Error finding container d36b63483e9f21456f23af408893d3c17f6f3e8535d2195d77177309e9c863fa: Status 404 returned error can't find the container with id d36b63483e9f21456f23af408893d3c17f6f3e8535d2195d77177309e9c863fa
Jul 10 02:21:30.948832 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.948799    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx" event={"ID":"63dc9af8-c708-4110-87fd-a6e1f50157c9","Type":"ContainerStarted","Data":"d0202a4ebe53d89243a69979e9450001772238e8b8a7df6984b128fb0b1609f6"}
Jul 10 02:21:30.948991 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.948849    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx" event={"ID":"63dc9af8-c708-4110-87fd-a6e1f50157c9","Type":"ContainerStarted","Data":"d36b63483e9f21456f23af408893d3c17f6f3e8535d2195d77177309e9c863fa"}
Jul 10 02:21:30.969324 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:30.969271    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx" podStartSLOduration=0.801055861 podStartE2EDuration="969.254534ms" totalImagesPullingTime="168.198673ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:21:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:21:30.968179827 +0000 UTC m=+819.734092063" watchObservedRunningTime="2026-07-10 02:21:30.969254534 +0000 UTC m=+819.735166767"
Jul 10 02:21:32.151849 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:32.151813    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:21:40.468607 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:40.468562    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"
Jul 10 02:21:40.469230 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:40.468643    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"
Jul 10 02:21:40.481160 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:40.481132    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"
Jul 10 02:21:40.957020 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:40.956975    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:21:41.004128 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:21:41.004097    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bgvnx"
Jul 10 02:22:52.452867 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:22:52.452788    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/2.log"
Jul 10 02:22:52.454591 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:22:52.454566    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/2.log"
Jul 10 02:22:52.456614 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:22:52.456595    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt7wb_164f62ad-8b5b-4a66-9bfe-17d863ddeeea/ovn-acl-logging/0.log"
Jul 10 02:22:52.457841 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:22:52.457825    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt7wb_164f62ad-8b5b-4a66-9bfe-17d863ddeeea/ovn-acl-logging/0.log"
Jul 10 02:23:02.957948 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:23:02.957912    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:23:12.961389 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:23:12.961350    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:23:24.959060 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:23:24.958341    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:23:33.157675 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:23:33.157640    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:23:44.064702 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:23:44.064665    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:24:11.159419 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:24:11.159383    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:24:24.264763 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:24:24.264675    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:24:57.949598 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:24:57.949559    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:25:06.955218 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:25:06.955183    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:25:15.964306 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:25:15.964268    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:25:22.052469 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:25:22.052426    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:25:33.056249 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:25:33.056207    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:25:44.058783 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:25:44.058701    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:25:55.461711 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:25:55.461676    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:26:05.263509 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:26:05.263476    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:26:28.460863 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:26:28.460833    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:26:37.661617 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:26:37.661585    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:27:01.557763 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:27:01.557730    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:27:12.445065 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:27:12.445010    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:27:27.551140 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:27:27.551053    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:27:37.154920 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:27:37.154882    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:27:47.055774 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:27:47.055739    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:27:52.487358 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:27:52.487328    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/2.log"
Jul 10 02:27:52.488353 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:27:52.488330    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/2.log"
Jul 10 02:27:52.490349 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:27:52.490328    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt7wb_164f62ad-8b5b-4a66-9bfe-17d863ddeeea/ovn-acl-logging/0.log"
Jul 10 02:27:52.491366 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:27:52.491339    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt7wb_164f62ad-8b5b-4a66-9bfe-17d863ddeeea/ovn-acl-logging/0.log"
Jul 10 02:27:56.760358 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:27:56.760325    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:28:06.063817 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:28:06.063779    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:29:56.862480 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:29:56.862438    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:30:06.756485 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:30:06.756441    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:30:20.348804 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:30:20.348711    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:30:33.266186 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:30:33.266153    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:30:46.051487 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:30:46.051450    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:30:55.788996 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:30:55.788959    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:31:04.156476 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:31:04.156435    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:31:14.060564 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:31:14.060530    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:31:25.367287 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:31:25.367246    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:31:34.758364 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:31:34.758327    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:31:45.750633 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:31:45.750542    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:32:07.361534 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:32:07.361494    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:32:16.861370 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:32:16.861336    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:32:27.651093 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:32:27.651056    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:32:39.066221 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:32:39.066190    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:32:52.516334 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:32:52.516304    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/2.log"
Jul 10 02:32:52.519158 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:32:52.519138    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/2.log"
Jul 10 02:32:52.519290 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:32:52.519183    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt7wb_164f62ad-8b5b-4a66-9bfe-17d863ddeeea/ovn-acl-logging/0.log"
Jul 10 02:32:52.521985 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:32:52.521965    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt7wb_164f62ad-8b5b-4a66-9bfe-17d863ddeeea/ovn-acl-logging/0.log"
Jul 10 02:33:05.160948 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:33:05.160907    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:33:14.756596 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:33:14.756505    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:33:26.254904 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:33:26.254868    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:33:35.659369 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:33:35.659336    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:33:46.760869 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:33:46.760842    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:33:58.458392 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:33:58.458357    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:34:08.156076 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:34:08.156043    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:34:23.254154 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:34:23.254116    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:34:31.360890 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:34:31.360857    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:34:43.755222 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:34:43.755141    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:35:01.354505 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:35:01.354470    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:35:13.359202 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:35:13.359165    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:35:26.357229 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:35:26.357194    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:35:36.059961 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:35:36.059925    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:35:46.673943 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:35:46.673909    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:35:58.957008 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:35:58.956972    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:36:10.155646 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:36:10.155610    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:37:14.549790 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:37:14.549748    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:37:27.156086 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:37:27.156050    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:37:52.546249 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:37:52.546223    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/2.log"
Jul 10 02:37:52.548908 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:37:52.548884    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt7wb_164f62ad-8b5b-4a66-9bfe-17d863ddeeea/ovn-acl-logging/0.log"
Jul 10 02:37:52.549872 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:37:52.549850    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/2.log"
Jul 10 02:37:52.552868 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:37:52.552848    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt7wb_164f62ad-8b5b-4a66-9bfe-17d863ddeeea/ovn-acl-logging/0.log"
Jul 10 02:38:38.255770 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:38:38.255734    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:38:59.254597 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:38:59.254557    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:39:59.352121 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:39:59.352086    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:41:32.560155 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:41:32.560120    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:41:41.454099 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:41:41.454063    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:41:55.353448 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:41:55.353407    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:42:15.749202 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:42:15.749126    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:42:52.575015 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:42:52.574984    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/2.log"
Jul 10 02:42:52.577849 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:42:52.577827    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt7wb_164f62ad-8b5b-4a66-9bfe-17d863ddeeea/ovn-acl-logging/0.log"
Jul 10 02:42:52.580136 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:42:52.580115    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/2.log"
Jul 10 02:42:52.582992 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:42:52.582971    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt7wb_164f62ad-8b5b-4a66-9bfe-17d863ddeeea/ovn-acl-logging/0.log"
Jul 10 02:42:57.955534 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:42:57.955501    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:43:06.444682 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.444652    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"]
Jul 10 02:43:06.448012 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.447996    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"
Jul 10 02:43:06.451305 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.451284    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b3d83c99\"/\"openshift-service-ca.crt\""
Jul 10 02:43:06.451474 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.451329    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b3d83c99\"/\"kube-root-ca.crt\""
Jul 10 02:43:06.452792 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.452774    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b3d83c99\"/\"default-dockercfg-qjtxc\""
Jul 10 02:43:06.452888 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.452806    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b3d83c99\"/\"e2e-lifecycle-model-b3d83c99-kserve-self-signed-certs\""
Jul 10 02:43:06.457055 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.457022    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"]
Jul 10 02:43:06.548012 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.547979    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55694b13-19ff-43a5-a9df-a72414491abe-tls-certs\") pod \"e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks\" (UID: \"55694b13-19ff-43a5-a9df-a72414491abe\") " pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"
Jul 10 02:43:06.548199 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.548059    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55694b13-19ff-43a5-a9df-a72414491abe-home\") pod \"e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks\" (UID: \"55694b13-19ff-43a5-a9df-a72414491abe\") " pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"
Jul 10 02:43:06.548199 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.548090    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55694b13-19ff-43a5-a9df-a72414491abe-tmp-dir\") pod \"e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks\" (UID: \"55694b13-19ff-43a5-a9df-a72414491abe\") " pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"
Jul 10 02:43:06.548199 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.548148    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xbt6\" (UniqueName: \"kubernetes.io/projected/55694b13-19ff-43a5-a9df-a72414491abe-kube-api-access-6xbt6\") pod \"e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks\" (UID: \"55694b13-19ff-43a5-a9df-a72414491abe\") " pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"
Jul 10 02:43:06.548199 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.548174    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55694b13-19ff-43a5-a9df-a72414491abe-dshm\") pod \"e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks\" (UID: \"55694b13-19ff-43a5-a9df-a72414491abe\") " pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"
Jul 10 02:43:06.548356 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.548222    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55694b13-19ff-43a5-a9df-a72414491abe-model-cache\") pod \"e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks\" (UID: \"55694b13-19ff-43a5-a9df-a72414491abe\") " pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"
Jul 10 02:43:06.648739 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.648696    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55694b13-19ff-43a5-a9df-a72414491abe-tls-certs\") pod \"e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks\" (UID: \"55694b13-19ff-43a5-a9df-a72414491abe\") " pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"
Jul 10 02:43:06.648921 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.648770    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55694b13-19ff-43a5-a9df-a72414491abe-home\") pod \"e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks\" (UID: \"55694b13-19ff-43a5-a9df-a72414491abe\") " pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"
Jul 10 02:43:06.648921 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.648792    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55694b13-19ff-43a5-a9df-a72414491abe-tmp-dir\") pod \"e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks\" (UID: \"55694b13-19ff-43a5-a9df-a72414491abe\") " pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"
Jul 10 02:43:06.648921 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.648836    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xbt6\" (UniqueName: \"kubernetes.io/projected/55694b13-19ff-43a5-a9df-a72414491abe-kube-api-access-6xbt6\") pod \"e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks\" (UID: \"55694b13-19ff-43a5-a9df-a72414491abe\") " pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"
Jul 10 02:43:06.648921 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.648869    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55694b13-19ff-43a5-a9df-a72414491abe-dshm\") pod \"e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks\" (UID: \"55694b13-19ff-43a5-a9df-a72414491abe\") " pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"
Jul 10 02:43:06.648921 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.648922    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55694b13-19ff-43a5-a9df-a72414491abe-model-cache\") pod \"e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks\" (UID: \"55694b13-19ff-43a5-a9df-a72414491abe\") " pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"
Jul 10 02:43:06.649297 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.649273    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55694b13-19ff-43a5-a9df-a72414491abe-tmp-dir\") pod \"e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks\" (UID: \"55694b13-19ff-43a5-a9df-a72414491abe\") " pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"
Jul 10 02:43:06.649367 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.649310    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55694b13-19ff-43a5-a9df-a72414491abe-model-cache\") pod \"e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks\" (UID: \"55694b13-19ff-43a5-a9df-a72414491abe\") " pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"
Jul 10 02:43:06.649425 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.649400    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55694b13-19ff-43a5-a9df-a72414491abe-home\") pod \"e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks\" (UID: \"55694b13-19ff-43a5-a9df-a72414491abe\") " pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"
Jul 10 02:43:06.651064 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.651042    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55694b13-19ff-43a5-a9df-a72414491abe-dshm\") pod \"e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks\" (UID: \"55694b13-19ff-43a5-a9df-a72414491abe\") " pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"
Jul 10 02:43:06.651227 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.651211    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55694b13-19ff-43a5-a9df-a72414491abe-tls-certs\") pod \"e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks\" (UID: \"55694b13-19ff-43a5-a9df-a72414491abe\") " pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"
Jul 10 02:43:06.658938 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.658915    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xbt6\" (UniqueName: \"kubernetes.io/projected/55694b13-19ff-43a5-a9df-a72414491abe-kube-api-access-6xbt6\") pod \"e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks\" (UID: \"55694b13-19ff-43a5-a9df-a72414491abe\") " pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"
Jul 10 02:43:06.758099 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.758001    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"
Jul 10 02:43:06.890360 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.890334    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"]
Jul 10 02:43:06.892213 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:43:06.892187    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55694b13_19ff_43a5_a9df_a72414491abe.slice/crio-5aa2c95f4ca0e9610db57ffd0e69fda4e6a951a2cb66c3b2a525c27463bb4b1f WatchSource:0}: Error finding container 5aa2c95f4ca0e9610db57ffd0e69fda4e6a951a2cb66c3b2a525c27463bb4b1f: Status 404 returned error can't find the container with id 5aa2c95f4ca0e9610db57ffd0e69fda4e6a951a2cb66c3b2a525c27463bb4b1f
Jul 10 02:43:06.979721 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.979692    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks" event={"ID":"55694b13-19ff-43a5-a9df-a72414491abe","Type":"ContainerStarted","Data":"2ac1e32193d10e1e2520e6812f4c0f8418d101eea761b188531b8d7d22a95215"}
Jul 10 02:43:06.979878 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:06.979736    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks" event={"ID":"55694b13-19ff-43a5-a9df-a72414491abe","Type":"ContainerStarted","Data":"5aa2c95f4ca0e9610db57ffd0e69fda4e6a951a2cb66c3b2a525c27463bb4b1f"}
Jul 10 02:43:07.000687 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:07.000640    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks" podStartSLOduration=1.000621736 podStartE2EDuration="1.000621736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:43:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:43:06.997416218 +0000 UTC m=+2115.763328465" watchObservedRunningTime="2026-07-10 02:43:07.000621736 +0000 UTC m=+2115.766533971"
Jul 10 02:43:13.152232 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:13.152199    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:43:16.759124 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:16.759089    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"
Jul 10 02:43:16.761502 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:16.759139    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"
Jul 10 02:43:16.771656 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:16.771628    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"
Jul 10 02:43:17.037793 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:17.037713    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"
Jul 10 02:43:22.753383 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:22.753349    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:43:42.749775 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:42.749738    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:43:49.577279 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:43:49.577239    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"]
Jul 10 02:44:04.598264 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:04.598227    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks" podUID="55694b13-19ff-43a5-a9df-a72414491abe" containerName="main" containerID="cri-o://2ac1e32193d10e1e2520e6812f4c0f8418d101eea761b188531b8d7d22a95215" gracePeriod=45
Jul 10 02:44:04.848501 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:04.848444    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"
Jul 10 02:44:04.992612 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:04.992580    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55694b13-19ff-43a5-a9df-a72414491abe-tmp-dir\") pod \"55694b13-19ff-43a5-a9df-a72414491abe\" (UID: \"55694b13-19ff-43a5-a9df-a72414491abe\") "
Jul 10 02:44:04.992612 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:04.992622    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55694b13-19ff-43a5-a9df-a72414491abe-model-cache\") pod \"55694b13-19ff-43a5-a9df-a72414491abe\" (UID: \"55694b13-19ff-43a5-a9df-a72414491abe\") "
Jul 10 02:44:04.992856 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:04.992681    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xbt6\" (UniqueName: \"kubernetes.io/projected/55694b13-19ff-43a5-a9df-a72414491abe-kube-api-access-6xbt6\") pod \"55694b13-19ff-43a5-a9df-a72414491abe\" (UID: \"55694b13-19ff-43a5-a9df-a72414491abe\") "
Jul 10 02:44:04.992856 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:04.992732    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55694b13-19ff-43a5-a9df-a72414491abe-home\") pod \"55694b13-19ff-43a5-a9df-a72414491abe\" (UID: \"55694b13-19ff-43a5-a9df-a72414491abe\") "
Jul 10 02:44:04.992856 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:04.992751    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55694b13-19ff-43a5-a9df-a72414491abe-tls-certs\") pod \"55694b13-19ff-43a5-a9df-a72414491abe\" (UID: \"55694b13-19ff-43a5-a9df-a72414491abe\") "
Jul 10 02:44:04.992856 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:04.992777    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55694b13-19ff-43a5-a9df-a72414491abe-dshm\") pod \"55694b13-19ff-43a5-a9df-a72414491abe\" (UID: \"55694b13-19ff-43a5-a9df-a72414491abe\") "
Jul 10 02:44:04.993007 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:04.992888    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55694b13-19ff-43a5-a9df-a72414491abe-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "55694b13-19ff-43a5-a9df-a72414491abe" (UID: "55694b13-19ff-43a5-a9df-a72414491abe"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:44:04.993007 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:04.992930    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55694b13-19ff-43a5-a9df-a72414491abe-model-cache" (OuterVolumeSpecName: "model-cache") pod "55694b13-19ff-43a5-a9df-a72414491abe" (UID: "55694b13-19ff-43a5-a9df-a72414491abe"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:44:04.993125 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:04.993006    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55694b13-19ff-43a5-a9df-a72414491abe-home" (OuterVolumeSpecName: "home") pod "55694b13-19ff-43a5-a9df-a72414491abe" (UID: "55694b13-19ff-43a5-a9df-a72414491abe"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:44:04.993175 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:04.993123    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55694b13-19ff-43a5-a9df-a72414491abe-tmp-dir\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:44:04.993175 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:04.993138    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55694b13-19ff-43a5-a9df-a72414491abe-model-cache\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:44:04.993175 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:04.993147    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55694b13-19ff-43a5-a9df-a72414491abe-home\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:44:04.995111 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:04.995086    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55694b13-19ff-43a5-a9df-a72414491abe-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "55694b13-19ff-43a5-a9df-a72414491abe" (UID: "55694b13-19ff-43a5-a9df-a72414491abe"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:44:04.995186 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:04.995113    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55694b13-19ff-43a5-a9df-a72414491abe-kube-api-access-6xbt6" (OuterVolumeSpecName: "kube-api-access-6xbt6") pod "55694b13-19ff-43a5-a9df-a72414491abe" (UID: "55694b13-19ff-43a5-a9df-a72414491abe"). InnerVolumeSpecName "kube-api-access-6xbt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:44:04.995186 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:04.995155    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55694b13-19ff-43a5-a9df-a72414491abe-dshm" (OuterVolumeSpecName: "dshm") pod "55694b13-19ff-43a5-a9df-a72414491abe" (UID: "55694b13-19ff-43a5-a9df-a72414491abe"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:44:05.094421 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:05.094391    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xbt6\" (UniqueName: \"kubernetes.io/projected/55694b13-19ff-43a5-a9df-a72414491abe-kube-api-access-6xbt6\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:44:05.094421 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:05.094417    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55694b13-19ff-43a5-a9df-a72414491abe-tls-certs\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:44:05.094421 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:05.094426    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55694b13-19ff-43a5-a9df-a72414491abe-dshm\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:44:05.268860 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:05.268827    2576 generic.go:356] "Generic (PLEG): container finished" podID="55694b13-19ff-43a5-a9df-a72414491abe" containerID="2ac1e32193d10e1e2520e6812f4c0f8418d101eea761b188531b8d7d22a95215" exitCode=0
Jul 10 02:44:05.269068 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:05.268881    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"
Jul 10 02:44:05.269068 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:05.268917    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks" event={"ID":"55694b13-19ff-43a5-a9df-a72414491abe","Type":"ContainerDied","Data":"2ac1e32193d10e1e2520e6812f4c0f8418d101eea761b188531b8d7d22a95215"}
Jul 10 02:44:05.269068 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:05.268972    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks" event={"ID":"55694b13-19ff-43a5-a9df-a72414491abe","Type":"ContainerDied","Data":"5aa2c95f4ca0e9610db57ffd0e69fda4e6a951a2cb66c3b2a525c27463bb4b1f"}
Jul 10 02:44:05.269068 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:05.268998    2576 scope.go:117] "RemoveContainer" containerID="2ac1e32193d10e1e2520e6812f4c0f8418d101eea761b188531b8d7d22a95215"
Jul 10 02:44:05.278106 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:05.278090    2576 scope.go:117] "RemoveContainer" containerID="2ac1e32193d10e1e2520e6812f4c0f8418d101eea761b188531b8d7d22a95215"
Jul 10 02:44:05.278390 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:44:05.278373    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ac1e32193d10e1e2520e6812f4c0f8418d101eea761b188531b8d7d22a95215\": container with ID starting with 2ac1e32193d10e1e2520e6812f4c0f8418d101eea761b188531b8d7d22a95215 not found: ID does not exist" containerID="2ac1e32193d10e1e2520e6812f4c0f8418d101eea761b188531b8d7d22a95215"
Jul 10 02:44:05.278442 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:05.278400    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ac1e32193d10e1e2520e6812f4c0f8418d101eea761b188531b8d7d22a95215"} err="failed to get container status \"2ac1e32193d10e1e2520e6812f4c0f8418d101eea761b188531b8d7d22a95215\": rpc error: code = NotFound desc = could not find container \"2ac1e32193d10e1e2520e6812f4c0f8418d101eea761b188531b8d7d22a95215\": container with ID starting with 2ac1e32193d10e1e2520e6812f4c0f8418d101eea761b188531b8d7d22a95215 not found: ID does not exist"
Jul 10 02:44:05.293163 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:05.293139    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"]
Jul 10 02:44:05.298252 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:05.298230    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-b3d83c99/e2e-lifecycle-model-b3d83c99-kserve-d646cfd47-z7pks"]
Jul 10 02:44:06.544123 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:06.544092    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55694b13-19ff-43a5-a9df-a72414491abe" path="/var/lib/kubelet/pods/55694b13-19ff-43a5-a9df-a72414491abe/volumes"
Jul 10 02:44:41.358386 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:41.358348    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:44:55.554735 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:44:55.554700    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:45:44.751003 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:45:44.750970    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:45:59.749227 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:45:59.749189    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:46:12.738668 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.738634    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"]
Jul 10 02:46:12.739290 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.739260    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55694b13-19ff-43a5-a9df-a72414491abe" containerName="main"
Jul 10 02:46:12.739290 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.739286    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="55694b13-19ff-43a5-a9df-a72414491abe" containerName="main"
Jul 10 02:46:12.739452 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.739385    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="55694b13-19ff-43a5-a9df-a72414491abe" containerName="main"
Jul 10 02:46:12.742853 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.742834    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"
Jul 10 02:46:12.747107 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.747084    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d76849\"/\"kube-root-ca.crt\""
Jul 10 02:46:12.747230 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.747088    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d76849\"/\"test-model-d76849-kserve-self-signed-certs\""
Jul 10 02:46:12.747230 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.747094    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d76849\"/\"openshift-service-ca.crt\""
Jul 10 02:46:12.747230 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.747140    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d76849\"/\"default-dockercfg-gbj4t\""
Jul 10 02:46:12.752418 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.752399    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"]
Jul 10 02:46:12.813556 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.813521    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b033fcc-8860-4d6d-976c-66d5275170d9-tls-certs\") pod \"test-model-d76849-kserve-5bc6cd6769-rr2wg\" (UID: \"6b033fcc-8860-4d6d-976c-66d5275170d9\") " pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"
Jul 10 02:46:12.813713 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.813566    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b033fcc-8860-4d6d-976c-66d5275170d9-dshm\") pod \"test-model-d76849-kserve-5bc6cd6769-rr2wg\" (UID: \"6b033fcc-8860-4d6d-976c-66d5275170d9\") " pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"
Jul 10 02:46:12.813713 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.813622    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd4q9\" (UniqueName: \"kubernetes.io/projected/6b033fcc-8860-4d6d-976c-66d5275170d9-kube-api-access-kd4q9\") pod \"test-model-d76849-kserve-5bc6cd6769-rr2wg\" (UID: \"6b033fcc-8860-4d6d-976c-66d5275170d9\") " pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"
Jul 10 02:46:12.813713 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.813676    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b033fcc-8860-4d6d-976c-66d5275170d9-model-cache\") pod \"test-model-d76849-kserve-5bc6cd6769-rr2wg\" (UID: \"6b033fcc-8860-4d6d-976c-66d5275170d9\") " pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"
Jul 10 02:46:12.813713 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.813702    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b033fcc-8860-4d6d-976c-66d5275170d9-home\") pod \"test-model-d76849-kserve-5bc6cd6769-rr2wg\" (UID: \"6b033fcc-8860-4d6d-976c-66d5275170d9\") " pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"
Jul 10 02:46:12.813870 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.813724    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b033fcc-8860-4d6d-976c-66d5275170d9-tmp-dir\") pod \"test-model-d76849-kserve-5bc6cd6769-rr2wg\" (UID: \"6b033fcc-8860-4d6d-976c-66d5275170d9\") " pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"
Jul 10 02:46:12.914801 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.914765    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b033fcc-8860-4d6d-976c-66d5275170d9-tls-certs\") pod \"test-model-d76849-kserve-5bc6cd6769-rr2wg\" (UID: \"6b033fcc-8860-4d6d-976c-66d5275170d9\") " pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"
Jul 10 02:46:12.915007 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.914816    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b033fcc-8860-4d6d-976c-66d5275170d9-dshm\") pod \"test-model-d76849-kserve-5bc6cd6769-rr2wg\" (UID: \"6b033fcc-8860-4d6d-976c-66d5275170d9\") " pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"
Jul 10 02:46:12.915007 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.914873    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd4q9\" (UniqueName: \"kubernetes.io/projected/6b033fcc-8860-4d6d-976c-66d5275170d9-kube-api-access-kd4q9\") pod \"test-model-d76849-kserve-5bc6cd6769-rr2wg\" (UID: \"6b033fcc-8860-4d6d-976c-66d5275170d9\") " pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"
Jul 10 02:46:12.915007 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.914911    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b033fcc-8860-4d6d-976c-66d5275170d9-model-cache\") pod \"test-model-d76849-kserve-5bc6cd6769-rr2wg\" (UID: \"6b033fcc-8860-4d6d-976c-66d5275170d9\") " pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"
Jul 10 02:46:12.915007 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.914941    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b033fcc-8860-4d6d-976c-66d5275170d9-home\") pod \"test-model-d76849-kserve-5bc6cd6769-rr2wg\" (UID: \"6b033fcc-8860-4d6d-976c-66d5275170d9\") " pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"
Jul 10 02:46:12.915007 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.914972    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b033fcc-8860-4d6d-976c-66d5275170d9-tmp-dir\") pod \"test-model-d76849-kserve-5bc6cd6769-rr2wg\" (UID: \"6b033fcc-8860-4d6d-976c-66d5275170d9\") " pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"
Jul 10 02:46:12.915407 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.915381    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b033fcc-8860-4d6d-976c-66d5275170d9-home\") pod \"test-model-d76849-kserve-5bc6cd6769-rr2wg\" (UID: \"6b033fcc-8860-4d6d-976c-66d5275170d9\") " pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"
Jul 10 02:46:12.915478 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.915418    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b033fcc-8860-4d6d-976c-66d5275170d9-model-cache\") pod \"test-model-d76849-kserve-5bc6cd6769-rr2wg\" (UID: \"6b033fcc-8860-4d6d-976c-66d5275170d9\") " pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"
Jul 10 02:46:12.915478 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.915437    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b033fcc-8860-4d6d-976c-66d5275170d9-tmp-dir\") pod \"test-model-d76849-kserve-5bc6cd6769-rr2wg\" (UID: \"6b033fcc-8860-4d6d-976c-66d5275170d9\") " pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"
Jul 10 02:46:12.917247 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.917223    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b033fcc-8860-4d6d-976c-66d5275170d9-dshm\") pod \"test-model-d76849-kserve-5bc6cd6769-rr2wg\" (UID: \"6b033fcc-8860-4d6d-976c-66d5275170d9\") " pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"
Jul 10 02:46:12.917474 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.917455    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b033fcc-8860-4d6d-976c-66d5275170d9-tls-certs\") pod \"test-model-d76849-kserve-5bc6cd6769-rr2wg\" (UID: \"6b033fcc-8860-4d6d-976c-66d5275170d9\") " pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"
Jul 10 02:46:12.924706 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:12.924684    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd4q9\" (UniqueName: \"kubernetes.io/projected/6b033fcc-8860-4d6d-976c-66d5275170d9-kube-api-access-kd4q9\") pod \"test-model-d76849-kserve-5bc6cd6769-rr2wg\" (UID: \"6b033fcc-8860-4d6d-976c-66d5275170d9\") " pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"
Jul 10 02:46:13.052459 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:13.052364    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"
Jul 10 02:46:13.193463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:13.193435    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"]
Jul 10 02:46:13.195549 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:46:13.195522    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b033fcc_8860_4d6d_976c_66d5275170d9.slice/crio-2abfb8f1fc497da1731f8cb20b48109740e392510686e68e790ab6db1807cf2e WatchSource:0}: Error finding container 2abfb8f1fc497da1731f8cb20b48109740e392510686e68e790ab6db1807cf2e: Status 404 returned error can't find the container with id 2abfb8f1fc497da1731f8cb20b48109740e392510686e68e790ab6db1807cf2e
Jul 10 02:46:13.878086 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:13.878049    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg" event={"ID":"6b033fcc-8860-4d6d-976c-66d5275170d9","Type":"ContainerStarted","Data":"ce041ae6186e25b6a983983950c9b937567831179f74db1fea20571d168c7add"}
Jul 10 02:46:13.878480 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:13.878095    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg" event={"ID":"6b033fcc-8860-4d6d-976c-66d5275170d9","Type":"ContainerStarted","Data":"2abfb8f1fc497da1731f8cb20b48109740e392510686e68e790ab6db1807cf2e"}
Jul 10 02:46:13.904366 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:13.899099    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg" podStartSLOduration=1.899080152 podStartE2EDuration="1.899080152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:46:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:46:13.896015659 +0000 UTC m=+2302.661927905" watchObservedRunningTime="2026-07-10 02:46:13.899080152 +0000 UTC m=+2302.664992386"
Jul 10 02:46:15.858853 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:15.858818    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:46:23.052547 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:23.052512    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"
Jul 10 02:46:23.053044 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:23.052562    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"
Jul 10 02:46:23.066523 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:23.066499    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"
Jul 10 02:46:23.938833 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:23.938799    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"
Jul 10 02:46:28.300859 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:28.300812    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:46:37.958728 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:37.958694    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"]
Jul 10 02:46:37.962053 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:37.962019    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"
Jul 10 02:46:37.964985 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:37.964959    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-bbcae0\"/\"kube-root-ca.crt\""
Jul 10 02:46:37.966323 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:37.966299    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-bbcae0\"/\"openshift-service-ca.crt\""
Jul 10 02:46:37.966493 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:37.966335    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-bbcae0\"/\"default-dockercfg-fj25w\""
Jul 10 02:46:37.966493 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:37.966409    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-bbcae0\"/\"test-model-bbcae0-kserve-self-signed-certs\""
Jul 10 02:46:37.971119 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:37.971098    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"]
Jul 10 02:46:38.053278 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:38.053248    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a177e64d-7106-413a-909a-bd978ffd8b34-home\") pod \"test-model-bbcae0-kserve-589555c5bc-p7jzt\" (UID: \"a177e64d-7106-413a-909a-bd978ffd8b34\") " pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"
Jul 10 02:46:38.053445 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:38.053300    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a177e64d-7106-413a-909a-bd978ffd8b34-model-cache\") pod \"test-model-bbcae0-kserve-589555c5bc-p7jzt\" (UID: \"a177e64d-7106-413a-909a-bd978ffd8b34\") " pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"
Jul 10 02:46:38.053445 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:38.053334    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a177e64d-7106-413a-909a-bd978ffd8b34-tmp-dir\") pod \"test-model-bbcae0-kserve-589555c5bc-p7jzt\" (UID: \"a177e64d-7106-413a-909a-bd978ffd8b34\") " pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"
Jul 10 02:46:38.053445 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:38.053373    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggjd5\" (UniqueName: \"kubernetes.io/projected/a177e64d-7106-413a-909a-bd978ffd8b34-kube-api-access-ggjd5\") pod \"test-model-bbcae0-kserve-589555c5bc-p7jzt\" (UID: \"a177e64d-7106-413a-909a-bd978ffd8b34\") " pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"
Jul 10 02:46:38.053445 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:38.053391    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a177e64d-7106-413a-909a-bd978ffd8b34-dshm\") pod \"test-model-bbcae0-kserve-589555c5bc-p7jzt\" (UID: \"a177e64d-7106-413a-909a-bd978ffd8b34\") " pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"
Jul 10 02:46:38.053576 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:38.053502    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a177e64d-7106-413a-909a-bd978ffd8b34-tls-certs\") pod \"test-model-bbcae0-kserve-589555c5bc-p7jzt\" (UID: \"a177e64d-7106-413a-909a-bd978ffd8b34\") " pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"
Jul 10 02:46:38.154220 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:38.154184    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a177e64d-7106-413a-909a-bd978ffd8b34-tls-certs\") pod \"test-model-bbcae0-kserve-589555c5bc-p7jzt\" (UID: \"a177e64d-7106-413a-909a-bd978ffd8b34\") " pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"
Jul 10 02:46:38.154412 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:38.154244    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a177e64d-7106-413a-909a-bd978ffd8b34-home\") pod \"test-model-bbcae0-kserve-589555c5bc-p7jzt\" (UID: \"a177e64d-7106-413a-909a-bd978ffd8b34\") " pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"
Jul 10 02:46:38.154412 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:38.154281    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a177e64d-7106-413a-909a-bd978ffd8b34-model-cache\") pod \"test-model-bbcae0-kserve-589555c5bc-p7jzt\" (UID: \"a177e64d-7106-413a-909a-bd978ffd8b34\") " pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"
Jul 10 02:46:38.154412 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:38.154295    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a177e64d-7106-413a-909a-bd978ffd8b34-tmp-dir\") pod \"test-model-bbcae0-kserve-589555c5bc-p7jzt\" (UID: \"a177e64d-7106-413a-909a-bd978ffd8b34\") " pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"
Jul 10 02:46:38.154412 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:38.154332    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggjd5\" (UniqueName: \"kubernetes.io/projected/a177e64d-7106-413a-909a-bd978ffd8b34-kube-api-access-ggjd5\") pod \"test-model-bbcae0-kserve-589555c5bc-p7jzt\" (UID: \"a177e64d-7106-413a-909a-bd978ffd8b34\") " pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"
Jul 10 02:46:38.154412 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:38.154352    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a177e64d-7106-413a-909a-bd978ffd8b34-dshm\") pod \"test-model-bbcae0-kserve-589555c5bc-p7jzt\" (UID: \"a177e64d-7106-413a-909a-bd978ffd8b34\") " pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"
Jul 10 02:46:38.154727 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:38.154698    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a177e64d-7106-413a-909a-bd978ffd8b34-home\") pod \"test-model-bbcae0-kserve-589555c5bc-p7jzt\" (UID: \"a177e64d-7106-413a-909a-bd978ffd8b34\") " pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"
Jul 10 02:46:38.154802 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:38.154743    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a177e64d-7106-413a-909a-bd978ffd8b34-tmp-dir\") pod \"test-model-bbcae0-kserve-589555c5bc-p7jzt\" (UID: \"a177e64d-7106-413a-909a-bd978ffd8b34\") " pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"
Jul 10 02:46:38.154802 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:38.154775    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a177e64d-7106-413a-909a-bd978ffd8b34-model-cache\") pod \"test-model-bbcae0-kserve-589555c5bc-p7jzt\" (UID: \"a177e64d-7106-413a-909a-bd978ffd8b34\") " pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"
Jul 10 02:46:38.156526 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:38.156507    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a177e64d-7106-413a-909a-bd978ffd8b34-dshm\") pod \"test-model-bbcae0-kserve-589555c5bc-p7jzt\" (UID: \"a177e64d-7106-413a-909a-bd978ffd8b34\") " pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"
Jul 10 02:46:38.156681 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:38.156665    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a177e64d-7106-413a-909a-bd978ffd8b34-tls-certs\") pod \"test-model-bbcae0-kserve-589555c5bc-p7jzt\" (UID: \"a177e64d-7106-413a-909a-bd978ffd8b34\") " pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"
Jul 10 02:46:38.163791 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:38.163769    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggjd5\" (UniqueName: \"kubernetes.io/projected/a177e64d-7106-413a-909a-bd978ffd8b34-kube-api-access-ggjd5\") pod \"test-model-bbcae0-kserve-589555c5bc-p7jzt\" (UID: \"a177e64d-7106-413a-909a-bd978ffd8b34\") " pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"
Jul 10 02:46:38.272805 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:38.272720    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"
Jul 10 02:46:38.404253 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:38.404223    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"]
Jul 10 02:46:38.406212 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:46:38.406188    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda177e64d_7106_413a_909a_bd978ffd8b34.slice/crio-e9fcd6b041b1bc8f4daab41fd554adf24a38b79e79e65254f9a1187db9891e88 WatchSource:0}: Error finding container e9fcd6b041b1bc8f4daab41fd554adf24a38b79e79e65254f9a1187db9891e88: Status 404 returned error can't find the container with id e9fcd6b041b1bc8f4daab41fd554adf24a38b79e79e65254f9a1187db9891e88
Jul 10 02:46:38.998497 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:38.998458    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt" event={"ID":"a177e64d-7106-413a-909a-bd978ffd8b34","Type":"ContainerStarted","Data":"dfb81b889cf0d3a47981cddeee3ee1ae9985ecbbf9176f9caa7ff4b55c62d53f"}
Jul 10 02:46:38.998497 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:38.998503    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt" event={"ID":"a177e64d-7106-413a-909a-bd978ffd8b34","Type":"ContainerStarted","Data":"e9fcd6b041b1bc8f4daab41fd554adf24a38b79e79e65254f9a1187db9891e88"}
Jul 10 02:46:39.016132 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:39.016083    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt" podStartSLOduration=2.016063384 podStartE2EDuration="2.016063384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:46:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:46:39.015826211 +0000 UTC m=+2327.781738446" watchObservedRunningTime="2026-07-10 02:46:39.016063384 +0000 UTC m=+2327.781975618"
Jul 10 02:46:43.159704 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:43.159623    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:46:48.273327 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:48.273289    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"
Jul 10 02:46:48.273839 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:48.273355    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"
Jul 10 02:46:48.285946 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:48.285921    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"
Jul 10 02:46:49.056716 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:49.056686    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"
Jul 10 02:46:57.762430 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:57.762392    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:46:59.181250 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:46:59.181216    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"]
Jul 10 02:47:00.091181 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:00.091145    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"]
Jul 10 02:47:10.850551 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:10.850513    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:47:14.202362 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:14.202316    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg" podUID="6b033fcc-8860-4d6d-976c-66d5275170d9" containerName="main" containerID="cri-o://ce041ae6186e25b6a983983950c9b937567831179f74db1fea20571d168c7add" gracePeriod=45
Jul 10 02:47:14.451426 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:14.451395    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"
Jul 10 02:47:14.600375 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:14.600286    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b033fcc-8860-4d6d-976c-66d5275170d9-tls-certs\") pod \"6b033fcc-8860-4d6d-976c-66d5275170d9\" (UID: \"6b033fcc-8860-4d6d-976c-66d5275170d9\") "
Jul 10 02:47:14.600375 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:14.600358    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b033fcc-8860-4d6d-976c-66d5275170d9-dshm\") pod \"6b033fcc-8860-4d6d-976c-66d5275170d9\" (UID: \"6b033fcc-8860-4d6d-976c-66d5275170d9\") "
Jul 10 02:47:14.600628 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:14.600394    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kd4q9\" (UniqueName: \"kubernetes.io/projected/6b033fcc-8860-4d6d-976c-66d5275170d9-kube-api-access-kd4q9\") pod \"6b033fcc-8860-4d6d-976c-66d5275170d9\" (UID: \"6b033fcc-8860-4d6d-976c-66d5275170d9\") "
Jul 10 02:47:14.600628 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:14.600413    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b033fcc-8860-4d6d-976c-66d5275170d9-home\") pod \"6b033fcc-8860-4d6d-976c-66d5275170d9\" (UID: \"6b033fcc-8860-4d6d-976c-66d5275170d9\") "
Jul 10 02:47:14.600628 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:14.600476    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b033fcc-8860-4d6d-976c-66d5275170d9-model-cache\") pod \"6b033fcc-8860-4d6d-976c-66d5275170d9\" (UID: \"6b033fcc-8860-4d6d-976c-66d5275170d9\") "
Jul 10 02:47:14.600628 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:14.600510    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b033fcc-8860-4d6d-976c-66d5275170d9-tmp-dir\") pod \"6b033fcc-8860-4d6d-976c-66d5275170d9\" (UID: \"6b033fcc-8860-4d6d-976c-66d5275170d9\") "
Jul 10 02:47:14.600847 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:14.600760    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b033fcc-8860-4d6d-976c-66d5275170d9-model-cache" (OuterVolumeSpecName: "model-cache") pod "6b033fcc-8860-4d6d-976c-66d5275170d9" (UID: "6b033fcc-8860-4d6d-976c-66d5275170d9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:47:14.600847 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:14.600772    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b033fcc-8860-4d6d-976c-66d5275170d9-home" (OuterVolumeSpecName: "home") pod "6b033fcc-8860-4d6d-976c-66d5275170d9" (UID: "6b033fcc-8860-4d6d-976c-66d5275170d9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:47:14.600938 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:14.600847    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b033fcc-8860-4d6d-976c-66d5275170d9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6b033fcc-8860-4d6d-976c-66d5275170d9" (UID: "6b033fcc-8860-4d6d-976c-66d5275170d9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:47:14.602707 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:14.602675    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b033fcc-8860-4d6d-976c-66d5275170d9-dshm" (OuterVolumeSpecName: "dshm") pod "6b033fcc-8860-4d6d-976c-66d5275170d9" (UID: "6b033fcc-8860-4d6d-976c-66d5275170d9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:47:14.602817 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:14.602723    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b033fcc-8860-4d6d-976c-66d5275170d9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6b033fcc-8860-4d6d-976c-66d5275170d9" (UID: "6b033fcc-8860-4d6d-976c-66d5275170d9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:47:14.602817 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:14.602739    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b033fcc-8860-4d6d-976c-66d5275170d9-kube-api-access-kd4q9" (OuterVolumeSpecName: "kube-api-access-kd4q9") pod "6b033fcc-8860-4d6d-976c-66d5275170d9" (UID: "6b033fcc-8860-4d6d-976c-66d5275170d9"). InnerVolumeSpecName "kube-api-access-kd4q9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:47:14.702020 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:14.701982    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b033fcc-8860-4d6d-976c-66d5275170d9-model-cache\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:47:14.702020 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:14.702014    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b033fcc-8860-4d6d-976c-66d5275170d9-tmp-dir\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:47:14.702020 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:14.702048    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b033fcc-8860-4d6d-976c-66d5275170d9-tls-certs\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:47:14.702296 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:14.702062    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b033fcc-8860-4d6d-976c-66d5275170d9-dshm\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:47:14.702296 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:14.702077    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kd4q9\" (UniqueName: \"kubernetes.io/projected/6b033fcc-8860-4d6d-976c-66d5275170d9-kube-api-access-kd4q9\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:47:14.702296 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:14.702090    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b033fcc-8860-4d6d-976c-66d5275170d9-home\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:47:15.111829 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.111773    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt" podUID="a177e64d-7106-413a-909a-bd978ffd8b34" containerName="main" containerID="cri-o://dfb81b889cf0d3a47981cddeee3ee1ae9985ecbbf9176f9caa7ff4b55c62d53f" gracePeriod=45
Jul 10 02:47:15.176727 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.176693    2576 generic.go:356] "Generic (PLEG): container finished" podID="6b033fcc-8860-4d6d-976c-66d5275170d9" containerID="ce041ae6186e25b6a983983950c9b937567831179f74db1fea20571d168c7add" exitCode=0
Jul 10 02:47:15.176912 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.176740    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"
Jul 10 02:47:15.176912 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.176778    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg" event={"ID":"6b033fcc-8860-4d6d-976c-66d5275170d9","Type":"ContainerDied","Data":"ce041ae6186e25b6a983983950c9b937567831179f74db1fea20571d168c7add"}
Jul 10 02:47:15.176912 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.176830    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg" event={"ID":"6b033fcc-8860-4d6d-976c-66d5275170d9","Type":"ContainerDied","Data":"2abfb8f1fc497da1731f8cb20b48109740e392510686e68e790ab6db1807cf2e"}
Jul 10 02:47:15.176912 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.176853    2576 scope.go:117] "RemoveContainer" containerID="ce041ae6186e25b6a983983950c9b937567831179f74db1fea20571d168c7add"
Jul 10 02:47:15.199571 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.199546    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"]
Jul 10 02:47:15.203637 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.203614    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-d76849/test-model-d76849-kserve-5bc6cd6769-rr2wg"]
Jul 10 02:47:15.222143 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.221937    2576 scope.go:117] "RemoveContainer" containerID="ce041ae6186e25b6a983983950c9b937567831179f74db1fea20571d168c7add"
Jul 10 02:47:15.222386 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:47:15.222368    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce041ae6186e25b6a983983950c9b937567831179f74db1fea20571d168c7add\": container with ID starting with ce041ae6186e25b6a983983950c9b937567831179f74db1fea20571d168c7add not found: ID does not exist" containerID="ce041ae6186e25b6a983983950c9b937567831179f74db1fea20571d168c7add"
Jul 10 02:47:15.222427 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.222397    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce041ae6186e25b6a983983950c9b937567831179f74db1fea20571d168c7add"} err="failed to get container status \"ce041ae6186e25b6a983983950c9b937567831179f74db1fea20571d168c7add\": rpc error: code = NotFound desc = could not find container \"ce041ae6186e25b6a983983950c9b937567831179f74db1fea20571d168c7add\": container with ID starting with ce041ae6186e25b6a983983950c9b937567831179f74db1fea20571d168c7add not found: ID does not exist"
Jul 10 02:47:15.378373 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.378343    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"
Jul 10 02:47:15.509372 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.509335    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a177e64d-7106-413a-909a-bd978ffd8b34-tls-certs\") pod \"a177e64d-7106-413a-909a-bd978ffd8b34\" (UID: \"a177e64d-7106-413a-909a-bd978ffd8b34\") "
Jul 10 02:47:15.509568 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.509426    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a177e64d-7106-413a-909a-bd978ffd8b34-model-cache\") pod \"a177e64d-7106-413a-909a-bd978ffd8b34\" (UID: \"a177e64d-7106-413a-909a-bd978ffd8b34\") "
Jul 10 02:47:15.509568 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.509445    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a177e64d-7106-413a-909a-bd978ffd8b34-tmp-dir\") pod \"a177e64d-7106-413a-909a-bd978ffd8b34\" (UID: \"a177e64d-7106-413a-909a-bd978ffd8b34\") "
Jul 10 02:47:15.509568 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.509495    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a177e64d-7106-413a-909a-bd978ffd8b34-dshm\") pod \"a177e64d-7106-413a-909a-bd978ffd8b34\" (UID: \"a177e64d-7106-413a-909a-bd978ffd8b34\") "
Jul 10 02:47:15.509568 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.509524    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a177e64d-7106-413a-909a-bd978ffd8b34-home\") pod \"a177e64d-7106-413a-909a-bd978ffd8b34\" (UID: \"a177e64d-7106-413a-909a-bd978ffd8b34\") "
Jul 10 02:47:15.509568 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.509564    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggjd5\" (UniqueName: \"kubernetes.io/projected/a177e64d-7106-413a-909a-bd978ffd8b34-kube-api-access-ggjd5\") pod \"a177e64d-7106-413a-909a-bd978ffd8b34\" (UID: \"a177e64d-7106-413a-909a-bd978ffd8b34\") "
Jul 10 02:47:15.509848 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.509782    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a177e64d-7106-413a-909a-bd978ffd8b34-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a177e64d-7106-413a-909a-bd978ffd8b34" (UID: "a177e64d-7106-413a-909a-bd978ffd8b34"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:47:15.509848 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.509793    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a177e64d-7106-413a-909a-bd978ffd8b34-model-cache" (OuterVolumeSpecName: "model-cache") pod "a177e64d-7106-413a-909a-bd978ffd8b34" (UID: "a177e64d-7106-413a-909a-bd978ffd8b34"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:47:15.509848 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.509825    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a177e64d-7106-413a-909a-bd978ffd8b34-home" (OuterVolumeSpecName: "home") pod "a177e64d-7106-413a-909a-bd978ffd8b34" (UID: "a177e64d-7106-413a-909a-bd978ffd8b34"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:47:15.511705 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.511680    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a177e64d-7106-413a-909a-bd978ffd8b34-dshm" (OuterVolumeSpecName: "dshm") pod "a177e64d-7106-413a-909a-bd978ffd8b34" (UID: "a177e64d-7106-413a-909a-bd978ffd8b34"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:47:15.511819 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.511755    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a177e64d-7106-413a-909a-bd978ffd8b34-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a177e64d-7106-413a-909a-bd978ffd8b34" (UID: "a177e64d-7106-413a-909a-bd978ffd8b34"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:47:15.511865 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.511811    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a177e64d-7106-413a-909a-bd978ffd8b34-kube-api-access-ggjd5" (OuterVolumeSpecName: "kube-api-access-ggjd5") pod "a177e64d-7106-413a-909a-bd978ffd8b34" (UID: "a177e64d-7106-413a-909a-bd978ffd8b34"). InnerVolumeSpecName "kube-api-access-ggjd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:47:15.610930 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.610897    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a177e64d-7106-413a-909a-bd978ffd8b34-model-cache\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:47:15.610930 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.610927    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a177e64d-7106-413a-909a-bd978ffd8b34-tmp-dir\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:47:15.610930 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.610938    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a177e64d-7106-413a-909a-bd978ffd8b34-dshm\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:47:15.611200 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.610949    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a177e64d-7106-413a-909a-bd978ffd8b34-home\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:47:15.611200 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.610960    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggjd5\" (UniqueName: \"kubernetes.io/projected/a177e64d-7106-413a-909a-bd978ffd8b34-kube-api-access-ggjd5\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:47:15.611200 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:15.610971    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a177e64d-7106-413a-909a-bd978ffd8b34-tls-certs\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:47:16.183537 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:16.183505    2576 generic.go:356] "Generic (PLEG): container finished" podID="a177e64d-7106-413a-909a-bd978ffd8b34" containerID="dfb81b889cf0d3a47981cddeee3ee1ae9985ecbbf9176f9caa7ff4b55c62d53f" exitCode=0
Jul 10 02:47:16.183740 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:16.183546    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"
Jul 10 02:47:16.183740 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:16.183568    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt" event={"ID":"a177e64d-7106-413a-909a-bd978ffd8b34","Type":"ContainerDied","Data":"dfb81b889cf0d3a47981cddeee3ee1ae9985ecbbf9176f9caa7ff4b55c62d53f"}
Jul 10 02:47:16.183740 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:16.183598    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt" event={"ID":"a177e64d-7106-413a-909a-bd978ffd8b34","Type":"ContainerDied","Data":"e9fcd6b041b1bc8f4daab41fd554adf24a38b79e79e65254f9a1187db9891e88"}
Jul 10 02:47:16.183740 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:16.183624    2576 scope.go:117] "RemoveContainer" containerID="dfb81b889cf0d3a47981cddeee3ee1ae9985ecbbf9176f9caa7ff4b55c62d53f"
Jul 10 02:47:16.191990 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:16.191969    2576 scope.go:117] "RemoveContainer" containerID="dfb81b889cf0d3a47981cddeee3ee1ae9985ecbbf9176f9caa7ff4b55c62d53f"
Jul 10 02:47:16.192281 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:47:16.192262    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfb81b889cf0d3a47981cddeee3ee1ae9985ecbbf9176f9caa7ff4b55c62d53f\": container with ID starting with dfb81b889cf0d3a47981cddeee3ee1ae9985ecbbf9176f9caa7ff4b55c62d53f not found: ID does not exist" containerID="dfb81b889cf0d3a47981cddeee3ee1ae9985ecbbf9176f9caa7ff4b55c62d53f"
Jul 10 02:47:16.192352 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:16.192289    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfb81b889cf0d3a47981cddeee3ee1ae9985ecbbf9176f9caa7ff4b55c62d53f"} err="failed to get container status \"dfb81b889cf0d3a47981cddeee3ee1ae9985ecbbf9176f9caa7ff4b55c62d53f\": rpc error: code = NotFound desc = could not find container \"dfb81b889cf0d3a47981cddeee3ee1ae9985ecbbf9176f9caa7ff4b55c62d53f\": container with ID starting with dfb81b889cf0d3a47981cddeee3ee1ae9985ecbbf9176f9caa7ff4b55c62d53f not found: ID does not exist"
Jul 10 02:47:16.206598 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:16.206563    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"]
Jul 10 02:47:16.211335 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:16.211315    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-bbcae0/test-model-bbcae0-kserve-589555c5bc-p7jzt"]
Jul 10 02:47:16.544189 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:16.544111    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b033fcc-8860-4d6d-976c-66d5275170d9" path="/var/lib/kubelet/pods/6b033fcc-8860-4d6d-976c-66d5275170d9/volumes"
Jul 10 02:47:16.544539 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:16.544526    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a177e64d-7106-413a-909a-bd978ffd8b34" path="/var/lib/kubelet/pods/a177e64d-7106-413a-909a-bd978ffd8b34/volumes"
Jul 10 02:47:21.253498 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:21.253462    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:47:40.153941 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:40.153905    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:47:52.604118 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:52.604088    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/2.log"
Jul 10 02:47:52.607131 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:52.607099    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt7wb_164f62ad-8b5b-4a66-9bfe-17d863ddeeea/ovn-acl-logging/0.log"
Jul 10 02:47:52.611317 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:52.611295    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/2.log"
Jul 10 02:47:52.614145 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:47:52.614130    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt7wb_164f62ad-8b5b-4a66-9bfe-17d863ddeeea/ovn-acl-logging/0.log"
Jul 10 02:48:01.153789 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:48:01.153745    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:48:13.761616 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:48:13.761537    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:48:32.762577 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:48:32.762542    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:48:57.156781 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:48:57.156747    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:49:18.058870 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:18.058832    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:49:34.743204 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:34.743170    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:49:40.054258 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.054222    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"]
Jul 10 02:49:40.054619 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.054612    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a177e64d-7106-413a-909a-bd978ffd8b34" containerName="main"
Jul 10 02:49:40.054665 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.054623    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a177e64d-7106-413a-909a-bd978ffd8b34" containerName="main"
Jul 10 02:49:40.054665 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.054633    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b033fcc-8860-4d6d-976c-66d5275170d9" containerName="main"
Jul 10 02:49:40.054665 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.054638    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b033fcc-8860-4d6d-976c-66d5275170d9" containerName="main"
Jul 10 02:49:40.054760 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.054695    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a177e64d-7106-413a-909a-bd978ffd8b34" containerName="main"
Jul 10 02:49:40.054760 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.054707    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b033fcc-8860-4d6d-976c-66d5275170d9" containerName="main"
Jul 10 02:49:40.058034 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.058008    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"
Jul 10 02:49:40.060863 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.060837    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d5b98a\"/\"openshift-service-ca.crt\""
Jul 10 02:49:40.060863 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.060857    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d5b98a\"/\"kube-root-ca.crt\""
Jul 10 02:49:40.062278 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.062259    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d5b98a\"/\"default-dockercfg-vmwh8\""
Jul 10 02:49:40.062380 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.062322    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d5b98a\"/\"auth-test-model-d5b98a-kserve-self-signed-certs\""
Jul 10 02:49:40.065927 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.065907    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"]
Jul 10 02:49:40.171796 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.171760    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54ac36f7-b900-4690-bf15-6931a71e790a-tmp-dir\") pod \"auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc\" (UID: \"54ac36f7-b900-4690-bf15-6931a71e790a\") " pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"
Jul 10 02:49:40.171976 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.171805    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx5f8\" (UniqueName: \"kubernetes.io/projected/54ac36f7-b900-4690-bf15-6931a71e790a-kube-api-access-zx5f8\") pod \"auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc\" (UID: \"54ac36f7-b900-4690-bf15-6931a71e790a\") " pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"
Jul 10 02:49:40.172086 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.171964    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54ac36f7-b900-4690-bf15-6931a71e790a-tls-certs\") pod \"auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc\" (UID: \"54ac36f7-b900-4690-bf15-6931a71e790a\") " pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"
Jul 10 02:49:40.172086 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.172015    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54ac36f7-b900-4690-bf15-6931a71e790a-model-cache\") pod \"auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc\" (UID: \"54ac36f7-b900-4690-bf15-6931a71e790a\") " pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"
Jul 10 02:49:40.172209 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.172093    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54ac36f7-b900-4690-bf15-6931a71e790a-dshm\") pod \"auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc\" (UID: \"54ac36f7-b900-4690-bf15-6931a71e790a\") " pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"
Jul 10 02:49:40.172209 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.172112    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54ac36f7-b900-4690-bf15-6931a71e790a-home\") pod \"auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc\" (UID: \"54ac36f7-b900-4690-bf15-6931a71e790a\") " pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"
Jul 10 02:49:40.273557 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.273510    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54ac36f7-b900-4690-bf15-6931a71e790a-tls-certs\") pod \"auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc\" (UID: \"54ac36f7-b900-4690-bf15-6931a71e790a\") " pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"
Jul 10 02:49:40.273557 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.273569    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54ac36f7-b900-4690-bf15-6931a71e790a-model-cache\") pod \"auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc\" (UID: \"54ac36f7-b900-4690-bf15-6931a71e790a\") " pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"
Jul 10 02:49:40.273772 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.273593    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54ac36f7-b900-4690-bf15-6931a71e790a-dshm\") pod \"auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc\" (UID: \"54ac36f7-b900-4690-bf15-6931a71e790a\") " pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"
Jul 10 02:49:40.273772 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.273609    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54ac36f7-b900-4690-bf15-6931a71e790a-home\") pod \"auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc\" (UID: \"54ac36f7-b900-4690-bf15-6931a71e790a\") " pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"
Jul 10 02:49:40.273772 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.273629    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54ac36f7-b900-4690-bf15-6931a71e790a-tmp-dir\") pod \"auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc\" (UID: \"54ac36f7-b900-4690-bf15-6931a71e790a\") " pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"
Jul 10 02:49:40.273772 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.273650    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx5f8\" (UniqueName: \"kubernetes.io/projected/54ac36f7-b900-4690-bf15-6931a71e790a-kube-api-access-zx5f8\") pod \"auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc\" (UID: \"54ac36f7-b900-4690-bf15-6931a71e790a\") " pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"
Jul 10 02:49:40.274148 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.274126    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54ac36f7-b900-4690-bf15-6931a71e790a-model-cache\") pod \"auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc\" (UID: \"54ac36f7-b900-4690-bf15-6931a71e790a\") " pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"
Jul 10 02:49:40.274238 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.274146    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54ac36f7-b900-4690-bf15-6931a71e790a-home\") pod \"auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc\" (UID: \"54ac36f7-b900-4690-bf15-6931a71e790a\") " pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"
Jul 10 02:49:40.274238 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.274175    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54ac36f7-b900-4690-bf15-6931a71e790a-tmp-dir\") pod \"auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc\" (UID: \"54ac36f7-b900-4690-bf15-6931a71e790a\") " pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"
Jul 10 02:49:40.276485 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.276448    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54ac36f7-b900-4690-bf15-6931a71e790a-dshm\") pod \"auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc\" (UID: \"54ac36f7-b900-4690-bf15-6931a71e790a\") " pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"
Jul 10 02:49:40.276623 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.276608    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54ac36f7-b900-4690-bf15-6931a71e790a-tls-certs\") pod \"auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc\" (UID: \"54ac36f7-b900-4690-bf15-6931a71e790a\") " pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"
Jul 10 02:49:40.283345 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.283326    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx5f8\" (UniqueName: \"kubernetes.io/projected/54ac36f7-b900-4690-bf15-6931a71e790a-kube-api-access-zx5f8\") pod \"auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc\" (UID: \"54ac36f7-b900-4690-bf15-6931a71e790a\") " pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"
Jul 10 02:49:40.368713 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.368677    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"
Jul 10 02:49:40.503898 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.503876    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"]
Jul 10 02:49:40.505744 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:49:40.505711    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54ac36f7_b900_4690_bf15_6931a71e790a.slice/crio-71bbc31be4427e050fc423eb7f2547fb3efb46e40dfadc23dcbcc358cd614df6 WatchSource:0}: Error finding container 71bbc31be4427e050fc423eb7f2547fb3efb46e40dfadc23dcbcc358cd614df6: Status 404 returned error can't find the container with id 71bbc31be4427e050fc423eb7f2547fb3efb46e40dfadc23dcbcc358cd614df6
Jul 10 02:49:40.869082 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.869048    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc" event={"ID":"54ac36f7-b900-4690-bf15-6931a71e790a","Type":"ContainerStarted","Data":"31eece46870f7fef3ad950584719fa5cfa9836950aa0ed3a48ff8679584b04e6"}
Jul 10 02:49:40.869272 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.869096    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc" event={"ID":"54ac36f7-b900-4690-bf15-6931a71e790a","Type":"ContainerStarted","Data":"71bbc31be4427e050fc423eb7f2547fb3efb46e40dfadc23dcbcc358cd614df6"}
Jul 10 02:49:40.889484 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:40.889433    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc" podStartSLOduration=0.88941901 podStartE2EDuration="889.41901ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:49:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:49:40.886816873 +0000 UTC m=+2509.652729100" watchObservedRunningTime="2026-07-10 02:49:40.88941901 +0000 UTC m=+2509.655331234"
Jul 10 02:49:44.551592 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:44.551515    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:49:50.369503 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:50.369461    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"
Jul 10 02:49:50.369995 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:50.369522    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"
Jul 10 02:49:50.381894 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:50.381866    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"
Jul 10 02:49:50.939077 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:49:50.939050    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"
Jul 10 02:50:00.763897 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:00.763865    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"]
Jul 10 02:50:00.767256 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:00.767235    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"
Jul 10 02:50:00.770269 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:00.770246    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-de8279\"/\"kube-root-ca.crt\""
Jul 10 02:50:00.771617 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:00.771600    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-de8279\"/\"default-dockercfg-9wb8g\""
Jul 10 02:50:00.771677 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:00.771612    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-de8279\"/\"auth-test-model-de8279-kserve-self-signed-certs\""
Jul 10 02:50:00.771677 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:00.771632    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-de8279\"/\"openshift-service-ca.crt\""
Jul 10 02:50:00.776299 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:00.776278    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1252428e-c975-43cc-88b3-ea578f75acb5-tls-certs\") pod \"auth-test-model-de8279-kserve-89449df6c-gg29x\" (UID: \"1252428e-c975-43cc-88b3-ea578f75acb5\") " pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"
Jul 10 02:50:00.776408 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:00.776324    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1252428e-c975-43cc-88b3-ea578f75acb5-home\") pod \"auth-test-model-de8279-kserve-89449df6c-gg29x\" (UID: \"1252428e-c975-43cc-88b3-ea578f75acb5\") " pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"
Jul 10 02:50:00.776465 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:00.776445    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1252428e-c975-43cc-88b3-ea578f75acb5-dshm\") pod \"auth-test-model-de8279-kserve-89449df6c-gg29x\" (UID: \"1252428e-c975-43cc-88b3-ea578f75acb5\") " pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"
Jul 10 02:50:00.776531 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:00.776476    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1252428e-c975-43cc-88b3-ea578f75acb5-tmp-dir\") pod \"auth-test-model-de8279-kserve-89449df6c-gg29x\" (UID: \"1252428e-c975-43cc-88b3-ea578f75acb5\") " pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"
Jul 10 02:50:00.776531 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:00.776504    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnmnr\" (UniqueName: \"kubernetes.io/projected/1252428e-c975-43cc-88b3-ea578f75acb5-kube-api-access-qnmnr\") pod \"auth-test-model-de8279-kserve-89449df6c-gg29x\" (UID: \"1252428e-c975-43cc-88b3-ea578f75acb5\") " pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"
Jul 10 02:50:00.776636 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:00.776570    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1252428e-c975-43cc-88b3-ea578f75acb5-model-cache\") pod \"auth-test-model-de8279-kserve-89449df6c-gg29x\" (UID: \"1252428e-c975-43cc-88b3-ea578f75acb5\") " pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"
Jul 10 02:50:00.778738 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:00.778715    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"]
Jul 10 02:50:00.877418 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:00.877379    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1252428e-c975-43cc-88b3-ea578f75acb5-tls-certs\") pod \"auth-test-model-de8279-kserve-89449df6c-gg29x\" (UID: \"1252428e-c975-43cc-88b3-ea578f75acb5\") " pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"
Jul 10 02:50:00.877626 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:00.877427    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1252428e-c975-43cc-88b3-ea578f75acb5-home\") pod \"auth-test-model-de8279-kserve-89449df6c-gg29x\" (UID: \"1252428e-c975-43cc-88b3-ea578f75acb5\") " pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"
Jul 10 02:50:00.877626 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:00.877459    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1252428e-c975-43cc-88b3-ea578f75acb5-dshm\") pod \"auth-test-model-de8279-kserve-89449df6c-gg29x\" (UID: \"1252428e-c975-43cc-88b3-ea578f75acb5\") " pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"
Jul 10 02:50:00.877626 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:00.877480    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1252428e-c975-43cc-88b3-ea578f75acb5-tmp-dir\") pod \"auth-test-model-de8279-kserve-89449df6c-gg29x\" (UID: \"1252428e-c975-43cc-88b3-ea578f75acb5\") " pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"
Jul 10 02:50:00.877626 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:00.877501    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnmnr\" (UniqueName: \"kubernetes.io/projected/1252428e-c975-43cc-88b3-ea578f75acb5-kube-api-access-qnmnr\") pod \"auth-test-model-de8279-kserve-89449df6c-gg29x\" (UID: \"1252428e-c975-43cc-88b3-ea578f75acb5\") " pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"
Jul 10 02:50:00.877626 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:00.877542    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1252428e-c975-43cc-88b3-ea578f75acb5-model-cache\") pod \"auth-test-model-de8279-kserve-89449df6c-gg29x\" (UID: \"1252428e-c975-43cc-88b3-ea578f75acb5\") " pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"
Jul 10 02:50:00.878039 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:00.877987    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1252428e-c975-43cc-88b3-ea578f75acb5-home\") pod \"auth-test-model-de8279-kserve-89449df6c-gg29x\" (UID: \"1252428e-c975-43cc-88b3-ea578f75acb5\") " pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"
Jul 10 02:50:00.878039 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:00.877988    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1252428e-c975-43cc-88b3-ea578f75acb5-tmp-dir\") pod \"auth-test-model-de8279-kserve-89449df6c-gg29x\" (UID: \"1252428e-c975-43cc-88b3-ea578f75acb5\") " pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"
Jul 10 02:50:00.878241 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:00.878067    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1252428e-c975-43cc-88b3-ea578f75acb5-model-cache\") pod \"auth-test-model-de8279-kserve-89449df6c-gg29x\" (UID: \"1252428e-c975-43cc-88b3-ea578f75acb5\") " pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"
Jul 10 02:50:00.879712 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:00.879684    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1252428e-c975-43cc-88b3-ea578f75acb5-dshm\") pod \"auth-test-model-de8279-kserve-89449df6c-gg29x\" (UID: \"1252428e-c975-43cc-88b3-ea578f75acb5\") " pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"
Jul 10 02:50:00.879988 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:00.879969    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1252428e-c975-43cc-88b3-ea578f75acb5-tls-certs\") pod \"auth-test-model-de8279-kserve-89449df6c-gg29x\" (UID: \"1252428e-c975-43cc-88b3-ea578f75acb5\") " pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"
Jul 10 02:50:00.887424 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:00.887398    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnmnr\" (UniqueName: \"kubernetes.io/projected/1252428e-c975-43cc-88b3-ea578f75acb5-kube-api-access-qnmnr\") pod \"auth-test-model-de8279-kserve-89449df6c-gg29x\" (UID: \"1252428e-c975-43cc-88b3-ea578f75acb5\") " pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"
Jul 10 02:50:01.077188 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:01.077100    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"
Jul 10 02:50:01.206834 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:01.206793    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"]
Jul 10 02:50:01.209105 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:50:01.209078    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1252428e_c975_43cc_88b3_ea578f75acb5.slice/crio-ae23d75d048c8130538914f7eccb35ba14a987d6251655914d0e1a3d7dcaf983 WatchSource:0}: Error finding container ae23d75d048c8130538914f7eccb35ba14a987d6251655914d0e1a3d7dcaf983: Status 404 returned error can't find the container with id ae23d75d048c8130538914f7eccb35ba14a987d6251655914d0e1a3d7dcaf983
Jul 10 02:50:01.981912 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:01.981876    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x" event={"ID":"1252428e-c975-43cc-88b3-ea578f75acb5","Type":"ContainerStarted","Data":"15aea8452286db49dc399519bb4aa7bf68337c7e55680fa22c3a128ef69b3bc6"}
Jul 10 02:50:01.982325 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:01.981923    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x" event={"ID":"1252428e-c975-43cc-88b3-ea578f75acb5","Type":"ContainerStarted","Data":"ae23d75d048c8130538914f7eccb35ba14a987d6251655914d0e1a3d7dcaf983"}
Jul 10 02:50:02.001013 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:02.000962    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x" podStartSLOduration=2.000947587 podStartE2EDuration="2.000947587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:50:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:50:02.000150828 +0000 UTC m=+2530.766063083" watchObservedRunningTime="2026-07-10 02:50:02.000947587 +0000 UTC m=+2530.766859871"
Jul 10 02:50:04.665294 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:04.665260    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:50:11.077664 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:11.077629    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"
Jul 10 02:50:11.077664 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:11.077672    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"
Jul 10 02:50:11.089868 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:11.089842    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"
Jul 10 02:50:12.040105 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:12.040072    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"
Jul 10 02:50:25.053407 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:25.053368    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:50:43.756159 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:50:43.756124    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:51:01.349542 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:51:01.349505    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:51:18.452099 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:51:18.452008    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:51:36.853124 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:51:36.853088    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:51:52.456332 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:51:52.456297    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:52:08.055622 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:08.055586    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:52:12.646473 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:12.646439    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"]
Jul 10 02:52:13.644335 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:13.644300    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"]
Jul 10 02:52:25.861576 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:25.861536    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:52:27.665787 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:27.665747    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc" podUID="54ac36f7-b900-4690-bf15-6931a71e790a" containerName="main" containerID="cri-o://31eece46870f7fef3ad950584719fa5cfa9836950aa0ed3a48ff8679584b04e6" gracePeriod=45
Jul 10 02:52:27.923300 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:27.923246    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"
Jul 10 02:52:28.090974 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.090944    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zx5f8\" (UniqueName: \"kubernetes.io/projected/54ac36f7-b900-4690-bf15-6931a71e790a-kube-api-access-zx5f8\") pod \"54ac36f7-b900-4690-bf15-6931a71e790a\" (UID: \"54ac36f7-b900-4690-bf15-6931a71e790a\") "
Jul 10 02:52:28.091199 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.091045    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54ac36f7-b900-4690-bf15-6931a71e790a-tls-certs\") pod \"54ac36f7-b900-4690-bf15-6931a71e790a\" (UID: \"54ac36f7-b900-4690-bf15-6931a71e790a\") "
Jul 10 02:52:28.091199 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.091096    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54ac36f7-b900-4690-bf15-6931a71e790a-tmp-dir\") pod \"54ac36f7-b900-4690-bf15-6931a71e790a\" (UID: \"54ac36f7-b900-4690-bf15-6931a71e790a\") "
Jul 10 02:52:28.091199 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.091118    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54ac36f7-b900-4690-bf15-6931a71e790a-model-cache\") pod \"54ac36f7-b900-4690-bf15-6931a71e790a\" (UID: \"54ac36f7-b900-4690-bf15-6931a71e790a\") "
Jul 10 02:52:28.091377 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.091233    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54ac36f7-b900-4690-bf15-6931a71e790a-dshm\") pod \"54ac36f7-b900-4690-bf15-6931a71e790a\" (UID: \"54ac36f7-b900-4690-bf15-6931a71e790a\") "
Jul 10 02:52:28.091377 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.091313    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54ac36f7-b900-4690-bf15-6931a71e790a-home\") pod \"54ac36f7-b900-4690-bf15-6931a71e790a\" (UID: \"54ac36f7-b900-4690-bf15-6931a71e790a\") "
Jul 10 02:52:28.091377 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.091346    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54ac36f7-b900-4690-bf15-6931a71e790a-model-cache" (OuterVolumeSpecName: "model-cache") pod "54ac36f7-b900-4690-bf15-6931a71e790a" (UID: "54ac36f7-b900-4690-bf15-6931a71e790a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:52:28.091546 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.091378    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54ac36f7-b900-4690-bf15-6931a71e790a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "54ac36f7-b900-4690-bf15-6931a71e790a" (UID: "54ac36f7-b900-4690-bf15-6931a71e790a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:52:28.091614 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.091555    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54ac36f7-b900-4690-bf15-6931a71e790a-home" (OuterVolumeSpecName: "home") pod "54ac36f7-b900-4690-bf15-6931a71e790a" (UID: "54ac36f7-b900-4690-bf15-6931a71e790a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:52:28.091683 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.091666    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54ac36f7-b900-4690-bf15-6931a71e790a-tmp-dir\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:52:28.091742 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.091685    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54ac36f7-b900-4690-bf15-6931a71e790a-model-cache\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:52:28.091742 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.091694    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54ac36f7-b900-4690-bf15-6931a71e790a-home\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:52:28.093359 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.093324    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54ac36f7-b900-4690-bf15-6931a71e790a-dshm" (OuterVolumeSpecName: "dshm") pod "54ac36f7-b900-4690-bf15-6931a71e790a" (UID: "54ac36f7-b900-4690-bf15-6931a71e790a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:52:28.093455 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.093384    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54ac36f7-b900-4690-bf15-6931a71e790a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "54ac36f7-b900-4690-bf15-6931a71e790a" (UID: "54ac36f7-b900-4690-bf15-6931a71e790a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:52:28.093455 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.093389    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54ac36f7-b900-4690-bf15-6931a71e790a-kube-api-access-zx5f8" (OuterVolumeSpecName: "kube-api-access-zx5f8") pod "54ac36f7-b900-4690-bf15-6931a71e790a" (UID: "54ac36f7-b900-4690-bf15-6931a71e790a"). InnerVolumeSpecName "kube-api-access-zx5f8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:52:28.192579 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.192514    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zx5f8\" (UniqueName: \"kubernetes.io/projected/54ac36f7-b900-4690-bf15-6931a71e790a-kube-api-access-zx5f8\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:52:28.192579 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.192538    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54ac36f7-b900-4690-bf15-6931a71e790a-tls-certs\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:52:28.192579 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.192546    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54ac36f7-b900-4690-bf15-6931a71e790a-dshm\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:52:28.664153 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.664090    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x" podUID="1252428e-c975-43cc-88b3-ea578f75acb5" containerName="main" containerID="cri-o://15aea8452286db49dc399519bb4aa7bf68337c7e55680fa22c3a128ef69b3bc6" gracePeriod=45
Jul 10 02:52:28.687924 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.687897    2576 generic.go:356] "Generic (PLEG): container finished" podID="54ac36f7-b900-4690-bf15-6931a71e790a" containerID="31eece46870f7fef3ad950584719fa5cfa9836950aa0ed3a48ff8679584b04e6" exitCode=0
Jul 10 02:52:28.688292 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.687952    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"
Jul 10 02:52:28.688292 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.687971    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc" event={"ID":"54ac36f7-b900-4690-bf15-6931a71e790a","Type":"ContainerDied","Data":"31eece46870f7fef3ad950584719fa5cfa9836950aa0ed3a48ff8679584b04e6"}
Jul 10 02:52:28.688292 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.688015    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc" event={"ID":"54ac36f7-b900-4690-bf15-6931a71e790a","Type":"ContainerDied","Data":"71bbc31be4427e050fc423eb7f2547fb3efb46e40dfadc23dcbcc358cd614df6"}
Jul 10 02:52:28.688292 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.688061    2576 scope.go:117] "RemoveContainer" containerID="31eece46870f7fef3ad950584719fa5cfa9836950aa0ed3a48ff8679584b04e6"
Jul 10 02:52:28.740700 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.740671    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"]
Jul 10 02:52:28.745574 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.745552    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d5b98a/auth-test-model-d5b98a-kserve-8464c9d57f-r7jbc"]
Jul 10 02:52:28.774658 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.774638    2576 scope.go:117] "RemoveContainer" containerID="31eece46870f7fef3ad950584719fa5cfa9836950aa0ed3a48ff8679584b04e6"
Jul 10 02:52:28.775041 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:52:28.775000    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31eece46870f7fef3ad950584719fa5cfa9836950aa0ed3a48ff8679584b04e6\": container with ID starting with 31eece46870f7fef3ad950584719fa5cfa9836950aa0ed3a48ff8679584b04e6 not found: ID does not exist" containerID="31eece46870f7fef3ad950584719fa5cfa9836950aa0ed3a48ff8679584b04e6"
Jul 10 02:52:28.775153 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.775045    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31eece46870f7fef3ad950584719fa5cfa9836950aa0ed3a48ff8679584b04e6"} err="failed to get container status \"31eece46870f7fef3ad950584719fa5cfa9836950aa0ed3a48ff8679584b04e6\": rpc error: code = NotFound desc = could not find container \"31eece46870f7fef3ad950584719fa5cfa9836950aa0ed3a48ff8679584b04e6\": container with ID starting with 31eece46870f7fef3ad950584719fa5cfa9836950aa0ed3a48ff8679584b04e6 not found: ID does not exist"
Jul 10 02:52:28.916750 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:28.916726    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"
Jul 10 02:52:29.102189 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.102095    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1252428e-c975-43cc-88b3-ea578f75acb5-tls-certs\") pod \"1252428e-c975-43cc-88b3-ea578f75acb5\" (UID: \"1252428e-c975-43cc-88b3-ea578f75acb5\") "
Jul 10 02:52:29.102189 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.102158    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1252428e-c975-43cc-88b3-ea578f75acb5-model-cache\") pod \"1252428e-c975-43cc-88b3-ea578f75acb5\" (UID: \"1252428e-c975-43cc-88b3-ea578f75acb5\") "
Jul 10 02:52:29.102399 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.102200    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1252428e-c975-43cc-88b3-ea578f75acb5-dshm\") pod \"1252428e-c975-43cc-88b3-ea578f75acb5\" (UID: \"1252428e-c975-43cc-88b3-ea578f75acb5\") "
Jul 10 02:52:29.102399 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.102236    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1252428e-c975-43cc-88b3-ea578f75acb5-home\") pod \"1252428e-c975-43cc-88b3-ea578f75acb5\" (UID: \"1252428e-c975-43cc-88b3-ea578f75acb5\") "
Jul 10 02:52:29.102399 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.102302    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1252428e-c975-43cc-88b3-ea578f75acb5-tmp-dir\") pod \"1252428e-c975-43cc-88b3-ea578f75acb5\" (UID: \"1252428e-c975-43cc-88b3-ea578f75acb5\") "
Jul 10 02:52:29.102399 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.102335    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnmnr\" (UniqueName: \"kubernetes.io/projected/1252428e-c975-43cc-88b3-ea578f75acb5-kube-api-access-qnmnr\") pod \"1252428e-c975-43cc-88b3-ea578f75acb5\" (UID: \"1252428e-c975-43cc-88b3-ea578f75acb5\") "
Jul 10 02:52:29.102594 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.102406    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1252428e-c975-43cc-88b3-ea578f75acb5-model-cache" (OuterVolumeSpecName: "model-cache") pod "1252428e-c975-43cc-88b3-ea578f75acb5" (UID: "1252428e-c975-43cc-88b3-ea578f75acb5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:52:29.102594 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.102492    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1252428e-c975-43cc-88b3-ea578f75acb5-home" (OuterVolumeSpecName: "home") pod "1252428e-c975-43cc-88b3-ea578f75acb5" (UID: "1252428e-c975-43cc-88b3-ea578f75acb5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:52:29.102594 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.102581    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1252428e-c975-43cc-88b3-ea578f75acb5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1252428e-c975-43cc-88b3-ea578f75acb5" (UID: "1252428e-c975-43cc-88b3-ea578f75acb5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:52:29.102744 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.102727    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1252428e-c975-43cc-88b3-ea578f75acb5-tmp-dir\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:52:29.102814 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.102747    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1252428e-c975-43cc-88b3-ea578f75acb5-model-cache\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:52:29.102814 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.102760    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1252428e-c975-43cc-88b3-ea578f75acb5-home\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:52:29.104434 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.104412    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1252428e-c975-43cc-88b3-ea578f75acb5-kube-api-access-qnmnr" (OuterVolumeSpecName: "kube-api-access-qnmnr") pod "1252428e-c975-43cc-88b3-ea578f75acb5" (UID: "1252428e-c975-43cc-88b3-ea578f75acb5"). InnerVolumeSpecName "kube-api-access-qnmnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:52:29.104556 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.104436    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1252428e-c975-43cc-88b3-ea578f75acb5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1252428e-c975-43cc-88b3-ea578f75acb5" (UID: "1252428e-c975-43cc-88b3-ea578f75acb5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:52:29.104556 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.104514    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1252428e-c975-43cc-88b3-ea578f75acb5-dshm" (OuterVolumeSpecName: "dshm") pod "1252428e-c975-43cc-88b3-ea578f75acb5" (UID: "1252428e-c975-43cc-88b3-ea578f75acb5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:52:29.203592 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.203556    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnmnr\" (UniqueName: \"kubernetes.io/projected/1252428e-c975-43cc-88b3-ea578f75acb5-kube-api-access-qnmnr\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:52:29.203592 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.203584    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1252428e-c975-43cc-88b3-ea578f75acb5-tls-certs\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:52:29.203592 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.203594    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1252428e-c975-43cc-88b3-ea578f75acb5-dshm\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:52:29.694692 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.694657    2576 generic.go:356] "Generic (PLEG): container finished" podID="1252428e-c975-43cc-88b3-ea578f75acb5" containerID="15aea8452286db49dc399519bb4aa7bf68337c7e55680fa22c3a128ef69b3bc6" exitCode=0
Jul 10 02:52:29.695190 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.694703    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"
Jul 10 02:52:29.695190 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.694722    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x" event={"ID":"1252428e-c975-43cc-88b3-ea578f75acb5","Type":"ContainerDied","Data":"15aea8452286db49dc399519bb4aa7bf68337c7e55680fa22c3a128ef69b3bc6"}
Jul 10 02:52:29.695190 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.694757    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x" event={"ID":"1252428e-c975-43cc-88b3-ea578f75acb5","Type":"ContainerDied","Data":"ae23d75d048c8130538914f7eccb35ba14a987d6251655914d0e1a3d7dcaf983"}
Jul 10 02:52:29.695190 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.694780    2576 scope.go:117] "RemoveContainer" containerID="15aea8452286db49dc399519bb4aa7bf68337c7e55680fa22c3a128ef69b3bc6"
Jul 10 02:52:29.703265 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.703121    2576 scope.go:117] "RemoveContainer" containerID="15aea8452286db49dc399519bb4aa7bf68337c7e55680fa22c3a128ef69b3bc6"
Jul 10 02:52:29.703396 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:52:29.703370    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15aea8452286db49dc399519bb4aa7bf68337c7e55680fa22c3a128ef69b3bc6\": container with ID starting with 15aea8452286db49dc399519bb4aa7bf68337c7e55680fa22c3a128ef69b3bc6 not found: ID does not exist" containerID="15aea8452286db49dc399519bb4aa7bf68337c7e55680fa22c3a128ef69b3bc6"
Jul 10 02:52:29.703448 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.703405    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15aea8452286db49dc399519bb4aa7bf68337c7e55680fa22c3a128ef69b3bc6"} err="failed to get container status \"15aea8452286db49dc399519bb4aa7bf68337c7e55680fa22c3a128ef69b3bc6\": rpc error: code = NotFound desc = could not find container \"15aea8452286db49dc399519bb4aa7bf68337c7e55680fa22c3a128ef69b3bc6\": container with ID starting with 15aea8452286db49dc399519bb4aa7bf68337c7e55680fa22c3a128ef69b3bc6 not found: ID does not exist"
Jul 10 02:52:29.718863 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.718840    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"]
Jul 10 02:52:29.722535 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:29.722510    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-de8279/auth-test-model-de8279-kserve-89449df6c-gg29x"]
Jul 10 02:52:30.545226 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:30.545194    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1252428e-c975-43cc-88b3-ea578f75acb5" path="/var/lib/kubelet/pods/1252428e-c975-43cc-88b3-ea578f75acb5/volumes"
Jul 10 02:52:30.545734 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:30.545701    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54ac36f7-b900-4690-bf15-6931a71e790a" path="/var/lib/kubelet/pods/54ac36f7-b900-4690-bf15-6931a71e790a/volumes"
Jul 10 02:52:43.255364 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.255282    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"]
Jul 10 02:52:43.255839 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.255824    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54ac36f7-b900-4690-bf15-6931a71e790a" containerName="main"
Jul 10 02:52:43.255892 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.255843    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="54ac36f7-b900-4690-bf15-6931a71e790a" containerName="main"
Jul 10 02:52:43.255892 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.255883    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1252428e-c975-43cc-88b3-ea578f75acb5" containerName="main"
Jul 10 02:52:43.255966 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.255892    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1252428e-c975-43cc-88b3-ea578f75acb5" containerName="main"
Jul 10 02:52:43.256002 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.255976    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="54ac36f7-b900-4690-bf15-6931a71e790a" containerName="main"
Jul 10 02:52:43.256002 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.255990    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1252428e-c975-43cc-88b3-ea578f75acb5" containerName="main"
Jul 10 02:52:43.260779 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.260760    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"
Jul 10 02:52:43.263786 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.263761    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d5b98a\"/\"kube-root-ca.crt\""
Jul 10 02:52:43.265351 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.265330    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d5b98a\"/\"sub-test-model-d5b98a-kserve-self-signed-certs\""
Jul 10 02:52:43.265566 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.265405    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d5b98a\"/\"default-dockercfg-vmwh8\""
Jul 10 02:52:43.265657 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.265598    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d5b98a\"/\"openshift-service-ca.crt\""
Jul 10 02:52:43.268904 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.268658    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"]
Jul 10 02:52:43.334259 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.334227    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71093850-9ba2-4042-a0d5-dfe5896ead87-tls-certs\") pod \"sub-test-model-d5b98a-kserve-6b99498f-flvj5\" (UID: \"71093850-9ba2-4042-a0d5-dfe5896ead87\") " pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"
Jul 10 02:52:43.334432 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.334274    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71093850-9ba2-4042-a0d5-dfe5896ead87-model-cache\") pod \"sub-test-model-d5b98a-kserve-6b99498f-flvj5\" (UID: \"71093850-9ba2-4042-a0d5-dfe5896ead87\") " pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"
Jul 10 02:52:43.334432 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.334306    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71093850-9ba2-4042-a0d5-dfe5896ead87-dshm\") pod \"sub-test-model-d5b98a-kserve-6b99498f-flvj5\" (UID: \"71093850-9ba2-4042-a0d5-dfe5896ead87\") " pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"
Jul 10 02:52:43.334432 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.334350    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71093850-9ba2-4042-a0d5-dfe5896ead87-home\") pod \"sub-test-model-d5b98a-kserve-6b99498f-flvj5\" (UID: \"71093850-9ba2-4042-a0d5-dfe5896ead87\") " pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"
Jul 10 02:52:43.334432 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.334394    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzg7w\" (UniqueName: \"kubernetes.io/projected/71093850-9ba2-4042-a0d5-dfe5896ead87-kube-api-access-gzg7w\") pod \"sub-test-model-d5b98a-kserve-6b99498f-flvj5\" (UID: \"71093850-9ba2-4042-a0d5-dfe5896ead87\") " pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"
Jul 10 02:52:43.334575 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.334434    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71093850-9ba2-4042-a0d5-dfe5896ead87-tmp-dir\") pod \"sub-test-model-d5b98a-kserve-6b99498f-flvj5\" (UID: \"71093850-9ba2-4042-a0d5-dfe5896ead87\") " pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"
Jul 10 02:52:43.435610 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.435575    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71093850-9ba2-4042-a0d5-dfe5896ead87-tls-certs\") pod \"sub-test-model-d5b98a-kserve-6b99498f-flvj5\" (UID: \"71093850-9ba2-4042-a0d5-dfe5896ead87\") " pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"
Jul 10 02:52:43.435789 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.435619    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71093850-9ba2-4042-a0d5-dfe5896ead87-model-cache\") pod \"sub-test-model-d5b98a-kserve-6b99498f-flvj5\" (UID: \"71093850-9ba2-4042-a0d5-dfe5896ead87\") " pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"
Jul 10 02:52:43.435789 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.435650    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71093850-9ba2-4042-a0d5-dfe5896ead87-dshm\") pod \"sub-test-model-d5b98a-kserve-6b99498f-flvj5\" (UID: \"71093850-9ba2-4042-a0d5-dfe5896ead87\") " pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"
Jul 10 02:52:43.435789 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.435706    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71093850-9ba2-4042-a0d5-dfe5896ead87-home\") pod \"sub-test-model-d5b98a-kserve-6b99498f-flvj5\" (UID: \"71093850-9ba2-4042-a0d5-dfe5896ead87\") " pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"
Jul 10 02:52:43.435948 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.435855    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzg7w\" (UniqueName: \"kubernetes.io/projected/71093850-9ba2-4042-a0d5-dfe5896ead87-kube-api-access-gzg7w\") pod \"sub-test-model-d5b98a-kserve-6b99498f-flvj5\" (UID: \"71093850-9ba2-4042-a0d5-dfe5896ead87\") " pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"
Jul 10 02:52:43.436003 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.435942    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71093850-9ba2-4042-a0d5-dfe5896ead87-tmp-dir\") pod \"sub-test-model-d5b98a-kserve-6b99498f-flvj5\" (UID: \"71093850-9ba2-4042-a0d5-dfe5896ead87\") " pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"
Jul 10 02:52:43.436173 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.436146    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71093850-9ba2-4042-a0d5-dfe5896ead87-home\") pod \"sub-test-model-d5b98a-kserve-6b99498f-flvj5\" (UID: \"71093850-9ba2-4042-a0d5-dfe5896ead87\") " pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"
Jul 10 02:52:43.436289 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.436153    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71093850-9ba2-4042-a0d5-dfe5896ead87-model-cache\") pod \"sub-test-model-d5b98a-kserve-6b99498f-flvj5\" (UID: \"71093850-9ba2-4042-a0d5-dfe5896ead87\") " pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"
Jul 10 02:52:43.436343 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.436307    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71093850-9ba2-4042-a0d5-dfe5896ead87-tmp-dir\") pod \"sub-test-model-d5b98a-kserve-6b99498f-flvj5\" (UID: \"71093850-9ba2-4042-a0d5-dfe5896ead87\") " pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"
Jul 10 02:52:43.438519 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.438499    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71093850-9ba2-4042-a0d5-dfe5896ead87-dshm\") pod \"sub-test-model-d5b98a-kserve-6b99498f-flvj5\" (UID: \"71093850-9ba2-4042-a0d5-dfe5896ead87\") " pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"
Jul 10 02:52:43.438764 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.438749    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71093850-9ba2-4042-a0d5-dfe5896ead87-tls-certs\") pod \"sub-test-model-d5b98a-kserve-6b99498f-flvj5\" (UID: \"71093850-9ba2-4042-a0d5-dfe5896ead87\") " pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"
Jul 10 02:52:43.446679 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.446652    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzg7w\" (UniqueName: \"kubernetes.io/projected/71093850-9ba2-4042-a0d5-dfe5896ead87-kube-api-access-gzg7w\") pod \"sub-test-model-d5b98a-kserve-6b99498f-flvj5\" (UID: \"71093850-9ba2-4042-a0d5-dfe5896ead87\") " pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"
Jul 10 02:52:43.572110 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.571982    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"
Jul 10 02:52:43.713489 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.713462    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"]
Jul 10 02:52:43.716092 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:52:43.716056    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71093850_9ba2_4042_a0d5_dfe5896ead87.slice/crio-d1d41030483e74e154a7d1aed58ca0b0a1fa1754d87430d1fca8f4d92a217dbe WatchSource:0}: Error finding container d1d41030483e74e154a7d1aed58ca0b0a1fa1754d87430d1fca8f4d92a217dbe: Status 404 returned error can't find the container with id d1d41030483e74e154a7d1aed58ca0b0a1fa1754d87430d1fca8f4d92a217dbe
Jul 10 02:52:43.766168 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:43.766134    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5" event={"ID":"71093850-9ba2-4042-a0d5-dfe5896ead87","Type":"ContainerStarted","Data":"d1d41030483e74e154a7d1aed58ca0b0a1fa1754d87430d1fca8f4d92a217dbe"}
Jul 10 02:52:44.772098 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:44.772057    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5" event={"ID":"71093850-9ba2-4042-a0d5-dfe5896ead87","Type":"ContainerStarted","Data":"a5e529561431ff546251d89a105576dab792f62d6955ca9318233dec21e5da1f"}
Jul 10 02:52:44.791961 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:44.791912    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5" podStartSLOduration=1.791896817 podStartE2EDuration="1.791896817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:52:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:52:44.79033078 +0000 UTC m=+2693.556243013" watchObservedRunningTime="2026-07-10 02:52:44.791896817 +0000 UTC m=+2693.557809050"
Jul 10 02:52:47.061834 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:47.061798    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:52:52.633758 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:52.633730    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/2.log"
Jul 10 02:52:52.636554 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:52.636534    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt7wb_164f62ad-8b5b-4a66-9bfe-17d863ddeeea/ovn-acl-logging/0.log"
Jul 10 02:52:52.641166 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:52.641145    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/2.log"
Jul 10 02:52:52.643809 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:52.643792    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt7wb_164f62ad-8b5b-4a66-9bfe-17d863ddeeea/ovn-acl-logging/0.log"
Jul 10 02:52:53.572883 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:53.572855    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"
Jul 10 02:52:53.573085 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:53.572899    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"
Jul 10 02:52:53.586119 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:53.586092    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"
Jul 10 02:52:53.828163 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:52:53.828075    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"
Jul 10 02:53:13.559496 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:13.559457    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"]
Jul 10 02:53:13.562689 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:13.562673    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"
Jul 10 02:53:13.567162 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:13.567124    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-de8279\"/\"openshift-service-ca.crt\""
Jul 10 02:53:13.567311 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:13.567173    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-de8279\"/\"kube-root-ca.crt\""
Jul 10 02:53:13.567311 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:13.567179    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-de8279\"/\"sub-test-model-de8279-kserve-self-signed-certs\""
Jul 10 02:53:13.567311 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:13.567181    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-de8279\"/\"default-dockercfg-9wb8g\""
Jul 10 02:53:13.572394 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:13.572372    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"]
Jul 10 02:53:13.623815 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:13.623782    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8sgj\" (UniqueName: \"kubernetes.io/projected/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-kube-api-access-v8sgj\") pod \"sub-test-model-de8279-kserve-7db77b5969-cwwdf\" (UID: \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\") " pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"
Jul 10 02:53:13.624003 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:13.623899    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-dshm\") pod \"sub-test-model-de8279-kserve-7db77b5969-cwwdf\" (UID: \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\") " pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"
Jul 10 02:53:13.624003 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:13.623923    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-home\") pod \"sub-test-model-de8279-kserve-7db77b5969-cwwdf\" (UID: \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\") " pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"
Jul 10 02:53:13.624003 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:13.623939    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-tls-certs\") pod \"sub-test-model-de8279-kserve-7db77b5969-cwwdf\" (UID: \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\") " pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"
Jul 10 02:53:13.624003 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:13.623988    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-tmp-dir\") pod \"sub-test-model-de8279-kserve-7db77b5969-cwwdf\" (UID: \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\") " pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"
Jul 10 02:53:13.624176 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:13.624057    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-model-cache\") pod \"sub-test-model-de8279-kserve-7db77b5969-cwwdf\" (UID: \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\") " pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"
Jul 10 02:53:13.725561 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:13.725524    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8sgj\" (UniqueName: \"kubernetes.io/projected/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-kube-api-access-v8sgj\") pod \"sub-test-model-de8279-kserve-7db77b5969-cwwdf\" (UID: \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\") " pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"
Jul 10 02:53:13.725740 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:13.725670    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-dshm\") pod \"sub-test-model-de8279-kserve-7db77b5969-cwwdf\" (UID: \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\") " pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"
Jul 10 02:53:13.725740 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:13.725693    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-home\") pod \"sub-test-model-de8279-kserve-7db77b5969-cwwdf\" (UID: \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\") " pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"
Jul 10 02:53:13.725740 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:13.725708    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-tls-certs\") pod \"sub-test-model-de8279-kserve-7db77b5969-cwwdf\" (UID: \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\") " pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"
Jul 10 02:53:13.725740 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:13.725725    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-tmp-dir\") pod \"sub-test-model-de8279-kserve-7db77b5969-cwwdf\" (UID: \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\") " pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"
Jul 10 02:53:13.726000 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:13.725975    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-model-cache\") pod \"sub-test-model-de8279-kserve-7db77b5969-cwwdf\" (UID: \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\") " pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"
Jul 10 02:53:13.726114 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:13.726069    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-home\") pod \"sub-test-model-de8279-kserve-7db77b5969-cwwdf\" (UID: \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\") " pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"
Jul 10 02:53:13.726200 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:13.726181    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-tmp-dir\") pod \"sub-test-model-de8279-kserve-7db77b5969-cwwdf\" (UID: \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\") " pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"
Jul 10 02:53:13.726270 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:13.726255    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-model-cache\") pod \"sub-test-model-de8279-kserve-7db77b5969-cwwdf\" (UID: \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\") " pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"
Jul 10 02:53:13.728075 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:13.728051    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-dshm\") pod \"sub-test-model-de8279-kserve-7db77b5969-cwwdf\" (UID: \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\") " pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"
Jul 10 02:53:13.728237 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:13.728218    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-tls-certs\") pod \"sub-test-model-de8279-kserve-7db77b5969-cwwdf\" (UID: \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\") " pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"
Jul 10 02:53:13.735776 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:13.735756    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8sgj\" (UniqueName: \"kubernetes.io/projected/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-kube-api-access-v8sgj\") pod \"sub-test-model-de8279-kserve-7db77b5969-cwwdf\" (UID: \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\") " pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"
Jul 10 02:53:13.872569 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:13.872540    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"
Jul 10 02:53:14.002642 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:14.002618    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"]
Jul 10 02:53:14.004017 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:53:14.003990    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f7f74ce_f675_4e6a_9717_81cc0ea1baf8.slice/crio-aed9cd8cedca88d4b12e71f5d116abe8b68e6b73cc2842f9be5892ca18b1bd07 WatchSource:0}: Error finding container aed9cd8cedca88d4b12e71f5d116abe8b68e6b73cc2842f9be5892ca18b1bd07: Status 404 returned error can't find the container with id aed9cd8cedca88d4b12e71f5d116abe8b68e6b73cc2842f9be5892ca18b1bd07
Jul 10 02:53:14.918186 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:14.918148    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf" event={"ID":"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8","Type":"ContainerStarted","Data":"a5fa20e66c90625fe3bae69f1dc262561aba477bd8a0505b7bab607d606cb2a3"}
Jul 10 02:53:14.918186 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:14.918186    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf" event={"ID":"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8","Type":"ContainerStarted","Data":"aed9cd8cedca88d4b12e71f5d116abe8b68e6b73cc2842f9be5892ca18b1bd07"}
Jul 10 02:53:14.936045 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:14.935987    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf" podStartSLOduration=1.9359729570000002 podStartE2EDuration="1.935972957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:53:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:53:14.935414663 +0000 UTC m=+2723.701326896" watchObservedRunningTime="2026-07-10 02:53:14.935972957 +0000 UTC m=+2723.701885189"
Jul 10 02:53:18.257470 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:18.257430    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:53:23.873633 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:23.873599    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"
Jul 10 02:53:23.874004 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:23.873646    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"
Jul 10 02:53:23.885976 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:23.885948    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"
Jul 10 02:53:23.971845 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:23.971818    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"
Jul 10 02:53:32.656475 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:32.656437    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:53:53.156796 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:53.156764    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:53:58.906971 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:58.906933    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"]
Jul 10 02:53:59.862062 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:53:59.862014    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"]
Jul 10 02:54:13.927067 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:13.926935    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5" podUID="71093850-9ba2-4042-a0d5-dfe5896ead87" containerName="main" containerID="cri-o://a5e529561431ff546251d89a105576dab792f62d6955ca9318233dec21e5da1f" gracePeriod=45
Jul 10 02:54:13.973761 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:13.973733    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:54:14.179518 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.179453    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"
Jul 10 02:54:14.198775 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.198748    2576 generic.go:356] "Generic (PLEG): container finished" podID="71093850-9ba2-4042-a0d5-dfe5896ead87" containerID="a5e529561431ff546251d89a105576dab792f62d6955ca9318233dec21e5da1f" exitCode=0
Jul 10 02:54:14.198910 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.198800    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"
Jul 10 02:54:14.198910 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.198811    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5" event={"ID":"71093850-9ba2-4042-a0d5-dfe5896ead87","Type":"ContainerDied","Data":"a5e529561431ff546251d89a105576dab792f62d6955ca9318233dec21e5da1f"}
Jul 10 02:54:14.198910 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.198842    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5" event={"ID":"71093850-9ba2-4042-a0d5-dfe5896ead87","Type":"ContainerDied","Data":"d1d41030483e74e154a7d1aed58ca0b0a1fa1754d87430d1fca8f4d92a217dbe"}
Jul 10 02:54:14.198910 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.198860    2576 scope.go:117] "RemoveContainer" containerID="a5e529561431ff546251d89a105576dab792f62d6955ca9318233dec21e5da1f"
Jul 10 02:54:14.208020 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.208003    2576 scope.go:117] "RemoveContainer" containerID="a5e529561431ff546251d89a105576dab792f62d6955ca9318233dec21e5da1f"
Jul 10 02:54:14.208325 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:54:14.208307    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5e529561431ff546251d89a105576dab792f62d6955ca9318233dec21e5da1f\": container with ID starting with a5e529561431ff546251d89a105576dab792f62d6955ca9318233dec21e5da1f not found: ID does not exist" containerID="a5e529561431ff546251d89a105576dab792f62d6955ca9318233dec21e5da1f"
Jul 10 02:54:14.208381 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.208335    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e529561431ff546251d89a105576dab792f62d6955ca9318233dec21e5da1f"} err="failed to get container status \"a5e529561431ff546251d89a105576dab792f62d6955ca9318233dec21e5da1f\": rpc error: code = NotFound desc = could not find container \"a5e529561431ff546251d89a105576dab792f62d6955ca9318233dec21e5da1f\": container with ID starting with a5e529561431ff546251d89a105576dab792f62d6955ca9318233dec21e5da1f not found: ID does not exist"
Jul 10 02:54:14.310941 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.310912    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzg7w\" (UniqueName: \"kubernetes.io/projected/71093850-9ba2-4042-a0d5-dfe5896ead87-kube-api-access-gzg7w\") pod \"71093850-9ba2-4042-a0d5-dfe5896ead87\" (UID: \"71093850-9ba2-4042-a0d5-dfe5896ead87\") "
Jul 10 02:54:14.311141 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.310955    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71093850-9ba2-4042-a0d5-dfe5896ead87-tmp-dir\") pod \"71093850-9ba2-4042-a0d5-dfe5896ead87\" (UID: \"71093850-9ba2-4042-a0d5-dfe5896ead87\") "
Jul 10 02:54:14.311141 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.311049    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71093850-9ba2-4042-a0d5-dfe5896ead87-dshm\") pod \"71093850-9ba2-4042-a0d5-dfe5896ead87\" (UID: \"71093850-9ba2-4042-a0d5-dfe5896ead87\") "
Jul 10 02:54:14.311141 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.311130    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71093850-9ba2-4042-a0d5-dfe5896ead87-tls-certs\") pod \"71093850-9ba2-4042-a0d5-dfe5896ead87\" (UID: \"71093850-9ba2-4042-a0d5-dfe5896ead87\") "
Jul 10 02:54:14.311324 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.311175    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71093850-9ba2-4042-a0d5-dfe5896ead87-model-cache\") pod \"71093850-9ba2-4042-a0d5-dfe5896ead87\" (UID: \"71093850-9ba2-4042-a0d5-dfe5896ead87\") "
Jul 10 02:54:14.311324 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.311210    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71093850-9ba2-4042-a0d5-dfe5896ead87-home\") pod \"71093850-9ba2-4042-a0d5-dfe5896ead87\" (UID: \"71093850-9ba2-4042-a0d5-dfe5896ead87\") "
Jul 10 02:54:14.311324 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.311305    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71093850-9ba2-4042-a0d5-dfe5896ead87-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "71093850-9ba2-4042-a0d5-dfe5896ead87" (UID: "71093850-9ba2-4042-a0d5-dfe5896ead87"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:54:14.311520 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.311502    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71093850-9ba2-4042-a0d5-dfe5896ead87-tmp-dir\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:54:14.311520 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.311504    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71093850-9ba2-4042-a0d5-dfe5896ead87-model-cache" (OuterVolumeSpecName: "model-cache") pod "71093850-9ba2-4042-a0d5-dfe5896ead87" (UID: "71093850-9ba2-4042-a0d5-dfe5896ead87"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:54:14.311631 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.311519    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71093850-9ba2-4042-a0d5-dfe5896ead87-home" (OuterVolumeSpecName: "home") pod "71093850-9ba2-4042-a0d5-dfe5896ead87" (UID: "71093850-9ba2-4042-a0d5-dfe5896ead87"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:54:14.313266 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.313242    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71093850-9ba2-4042-a0d5-dfe5896ead87-dshm" (OuterVolumeSpecName: "dshm") pod "71093850-9ba2-4042-a0d5-dfe5896ead87" (UID: "71093850-9ba2-4042-a0d5-dfe5896ead87"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:54:14.313367 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.313243    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71093850-9ba2-4042-a0d5-dfe5896ead87-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "71093850-9ba2-4042-a0d5-dfe5896ead87" (UID: "71093850-9ba2-4042-a0d5-dfe5896ead87"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:54:14.313367 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.313294    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71093850-9ba2-4042-a0d5-dfe5896ead87-kube-api-access-gzg7w" (OuterVolumeSpecName: "kube-api-access-gzg7w") pod "71093850-9ba2-4042-a0d5-dfe5896ead87" (UID: "71093850-9ba2-4042-a0d5-dfe5896ead87"). InnerVolumeSpecName "kube-api-access-gzg7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:54:14.415672 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.413577    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71093850-9ba2-4042-a0d5-dfe5896ead87-tls-certs\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:54:14.415672 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.413613    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71093850-9ba2-4042-a0d5-dfe5896ead87-model-cache\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:54:14.415672 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.413628    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71093850-9ba2-4042-a0d5-dfe5896ead87-home\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:54:14.415672 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.413641    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzg7w\" (UniqueName: \"kubernetes.io/projected/71093850-9ba2-4042-a0d5-dfe5896ead87-kube-api-access-gzg7w\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:54:14.415672 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.413659    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71093850-9ba2-4042-a0d5-dfe5896ead87-dshm\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:54:14.522737 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.522704    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"]
Jul 10 02:54:14.527571 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.527546    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d5b98a/sub-test-model-d5b98a-kserve-6b99498f-flvj5"]
Jul 10 02:54:14.545707 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.545681    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71093850-9ba2-4042-a0d5-dfe5896ead87" path="/var/lib/kubelet/pods/71093850-9ba2-4042-a0d5-dfe5896ead87/volumes"
Jul 10 02:54:14.882322 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:14.882259    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf" podUID="5f7f74ce-f675-4e6a-9717-81cc0ea1baf8" containerName="main" containerID="cri-o://a5fa20e66c90625fe3bae69f1dc262561aba477bd8a0505b7bab607d606cb2a3" gracePeriod=45
Jul 10 02:54:15.130814 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.130786    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"
Jul 10 02:54:15.206173 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.206087    2576 generic.go:356] "Generic (PLEG): container finished" podID="5f7f74ce-f675-4e6a-9717-81cc0ea1baf8" containerID="a5fa20e66c90625fe3bae69f1dc262561aba477bd8a0505b7bab607d606cb2a3" exitCode=0
Jul 10 02:54:15.206173 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.206127    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"
Jul 10 02:54:15.206173 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.206134    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf" event={"ID":"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8","Type":"ContainerDied","Data":"a5fa20e66c90625fe3bae69f1dc262561aba477bd8a0505b7bab607d606cb2a3"}
Jul 10 02:54:15.206173 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.206159    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf" event={"ID":"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8","Type":"ContainerDied","Data":"aed9cd8cedca88d4b12e71f5d116abe8b68e6b73cc2842f9be5892ca18b1bd07"}
Jul 10 02:54:15.206173 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.206175    2576 scope.go:117] "RemoveContainer" containerID="a5fa20e66c90625fe3bae69f1dc262561aba477bd8a0505b7bab607d606cb2a3"
Jul 10 02:54:15.214301 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.214282    2576 scope.go:117] "RemoveContainer" containerID="a5fa20e66c90625fe3bae69f1dc262561aba477bd8a0505b7bab607d606cb2a3"
Jul 10 02:54:15.214547 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:54:15.214525    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5fa20e66c90625fe3bae69f1dc262561aba477bd8a0505b7bab607d606cb2a3\": container with ID starting with a5fa20e66c90625fe3bae69f1dc262561aba477bd8a0505b7bab607d606cb2a3 not found: ID does not exist" containerID="a5fa20e66c90625fe3bae69f1dc262561aba477bd8a0505b7bab607d606cb2a3"
Jul 10 02:54:15.214607 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.214550    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5fa20e66c90625fe3bae69f1dc262561aba477bd8a0505b7bab607d606cb2a3"} err="failed to get container status \"a5fa20e66c90625fe3bae69f1dc262561aba477bd8a0505b7bab607d606cb2a3\": rpc error: code = NotFound desc = could not find container \"a5fa20e66c90625fe3bae69f1dc262561aba477bd8a0505b7bab607d606cb2a3\": container with ID starting with a5fa20e66c90625fe3bae69f1dc262561aba477bd8a0505b7bab607d606cb2a3 not found: ID does not exist"
Jul 10 02:54:15.221245 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.221227    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-model-cache\") pod \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\" (UID: \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\") "
Jul 10 02:54:15.221350 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.221335    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-tls-certs\") pod \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\" (UID: \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\") "
Jul 10 02:54:15.221397 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.221377    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8sgj\" (UniqueName: \"kubernetes.io/projected/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-kube-api-access-v8sgj\") pod \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\" (UID: \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\") "
Jul 10 02:54:15.221447 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.221418    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-home\") pod \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\" (UID: \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\") "
Jul 10 02:54:15.221503 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.221469    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-tmp-dir\") pod \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\" (UID: \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\") "
Jul 10 02:54:15.221503 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.221481    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-model-cache" (OuterVolumeSpecName: "model-cache") pod "5f7f74ce-f675-4e6a-9717-81cc0ea1baf8" (UID: "5f7f74ce-f675-4e6a-9717-81cc0ea1baf8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:54:15.221503 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.221497    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-dshm\") pod \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\" (UID: \"5f7f74ce-f675-4e6a-9717-81cc0ea1baf8\") "
Jul 10 02:54:15.221752 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.221725    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5f7f74ce-f675-4e6a-9717-81cc0ea1baf8" (UID: "5f7f74ce-f675-4e6a-9717-81cc0ea1baf8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:54:15.221752 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.221734    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-home" (OuterVolumeSpecName: "home") pod "5f7f74ce-f675-4e6a-9717-81cc0ea1baf8" (UID: "5f7f74ce-f675-4e6a-9717-81cc0ea1baf8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:54:15.221888 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.221808    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-home\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:54:15.221888 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.221825    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-tmp-dir\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:54:15.221888 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.221837    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-model-cache\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:54:15.223468 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.223440    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-kube-api-access-v8sgj" (OuterVolumeSpecName: "kube-api-access-v8sgj") pod "5f7f74ce-f675-4e6a-9717-81cc0ea1baf8" (UID: "5f7f74ce-f675-4e6a-9717-81cc0ea1baf8"). InnerVolumeSpecName "kube-api-access-v8sgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:54:15.223468 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.223455    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5f7f74ce-f675-4e6a-9717-81cc0ea1baf8" (UID: "5f7f74ce-f675-4e6a-9717-81cc0ea1baf8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:54:15.223644 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.223471    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-dshm" (OuterVolumeSpecName: "dshm") pod "5f7f74ce-f675-4e6a-9717-81cc0ea1baf8" (UID: "5f7f74ce-f675-4e6a-9717-81cc0ea1baf8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:54:15.322688 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.322649    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-tls-certs\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:54:15.322688 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.322679    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8sgj\" (UniqueName: \"kubernetes.io/projected/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-kube-api-access-v8sgj\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:54:15.322688 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.322693    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8-dshm\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:54:15.529601 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.529566    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"]
Jul 10 02:54:15.535556 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:15.535528    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-de8279/sub-test-model-de8279-kserve-7db77b5969-cwwdf"]
Jul 10 02:54:16.544457 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:16.544422    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f7f74ce-f675-4e6a-9717-81cc0ea1baf8" path="/var/lib/kubelet/pods/5f7f74ce-f675-4e6a-9717-81cc0ea1baf8/volumes"
Jul 10 02:54:17.757864 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.757832    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"]
Jul 10 02:54:17.758244 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.758202    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f7f74ce-f675-4e6a-9717-81cc0ea1baf8" containerName="main"
Jul 10 02:54:17.758244 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.758213    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f7f74ce-f675-4e6a-9717-81cc0ea1baf8" containerName="main"
Jul 10 02:54:17.758244 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.758242    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71093850-9ba2-4042-a0d5-dfe5896ead87" containerName="main"
Jul 10 02:54:17.758341 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.758248    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="71093850-9ba2-4042-a0d5-dfe5896ead87" containerName="main"
Jul 10 02:54:17.758341 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.758304    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="71093850-9ba2-4042-a0d5-dfe5896ead87" containerName="main"
Jul 10 02:54:17.758341 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.758310    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f7f74ce-f675-4e6a-9717-81cc0ea1baf8" containerName="main"
Jul 10 02:54:17.762435 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.762414    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"
Jul 10 02:54:17.766980 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.766959    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d5b98a\"/\"rate-test-model-d5b98a-kserve-self-signed-certs\""
Jul 10 02:54:17.767124 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.767004    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d5b98a\"/\"default-dockercfg-vmwh8\""
Jul 10 02:54:17.767124 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.766961    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d5b98a\"/\"kube-root-ca.crt\""
Jul 10 02:54:17.767124 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.767068    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d5b98a\"/\"openshift-service-ca.crt\""
Jul 10 02:54:17.770979 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.770961    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"]
Jul 10 02:54:17.848468 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.848436    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eef67c8f-b540-4416-8032-73014d8e69ac-model-cache\") pod \"rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr\" (UID: \"eef67c8f-b540-4416-8032-73014d8e69ac\") " pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"
Jul 10 02:54:17.848627 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.848478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eef67c8f-b540-4416-8032-73014d8e69ac-tls-certs\") pod \"rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr\" (UID: \"eef67c8f-b540-4416-8032-73014d8e69ac\") " pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"
Jul 10 02:54:17.848627 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.848513    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eef67c8f-b540-4416-8032-73014d8e69ac-dshm\") pod \"rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr\" (UID: \"eef67c8f-b540-4416-8032-73014d8e69ac\") " pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"
Jul 10 02:54:17.848627 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.848538    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlqpr\" (UniqueName: \"kubernetes.io/projected/eef67c8f-b540-4416-8032-73014d8e69ac-kube-api-access-dlqpr\") pod \"rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr\" (UID: \"eef67c8f-b540-4416-8032-73014d8e69ac\") " pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"
Jul 10 02:54:17.848627 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.848602    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eef67c8f-b540-4416-8032-73014d8e69ac-home\") pod \"rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr\" (UID: \"eef67c8f-b540-4416-8032-73014d8e69ac\") " pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"
Jul 10 02:54:17.848627 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.848619    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eef67c8f-b540-4416-8032-73014d8e69ac-tmp-dir\") pod \"rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr\" (UID: \"eef67c8f-b540-4416-8032-73014d8e69ac\") " pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"
Jul 10 02:54:17.949446 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.949412    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eef67c8f-b540-4416-8032-73014d8e69ac-tls-certs\") pod \"rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr\" (UID: \"eef67c8f-b540-4416-8032-73014d8e69ac\") " pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"
Jul 10 02:54:17.949446 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.949451    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eef67c8f-b540-4416-8032-73014d8e69ac-dshm\") pod \"rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr\" (UID: \"eef67c8f-b540-4416-8032-73014d8e69ac\") " pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"
Jul 10 02:54:17.949664 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.949470    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlqpr\" (UniqueName: \"kubernetes.io/projected/eef67c8f-b540-4416-8032-73014d8e69ac-kube-api-access-dlqpr\") pod \"rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr\" (UID: \"eef67c8f-b540-4416-8032-73014d8e69ac\") " pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"
Jul 10 02:54:17.949664 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.949543    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eef67c8f-b540-4416-8032-73014d8e69ac-home\") pod \"rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr\" (UID: \"eef67c8f-b540-4416-8032-73014d8e69ac\") " pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"
Jul 10 02:54:17.949664 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.949570    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eef67c8f-b540-4416-8032-73014d8e69ac-tmp-dir\") pod \"rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr\" (UID: \"eef67c8f-b540-4416-8032-73014d8e69ac\") " pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"
Jul 10 02:54:17.949664 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.949627    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eef67c8f-b540-4416-8032-73014d8e69ac-model-cache\") pod \"rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr\" (UID: \"eef67c8f-b540-4416-8032-73014d8e69ac\") " pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"
Jul 10 02:54:17.949996 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.949967    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eef67c8f-b540-4416-8032-73014d8e69ac-home\") pod \"rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr\" (UID: \"eef67c8f-b540-4416-8032-73014d8e69ac\") " pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"
Jul 10 02:54:17.950151 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.949997    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eef67c8f-b540-4416-8032-73014d8e69ac-tmp-dir\") pod \"rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr\" (UID: \"eef67c8f-b540-4416-8032-73014d8e69ac\") " pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"
Jul 10 02:54:17.950151 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.950078    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eef67c8f-b540-4416-8032-73014d8e69ac-model-cache\") pod \"rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr\" (UID: \"eef67c8f-b540-4416-8032-73014d8e69ac\") " pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"
Jul 10 02:54:17.951818 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.951789    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eef67c8f-b540-4416-8032-73014d8e69ac-dshm\") pod \"rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr\" (UID: \"eef67c8f-b540-4416-8032-73014d8e69ac\") " pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"
Jul 10 02:54:17.952002 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.951984    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eef67c8f-b540-4416-8032-73014d8e69ac-tls-certs\") pod \"rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr\" (UID: \"eef67c8f-b540-4416-8032-73014d8e69ac\") " pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"
Jul 10 02:54:17.959101 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:17.959082    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlqpr\" (UniqueName: \"kubernetes.io/projected/eef67c8f-b540-4416-8032-73014d8e69ac-kube-api-access-dlqpr\") pod \"rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr\" (UID: \"eef67c8f-b540-4416-8032-73014d8e69ac\") " pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"
Jul 10 02:54:18.073849 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:18.073767    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"
Jul 10 02:54:18.208488 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:18.208452    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"]
Jul 10 02:54:18.210088 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:54:18.210061    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeef67c8f_b540_4416_8032_73014d8e69ac.slice/crio-fb1a7e39aa83472e9b516a49cdc113c0c9c4fef6c596af9692d27843ff90e211 WatchSource:0}: Error finding container fb1a7e39aa83472e9b516a49cdc113c0c9c4fef6c596af9692d27843ff90e211: Status 404 returned error can't find the container with id fb1a7e39aa83472e9b516a49cdc113c0c9c4fef6c596af9692d27843ff90e211
Jul 10 02:54:18.222530 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:18.222506    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr" event={"ID":"eef67c8f-b540-4416-8032-73014d8e69ac","Type":"ContainerStarted","Data":"fb1a7e39aa83472e9b516a49cdc113c0c9c4fef6c596af9692d27843ff90e211"}
Jul 10 02:54:19.228472 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:19.228436    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr" event={"ID":"eef67c8f-b540-4416-8032-73014d8e69ac","Type":"ContainerStarted","Data":"4ba1dfdfde6dc74eb845b31321afe04e509c658b52a1ba4ab8092359b3f4d643"}
Jul 10 02:54:19.248552 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:19.248497    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr" podStartSLOduration=2.248474363 podStartE2EDuration="2.248474363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:54:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:54:19.247659114 +0000 UTC m=+2788.013571336" watchObservedRunningTime="2026-07-10 02:54:19.248474363 +0000 UTC m=+2788.014386586"
Jul 10 02:54:28.074715 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:28.074679    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"
Jul 10 02:54:28.074715 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:28.074723    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"
Jul 10 02:54:28.087381 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:28.087361    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"
Jul 10 02:54:28.280815 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:28.280776    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"
Jul 10 02:54:30.053064 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:54:30.053017    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:55:08.436300 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.436256    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"]
Jul 10 02:55:08.440302 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.440278    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"
Jul 10 02:55:08.443221 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.443196    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-de8279\"/\"openshift-service-ca.crt\""
Jul 10 02:55:08.443343 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.443269    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-de8279\"/\"rate-test-model-de8279-kserve-self-signed-certs\""
Jul 10 02:55:08.444739 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.444720    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-de8279\"/\"default-dockercfg-9wb8g\""
Jul 10 02:55:08.444848 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.444762    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-de8279\"/\"kube-root-ca.crt\""
Jul 10 02:55:08.449617 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.449592    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"]
Jul 10 02:55:08.529895 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.529864    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/593dc87b-16a3-45c9-a598-853e4e1a8a52-home\") pod \"rate-test-model-de8279-kserve-d77576499-kldtl\" (UID: \"593dc87b-16a3-45c9-a598-853e4e1a8a52\") " pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"
Jul 10 02:55:08.530100 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.529944    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/593dc87b-16a3-45c9-a598-853e4e1a8a52-tls-certs\") pod \"rate-test-model-de8279-kserve-d77576499-kldtl\" (UID: \"593dc87b-16a3-45c9-a598-853e4e1a8a52\") " pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"
Jul 10 02:55:08.530100 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.529980    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/593dc87b-16a3-45c9-a598-853e4e1a8a52-dshm\") pod \"rate-test-model-de8279-kserve-d77576499-kldtl\" (UID: \"593dc87b-16a3-45c9-a598-853e4e1a8a52\") " pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"
Jul 10 02:55:08.530100 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.529997    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/593dc87b-16a3-45c9-a598-853e4e1a8a52-model-cache\") pod \"rate-test-model-de8279-kserve-d77576499-kldtl\" (UID: \"593dc87b-16a3-45c9-a598-853e4e1a8a52\") " pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"
Jul 10 02:55:08.530100 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.530090    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/593dc87b-16a3-45c9-a598-853e4e1a8a52-tmp-dir\") pod \"rate-test-model-de8279-kserve-d77576499-kldtl\" (UID: \"593dc87b-16a3-45c9-a598-853e4e1a8a52\") " pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"
Jul 10 02:55:08.530243 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.530127    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt6cv\" (UniqueName: \"kubernetes.io/projected/593dc87b-16a3-45c9-a598-853e4e1a8a52-kube-api-access-qt6cv\") pod \"rate-test-model-de8279-kserve-d77576499-kldtl\" (UID: \"593dc87b-16a3-45c9-a598-853e4e1a8a52\") " pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"
Jul 10 02:55:08.630790 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.630757    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/593dc87b-16a3-45c9-a598-853e4e1a8a52-home\") pod \"rate-test-model-de8279-kserve-d77576499-kldtl\" (UID: \"593dc87b-16a3-45c9-a598-853e4e1a8a52\") " pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"
Jul 10 02:55:08.630969 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.630811    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/593dc87b-16a3-45c9-a598-853e4e1a8a52-tls-certs\") pod \"rate-test-model-de8279-kserve-d77576499-kldtl\" (UID: \"593dc87b-16a3-45c9-a598-853e4e1a8a52\") " pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"
Jul 10 02:55:08.630969 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.630860    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/593dc87b-16a3-45c9-a598-853e4e1a8a52-dshm\") pod \"rate-test-model-de8279-kserve-d77576499-kldtl\" (UID: \"593dc87b-16a3-45c9-a598-853e4e1a8a52\") " pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"
Jul 10 02:55:08.630969 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.630881    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/593dc87b-16a3-45c9-a598-853e4e1a8a52-model-cache\") pod \"rate-test-model-de8279-kserve-d77576499-kldtl\" (UID: \"593dc87b-16a3-45c9-a598-853e4e1a8a52\") " pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"
Jul 10 02:55:08.630969 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.630908    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/593dc87b-16a3-45c9-a598-853e4e1a8a52-tmp-dir\") pod \"rate-test-model-de8279-kserve-d77576499-kldtl\" (UID: \"593dc87b-16a3-45c9-a598-853e4e1a8a52\") " pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"
Jul 10 02:55:08.630969 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.630939    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt6cv\" (UniqueName: \"kubernetes.io/projected/593dc87b-16a3-45c9-a598-853e4e1a8a52-kube-api-access-qt6cv\") pod \"rate-test-model-de8279-kserve-d77576499-kldtl\" (UID: \"593dc87b-16a3-45c9-a598-853e4e1a8a52\") " pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"
Jul 10 02:55:08.631265 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.631235    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/593dc87b-16a3-45c9-a598-853e4e1a8a52-home\") pod \"rate-test-model-de8279-kserve-d77576499-kldtl\" (UID: \"593dc87b-16a3-45c9-a598-853e4e1a8a52\") " pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"
Jul 10 02:55:08.631329 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.631267    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/593dc87b-16a3-45c9-a598-853e4e1a8a52-model-cache\") pod \"rate-test-model-de8279-kserve-d77576499-kldtl\" (UID: \"593dc87b-16a3-45c9-a598-853e4e1a8a52\") " pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"
Jul 10 02:55:08.631437 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.631414    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/593dc87b-16a3-45c9-a598-853e4e1a8a52-tmp-dir\") pod \"rate-test-model-de8279-kserve-d77576499-kldtl\" (UID: \"593dc87b-16a3-45c9-a598-853e4e1a8a52\") " pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"
Jul 10 02:55:08.633221 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.633202    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/593dc87b-16a3-45c9-a598-853e4e1a8a52-dshm\") pod \"rate-test-model-de8279-kserve-d77576499-kldtl\" (UID: \"593dc87b-16a3-45c9-a598-853e4e1a8a52\") " pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"
Jul 10 02:55:08.633416 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.633400    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/593dc87b-16a3-45c9-a598-853e4e1a8a52-tls-certs\") pod \"rate-test-model-de8279-kserve-d77576499-kldtl\" (UID: \"593dc87b-16a3-45c9-a598-853e4e1a8a52\") " pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"
Jul 10 02:55:08.640435 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.640413    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt6cv\" (UniqueName: \"kubernetes.io/projected/593dc87b-16a3-45c9-a598-853e4e1a8a52-kube-api-access-qt6cv\") pod \"rate-test-model-de8279-kserve-d77576499-kldtl\" (UID: \"593dc87b-16a3-45c9-a598-853e4e1a8a52\") " pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"
Jul 10 02:55:08.751324 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.751242    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"
Jul 10 02:55:08.882520 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:08.882495    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"]
Jul 10 02:55:08.884146 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:55:08.884118    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod593dc87b_16a3_45c9_a598_853e4e1a8a52.slice/crio-9c86bc1a64506ff4e1e9f3858e68d3e93337ca02219a71a370bdbacf86eb5784 WatchSource:0}: Error finding container 9c86bc1a64506ff4e1e9f3858e68d3e93337ca02219a71a370bdbacf86eb5784: Status 404 returned error can't find the container with id 9c86bc1a64506ff4e1e9f3858e68d3e93337ca02219a71a370bdbacf86eb5784
Jul 10 02:55:09.468071 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:09.468013    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl" event={"ID":"593dc87b-16a3-45c9-a598-853e4e1a8a52","Type":"ContainerStarted","Data":"81ce16a653ee84256313432bfdf33633487e2fe33b19dbdc6dc26573b3225b93"}
Jul 10 02:55:09.468071 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:09.468075    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl" event={"ID":"593dc87b-16a3-45c9-a598-853e4e1a8a52","Type":"ContainerStarted","Data":"9c86bc1a64506ff4e1e9f3858e68d3e93337ca02219a71a370bdbacf86eb5784"}
Jul 10 02:55:09.491311 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:09.491261    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl" podStartSLOduration=1.491246762 podStartE2EDuration="1.491246762s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:55:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:55:09.488340193 +0000 UTC m=+2838.254252436" watchObservedRunningTime="2026-07-10 02:55:09.491246762 +0000 UTC m=+2838.257158995"
Jul 10 02:55:13.259914 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:13.259881    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:55:18.751508 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:18.751474    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"
Jul 10 02:55:18.751508 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:18.751515    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"
Jul 10 02:55:18.764011 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:18.763988    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"
Jul 10 02:55:19.525580 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:19.525556    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"
Jul 10 02:55:28.859992 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:28.859948    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:55:52.951898 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:52.951819    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:55:56.945758 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:56.945727    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"]
Jul 10 02:55:57.944392 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:57.944362    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"]
Jul 10 02:55:58.968769 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:58.968732    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7632-140000512147760"]
Jul 10 02:55:58.972415 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:58.972398    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7632-140000512147760"
Jul 10 02:55:58.975194 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:58.975177    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-hw75f\""
Jul 10 02:55:58.978695 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:58.978674    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7632-140000512147760"]
Jul 10 02:55:59.117003 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:59.116971    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th9j7\" (UniqueName: \"kubernetes.io/projected/d796c5a4-f790-412f-974c-e7ae50f2f0c9-kube-api-access-th9j7\") pod \"test-curl-7632-140000512147760\" (UID: \"d796c5a4-f790-412f-974c-e7ae50f2f0c9\") " pod="openshift-ingress/test-curl-7632-140000512147760"
Jul 10 02:55:59.218631 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:59.218586    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th9j7\" (UniqueName: \"kubernetes.io/projected/d796c5a4-f790-412f-974c-e7ae50f2f0c9-kube-api-access-th9j7\") pod \"test-curl-7632-140000512147760\" (UID: \"d796c5a4-f790-412f-974c-e7ae50f2f0c9\") " pod="openshift-ingress/test-curl-7632-140000512147760"
Jul 10 02:55:59.228218 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:59.228151    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th9j7\" (UniqueName: \"kubernetes.io/projected/d796c5a4-f790-412f-974c-e7ae50f2f0c9-kube-api-access-th9j7\") pod \"test-curl-7632-140000512147760\" (UID: \"d796c5a4-f790-412f-974c-e7ae50f2f0c9\") " pod="openshift-ingress/test-curl-7632-140000512147760"
Jul 10 02:55:59.282573 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:59.282544    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7632-140000512147760"
Jul 10 02:55:59.408301 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:59.408278    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7632-140000512147760"]
Jul 10 02:55:59.409663 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:55:59.409641    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd796c5a4_f790_412f_974c_e7ae50f2f0c9.slice/crio-dbe67e706dcb74446ca3a134f1b11b2fed3349d5ce5f40fab477c5abbe542cb6 WatchSource:0}: Error finding container dbe67e706dcb74446ca3a134f1b11b2fed3349d5ce5f40fab477c5abbe542cb6: Status 404 returned error can't find the container with id dbe67e706dcb74446ca3a134f1b11b2fed3349d5ce5f40fab477c5abbe542cb6
Jul 10 02:55:59.410992 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:59.410976    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 02:55:59.715416 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:55:59.715382    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7632-140000512147760" event={"ID":"d796c5a4-f790-412f-974c-e7ae50f2f0c9","Type":"ContainerStarted","Data":"dbe67e706dcb74446ca3a134f1b11b2fed3349d5ce5f40fab477c5abbe542cb6"}
Jul 10 02:56:00.721836 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:00.721802    2576 generic.go:356] "Generic (PLEG): container finished" podID="d796c5a4-f790-412f-974c-e7ae50f2f0c9" containerID="6e8a8caed778ad4e1e06f3498b28299d976589b3b8c5928cbac88694629d1634" exitCode=0
Jul 10 02:56:00.722231 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:00.721862    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7632-140000512147760" event={"ID":"d796c5a4-f790-412f-974c-e7ae50f2f0c9","Type":"ContainerDied","Data":"6e8a8caed778ad4e1e06f3498b28299d976589b3b8c5928cbac88694629d1634"}
Jul 10 02:56:01.864450 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:01.864424    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7632-140000512147760"
Jul 10 02:56:01.901725 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:01.901701    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7632-140000512147760_d796c5a4-f790-412f-974c-e7ae50f2f0c9/test-curl-7632-140000512147760/0.log"
Jul 10 02:56:01.927308 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:01.927278    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7632-140000512147760"]
Jul 10 02:56:01.931469 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:01.931447    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7632-140000512147760"]
Jul 10 02:56:01.944976 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:01.944953    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-th9j7\" (UniqueName: \"kubernetes.io/projected/d796c5a4-f790-412f-974c-e7ae50f2f0c9-kube-api-access-th9j7\") pod \"d796c5a4-f790-412f-974c-e7ae50f2f0c9\" (UID: \"d796c5a4-f790-412f-974c-e7ae50f2f0c9\") "
Jul 10 02:56:01.947165 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:01.947143    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d796c5a4-f790-412f-974c-e7ae50f2f0c9-kube-api-access-th9j7" (OuterVolumeSpecName: "kube-api-access-th9j7") pod "d796c5a4-f790-412f-974c-e7ae50f2f0c9" (UID: "d796c5a4-f790-412f-974c-e7ae50f2f0c9"). InnerVolumeSpecName "kube-api-access-th9j7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:56:02.046919 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:02.046816    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-th9j7\" (UniqueName: \"kubernetes.io/projected/d796c5a4-f790-412f-974c-e7ae50f2f0c9-kube-api-access-th9j7\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:56:02.544830 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:02.544795    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d796c5a4-f790-412f-974c-e7ae50f2f0c9" path="/var/lib/kubelet/pods/d796c5a4-f790-412f-974c-e7ae50f2f0c9/volumes"
Jul 10 02:56:02.732935 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:02.732910    2576 scope.go:117] "RemoveContainer" containerID="6e8a8caed778ad4e1e06f3498b28299d976589b3b8c5928cbac88694629d1634"
Jul 10 02:56:02.732935 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:02.732918    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7632-140000512147760"
Jul 10 02:56:05.086688 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:05.086649    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7632-140000509483312"]
Jul 10 02:56:05.087081 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:05.087022    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d796c5a4-f790-412f-974c-e7ae50f2f0c9" containerName="test-curl-7632-140000512147760"
Jul 10 02:56:05.087081 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:05.087049    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d796c5a4-f790-412f-974c-e7ae50f2f0c9" containerName="test-curl-7632-140000512147760"
Jul 10 02:56:05.087163 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:05.087125    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d796c5a4-f790-412f-974c-e7ae50f2f0c9" containerName="test-curl-7632-140000512147760"
Jul 10 02:56:05.091353 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:05.091337    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7632-140000509483312"
Jul 10 02:56:05.094463 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:05.094440    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-hw75f\""
Jul 10 02:56:05.095903 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:05.095878    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7632-140000509483312"]
Jul 10 02:56:05.173907 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:05.173871    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp7cb\" (UniqueName: \"kubernetes.io/projected/7a36e8e9-60f0-41df-bdb0-ff54444e90fe-kube-api-access-qp7cb\") pod \"test-curl-7632-140000509483312\" (UID: \"7a36e8e9-60f0-41df-bdb0-ff54444e90fe\") " pod="openshift-ingress/test-curl-7632-140000509483312"
Jul 10 02:56:05.274816 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:05.274787    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp7cb\" (UniqueName: \"kubernetes.io/projected/7a36e8e9-60f0-41df-bdb0-ff54444e90fe-kube-api-access-qp7cb\") pod \"test-curl-7632-140000509483312\" (UID: \"7a36e8e9-60f0-41df-bdb0-ff54444e90fe\") " pod="openshift-ingress/test-curl-7632-140000509483312"
Jul 10 02:56:05.284779 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:05.284754    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp7cb\" (UniqueName: \"kubernetes.io/projected/7a36e8e9-60f0-41df-bdb0-ff54444e90fe-kube-api-access-qp7cb\") pod \"test-curl-7632-140000509483312\" (UID: \"7a36e8e9-60f0-41df-bdb0-ff54444e90fe\") " pod="openshift-ingress/test-curl-7632-140000509483312"
Jul 10 02:56:05.401050 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:05.400995    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7632-140000509483312"
Jul 10 02:56:05.527915 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:05.527889    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7632-140000509483312"]
Jul 10 02:56:05.529867 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:56:05.529842    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a36e8e9_60f0_41df_bdb0_ff54444e90fe.slice/crio-a62ae8f4df576461a66eb2a94fb97c4560809a2aae9d9e2725627383319156c1 WatchSource:0}: Error finding container a62ae8f4df576461a66eb2a94fb97c4560809a2aae9d9e2725627383319156c1: Status 404 returned error can't find the container with id a62ae8f4df576461a66eb2a94fb97c4560809a2aae9d9e2725627383319156c1
Jul 10 02:56:05.748681 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:05.748594    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7632-140000509483312" event={"ID":"7a36e8e9-60f0-41df-bdb0-ff54444e90fe","Type":"ContainerStarted","Data":"a62ae8f4df576461a66eb2a94fb97c4560809a2aae9d9e2725627383319156c1"}
Jul 10 02:56:06.754563 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:06.754533    2576 generic.go:356] "Generic (PLEG): container finished" podID="7a36e8e9-60f0-41df-bdb0-ff54444e90fe" containerID="687e761413b76b87f234fd942f4d122017a97c51757b9594a37bab049fa074c6" exitCode=0
Jul 10 02:56:06.754937 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:06.754612    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7632-140000509483312" event={"ID":"7a36e8e9-60f0-41df-bdb0-ff54444e90fe","Type":"ContainerDied","Data":"687e761413b76b87f234fd942f4d122017a97c51757b9594a37bab049fa074c6"}
Jul 10 02:56:07.896352 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:07.896328    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7632-140000509483312"
Jul 10 02:56:07.918997 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:07.918974    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7632-140000509483312_7a36e8e9-60f0-41df-bdb0-ff54444e90fe/test-curl-7632-140000509483312/0.log"
Jul 10 02:56:07.944654 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:07.944622    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7632-140000509483312"]
Jul 10 02:56:07.951803 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:07.951781    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7632-140000509483312"]
Jul 10 02:56:08.000007 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:07.999974    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qp7cb\" (UniqueName: \"kubernetes.io/projected/7a36e8e9-60f0-41df-bdb0-ff54444e90fe-kube-api-access-qp7cb\") pod \"7a36e8e9-60f0-41df-bdb0-ff54444e90fe\" (UID: \"7a36e8e9-60f0-41df-bdb0-ff54444e90fe\") "
Jul 10 02:56:08.002023 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:08.002003    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a36e8e9-60f0-41df-bdb0-ff54444e90fe-kube-api-access-qp7cb" (OuterVolumeSpecName: "kube-api-access-qp7cb") pod "7a36e8e9-60f0-41df-bdb0-ff54444e90fe" (UID: "7a36e8e9-60f0-41df-bdb0-ff54444e90fe"). InnerVolumeSpecName "kube-api-access-qp7cb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:56:08.101259 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:08.101174    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qp7cb\" (UniqueName: \"kubernetes.io/projected/7a36e8e9-60f0-41df-bdb0-ff54444e90fe-kube-api-access-qp7cb\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:56:08.544247 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:08.544206    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a36e8e9-60f0-41df-bdb0-ff54444e90fe" path="/var/lib/kubelet/pods/7a36e8e9-60f0-41df-bdb0-ff54444e90fe/volumes"
Jul 10 02:56:08.766156 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:08.766128    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7632-140000509483312"
Jul 10 02:56:08.766302 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:08.766163    2576 scope.go:117] "RemoveContainer" containerID="687e761413b76b87f234fd942f4d122017a97c51757b9594a37bab049fa074c6"
Jul 10 02:56:09.250128 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:09.250091    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:56:11.068409 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:11.068373    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7632-140000509484320"]
Jul 10 02:56:11.068999 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:11.068979    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a36e8e9-60f0-41df-bdb0-ff54444e90fe" containerName="test-curl-7632-140000509483312"
Jul 10 02:56:11.069068 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:11.069003    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a36e8e9-60f0-41df-bdb0-ff54444e90fe" containerName="test-curl-7632-140000509483312"
Jul 10 02:56:11.069133 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:11.069120    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a36e8e9-60f0-41df-bdb0-ff54444e90fe" containerName="test-curl-7632-140000509483312"
Jul 10 02:56:11.074344 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:11.074327    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7632-140000509484320"
Jul 10 02:56:11.077634 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:11.077614    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-hw75f\""
Jul 10 02:56:11.079014 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:11.078992    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7632-140000509484320"]
Jul 10 02:56:11.232854 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:11.232817    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrvcz\" (UniqueName: \"kubernetes.io/projected/3c60ca42-6e98-4dab-9740-112029b2432c-kube-api-access-lrvcz\") pod \"test-curl-7632-140000509484320\" (UID: \"3c60ca42-6e98-4dab-9740-112029b2432c\") " pod="openshift-ingress/test-curl-7632-140000509484320"
Jul 10 02:56:11.334296 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:11.334215    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrvcz\" (UniqueName: \"kubernetes.io/projected/3c60ca42-6e98-4dab-9740-112029b2432c-kube-api-access-lrvcz\") pod \"test-curl-7632-140000509484320\" (UID: \"3c60ca42-6e98-4dab-9740-112029b2432c\") " pod="openshift-ingress/test-curl-7632-140000509484320"
Jul 10 02:56:11.343678 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:11.343651    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrvcz\" (UniqueName: \"kubernetes.io/projected/3c60ca42-6e98-4dab-9740-112029b2432c-kube-api-access-lrvcz\") pod \"test-curl-7632-140000509484320\" (UID: \"3c60ca42-6e98-4dab-9740-112029b2432c\") " pod="openshift-ingress/test-curl-7632-140000509484320"
Jul 10 02:56:11.385301 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:11.385278    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7632-140000509484320"
Jul 10 02:56:11.515237 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:11.515213    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7632-140000509484320"]
Jul 10 02:56:11.516847 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:56:11.516822    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c60ca42_6e98_4dab_9740_112029b2432c.slice/crio-245e938dd1f73e25f8d0eb8a28b626da1a6886b1b270e3d31d633e2e8c9982d6 WatchSource:0}: Error finding container 245e938dd1f73e25f8d0eb8a28b626da1a6886b1b270e3d31d633e2e8c9982d6: Status 404 returned error can't find the container with id 245e938dd1f73e25f8d0eb8a28b626da1a6886b1b270e3d31d633e2e8c9982d6
Jul 10 02:56:11.782529 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:11.782491    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7632-140000509484320" event={"ID":"3c60ca42-6e98-4dab-9740-112029b2432c","Type":"ContainerStarted","Data":"245e938dd1f73e25f8d0eb8a28b626da1a6886b1b270e3d31d633e2e8c9982d6"}
Jul 10 02:56:11.965221 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:11.965188    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr" podUID="eef67c8f-b540-4416-8032-73014d8e69ac" containerName="main" containerID="cri-o://4ba1dfdfde6dc74eb845b31321afe04e509c658b52a1ba4ab8092359b3f4d643" gracePeriod=45
Jul 10 02:56:12.199717 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.199692    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"
Jul 10 02:56:12.344193 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.344122    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eef67c8f-b540-4416-8032-73014d8e69ac-tmp-dir\") pod \"eef67c8f-b540-4416-8032-73014d8e69ac\" (UID: \"eef67c8f-b540-4416-8032-73014d8e69ac\") "
Jul 10 02:56:12.344193 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.344154    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eef67c8f-b540-4416-8032-73014d8e69ac-tls-certs\") pod \"eef67c8f-b540-4416-8032-73014d8e69ac\" (UID: \"eef67c8f-b540-4416-8032-73014d8e69ac\") "
Jul 10 02:56:12.344420 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.344205    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eef67c8f-b540-4416-8032-73014d8e69ac-model-cache\") pod \"eef67c8f-b540-4416-8032-73014d8e69ac\" (UID: \"eef67c8f-b540-4416-8032-73014d8e69ac\") "
Jul 10 02:56:12.344420 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.344229    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlqpr\" (UniqueName: \"kubernetes.io/projected/eef67c8f-b540-4416-8032-73014d8e69ac-kube-api-access-dlqpr\") pod \"eef67c8f-b540-4416-8032-73014d8e69ac\" (UID: \"eef67c8f-b540-4416-8032-73014d8e69ac\") "
Jul 10 02:56:12.344420 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.344294    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eef67c8f-b540-4416-8032-73014d8e69ac-dshm\") pod \"eef67c8f-b540-4416-8032-73014d8e69ac\" (UID: \"eef67c8f-b540-4416-8032-73014d8e69ac\") "
Jul 10 02:56:12.344420 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.344325    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eef67c8f-b540-4416-8032-73014d8e69ac-home\") pod \"eef67c8f-b540-4416-8032-73014d8e69ac\" (UID: \"eef67c8f-b540-4416-8032-73014d8e69ac\") "
Jul 10 02:56:12.344636 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.344424    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eef67c8f-b540-4416-8032-73014d8e69ac-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "eef67c8f-b540-4416-8032-73014d8e69ac" (UID: "eef67c8f-b540-4416-8032-73014d8e69ac"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:56:12.344636 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.344519    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eef67c8f-b540-4416-8032-73014d8e69ac-model-cache" (OuterVolumeSpecName: "model-cache") pod "eef67c8f-b540-4416-8032-73014d8e69ac" (UID: "eef67c8f-b540-4416-8032-73014d8e69ac"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:56:12.344753 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.344676    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eef67c8f-b540-4416-8032-73014d8e69ac-home" (OuterVolumeSpecName: "home") pod "eef67c8f-b540-4416-8032-73014d8e69ac" (UID: "eef67c8f-b540-4416-8032-73014d8e69ac"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:56:12.344753 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.344686    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eef67c8f-b540-4416-8032-73014d8e69ac-tmp-dir\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:56:12.344753 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.344706    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eef67c8f-b540-4416-8032-73014d8e69ac-model-cache\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:56:12.346392 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.346365    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eef67c8f-b540-4416-8032-73014d8e69ac-dshm" (OuterVolumeSpecName: "dshm") pod "eef67c8f-b540-4416-8032-73014d8e69ac" (UID: "eef67c8f-b540-4416-8032-73014d8e69ac"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:56:12.346505 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.346406    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eef67c8f-b540-4416-8032-73014d8e69ac-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "eef67c8f-b540-4416-8032-73014d8e69ac" (UID: "eef67c8f-b540-4416-8032-73014d8e69ac"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:56:12.346505 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.346420    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eef67c8f-b540-4416-8032-73014d8e69ac-kube-api-access-dlqpr" (OuterVolumeSpecName: "kube-api-access-dlqpr") pod "eef67c8f-b540-4416-8032-73014d8e69ac" (UID: "eef67c8f-b540-4416-8032-73014d8e69ac"). InnerVolumeSpecName "kube-api-access-dlqpr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:56:12.445480 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.445444    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eef67c8f-b540-4416-8032-73014d8e69ac-dshm\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:56:12.445480 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.445473    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eef67c8f-b540-4416-8032-73014d8e69ac-home\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:56:12.445480 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.445482    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eef67c8f-b540-4416-8032-73014d8e69ac-tls-certs\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:56:12.445711 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.445492    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlqpr\" (UniqueName: \"kubernetes.io/projected/eef67c8f-b540-4416-8032-73014d8e69ac-kube-api-access-dlqpr\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:56:12.788276 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.788241    2576 generic.go:356] "Generic (PLEG): container finished" podID="3c60ca42-6e98-4dab-9740-112029b2432c" containerID="fa10c9ba0f521767e41afcd4444ad95a4235e316413314bc7d63294dfcc6a787" exitCode=0
Jul 10 02:56:12.788488 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.788322    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7632-140000509484320" event={"ID":"3c60ca42-6e98-4dab-9740-112029b2432c","Type":"ContainerDied","Data":"fa10c9ba0f521767e41afcd4444ad95a4235e316413314bc7d63294dfcc6a787"}
Jul 10 02:56:12.789502 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.789480    2576 generic.go:356] "Generic (PLEG): container finished" podID="eef67c8f-b540-4416-8032-73014d8e69ac" containerID="4ba1dfdfde6dc74eb845b31321afe04e509c658b52a1ba4ab8092359b3f4d643" exitCode=0
Jul 10 02:56:12.789582 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.789516    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"
Jul 10 02:56:12.789582 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.789559    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr" event={"ID":"eef67c8f-b540-4416-8032-73014d8e69ac","Type":"ContainerDied","Data":"4ba1dfdfde6dc74eb845b31321afe04e509c658b52a1ba4ab8092359b3f4d643"}
Jul 10 02:56:12.789657 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.789596    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr" event={"ID":"eef67c8f-b540-4416-8032-73014d8e69ac","Type":"ContainerDied","Data":"fb1a7e39aa83472e9b516a49cdc113c0c9c4fef6c596af9692d27843ff90e211"}
Jul 10 02:56:12.789657 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.789618    2576 scope.go:117] "RemoveContainer" containerID="4ba1dfdfde6dc74eb845b31321afe04e509c658b52a1ba4ab8092359b3f4d643"
Jul 10 02:56:12.797772 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.797754    2576 scope.go:117] "RemoveContainer" containerID="4ba1dfdfde6dc74eb845b31321afe04e509c658b52a1ba4ab8092359b3f4d643"
Jul 10 02:56:12.798061 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:56:12.798044    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ba1dfdfde6dc74eb845b31321afe04e509c658b52a1ba4ab8092359b3f4d643\": container with ID starting with 4ba1dfdfde6dc74eb845b31321afe04e509c658b52a1ba4ab8092359b3f4d643 not found: ID does not exist" containerID="4ba1dfdfde6dc74eb845b31321afe04e509c658b52a1ba4ab8092359b3f4d643"
Jul 10 02:56:12.798116 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.798070    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ba1dfdfde6dc74eb845b31321afe04e509c658b52a1ba4ab8092359b3f4d643"} err="failed to get container status \"4ba1dfdfde6dc74eb845b31321afe04e509c658b52a1ba4ab8092359b3f4d643\": rpc error: code = NotFound desc = could not find container \"4ba1dfdfde6dc74eb845b31321afe04e509c658b52a1ba4ab8092359b3f4d643\": container with ID starting with 4ba1dfdfde6dc74eb845b31321afe04e509c658b52a1ba4ab8092359b3f4d643 not found: ID does not exist"
Jul 10 02:56:12.818887 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.818863    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"]
Jul 10 02:56:12.823582 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.823561    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d5b98a/rate-test-model-d5b98a-kserve-5b9db9654c-k4jxr"]
Jul 10 02:56:12.967458 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:12.967419    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl" podUID="593dc87b-16a3-45c9-a598-853e4e1a8a52" containerName="main" containerID="cri-o://81ce16a653ee84256313432bfdf33633487e2fe33b19dbdc6dc26573b3225b93" gracePeriod=45
Jul 10 02:56:13.223680 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.223653    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"
Jul 10 02:56:13.354063 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.353956    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/593dc87b-16a3-45c9-a598-853e4e1a8a52-model-cache\") pod \"593dc87b-16a3-45c9-a598-853e4e1a8a52\" (UID: \"593dc87b-16a3-45c9-a598-853e4e1a8a52\") "
Jul 10 02:56:13.354063 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.354000    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/593dc87b-16a3-45c9-a598-853e4e1a8a52-tls-certs\") pod \"593dc87b-16a3-45c9-a598-853e4e1a8a52\" (UID: \"593dc87b-16a3-45c9-a598-853e4e1a8a52\") "
Jul 10 02:56:13.354063 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.354060    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qt6cv\" (UniqueName: \"kubernetes.io/projected/593dc87b-16a3-45c9-a598-853e4e1a8a52-kube-api-access-qt6cv\") pod \"593dc87b-16a3-45c9-a598-853e4e1a8a52\" (UID: \"593dc87b-16a3-45c9-a598-853e4e1a8a52\") "
Jul 10 02:56:13.354311 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.354081    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/593dc87b-16a3-45c9-a598-853e4e1a8a52-home\") pod \"593dc87b-16a3-45c9-a598-853e4e1a8a52\" (UID: \"593dc87b-16a3-45c9-a598-853e4e1a8a52\") "
Jul 10 02:56:13.354311 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.354107    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/593dc87b-16a3-45c9-a598-853e4e1a8a52-tmp-dir\") pod \"593dc87b-16a3-45c9-a598-853e4e1a8a52\" (UID: \"593dc87b-16a3-45c9-a598-853e4e1a8a52\") "
Jul 10 02:56:13.354311 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.354136    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/593dc87b-16a3-45c9-a598-853e4e1a8a52-dshm\") pod \"593dc87b-16a3-45c9-a598-853e4e1a8a52\" (UID: \"593dc87b-16a3-45c9-a598-853e4e1a8a52\") "
Jul 10 02:56:13.354471 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.354319    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/593dc87b-16a3-45c9-a598-853e4e1a8a52-model-cache" (OuterVolumeSpecName: "model-cache") pod "593dc87b-16a3-45c9-a598-853e4e1a8a52" (UID: "593dc87b-16a3-45c9-a598-853e4e1a8a52"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:56:13.354471 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.354408    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/593dc87b-16a3-45c9-a598-853e4e1a8a52-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "593dc87b-16a3-45c9-a598-853e4e1a8a52" (UID: "593dc87b-16a3-45c9-a598-853e4e1a8a52"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:56:13.354471 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.354421    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/593dc87b-16a3-45c9-a598-853e4e1a8a52-home" (OuterVolumeSpecName: "home") pod "593dc87b-16a3-45c9-a598-853e4e1a8a52" (UID: "593dc87b-16a3-45c9-a598-853e4e1a8a52"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:56:13.354605 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.354544    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/593dc87b-16a3-45c9-a598-853e4e1a8a52-home\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:56:13.354605 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.354565    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/593dc87b-16a3-45c9-a598-853e4e1a8a52-tmp-dir\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:56:13.354605 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.354584    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/593dc87b-16a3-45c9-a598-853e4e1a8a52-model-cache\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:56:13.356274 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.356236    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/593dc87b-16a3-45c9-a598-853e4e1a8a52-dshm" (OuterVolumeSpecName: "dshm") pod "593dc87b-16a3-45c9-a598-853e4e1a8a52" (UID: "593dc87b-16a3-45c9-a598-853e4e1a8a52"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:56:13.356386 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.356308    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/593dc87b-16a3-45c9-a598-853e4e1a8a52-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "593dc87b-16a3-45c9-a598-853e4e1a8a52" (UID: "593dc87b-16a3-45c9-a598-853e4e1a8a52"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:56:13.356386 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.356321    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/593dc87b-16a3-45c9-a598-853e4e1a8a52-kube-api-access-qt6cv" (OuterVolumeSpecName: "kube-api-access-qt6cv") pod "593dc87b-16a3-45c9-a598-853e4e1a8a52" (UID: "593dc87b-16a3-45c9-a598-853e4e1a8a52"). InnerVolumeSpecName "kube-api-access-qt6cv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:56:13.455856 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.455822    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/593dc87b-16a3-45c9-a598-853e4e1a8a52-tls-certs\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:56:13.455856 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.455849    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qt6cv\" (UniqueName: \"kubernetes.io/projected/593dc87b-16a3-45c9-a598-853e4e1a8a52-kube-api-access-qt6cv\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:56:13.455856 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.455858    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/593dc87b-16a3-45c9-a598-853e4e1a8a52-dshm\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:56:13.795973 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.795941    2576 generic.go:356] "Generic (PLEG): container finished" podID="593dc87b-16a3-45c9-a598-853e4e1a8a52" containerID="81ce16a653ee84256313432bfdf33633487e2fe33b19dbdc6dc26573b3225b93" exitCode=0
Jul 10 02:56:13.796185 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.795988    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"
Jul 10 02:56:13.796185 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.796042    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl" event={"ID":"593dc87b-16a3-45c9-a598-853e4e1a8a52","Type":"ContainerDied","Data":"81ce16a653ee84256313432bfdf33633487e2fe33b19dbdc6dc26573b3225b93"}
Jul 10 02:56:13.796185 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.796088    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl" event={"ID":"593dc87b-16a3-45c9-a598-853e4e1a8a52","Type":"ContainerDied","Data":"9c86bc1a64506ff4e1e9f3858e68d3e93337ca02219a71a370bdbacf86eb5784"}
Jul 10 02:56:13.796185 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.796105    2576 scope.go:117] "RemoveContainer" containerID="81ce16a653ee84256313432bfdf33633487e2fe33b19dbdc6dc26573b3225b93"
Jul 10 02:56:13.805661 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.805647    2576 scope.go:117] "RemoveContainer" containerID="81ce16a653ee84256313432bfdf33633487e2fe33b19dbdc6dc26573b3225b93"
Jul 10 02:56:13.805910 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:56:13.805889    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81ce16a653ee84256313432bfdf33633487e2fe33b19dbdc6dc26573b3225b93\": container with ID starting with 81ce16a653ee84256313432bfdf33633487e2fe33b19dbdc6dc26573b3225b93 not found: ID does not exist" containerID="81ce16a653ee84256313432bfdf33633487e2fe33b19dbdc6dc26573b3225b93"
Jul 10 02:56:13.805975 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.805923    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81ce16a653ee84256313432bfdf33633487e2fe33b19dbdc6dc26573b3225b93"} err="failed to get container status \"81ce16a653ee84256313432bfdf33633487e2fe33b19dbdc6dc26573b3225b93\": rpc error: code = NotFound desc = could not find container \"81ce16a653ee84256313432bfdf33633487e2fe33b19dbdc6dc26573b3225b93\": container with ID starting with 81ce16a653ee84256313432bfdf33633487e2fe33b19dbdc6dc26573b3225b93 not found: ID does not exist"
Jul 10 02:56:13.820093 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.820067    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"]
Jul 10 02:56:13.824920 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.824896    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-de8279/rate-test-model-de8279-kserve-d77576499-kldtl"]
Jul 10 02:56:13.944766 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.944742    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7632-140000509484320"
Jul 10 02:56:13.967902 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.967881    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7632-140000509484320_3c60ca42-6e98-4dab-9740-112029b2432c/test-curl-7632-140000509484320/0.log"
Jul 10 02:56:13.994421 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.994388    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7632-140000509484320"]
Jul 10 02:56:13.999928 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:13.999905    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7632-140000509484320"]
Jul 10 02:56:14.061669 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:14.061595    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrvcz\" (UniqueName: \"kubernetes.io/projected/3c60ca42-6e98-4dab-9740-112029b2432c-kube-api-access-lrvcz\") pod \"3c60ca42-6e98-4dab-9740-112029b2432c\" (UID: \"3c60ca42-6e98-4dab-9740-112029b2432c\") "
Jul 10 02:56:14.063669 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:14.063646    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c60ca42-6e98-4dab-9740-112029b2432c-kube-api-access-lrvcz" (OuterVolumeSpecName: "kube-api-access-lrvcz") pod "3c60ca42-6e98-4dab-9740-112029b2432c" (UID: "3c60ca42-6e98-4dab-9740-112029b2432c"). InnerVolumeSpecName "kube-api-access-lrvcz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:56:14.136600 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:14.136571    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7632-140000509484320"]
Jul 10 02:56:14.136964 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:14.136951    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eef67c8f-b540-4416-8032-73014d8e69ac" containerName="main"
Jul 10 02:56:14.137005 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:14.136966    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="eef67c8f-b540-4416-8032-73014d8e69ac" containerName="main"
Jul 10 02:56:14.137005 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:14.136981    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="593dc87b-16a3-45c9-a598-853e4e1a8a52" containerName="main"
Jul 10 02:56:14.137005 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:14.136987    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="593dc87b-16a3-45c9-a598-853e4e1a8a52" containerName="main"
Jul 10 02:56:14.137005 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:14.136997    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c60ca42-6e98-4dab-9740-112029b2432c" containerName="test-curl-7632-140000509484320"
Jul 10 02:56:14.137005 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:14.137002    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c60ca42-6e98-4dab-9740-112029b2432c" containerName="test-curl-7632-140000509484320"
Jul 10 02:56:14.137181 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:14.137065    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="eef67c8f-b540-4416-8032-73014d8e69ac" containerName="main"
Jul 10 02:56:14.137181 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:14.137076    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="593dc87b-16a3-45c9-a598-853e4e1a8a52" containerName="main"
Jul 10 02:56:14.137181 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:14.137082    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c60ca42-6e98-4dab-9740-112029b2432c" containerName="test-curl-7632-140000509484320"
Jul 10 02:56:14.139898 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:14.139882    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7632-140000509484320"
Jul 10 02:56:14.151053 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:14.151014    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7632-140000509484320"]
Jul 10 02:56:14.162622 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:14.162601    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrvcz\" (UniqueName: \"kubernetes.io/projected/3c60ca42-6e98-4dab-9740-112029b2432c-kube-api-access-lrvcz\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:56:14.263485 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:14.263454    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbzg6\" (UniqueName: \"kubernetes.io/projected/e1d1f4ac-266a-4910-bdfb-329a63431dbb-kube-api-access-nbzg6\") pod \"test-curl-7632-140000509484320\" (UID: \"e1d1f4ac-266a-4910-bdfb-329a63431dbb\") " pod="openshift-ingress/test-curl-7632-140000509484320"
Jul 10 02:56:14.364134 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:14.364053    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbzg6\" (UniqueName: \"kubernetes.io/projected/e1d1f4ac-266a-4910-bdfb-329a63431dbb-kube-api-access-nbzg6\") pod \"test-curl-7632-140000509484320\" (UID: \"e1d1f4ac-266a-4910-bdfb-329a63431dbb\") " pod="openshift-ingress/test-curl-7632-140000509484320"
Jul 10 02:56:14.373360 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:14.373337    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbzg6\" (UniqueName: \"kubernetes.io/projected/e1d1f4ac-266a-4910-bdfb-329a63431dbb-kube-api-access-nbzg6\") pod \"test-curl-7632-140000509484320\" (UID: \"e1d1f4ac-266a-4910-bdfb-329a63431dbb\") " pod="openshift-ingress/test-curl-7632-140000509484320"
Jul 10 02:56:14.448945 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:14.448909    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7632-140000509484320"
Jul 10 02:56:14.544445 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:14.544414    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c60ca42-6e98-4dab-9740-112029b2432c" path="/var/lib/kubelet/pods/3c60ca42-6e98-4dab-9740-112029b2432c/volumes"
Jul 10 02:56:14.544980 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:14.544953    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="593dc87b-16a3-45c9-a598-853e4e1a8a52" path="/var/lib/kubelet/pods/593dc87b-16a3-45c9-a598-853e4e1a8a52/volumes"
Jul 10 02:56:14.545440 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:14.545418    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eef67c8f-b540-4416-8032-73014d8e69ac" path="/var/lib/kubelet/pods/eef67c8f-b540-4416-8032-73014d8e69ac/volumes"
Jul 10 02:56:14.578974 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:14.578947    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7632-140000509484320"]
Jul 10 02:56:14.582227 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:56:14.582195    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1d1f4ac_266a_4910_bdfb_329a63431dbb.slice/crio-6977b52746e24bcc6b2a844500407d71551834804113d442ef6691b3369e11b1 WatchSource:0}: Error finding container 6977b52746e24bcc6b2a844500407d71551834804113d442ef6691b3369e11b1: Status 404 returned error can't find the container with id 6977b52746e24bcc6b2a844500407d71551834804113d442ef6691b3369e11b1
Jul 10 02:56:14.801953 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:14.801921    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7632-140000509484320" event={"ID":"e1d1f4ac-266a-4910-bdfb-329a63431dbb","Type":"ContainerStarted","Data":"6977b52746e24bcc6b2a844500407d71551834804113d442ef6691b3369e11b1"}
Jul 10 02:56:14.804012 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:14.803994    2576 scope.go:117] "RemoveContainer" containerID="fa10c9ba0f521767e41afcd4444ad95a4235e316413314bc7d63294dfcc6a787"
Jul 10 02:56:14.804182 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:14.804016    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7632-140000509484320"
Jul 10 02:56:15.810097 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:15.809996    2576 generic.go:356] "Generic (PLEG): container finished" podID="e1d1f4ac-266a-4910-bdfb-329a63431dbb" containerID="3a990ec2020a6236c45df307e4f05381cc0267fa9837b49ac1e51bc1de3c4350" exitCode=0
Jul 10 02:56:15.810486 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:15.810084    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7632-140000509484320" event={"ID":"e1d1f4ac-266a-4910-bdfb-329a63431dbb","Type":"ContainerDied","Data":"3a990ec2020a6236c45df307e4f05381cc0267fa9837b49ac1e51bc1de3c4350"}
Jul 10 02:56:16.950984 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:16.950962    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7632-140000509484320"
Jul 10 02:56:16.972676 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:16.972642    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7632-140000509484320_e1d1f4ac-266a-4910-bdfb-329a63431dbb/test-curl-7632-140000509484320/0.log"
Jul 10 02:56:16.985372 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:16.985348    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbzg6\" (UniqueName: \"kubernetes.io/projected/e1d1f4ac-266a-4910-bdfb-329a63431dbb-kube-api-access-nbzg6\") pod \"e1d1f4ac-266a-4910-bdfb-329a63431dbb\" (UID: \"e1d1f4ac-266a-4910-bdfb-329a63431dbb\") "
Jul 10 02:56:16.987353 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:16.987330    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1d1f4ac-266a-4910-bdfb-329a63431dbb-kube-api-access-nbzg6" (OuterVolumeSpecName: "kube-api-access-nbzg6") pod "e1d1f4ac-266a-4910-bdfb-329a63431dbb" (UID: "e1d1f4ac-266a-4910-bdfb-329a63431dbb"). InnerVolumeSpecName "kube-api-access-nbzg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:56:16.997392 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:16.997369    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7632-140000509484320"]
Jul 10 02:56:17.001788 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:17.001765    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7632-140000509484320"]
Jul 10 02:56:17.086402 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:17.086324    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbzg6\" (UniqueName: \"kubernetes.io/projected/e1d1f4ac-266a-4910-bdfb-329a63431dbb-kube-api-access-nbzg6\") on node \"ip-10-0-139-215.ec2.internal\" DevicePath \"\""
Jul 10 02:56:17.821469 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:17.821441    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6977b52746e24bcc6b2a844500407d71551834804113d442ef6691b3369e11b1"
Jul 10 02:56:17.821469 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:17.821443    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7632-140000509484320"
Jul 10 02:56:17.831695 ip-10-0-139-215 kubenswrapper[2576]: E0710 02:56:17.831669    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7632-140000509484320\" is forbidden: User \"system:node:ip-10-0-139-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-215.ec2.internal' and this object" podUID="e1d1f4ac-266a-4910-bdfb-329a63431dbb" pod="openshift-ingress/test-curl-7632-140000509484320"
Jul 10 02:56:18.544846 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:18.544814    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1d1f4ac-266a-4910-bdfb-329a63431dbb" path="/var/lib/kubelet/pods/e1d1f4ac-266a-4910-bdfb-329a63431dbb/volumes"
Jul 10 02:56:31.046607 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:31.046572    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:56:57.358019 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:56:57.357981    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8m4j5"]
Jul 10 02:57:16.027984 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:16.027901    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78b9cbb96-vqvw6_2a6a9fb6-c579-4ee6-8703-3eb27f550ee2/copy-manifests/0.log"
Jul 10 02:57:16.036448 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:16.036420    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78b9cbb96-vqvw6_2a6a9fb6-c579-4ee6-8703-3eb27f550ee2/manager/0.log"
Jul 10 02:57:19.837936 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:19.837907    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-qqhvs_a8f1aa2f-f5e3-435e-ae1c-e7c72e77fdaf/kuadrant-console-plugin/0.log"
Jul 10 02:57:20.240664 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:20.240637    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-8m4j5_032a1714-d10b-411f-a950-7d0923333a6e/limitador/0.log"
Jul 10 02:57:21.100661 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:21.100610    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6cf46c8b8c-x4hnq_5cf16ed2-2be5-4cb9-9a4e-4de146cd61b4/kube-auth-proxy/0.log"
Jul 10 02:57:22.230748 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:22.230715    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-8w9s2_bcdc6b72-52f6-4d22-b439-f8cdef6b13c9/main/0.log"
Jul 10 02:57:22.473395 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:22.473358    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-bgvnx_63dc9af8-c708-4110-87fd-a6e1f50157c9/main/0.log"
Jul 10 02:57:27.219361 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:27.219319    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s4bld/must-gather-sbczc"]
Jul 10 02:57:27.220372 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:27.220349    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1d1f4ac-266a-4910-bdfb-329a63431dbb" containerName="test-curl-7632-140000509484320"
Jul 10 02:57:27.220515 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:27.220503    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1d1f4ac-266a-4910-bdfb-329a63431dbb" containerName="test-curl-7632-140000509484320"
Jul 10 02:57:27.220703 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:27.220693    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1d1f4ac-266a-4910-bdfb-329a63431dbb" containerName="test-curl-7632-140000509484320"
Jul 10 02:57:27.232464 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:27.232440    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s4bld/must-gather-sbczc"
Jul 10 02:57:27.235689 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:27.235667    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s4bld\"/\"default-dockercfg-q2jnq\""
Jul 10 02:57:27.236226 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:27.236207    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s4bld\"/\"kube-root-ca.crt\""
Jul 10 02:57:27.237628 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:27.237614    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s4bld\"/\"openshift-service-ca.crt\""
Jul 10 02:57:27.238589 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:27.238571    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s4bld/must-gather-sbczc"]
Jul 10 02:57:27.341333 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:27.341299    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blhxt\" (UniqueName: \"kubernetes.io/projected/cc2e5a30-b1b5-47d4-b9e5-0dd4a540edc0-kube-api-access-blhxt\") pod \"must-gather-sbczc\" (UID: \"cc2e5a30-b1b5-47d4-b9e5-0dd4a540edc0\") " pod="openshift-must-gather-s4bld/must-gather-sbczc"
Jul 10 02:57:27.341530 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:27.341370    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cc2e5a30-b1b5-47d4-b9e5-0dd4a540edc0-must-gather-output\") pod \"must-gather-sbczc\" (UID: \"cc2e5a30-b1b5-47d4-b9e5-0dd4a540edc0\") " pod="openshift-must-gather-s4bld/must-gather-sbczc"
Jul 10 02:57:27.442161 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:27.442114    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cc2e5a30-b1b5-47d4-b9e5-0dd4a540edc0-must-gather-output\") pod \"must-gather-sbczc\" (UID: \"cc2e5a30-b1b5-47d4-b9e5-0dd4a540edc0\") " pod="openshift-must-gather-s4bld/must-gather-sbczc"
Jul 10 02:57:27.442396 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:27.442194    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blhxt\" (UniqueName: \"kubernetes.io/projected/cc2e5a30-b1b5-47d4-b9e5-0dd4a540edc0-kube-api-access-blhxt\") pod \"must-gather-sbczc\" (UID: \"cc2e5a30-b1b5-47d4-b9e5-0dd4a540edc0\") " pod="openshift-must-gather-s4bld/must-gather-sbczc"
Jul 10 02:57:27.442396 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:27.442380    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cc2e5a30-b1b5-47d4-b9e5-0dd4a540edc0-must-gather-output\") pod \"must-gather-sbczc\" (UID: \"cc2e5a30-b1b5-47d4-b9e5-0dd4a540edc0\") " pod="openshift-must-gather-s4bld/must-gather-sbczc"
Jul 10 02:57:27.452292 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:27.452261    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blhxt\" (UniqueName: \"kubernetes.io/projected/cc2e5a30-b1b5-47d4-b9e5-0dd4a540edc0-kube-api-access-blhxt\") pod \"must-gather-sbczc\" (UID: \"cc2e5a30-b1b5-47d4-b9e5-0dd4a540edc0\") " pod="openshift-must-gather-s4bld/must-gather-sbczc"
Jul 10 02:57:27.546330 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:27.546251    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s4bld/must-gather-sbczc"
Jul 10 02:57:27.684022 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:27.683988    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s4bld/must-gather-sbczc"]
Jul 10 02:57:27.685256 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:57:27.685231    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc2e5a30_b1b5_47d4_b9e5_0dd4a540edc0.slice/crio-60abdba17fe0cfb837b5477b3c413b8c9af27975c6bdaf58ebfc8cb6fea6611a WatchSource:0}: Error finding container 60abdba17fe0cfb837b5477b3c413b8c9af27975c6bdaf58ebfc8cb6fea6611a: Status 404 returned error can't find the container with id 60abdba17fe0cfb837b5477b3c413b8c9af27975c6bdaf58ebfc8cb6fea6611a
Jul 10 02:57:28.145500 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:28.145468    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s4bld/must-gather-sbczc" event={"ID":"cc2e5a30-b1b5-47d4-b9e5-0dd4a540edc0","Type":"ContainerStarted","Data":"60abdba17fe0cfb837b5477b3c413b8c9af27975c6bdaf58ebfc8cb6fea6611a"}
Jul 10 02:57:29.156069 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:29.154943    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s4bld/must-gather-sbczc" event={"ID":"cc2e5a30-b1b5-47d4-b9e5-0dd4a540edc0","Type":"ContainerStarted","Data":"04d383b3aab7e0fae05c36f62dc411af032316d36734d53fd38b6a832ce52227"}
Jul 10 02:57:29.156069 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:29.154998    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s4bld/must-gather-sbczc" event={"ID":"cc2e5a30-b1b5-47d4-b9e5-0dd4a540edc0","Type":"ContainerStarted","Data":"7ba800db8e1d1bc9c8da7fa923d9fb6d9dc3477d5c387368a6b9bed5b414bddb"}
Jul 10 02:57:29.174019 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:29.173956    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s4bld/must-gather-sbczc" podStartSLOduration=1.474344815 podStartE2EDuration="2.173934458s" totalImagesPullingTime="699.589643ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:57:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:57:29.173048773 +0000 UTC m=+2977.938961004" watchObservedRunningTime="2026-07-10 02:57:29.173934458 +0000 UTC m=+2977.939846691"
Jul 10 02:57:30.111756 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:30.111721    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-v2d92_087c6267-c774-4dbc-ab49-e5bf96684f7c/global-pull-secret-syncer/0.log"
Jul 10 02:57:30.203526 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:30.203482    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kczv8_80b5bdb5-3660-434c-9384-84014e3dcf5b/konnectivity-agent/0.log"
Jul 10 02:57:30.324160 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:30.324126    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-215.ec2.internal_7e242c33d17613db0772626c3ed59e80/haproxy/0.log"
Jul 10 02:57:35.357076 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:35.357043    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-qqhvs_a8f1aa2f-f5e3-435e-ae1c-e7c72e77fdaf/kuadrant-console-plugin/0.log"
Jul 10 02:57:35.639064 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:35.639004    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-8m4j5_032a1714-d10b-411f-a950-7d0923333a6e/limitador/0.log"
Jul 10 02:57:37.426914 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:37.426848    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85a84e10-28de-4faa-9fcd-a2a7d24ca78f/alertmanager/0.log"
Jul 10 02:57:37.455490 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:37.455458    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85a84e10-28de-4faa-9fcd-a2a7d24ca78f/config-reloader/0.log"
Jul 10 02:57:37.488285 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:37.488244    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85a84e10-28de-4faa-9fcd-a2a7d24ca78f/kube-rbac-proxy-web/0.log"
Jul 10 02:57:37.515452 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:37.515426    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85a84e10-28de-4faa-9fcd-a2a7d24ca78f/kube-rbac-proxy/0.log"
Jul 10 02:57:37.543222 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:37.543191    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85a84e10-28de-4faa-9fcd-a2a7d24ca78f/kube-rbac-proxy-metric/0.log"
Jul 10 02:57:37.573108 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:37.573080    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85a84e10-28de-4faa-9fcd-a2a7d24ca78f/prom-label-proxy/0.log"
Jul 10 02:57:37.596615 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:37.596581    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85a84e10-28de-4faa-9fcd-a2a7d24ca78f/init-config-reloader/0.log"
Jul 10 02:57:37.639533 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:37.639498    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-j6scc_3f52d95a-6ca8-4b73-b8ba-1b25f6b1e0dd/cluster-monitoring-operator/0.log"
Jul 10 02:57:37.906122 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:37.906077    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k2bxj_a9b3945f-9aa5-4ae0-820d-0f71abb3150c/node-exporter/0.log"
Jul 10 02:57:37.932401 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:37.932365    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k2bxj_a9b3945f-9aa5-4ae0-820d-0f71abb3150c/kube-rbac-proxy/0.log"
Jul 10 02:57:37.957601 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:37.957500    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k2bxj_a9b3945f-9aa5-4ae0-820d-0f71abb3150c/init-textfile/0.log"
Jul 10 02:57:38.199612 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:38.199562    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_beadaae9-d8d8-494c-a330-4d8133514326/prometheus/0.log"
Jul 10 02:57:38.225574 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:38.225544    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_beadaae9-d8d8-494c-a330-4d8133514326/config-reloader/0.log"
Jul 10 02:57:38.250893 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:38.250860    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_beadaae9-d8d8-494c-a330-4d8133514326/thanos-sidecar/0.log"
Jul 10 02:57:38.274303 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:38.274277    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_beadaae9-d8d8-494c-a330-4d8133514326/kube-rbac-proxy-web/0.log"
Jul 10 02:57:38.299486 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:38.299443    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_beadaae9-d8d8-494c-a330-4d8133514326/kube-rbac-proxy/0.log"
Jul 10 02:57:38.324335 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:38.324306    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_beadaae9-d8d8-494c-a330-4d8133514326/kube-rbac-proxy-thanos/0.log"
Jul 10 02:57:38.350838 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:38.350806    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_beadaae9-d8d8-494c-a330-4d8133514326/init-config-reloader/0.log"
Jul 10 02:57:38.383327 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:38.383291    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-27s4m_acf46b9f-c04d-46f2-9efb-e0fa86578baa/prometheus-operator/0.log"
Jul 10 02:57:38.404239 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:38.404191    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-27s4m_acf46b9f-c04d-46f2-9efb-e0fa86578baa/kube-rbac-proxy/0.log"
Jul 10 02:57:38.431769 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:38.431737    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-5dmr6_5d2a5df5-fb8d-4d21-9e91-382d2b964442/prometheus-operator-admission-webhook/0.log"
Jul 10 02:57:38.465455 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:38.465374    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-79786975d5-89z7z_e269305b-e873-4bb2-b660-91cf256329ed/telemeter-client/0.log"
Jul 10 02:57:38.489773 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:38.489743    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-79786975d5-89z7z_e269305b-e873-4bb2-b660-91cf256329ed/reload/0.log"
Jul 10 02:57:38.518095 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:38.518064    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-79786975d5-89z7z_e269305b-e873-4bb2-b660-91cf256329ed/kube-rbac-proxy/0.log"
Jul 10 02:57:38.549081 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:38.549054    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-856fbf494b-qfdth_b622a8a0-d0e8-4c36-a2bc-a373194624cf/thanos-query/0.log"
Jul 10 02:57:38.573801 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:38.573773    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-856fbf494b-qfdth_b622a8a0-d0e8-4c36-a2bc-a373194624cf/kube-rbac-proxy-web/0.log"
Jul 10 02:57:38.597449 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:38.597417    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-856fbf494b-qfdth_b622a8a0-d0e8-4c36-a2bc-a373194624cf/kube-rbac-proxy/0.log"
Jul 10 02:57:38.620732 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:38.620702    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-856fbf494b-qfdth_b622a8a0-d0e8-4c36-a2bc-a373194624cf/prom-label-proxy/0.log"
Jul 10 02:57:38.647680 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:38.647645    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-856fbf494b-qfdth_b622a8a0-d0e8-4c36-a2bc-a373194624cf/kube-rbac-proxy-rules/0.log"
Jul 10 02:57:38.671145 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:38.671119    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-856fbf494b-qfdth_b622a8a0-d0e8-4c36-a2bc-a373194624cf/kube-rbac-proxy-metrics/0.log"
Jul 10 02:57:39.649720 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:39.649686    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s4bld/perf-node-gather-daemonset-62lv5"]
Jul 10 02:57:39.657981 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:39.657961    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s4bld/perf-node-gather-daemonset-62lv5"
Jul 10 02:57:39.663315 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:39.663282    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s4bld/perf-node-gather-daemonset-62lv5"]
Jul 10 02:57:39.685736 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:39.685693    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a6f84d97-a4d0-418e-ab1a-c9d486959166-proc\") pod \"perf-node-gather-daemonset-62lv5\" (UID: \"a6f84d97-a4d0-418e-ab1a-c9d486959166\") " pod="openshift-must-gather-s4bld/perf-node-gather-daemonset-62lv5"
Jul 10 02:57:39.685958 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:39.685938    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6f84d97-a4d0-418e-ab1a-c9d486959166-sys\") pod \"perf-node-gather-daemonset-62lv5\" (UID: \"a6f84d97-a4d0-418e-ab1a-c9d486959166\") " pod="openshift-must-gather-s4bld/perf-node-gather-daemonset-62lv5"
Jul 10 02:57:39.686163 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:39.686145    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a6f84d97-a4d0-418e-ab1a-c9d486959166-podres\") pod \"perf-node-gather-daemonset-62lv5\" (UID: \"a6f84d97-a4d0-418e-ab1a-c9d486959166\") " pod="openshift-must-gather-s4bld/perf-node-gather-daemonset-62lv5"
Jul 10 02:57:39.686350 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:39.686333    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvp9f\" (UniqueName: \"kubernetes.io/projected/a6f84d97-a4d0-418e-ab1a-c9d486959166-kube-api-access-bvp9f\") pod \"perf-node-gather-daemonset-62lv5\" (UID: \"a6f84d97-a4d0-418e-ab1a-c9d486959166\") " pod="openshift-must-gather-s4bld/perf-node-gather-daemonset-62lv5"
Jul 10 02:57:39.686500 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:39.686480    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6f84d97-a4d0-418e-ab1a-c9d486959166-lib-modules\") pod \"perf-node-gather-daemonset-62lv5\" (UID: \"a6f84d97-a4d0-418e-ab1a-c9d486959166\") " pod="openshift-must-gather-s4bld/perf-node-gather-daemonset-62lv5"
Jul 10 02:57:39.787116 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:39.787085    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvp9f\" (UniqueName: \"kubernetes.io/projected/a6f84d97-a4d0-418e-ab1a-c9d486959166-kube-api-access-bvp9f\") pod \"perf-node-gather-daemonset-62lv5\" (UID: \"a6f84d97-a4d0-418e-ab1a-c9d486959166\") " pod="openshift-must-gather-s4bld/perf-node-gather-daemonset-62lv5"
Jul 10 02:57:39.787299 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:39.787133    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6f84d97-a4d0-418e-ab1a-c9d486959166-lib-modules\") pod \"perf-node-gather-daemonset-62lv5\" (UID: \"a6f84d97-a4d0-418e-ab1a-c9d486959166\") " pod="openshift-must-gather-s4bld/perf-node-gather-daemonset-62lv5"
Jul 10 02:57:39.787299 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:39.787181    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a6f84d97-a4d0-418e-ab1a-c9d486959166-proc\") pod \"perf-node-gather-daemonset-62lv5\" (UID: \"a6f84d97-a4d0-418e-ab1a-c9d486959166\") " pod="openshift-must-gather-s4bld/perf-node-gather-daemonset-62lv5"
Jul 10 02:57:39.787299 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:39.787199    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6f84d97-a4d0-418e-ab1a-c9d486959166-sys\") pod \"perf-node-gather-daemonset-62lv5\" (UID: \"a6f84d97-a4d0-418e-ab1a-c9d486959166\") " pod="openshift-must-gather-s4bld/perf-node-gather-daemonset-62lv5"
Jul 10 02:57:39.787299 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:39.787230    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a6f84d97-a4d0-418e-ab1a-c9d486959166-podres\") pod \"perf-node-gather-daemonset-62lv5\" (UID: \"a6f84d97-a4d0-418e-ab1a-c9d486959166\") " pod="openshift-must-gather-s4bld/perf-node-gather-daemonset-62lv5"
Jul 10 02:57:39.787440 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:39.787297    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a6f84d97-a4d0-418e-ab1a-c9d486959166-proc\") pod \"perf-node-gather-daemonset-62lv5\" (UID: \"a6f84d97-a4d0-418e-ab1a-c9d486959166\") " pod="openshift-must-gather-s4bld/perf-node-gather-daemonset-62lv5"
Jul 10 02:57:39.787440 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:39.787310    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6f84d97-a4d0-418e-ab1a-c9d486959166-sys\") pod \"perf-node-gather-daemonset-62lv5\" (UID: \"a6f84d97-a4d0-418e-ab1a-c9d486959166\") " pod="openshift-must-gather-s4bld/perf-node-gather-daemonset-62lv5"
Jul 10 02:57:39.787440 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:39.787383    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a6f84d97-a4d0-418e-ab1a-c9d486959166-podres\") pod \"perf-node-gather-daemonset-62lv5\" (UID: \"a6f84d97-a4d0-418e-ab1a-c9d486959166\") " pod="openshift-must-gather-s4bld/perf-node-gather-daemonset-62lv5"
Jul 10 02:57:39.787532 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:39.787438    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6f84d97-a4d0-418e-ab1a-c9d486959166-lib-modules\") pod \"perf-node-gather-daemonset-62lv5\" (UID: \"a6f84d97-a4d0-418e-ab1a-c9d486959166\") " pod="openshift-must-gather-s4bld/perf-node-gather-daemonset-62lv5"
Jul 10 02:57:39.797954 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:39.797923    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvp9f\" (UniqueName: \"kubernetes.io/projected/a6f84d97-a4d0-418e-ab1a-c9d486959166-kube-api-access-bvp9f\") pod \"perf-node-gather-daemonset-62lv5\" (UID: \"a6f84d97-a4d0-418e-ab1a-c9d486959166\") " pod="openshift-must-gather-s4bld/perf-node-gather-daemonset-62lv5"
Jul 10 02:57:39.972173 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:39.972085    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s4bld/perf-node-gather-daemonset-62lv5"
Jul 10 02:57:40.162458 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:40.162392    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s4bld/perf-node-gather-daemonset-62lv5"]
Jul 10 02:57:40.166697 ip-10-0-139-215 kubenswrapper[2576]: W0710 02:57:40.166663    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda6f84d97_a4d0_418e_ab1a_c9d486959166.slice/crio-10a5722aef25e415249491bcb1b9afb80abe7120fcb026b3f2481b9576bee618 WatchSource:0}: Error finding container 10a5722aef25e415249491bcb1b9afb80abe7120fcb026b3f2481b9576bee618: Status 404 returned error can't find the container with id 10a5722aef25e415249491bcb1b9afb80abe7120fcb026b3f2481b9576bee618
Jul 10 02:57:40.231723 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:40.231188    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s4bld/perf-node-gather-daemonset-62lv5" event={"ID":"a6f84d97-a4d0-418e-ab1a-c9d486959166","Type":"ContainerStarted","Data":"10a5722aef25e415249491bcb1b9afb80abe7120fcb026b3f2481b9576bee618"}
Jul 10 02:57:40.560260 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:40.560183    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/2.log"
Jul 10 02:57:40.569642 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:40.569607    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/3.log"
Jul 10 02:57:41.240723 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:41.240680    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s4bld/perf-node-gather-daemonset-62lv5" event={"ID":"a6f84d97-a4d0-418e-ab1a-c9d486959166","Type":"ContainerStarted","Data":"f1d589845d2e673b3dc561ca44d36e98a364b2709617584045e52afe02151032"}
Jul 10 02:57:41.241269 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:41.240889    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s4bld/perf-node-gather-daemonset-62lv5"
Jul 10 02:57:41.261410 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:41.261364    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s4bld/perf-node-gather-daemonset-62lv5" podStartSLOduration=2.26134752 podStartE2EDuration="2.26134752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:57:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:57:41.259094534 +0000 UTC m=+2990.025006765" watchObservedRunningTime="2026-07-10 02:57:41.26134752 +0000 UTC m=+2990.027259732"
Jul 10 02:57:42.816231 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:42.816206    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cdrpn_2de5e788-9b05-474d-9225-752dc7d291a6/dns/0.log"
Jul 10 02:57:42.839931 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:42.839904    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cdrpn_2de5e788-9b05-474d-9225-752dc7d291a6/kube-rbac-proxy/0.log"
Jul 10 02:57:42.999863 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:42.999823    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tbgpl_cd032043-9d19-4516-b808-365276e33254/dns-node-resolver/0.log"
Jul 10 02:57:43.630397 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:43.630269    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-749655cb8c-htw78_37215647-0029-42ce-a079-cf630e544aed/registry/0.log"
Jul 10 02:57:43.657789 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:43.657761    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8kqm6_0177cb8b-5ebf-4268-81a4-25476eae55ea/node-ca/0.log"
Jul 10 02:57:44.897562 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:44.897535    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6cf46c8b8c-x4hnq_5cf16ed2-2be5-4cb9-9a4e-4de146cd61b4/kube-auth-proxy/0.log"
Jul 10 02:57:45.842659 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:45.842628    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-84rg4_669ccaa9-c014-4d81-95b5-ef08cb4a8cd1/serve-healthcheck-canary/0.log"
Jul 10 02:57:46.401655 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:46.401626    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-fsvq7_d28e2125-12b1-44e4-be4e-92556f9092aa/insights-operator/0.log"
Jul 10 02:57:46.404892 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:46.404867    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-fsvq7_d28e2125-12b1-44e4-be4e-92556f9092aa/insights-operator/1.log"
Jul 10 02:57:46.507054 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:46.507011    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xxng6_bc0704bf-e998-412b-94ee-8ab671baade7/kube-rbac-proxy/0.log"
Jul 10 02:57:46.532100 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:46.532073    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xxng6_bc0704bf-e998-412b-94ee-8ab671baade7/exporter/0.log"
Jul 10 02:57:46.557990 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:46.557963    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xxng6_bc0704bf-e998-412b-94ee-8ab671baade7/extractor/0.log"
Jul 10 02:57:47.258758 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:47.258734    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s4bld/perf-node-gather-daemonset-62lv5"
Jul 10 02:57:49.723699 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:49.723667    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78b9cbb96-vqvw6_2a6a9fb6-c579-4ee6-8703-3eb27f550ee2/manager/0.log"
Jul 10 02:57:49.748824 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:49.748795    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78b9cbb96-vqvw6_2a6a9fb6-c579-4ee6-8703-3eb27f550ee2/copy-manifests/0.log"
Jul 10 02:57:50.270443 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:50.270417    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6cf46c8b8c-x4hnq_5cf16ed2-2be5-4cb9-9a4e-4de146cd61b4/kube-auth-proxy/0.log"
Jul 10 02:57:51.016697 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:51.016660    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-58d7cbdf66-z577x_68472712-2e8f-414a-a95a-996b35174b2c/manager/0.log"
Jul 10 02:57:51.849443 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:51.849359    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6cf46c8b8c-x4hnq_5cf16ed2-2be5-4cb9-9a4e-4de146cd61b4/kube-auth-proxy/0.log"
Jul 10 02:57:52.674903 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:52.674871    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/2.log"
Jul 10 02:57:52.681338 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:52.681309    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt7wb_164f62ad-8b5b-4a66-9bfe-17d863ddeeea/ovn-acl-logging/0.log"
Jul 10 02:57:52.682442 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:52.682420    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wlk8h_b2e5ea06-8452-4568-88b8-d907a1e2c864/console-operator/2.log"
Jul 10 02:57:52.685998 ip-10-0-139-215 kubenswrapper[2576]: I0710 02:57:52.685978    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kt7wb_164f62ad-8b5b-4a66-9bfe-17d863ddeeea/ovn-acl-logging/0.log"